2023-10-06T03:04:31.532 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-06T03:04:31.532 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/recovery-fs} --archive /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412190 --owner scheduled_yuriw@teuthology --verbose --name yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi -- /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412190/orig.config.yaml 2023-10-06T03:04:31.576 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T03:04:31.669 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412190 branch: wip-yuri-testing-2023-10-05-0730-quincy description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/recovery-fs} email: yweinste@redhat.com first_in_suite: false job_id: '7412190' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.4' overrides: admin_socket: branch: wip-yuri-testing-2023-10-05-0730-quincy ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri-testing-2023-10-05-0730-quincy sha1: f1e315a9732d36c05ec316678e2397dc58561c7f owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 7519 sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri-testing-2023-10-05-0730-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: f1e315a9732d36c05ec316678e2397dc58561c7f targets: smithi081.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAng7mx3KK1mbrZaEcAuFf4OFz3tDcmGoUSySkZNN4nrOuQCh6AdwilToSGjD2wT5DO2iskM/PGDZ6iRRZoS2cg= smithi083.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNRMH/N5QcDWa4IoLhxpFtPD4tBR5xwZfDHY9UNeUhQ9Aa3PdfqvWber4izkcZSlWpbVFZNH8PUk2XaPboLbaSs= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_recovery_fs teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-05_23:52:50 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-06T03:04:31.670 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa; will attempt to use it 2023-10-06T03:04:31.671 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa/tasks 2023-10-06T03:04:31.671 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-06T03:04:31.672 INFO:teuthology.task.internal:Checking packages... 2023-10-06T03:04:31.695 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2' 2023-10-06T03:04:31.695 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-06T03:04:31.695 INFO:teuthology.packaging:ref: None 2023-10-06T03:04:31.695 INFO:teuthology.packaging:tag: None 2023-10-06T03:04:31.695 INFO:teuthology.packaging:branch: wip-yuri-testing-2023-10-05-0730-quincy 2023-10-06T03:04:31.695 INFO:teuthology.packaging:sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T03:04:31.695 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri-testing-2023-10-05-0730-quincy 2023-10-06T03:04:31.842 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1296.gf1e315a9 2023-10-06T03:04:31.842 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-06T03:04:31.849 INFO:teuthology.task.internal:no buildpackages task found 2023-10-06T03:04:31.849 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-06T03:04:31.870 INFO:teuthology.task.internal:Saving configuration 2023-10-06T03:04:31.889 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-06T03:04:31.896 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T03:04:31.921 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412190', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 02:59:34.853740', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAng7mx3KK1mbrZaEcAuFf4OFz3tDcmGoUSySkZNN4nrOuQCh6AdwilToSGjD2wT5DO2iskM/PGDZ6iRRZoS2cg='} 2023-10-06T03:04:31.942 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi083.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412190', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 02:59:34.851707', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNRMH/N5QcDWa4IoLhxpFtPD4tBR5xwZfDHY9UNeUhQ9Aa3PdfqvWber4izkcZSlWpbVFZNH8PUk2XaPboLbaSs='} 2023-10-06T03:04:31.942 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-06T03:04:31.988 INFO:teuthology.task.internal:roles: ubuntu@smithi081.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-06T03:04:31.989 INFO:teuthology.task.internal:roles: ubuntu@smithi083.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-06T03:04:31.989 INFO:teuthology.run_tasks:Running task console_log... 2023-10-06T03:04:32.065 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd7b11eeb80>, signals=[15]) 2023-10-06T03:04:32.065 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-06T03:04:32.072 INFO:teuthology.task.internal:Opening connections... 2023-10-06T03:04:32.072 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi081.front.sepia.ceph.com 2023-10-06T03:04:32.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T03:04:32.140 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T03:04:32.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T03:04:32.208 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-06T03:04:32.214 DEBUG:teuthology.orchestra.run.smithi081:> uname -m 2023-10-06T03:04:32.231 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2023-10-06T03:04:32.232 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2023-10-06T03:04:32.287 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T03:04:32.288 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="8.4 (Ootpa)" 2023-10-06T03:04:32.288 INFO:teuthology.orchestra.run.smithi081.stdout:ID="rhel" 2023-10-06T03:04:32.288 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="fedora" 2023-10-06T03:04:32.288 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="8.4" 2023-10-06T03:04:32.288 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el8" 2023-10-06T03:04:32.288 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-06T03:04:32.288 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2023-10-06T03:04:32.288 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-06T03:04:32.288 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T03:04:32.288 INFO:teuthology.orchestra.run.smithi081.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T03:04:32.288 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T03:04:32.289 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:04:32.289 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T03:04:32.289 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-06T03:04:32.289 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T03:04:32.289 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-06T03:04:32.289 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2023-10-06T03:04:32.310 DEBUG:teuthology.orchestra.run.smithi083:> uname -m 2023-10-06T03:04:32.326 INFO:teuthology.orchestra.run.smithi083.stdout:x86_64 2023-10-06T03:04:32.327 DEBUG:teuthology.orchestra.run.smithi083:> cat /etc/os-release 2023-10-06T03:04:32.382 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T03:04:32.383 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="8.4 (Ootpa)" 2023-10-06T03:04:32.383 INFO:teuthology.orchestra.run.smithi083.stdout:ID="rhel" 2023-10-06T03:04:32.383 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE="fedora" 2023-10-06T03:04:32.383 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="8.4" 2023-10-06T03:04:32.383 INFO:teuthology.orchestra.run.smithi083.stdout:PLATFORM_ID="platform:el8" 2023-10-06T03:04:32.383 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-06T03:04:32.383 INFO:teuthology.orchestra.run.smithi083.stdout:ANSI_COLOR="0;31" 2023-10-06T03:04:32.383 INFO:teuthology.orchestra.run.smithi083.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-06T03:04:32.383 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T03:04:32.383 INFO:teuthology.orchestra.run.smithi083.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T03:04:32.383 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T03:04:32.384 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T03:04:32.384 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T03:04:32.384 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-06T03:04:32.384 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T03:04:32.384 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-06T03:04:32.384 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2023-10-06T03:04:32.401 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-06T03:04:32.411 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-06T03:04:32.418 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-06T03:04:32.418 DEBUG:teuthology.orchestra.run.smithi081:> test '!' -e /home/ubuntu/cephtest 2023-10-06T03:04:32.420 DEBUG:teuthology.orchestra.run.smithi083:> test '!' -e /home/ubuntu/cephtest 2023-10-06T03:04:32.437 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-06T03:04:32.443 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-06T03:04:32.443 DEBUG:teuthology.orchestra.run.smithi081:> test -z $(ls -A /var/lib/ceph) 2023-10-06T03:04:32.476 DEBUG:teuthology.orchestra.run.smithi083:> test -z $(ls -A /var/lib/ceph) 2023-10-06T03:04:32.489 INFO:teuthology.orchestra.run.smithi081.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-06T03:04:32.493 INFO:teuthology.orchestra.run.smithi083.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-06T03:04:32.493 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-06T03:04:32.544 INFO:teuthology.run_tasks:Running task kernel... 2023-10-06T03:04:32.558 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2023-10-06T03:04:32.559 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-10-06T03:04:32.559 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-10-06T03:04:32.559 DEBUG:teuthology.orchestra.run.smithi081:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T03:04:32.560 DEBUG:teuthology.orchestra.run.smithi083:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T03:04:32.574 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:04:32.575 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-10-06T03:04:32.578 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:04:32.579 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-10-06T03:04:32.730 DEBUG:teuthology.task.kernel:sha1 for client.1 is fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T03:04:32.731 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c"... 2023-10-06T03:04:32.731 DEBUG:teuthology.orchestra.run.smithi083:> uname -r 2023-10-06T03:04:32.747 INFO:teuthology.orchestra.run.smithi083.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-06T03:04:32.747 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-305.25.1.el8_4.x86_64 vs fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T03:04:32.748 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-06T03:04:32.748 DEBUG:teuthology.orchestra.run.smithi083:> sudo yum upgrade -y linux-firmware 2023-10-06T03:04:32.872 DEBUG:teuthology.task.kernel:sha1 for client.0 is fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T03:04:32.872 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c"... 2023-10-06T03:04:32.872 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2023-10-06T03:04:32.888 INFO:teuthology.orchestra.run.smithi081.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-06T03:04:32.889 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-305.25.1.el8_4.x86_64 vs fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T03:04:32.889 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-06T03:04:32.889 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum upgrade -y linux-firmware 2023-10-06T03:04:34.225 INFO:teuthology.orchestra.run.smithi083.stdout:Updating Subscription Management repositories. 2023-10-06T03:04:34.226 INFO:teuthology.orchestra.run.smithi083.stdout:Unable to read consumer identity 2023-10-06T03:04:34.373 INFO:teuthology.orchestra.run.smithi081.stdout:Updating Subscription Management repositories. 2023-10-06T03:04:34.374 INFO:teuthology.orchestra.run.smithi081.stdout:Unable to read consumer identity 2023-10-06T03:04:35.714 INFO:teuthology.orchestra.run.smithi083.stdout:Copr repo for python3-asyncssh owned by ceph 17 kB/s | 3.5 kB 00:00 2023-10-06T03:04:35.836 INFO:teuthology.orchestra.run.smithi081.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2023-10-06T03:04:36.326 INFO:teuthology.orchestra.run.smithi083.stdout:Extra Packages for Enterprise Linux 28 MB/s | 16 MB 00:00 2023-10-06T03:04:37.407 INFO:teuthology.orchestra.run.smithi081.stdout:Extra Packages for Enterprise Linux 10 MB/s | 16 MB 00:01 2023-10-06T03:04:39.658 INFO:teuthology.orchestra.run.smithi083.stdout:lab-extras 4.0 MB/s | 24 kB 00:00 2023-10-06T03:04:40.544 INFO:teuthology.orchestra.run.smithi083.stdout:Dependencies resolved. 2023-10-06T03:04:40.545 INFO:teuthology.orchestra.run.smithi083.stdout:Nothing to do. 2023-10-06T03:04:40.545 INFO:teuthology.orchestra.run.smithi083.stdout:Complete! 2023-10-06T03:04:40.663 INFO:teuthology.task.kernel:Downloading kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.1... 2023-10-06T03:04:40.663 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T03:04:40.678 INFO:teuthology.orchestra.run.smithi081.stdout:lab-extras 4.4 MB/s | 24 kB 00:00 2023-10-06T03:04:40.808 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ 2023-10-06T03:04:40.808 DEBUG:teuthology.orchestra.run.smithi083:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ --input-file=- 2023-10-06T03:04:40.810 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi083.front.sepia.ceph.com to complete... 2023-10-06T03:04:41.593 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2023-10-06T03:04:41.594 INFO:teuthology.orchestra.run.smithi081.stdout:Nothing to do. 2023-10-06T03:04:41.594 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2023-10-06T03:04:41.701 INFO:teuthology.task.kernel:Downloading kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.0... 2023-10-06T03:04:41.701 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T03:04:41.920 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ 2023-10-06T03:04:41.921 DEBUG:teuthology.orchestra.run.smithi081:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ --input-file=- 2023-10-06T03:04:41.923 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi081.front.sepia.ceph.com to complete... 2023-10-06T03:05:24.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06 03:05:24 URL:https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm [380759012/380759012] -> "/tmp/kernel.x86_64.rpm" [1] 2023-10-06T03:05:24.790 INFO:teuthology.orchestra.run.smithi081.stderr:FINISHED --2023-10-06 03:05:24-- 2023-10-06T03:05:24.790 INFO:teuthology.orchestra.run.smithi081.stderr:Total wall clock time: 43s 2023-10-06T03:05:24.790 INFO:teuthology.orchestra.run.smithi081.stderr:Downloaded: 1 files, 363M in 42s (8.57 MB/s) 2023-10-06T03:05:24.791 INFO:teuthology.task.kernel:Installing kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.0... 2023-10-06T03:05:24.792 DEBUG:teuthology.orchestra.run.smithi081:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-10-06T03:05:26.560 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying... ######################################## 2023-10-06T03:05:26.969 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing... ######################################## 2023-10-06T03:05:27.100 INFO:teuthology.orchestra.run.smithi081.stdout:Updating / installing... 2023-10-06T03:06:04.971 INFO:teuthology.orchestra.run.smithi081.stdout:kernel-6.5.0_rc7_gfef64f93da2b-1 ######################################## 2023-10-06T03:06:17.214 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06 03:06:17 URL:https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm [380759012/380759012] -> "/tmp/kernel.x86_64.rpm" [1] 2023-10-06T03:06:17.215 INFO:teuthology.orchestra.run.smithi083.stderr:FINISHED --2023-10-06 03:06:17-- 2023-10-06T03:06:17.215 INFO:teuthology.orchestra.run.smithi083.stderr:Total wall clock time: 1m 36s 2023-10-06T03:06:17.215 INFO:teuthology.orchestra.run.smithi083.stderr:Downloaded: 1 files, 363M in 1m 36s (3.79 MB/s) 2023-10-06T03:06:17.216 INFO:teuthology.task.kernel:Installing kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.1... 2023-10-06T03:06:17.216 DEBUG:teuthology.orchestra.run.smithi083:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-10-06T03:06:18.957 INFO:teuthology.orchestra.run.smithi083.stdout:Verifying... ######################################## 2023-10-06T03:06:19.367 INFO:teuthology.orchestra.run.smithi083.stdout:Preparing... ######################################## 2023-10-06T03:06:19.489 INFO:teuthology.orchestra.run.smithi083.stdout:Updating / installing... 2023-10-06T03:06:27.998 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi081.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-10-06T03:06:27.998 DEBUG:teuthology.orchestra.run.smithi081:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-10-06T03:06:28.054 INFO:teuthology.orchestra.run.smithi081.stdout:/boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-06T03:06:28.054 INFO:teuthology.orchestra.run.smithi081.stdout:/boot/config-6.5.0-rc7-gfef64f93da2b 2023-10-06T03:06:28.054 INFO:teuthology.orchestra.run.smithi081.stdout:/boot/vmlinuz-6.5.0-rc7-gfef64f93da2b 2023-10-06T03:06:28.054 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b 2023-10-06T03:06:28.054 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel 2023-10-06T03:06:28.054 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch 2023-10-06T03:06:28.054 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86 2023-10-06T03:06:28.054 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto 2023-10-06T03:06:28.054 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-06T03:06:28.055 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-06T03:06:28.055 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-06T03:06:28.055 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-06T03:06:28.055 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-06T03:06:28.055 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-06T03:06:28.055 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-06T03:06:28.055 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-10-06T03:06:28.055 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-06T03:06:28.055 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-06T03:06:28.055 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-06T03:06:28.055 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-06T03:06:28.055 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-06T03:06:28.056 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-06T03:06:28.056 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-06T03:06:28.056 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-06T03:06:28.056 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-06T03:06:28.056 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-06T03:06:28.056 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-06T03:06:28.056 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-06T03:06:28.056 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel 2023-10-06T03:06:28.056 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu 2023-10-06T03:06:28.056 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce 2023-10-06T03:06:28.056 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-06T03:06:28.056 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm 2023-10-06T03:06:28.057 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-06T03:06:28.057 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-06T03:06:28.057 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm.ko 2023-10-06T03:06:28.057 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto 2023-10-06T03:06:28.057 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ansi_cprng.ko 2023-10-06T03:06:28.057 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/anubis.ko 2023-10-06T03:06:28.057 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/arc4.ko 2023-10-06T03:06:28.057 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx 2023-10-06T03:06:28.057 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-06T03:06:28.057 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_pq.ko 2023-10-06T03:06:28.057 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-06T03:06:28.057 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_tx.ko 2023-10-06T03:06:28.058 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_xor.ko 2023-10-06T03:06:28.058 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/raid6test.ko 2023-10-06T03:06:28.058 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authenc.ko 2023-10-06T03:06:28.058 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authencesn.ko 2023-10-06T03:06:28.058 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blake2b_generic.ko 2023-10-06T03:06:28.058 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_common.ko 2023-10-06T03:06:28.058 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_generic.ko 2023-10-06T03:06:28.058 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/camellia_generic.ko 2023-10-06T03:06:28.058 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast5_generic.ko 2023-10-06T03:06:28.058 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast6_generic.ko 2023-10-06T03:06:28.058 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast_common.ko 2023-10-06T03:06:28.059 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ccm.ko 2023-10-06T03:06:28.059 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cmac.ko 2023-10-06T03:06:28.059 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crc32_generic.ko 2023-10-06T03:06:28.059 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_engine.ko 2023-10-06T03:06:28.059 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_user.ko 2023-10-06T03:06:28.059 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cts.ko 2023-10-06T03:06:28.059 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/des_generic.ko 2023-10-06T03:06:28.059 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/dh_generic.ko 2023-10-06T03:06:28.059 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/echainiv.ko 2023-10-06T03:06:28.059 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/essiv.ko 2023-10-06T03:06:28.059 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/fcrypt.ko 2023-10-06T03:06:28.059 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/khazad.ko 2023-10-06T03:06:28.059 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4.ko 2023-10-06T03:06:28.060 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4hc.ko 2023-10-06T03:06:28.060 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/md4.ko 2023-10-06T03:06:28.060 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/michael_mic.ko 2023-10-06T03:06:28.060 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcbc.ko 2023-10-06T03:06:28.060 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcrypt.ko 2023-10-06T03:06:28.060 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/rmd160.ko 2023-10-06T03:06:28.060 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/seed.ko 2023-10-06T03:06:28.060 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/serpent_generic.ko 2023-10-06T03:06:28.060 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tcrypt.ko 2023-10-06T03:06:28.060 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tea.ko 2023-10-06T03:06:28.060 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_common.ko 2023-10-06T03:06:28.060 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_generic.ko 2023-10-06T03:06:28.061 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/vmac.ko 2023-10-06T03:06:28.061 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/wp512.ko 2023-10-06T03:06:28.061 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xcbc.ko 2023-10-06T03:06:28.061 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xor.ko 2023-10-06T03:06:28.061 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xxhash_generic.ko 2023-10-06T03:06:28.061 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers 2023-10-06T03:06:28.061 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi 2023-10-06T03:06:28.061 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-06T03:06:28.061 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_pad.ko 2023-10-06T03:06:28.061 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/custom_method.ko 2023-10-06T03:06:28.061 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/ec_sys.ko 2023-10-06T03:06:28.061 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/platform_profile.ko 2023-10-06T03:06:28.062 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbs.ko 2023-10-06T03:06:28.062 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbshc.ko 2023-10-06T03:06:28.062 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/video.ko 2023-10-06T03:06:28.062 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata 2023-10-06T03:06:28.062 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/acard-ahci.ko 2023-10-06T03:06:28.062 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ahci_platform.ko 2023-10-06T03:06:28.062 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ata_generic.ko 2023-10-06T03:06:28.062 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/libahci_platform.ko 2023-10-06T03:06:28.062 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_acpi.ko 2023-10-06T03:06:28.062 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ali.ko 2023-10-06T03:06:28.062 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_amd.ko 2023-10-06T03:06:28.063 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_artop.ko 2023-10-06T03:06:28.063 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atiixp.ko 2023-10-06T03:06:28.063 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atp867x.ko 2023-10-06T03:06:28.063 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd640.ko 2023-10-06T03:06:28.063 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-06T03:06:28.063 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cypress.ko 2023-10-06T03:06:28.063 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_efar.ko 2023-10-06T03:06:28.063 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt366.ko 2023-10-06T03:06:28.063 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-06T03:06:28.063 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-06T03:06:28.063 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-06T03:06:28.063 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it8213.ko 2023-10-06T03:06:28.063 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it821x.ko 2023-10-06T03:06:28.064 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_jmicron.ko 2023-10-06T03:06:28.064 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_marvell.ko 2023-10-06T03:06:28.064 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_mpiix.ko 2023-10-06T03:06:28.064 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_netcell.ko 2023-10-06T03:06:28.064 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ninja32.ko 2023-10-06T03:06:28.064 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87410.ko 2023-10-06T03:06:28.064 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87415.ko 2023-10-06T03:06:28.064 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-06T03:06:28.064 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_opti.ko 2023-10-06T03:06:28.064 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_optidma.ko 2023-10-06T03:06:28.064 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-06T03:06:28.064 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-06T03:06:28.065 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-06T03:06:28.065 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_piccolo.ko 2023-10-06T03:06:28.065 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_rdc.ko 2023-10-06T03:06:28.065 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sch.ko 2023-10-06T03:06:28.065 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_serverworks.ko 2023-10-06T03:06:28.065 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sil680.ko 2023-10-06T03:06:28.065 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sis.ko 2023-10-06T03:06:28.065 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-06T03:06:28.065 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_triflex.ko 2023-10-06T03:06:28.065 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_via.ko 2023-10-06T03:06:28.065 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pdc_adma.ko 2023-10-06T03:06:28.065 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_inic162x.ko 2023-10-06T03:06:28.066 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_mv.ko 2023-10-06T03:06:28.066 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_nv.ko 2023-10-06T03:06:28.066 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_promise.ko 2023-10-06T03:06:28.066 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_qstor.ko 2023-10-06T03:06:28.066 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil.ko 2023-10-06T03:06:28.066 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil24.ko 2023-10-06T03:06:28.066 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sis.ko 2023-10-06T03:06:28.066 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_svw.ko 2023-10-06T03:06:28.066 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sx4.ko 2023-10-06T03:06:28.066 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_uli.ko 2023-10-06T03:06:28.066 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_via.ko 2023-10-06T03:06:28.066 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_vsc.ko 2023-10-06T03:06:28.067 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay 2023-10-06T03:06:28.067 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-06T03:06:28.067 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base 2023-10-06T03:06:28.067 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap 2023-10-06T03:06:28.067 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-10-06T03:06:28.067 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-10-06T03:06:28.067 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma 2023-10-06T03:06:28.067 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma/bcma.ko 2023-10-06T03:06:28.067 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block 2023-10-06T03:06:28.067 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe 2023-10-06T03:06:28.067 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe/aoe.ko 2023-10-06T03:06:28.067 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/brd.ko 2023-10-06T03:06:28.068 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd 2023-10-06T03:06:28.068 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd/drbd.ko 2023-10-06T03:06:28.068 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/floppy.ko 2023-10-06T03:06:28.068 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/loop.ko 2023-10-06T03:06:28.068 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx 2023-10-06T03:06:28.068 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-06T03:06:28.068 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/nbd.ko 2023-10-06T03:06:28.068 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk 2023-10-06T03:06:28.068 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-06T03:06:28.068 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/pktcdvd.ko 2023-10-06T03:06:28.068 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/rbd.ko 2023-10-06T03:06:28.068 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/virtio_blk.ko 2023-10-06T03:06:28.069 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback 2023-10-06T03:06:28.069 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-06T03:06:28.069 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkfront.ko 2023-10-06T03:06:28.069 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram 2023-10-06T03:06:28.069 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram/zram.ko 2023-10-06T03:06:28.069 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char 2023-10-06T03:06:28.069 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hangcheck-timer.ko 2023-10-06T03:06:28.069 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random 2023-10-06T03:06:28.069 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-06T03:06:28.069 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-06T03:06:28.069 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-06T03:06:28.069 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-06T03:06:28.069 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-06T03:06:28.070 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi 2023-10-06T03:06:28.070 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-06T03:06:28.070 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-06T03:06:28.070 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-06T03:06:28.070 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-06T03:06:28.070 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-06T03:06:28.070 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-06T03:06:28.070 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/lp.ko 2023-10-06T03:06:28.070 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave 2023-10-06T03:06:28.070 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave/mwave.ko 2023-10-06T03:06:28.070 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ppdev.ko 2023-10-06T03:06:28.070 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tlclk.ko 2023-10-06T03:06:28.071 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm 2023-10-06T03:06:28.071 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm.ko 2023-10-06T03:06:28.071 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-06T03:06:28.071 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-06T03:06:28.071 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-06T03:06:28.071 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis.ko 2023-10-06T03:06:28.071 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-10-06T03:06:28.071 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/uv_mmtimer.ko 2023-10-06T03:06:28.071 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/virtio_console.ko 2023-10-06T03:06:28.071 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq 2023-10-06T03:06:28.071 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-10-06T03:06:28.071 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-06T03:06:28.072 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-06T03:06:28.072 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-10-06T03:06:28.072 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/powernow-k8.ko 2023-10-06T03:06:28.072 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-06T03:06:28.072 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto 2023-10-06T03:06:28.072 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp 2023-10-06T03:06:28.072 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-06T03:06:28.072 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-06T03:06:28.072 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel 2023-10-06T03:06:28.072 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat 2023-10-06T03:06:28.072 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common 2023-10-06T03:06:28.072 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-06T03:06:28.073 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-10-06T03:06:28.073 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-06T03:06:28.073 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-aes.ko 2023-10-06T03:06:28.073 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-sha.ko 2023-10-06T03:06:28.073 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio 2023-10-06T03:06:28.073 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-06T03:06:28.073 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca 2023-10-06T03:06:28.073 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca/dca.ko 2023-10-06T03:06:28.073 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq 2023-10-06T03:06:28.073 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-10-06T03:06:28.073 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma 2023-10-06T03:06:28.073 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw 2023-10-06T03:06:28.073 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-06T03:06:28.074 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat 2023-10-06T03:06:28.074 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-06T03:06:28.074 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac 2023-10-06T03:06:28.074 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/amd64_edac.ko 2023-10-06T03:06:28.074 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/e752x_edac.ko 2023-10-06T03:06:28.074 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-06T03:06:28.074 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3000_edac.ko 2023-10-06T03:06:28.074 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3200_edac.ko 2023-10-06T03:06:28.074 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5100_edac.ko 2023-10-06T03:06:28.074 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5400_edac.ko 2023-10-06T03:06:28.074 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7300_edac.ko 2023-10-06T03:06:28.074 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7core_edac.ko 2023-10-06T03:06:28.075 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i82975x_edac.ko 2023-10-06T03:06:28.075 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/ie31200_edac.ko 2023-10-06T03:06:28.075 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/sb_edac.ko 2023-10-06T03:06:28.075 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/x38_edac.ko 2023-10-06T03:06:28.075 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware 2023-10-06T03:06:28.075 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/edd.ko 2023-10-06T03:06:28.075 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-06T03:06:28.075 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio 2023-10-06T03:06:28.075 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-ich.ko 2023-10-06T03:06:28.075 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-06T03:06:28.075 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid 2023-10-06T03:06:28.075 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-appleir.ko 2023-10-06T03:06:28.076 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-aureal.ko 2023-10-06T03:06:28.076 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-axff.ko 2023-10-06T03:06:28.076 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-dr.ko 2023-10-06T03:06:28.076 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elecom.ko 2023-10-06T03:06:28.076 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elo.ko 2023-10-06T03:06:28.076 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-emsff.ko 2023-10-06T03:06:28.076 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gaff.ko 2023-10-06T03:06:28.076 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gt683r.ko 2023-10-06T03:06:28.076 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gyration.ko 2023-10-06T03:06:28.076 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-06T03:06:28.076 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-06T03:06:28.076 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtekff.ko 2023-10-06T03:06:28.077 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-hyperv.ko 2023-10-06T03:06:28.077 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-icade.ko 2023-10-06T03:06:28.077 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-keytouch.ko 2023-10-06T03:06:28.077 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-kye.ko 2023-10-06T03:06:28.077 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lcpower.ko 2023-10-06T03:06:28.077 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-led.ko 2023-10-06T03:06:28.077 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lenovo.ko 2023-10-06T03:06:28.077 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-06T03:06:28.077 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-06T03:06:28.077 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-multitouch.ko 2023-10-06T03:06:28.077 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-ortek.ko 2023-10-06T03:06:28.077 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-penmount.ko 2023-10-06T03:06:28.078 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-petalynx.ko 2023-10-06T03:06:28.078 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-picolcd.ko 2023-10-06T03:06:28.078 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-pl.ko 2023-10-06T03:06:28.078 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-plantronics.ko 2023-10-06T03:06:28.078 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-primax.ko 2023-10-06T03:06:28.078 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-rmi.ko 2023-10-06T03:06:28.078 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-06T03:06:28.078 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-06T03:06:28.078 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-06T03:06:28.078 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-06T03:06:28.078 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-06T03:06:28.078 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-06T03:06:28.079 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-06T03:06:28.079 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-06T03:06:28.079 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-06T03:06:28.079 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-06T03:06:28.079 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-06T03:06:28.079 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat.ko 2023-10-06T03:06:28.079 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-saitek.ko 2023-10-06T03:06:28.079 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-samsung.ko 2023-10-06T03:06:28.079 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-06T03:06:28.079 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sjoy.ko 2023-10-06T03:06:28.079 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sony.ko 2023-10-06T03:06:28.079 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-speedlink.ko 2023-10-06T03:06:28.079 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-steelseries.ko 2023-10-06T03:06:28.080 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sunplus.ko 2023-10-06T03:06:28.080 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-06T03:06:28.080 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tivo.ko 2023-10-06T03:06:28.080 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tmff.ko 2023-10-06T03:06:28.080 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-topseed.ko 2023-10-06T03:06:28.080 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-twinhan.ko 2023-10-06T03:06:28.080 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-uclogic.ko 2023-10-06T03:06:28.080 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-waltop.ko 2023-10-06T03:06:28.080 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-wiimote.ko 2023-10-06T03:06:28.080 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-xinmo.ko 2023-10-06T03:06:28.080 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zpff.ko 2023-10-06T03:06:28.080 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zydacron.ko 2023-10-06T03:06:28.081 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/uhid.ko 2023-10-06T03:06:28.081 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/wacom.ko 2023-10-06T03:06:28.081 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv 2023-10-06T03:06:28.081 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_balloon.ko 2023-10-06T03:06:28.081 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_utils.ko 2023-10-06T03:06:28.081 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_vmbus.ko 2023-10-06T03:06:28.081 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon 2023-10-06T03:06:28.081 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru.ko 2023-10-06T03:06:28.081 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru3.ko 2023-10-06T03:06:28.081 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-06T03:06:28.081 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7414.ko 2023-10-06T03:06:28.081 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7418.ko 2023-10-06T03:06:28.081 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adc128d818.ko 2023-10-06T03:06:28.082 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1025.ko 2023-10-06T03:06:28.082 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1026.ko 2023-10-06T03:06:28.082 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1029.ko 2023-10-06T03:06:28.082 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1031.ko 2023-10-06T03:06:28.082 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm9240.ko 2023-10-06T03:06:28.082 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ads7828.ko 2023-10-06T03:06:28.082 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7410.ko 2023-10-06T03:06:28.082 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7411.ko 2023-10-06T03:06:28.082 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7462.ko 2023-10-06T03:06:28.082 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7470.ko 2023-10-06T03:06:28.082 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7475.ko 2023-10-06T03:06:28.082 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7x10.ko 2023-10-06T03:06:28.083 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/amc6821.ko 2023-10-06T03:06:28.083 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/applesmc.ko 2023-10-06T03:06:28.083 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asb100.ko 2023-10-06T03:06:28.083 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asc7621.ko 2023-10-06T03:06:28.083 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-06T03:06:28.083 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/atxp1.ko 2023-10-06T03:06:28.083 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/coretemp.ko 2023-10-06T03:06:28.083 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-06T03:06:28.083 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dme1737.ko 2023-10-06T03:06:28.083 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds1621.ko 2023-10-06T03:06:28.083 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds620.ko 2023-10-06T03:06:28.084 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc1403.ko 2023-10-06T03:06:28.084 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc6w201.ko 2023-10-06T03:06:28.084 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71805f.ko 2023-10-06T03:06:28.084 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71882fg.ko 2023-10-06T03:06:28.084 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f75375s.ko 2023-10-06T03:06:28.084 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-06T03:06:28.084 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fschmd.ko 2023-10-06T03:06:28.084 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g760a.ko 2023-10-06T03:06:28.084 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g762.ko 2023-10-06T03:06:28.084 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl518sm.ko 2023-10-06T03:06:28.084 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl520sm.ko 2023-10-06T03:06:28.084 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-06T03:06:28.085 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-06T03:06:28.085 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-06T03:06:28.085 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmaem.ko 2023-10-06T03:06:28.085 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmpex.ko 2023-10-06T03:06:28.085 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina209.ko 2023-10-06T03:06:28.085 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina2xx.ko 2023-10-06T03:06:28.085 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/it87.ko 2023-10-06T03:06:28.085 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k10temp.ko 2023-10-06T03:06:28.085 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k8temp.ko 2023-10-06T03:06:28.085 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-06T03:06:28.085 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm63.ko 2023-10-06T03:06:28.085 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm73.ko 2023-10-06T03:06:28.085 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm75.ko 2023-10-06T03:06:28.086 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm77.ko 2023-10-06T03:06:28.086 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm78.ko 2023-10-06T03:06:28.086 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm80.ko 2023-10-06T03:06:28.086 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm83.ko 2023-10-06T03:06:28.086 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm85.ko 2023-10-06T03:06:28.086 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm87.ko 2023-10-06T03:06:28.086 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm90.ko 2023-10-06T03:06:28.086 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm92.ko 2023-10-06T03:06:28.086 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm93.ko 2023-10-06T03:06:28.086 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95234.ko 2023-10-06T03:06:28.086 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95241.ko 2023-10-06T03:06:28.086 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95245.ko 2023-10-06T03:06:28.087 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc2945.ko 2023-10-06T03:06:28.087 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4151.ko 2023-10-06T03:06:28.087 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4215.ko 2023-10-06T03:06:28.087 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4222.ko 2023-10-06T03:06:28.087 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4245.ko 2023-10-06T03:06:28.087 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4260.ko 2023-10-06T03:06:28.087 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4261.ko 2023-10-06T03:06:28.087 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max16065.ko 2023-10-06T03:06:28.087 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1619.ko 2023-10-06T03:06:28.087 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1668.ko 2023-10-06T03:06:28.087 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max197.ko 2023-10-06T03:06:28.087 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6639.ko 2023-10-06T03:06:28.088 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6650.ko 2023-10-06T03:06:28.088 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6697.ko 2023-10-06T03:06:28.088 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/mcp3021.ko 2023-10-06T03:06:28.088 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6683.ko 2023-10-06T03:06:28.088 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-06T03:06:28.088 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775.ko 2023-10-06T03:06:28.088 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct7802.ko 2023-10-06T03:06:28.088 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87360.ko 2023-10-06T03:06:28.088 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87427.ko 2023-10-06T03:06:28.088 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pcf8591.ko 2023-10-06T03:06:28.088 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus 2023-10-06T03:06:28.088 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-06T03:06:28.089 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-06T03:06:28.089 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-06T03:06:28.089 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-06T03:06:28.089 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-06T03:06:28.089 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-06T03:06:28.089 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-06T03:06:28.089 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-06T03:06:28.089 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-06T03:06:28.089 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-06T03:06:28.089 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-06T03:06:28.089 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-06T03:06:28.089 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/powr1220.ko 2023-10-06T03:06:28.089 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5627.ko 2023-10-06T03:06:28.090 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5636.ko 2023-10-06T03:06:28.090 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-06T03:06:28.090 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht15.ko 2023-10-06T03:06:28.090 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht21.ko 2023-10-06T03:06:28.090 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/shtc1.ko 2023-10-06T03:06:28.090 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sis5595.ko 2023-10-06T03:06:28.090 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-06T03:06:28.090 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-06T03:06:28.090 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-06T03:06:28.090 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/thmc50.ko 2023-10-06T03:06:28.090 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp102.ko 2023-10-06T03:06:28.091 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp103.ko 2023-10-06T03:06:28.091 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp401.ko 2023-10-06T03:06:28.091 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp421.ko 2023-10-06T03:06:28.091 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-06T03:06:28.091 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via686a.ko 2023-10-06T03:06:28.091 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt1211.ko 2023-10-06T03:06:28.091 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt8231.ko 2023-10-06T03:06:28.091 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-06T03:06:28.091 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627hf.ko 2023-10-06T03:06:28.091 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83781d.ko 2023-10-06T03:06:28.091 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83791d.ko 2023-10-06T03:06:28.091 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83792d.ko 2023-10-06T03:06:28.092 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83793.ko 2023-10-06T03:06:28.092 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83795.ko 2023-10-06T03:06:28.092 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-06T03:06:28.092 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-06T03:06:28.092 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c 2023-10-06T03:06:28.092 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos 2023-10-06T03:06:28.092 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-06T03:06:28.092 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-06T03:06:28.092 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses 2023-10-06T03:06:28.092 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-06T03:06:28.092 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-06T03:06:28.092 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-06T03:06:28.093 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-06T03:06:28.093 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-06T03:06:28.093 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-06T03:06:28.093 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-06T03:06:28.093 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-06T03:06:28.093 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-06T03:06:28.093 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-06T03:06:28.093 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-06T03:06:28.093 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-06T03:06:28.093 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-06T03:06:28.093 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-06T03:06:28.093 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-06T03:06:28.094 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-06T03:06:28.094 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-06T03:06:28.094 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-06T03:06:28.094 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-06T03:06:28.094 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-06T03:06:28.094 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-06T03:06:28.094 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-06T03:06:28.094 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-06T03:06:28.094 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-dev.ko 2023-10-06T03:06:28.094 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-mux.ko 2023-10-06T03:06:28.094 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-10-06T03:06:28.094 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-06T03:06:28.095 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-stub.ko 2023-10-06T03:06:28.095 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband 2023-10-06T03:06:28.095 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core 2023-10-06T03:06:28.095 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-06T03:06:28.095 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-06T03:06:28.095 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-06T03:06:28.095 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-06T03:06:28.095 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-06T03:06:28.095 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-06T03:06:28.095 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-06T03:06:28.095 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw 2023-10-06T03:06:28.095 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4 2023-10-06T03:06:28.096 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-06T03:06:28.096 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4 2023-10-06T03:06:28.096 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-06T03:06:28.096 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5 2023-10-06T03:06:28.096 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-06T03:06:28.096 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca 2023-10-06T03:06:28.096 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-06T03:06:28.096 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp 2023-10-06T03:06:28.096 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib 2023-10-06T03:06:28.096 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-06T03:06:28.096 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser 2023-10-06T03:06:28.096 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-06T03:06:28.097 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert 2023-10-06T03:06:28.097 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-06T03:06:28.097 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp 2023-10-06T03:06:28.097 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-06T03:06:28.097 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt 2023-10-06T03:06:28.097 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-06T03:06:28.097 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input 2023-10-06T03:06:28.097 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport 2023-10-06T03:06:28.097 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-06T03:06:28.097 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-06T03:06:28.097 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/gameport.ko 2023-10-06T03:06:28.097 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/lightning.ko 2023-10-06T03:06:28.098 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/ns558.ko 2023-10-06T03:06:28.098 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/joydev.ko 2023-10-06T03:06:28.098 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard 2023-10-06T03:06:28.098 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-06T03:06:28.098 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse 2023-10-06T03:06:28.098 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/appletouch.ko 2023-10-06T03:06:28.098 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-06T03:06:28.098 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-06T03:06:28.098 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-06T03:06:28.098 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/sermouse.ko 2023-10-06T03:06:28.098 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-06T03:06:28.098 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-06T03:06:28.099 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-06T03:06:28.099 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4 2023-10-06T03:06:28.099 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-06T03:06:28.099 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio 2023-10-06T03:06:28.099 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-06T03:06:28.099 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-06T03:06:28.099 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-06T03:06:28.099 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/serio_raw.ko 2023-10-06T03:06:28.099 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/sparse-keymap.ko 2023-10-06T03:06:28.099 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu 2023-10-06T03:06:28.099 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd 2023-10-06T03:06:28.099 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-06T03:06:28.100 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds 2023-10-06T03:06:28.100 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-blinkm.ko 2023-10-06T03:06:28.100 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm3530.ko 2023-10-06T03:06:28.100 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lp3944.ko 2023-10-06T03:06:28.100 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-ss4200.ko 2023-10-06T03:06:28.100 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger 2023-10-06T03:06:28.100 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-06T03:06:28.100 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-06T03:06:28.100 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-06T03:06:28.100 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-06T03:06:28.100 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-06T03:06:28.100 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-06T03:06:28.100 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-06T03:06:28.101 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-06T03:06:28.101 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md 2023-10-06T03:06:28.101 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache 2023-10-06T03:06:28.101 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache/bcache.ko 2023-10-06T03:06:28.101 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-bio-prison.ko 2023-10-06T03:06:28.101 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache-smq.ko 2023-10-06T03:06:28.101 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache.ko 2023-10-06T03:06:28.101 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-crypt.ko 2023-10-06T03:06:28.101 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-delay.ko 2023-10-06T03:06:28.101 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-flakey.ko 2023-10-06T03:06:28.101 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-log-userspace.ko 2023-10-06T03:06:28.101 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-multipath.ko 2023-10-06T03:06:28.102 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-queue-length.ko 2023-10-06T03:06:28.102 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-raid.ko 2023-10-06T03:06:28.102 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-round-robin.ko 2023-10-06T03:06:28.102 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-service-time.ko 2023-10-06T03:06:28.102 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-switch.ko 2023-10-06T03:06:28.102 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-thin-pool.ko 2023-10-06T03:06:28.102 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-verity.ko 2023-10-06T03:06:28.102 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/faulty.ko 2023-10-06T03:06:28.102 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/linear.ko 2023-10-06T03:06:28.102 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/multipath.ko 2023-10-06T03:06:28.102 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data 2023-10-06T03:06:28.102 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-06T03:06:28.103 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid0.ko 2023-10-06T03:06:28.103 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid1.ko 2023-10-06T03:06:28.103 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid10.ko 2023-10-06T03:06:28.103 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid456.ko 2023-10-06T03:06:28.103 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message 2023-10-06T03:06:28.103 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion 2023-10-06T03:06:28.103 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptbase.ko 2023-10-06T03:06:28.103 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptctl.ko 2023-10-06T03:06:28.103 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptfc.ko 2023-10-06T03:06:28.103 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptlan.ko 2023-10-06T03:06:28.103 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptsas.ko 2023-10-06T03:06:28.103 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-06T03:06:28.104 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptspi.ko 2023-10-06T03:06:28.104 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd 2023-10-06T03:06:28.104 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_ich.ko 2023-10-06T03:06:28.104 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_sch.ko 2023-10-06T03:06:28.104 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/mfd-core.ko 2023-10-06T03:06:28.104 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/sm501.ko 2023-10-06T03:06:28.104 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/viperboard.ko 2023-10-06T03:06:28.104 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/vx855.ko 2023-10-06T03:06:28.104 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/wl1273-core.ko 2023-10-06T03:06:28.104 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc 2023-10-06T03:06:28.104 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl 2023-10-06T03:06:28.104 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-06T03:06:28.104 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds9802als.ko 2023-10-06T03:06:28.105 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds990x.ko 2023-10-06T03:06:28.105 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/bh1770glc.ko 2023-10-06T03:06:28.105 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710 2023-10-06T03:06:28.105 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710/cb710.ko 2023-10-06T03:06:28.105 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom 2023-10-06T03:06:28.105 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/at24.ko 2023-10-06T03:06:28.105 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-06T03:06:28.105 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-06T03:06:28.105 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-06T03:06:28.105 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/enclosure.ko 2023-10-06T03:06:28.105 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/hpilo.ko 2023-10-06T03:06:28.105 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29003.ko 2023-10-06T03:06:28.106 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29020.ko 2023-10-06T03:06:28.106 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d 2023-10-06T03:06:28.106 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-06T03:06:28.106 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-06T03:06:28.106 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei 2023-10-06T03:06:28.106 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-me.ko 2023-10-06T03:06:28.106 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-06T03:06:28.106 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei.ko 2023-10-06T03:06:28.106 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru 2023-10-06T03:06:28.106 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru/gru.ko 2023-10-06T03:06:28.106 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp 2023-10-06T03:06:28.106 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xp.ko 2023-10-06T03:06:28.107 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-10-06T03:06:28.107 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-10-06T03:06:28.107 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-06T03:06:28.107 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_core.ko 2023-10-06T03:06:28.107 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tsl2550.ko 2023-10-06T03:06:28.107 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_balloon.ko 2023-10-06T03:06:28.107 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci 2023-10-06T03:06:28.107 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-06T03:06:28.107 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net 2023-10-06T03:06:28.107 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding 2023-10-06T03:06:28.107 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding/bonding.ko 2023-10-06T03:06:28.107 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa 2023-10-06T03:06:28.108 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53 2023-10-06T03:06:28.108 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-06T03:06:28.108 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-06T03:06:28.108 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-06T03:06:28.108 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx 2023-10-06T03:06:28.108 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-06T03:06:28.108 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dummy.ko 2023-10-06T03:06:28.108 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/eql.ko 2023-10-06T03:06:28.108 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet 2023-10-06T03:06:28.108 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com 2023-10-06T03:06:28.108 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-06T03:06:28.108 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-06T03:06:28.108 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-06T03:06:28.109 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-06T03:06:28.109 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390 2023-10-06T03:06:28.109 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-06T03:06:28.109 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-06T03:06:28.109 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-06T03:06:28.109 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-06T03:06:28.109 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec 2023-10-06T03:06:28.109 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-06T03:06:28.109 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere 2023-10-06T03:06:28.109 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-06T03:06:28.109 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon 2023-10-06T03:06:28.109 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-06T03:06:28.110 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera 2023-10-06T03:06:28.110 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-06T03:06:28.110 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd 2023-10-06T03:06:28.110 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-06T03:06:28.110 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-06T03:06:28.110 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-06T03:06:28.110 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros 2023-10-06T03:06:28.110 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx 2023-10-06T03:06:28.110 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-06T03:06:28.110 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c 2023-10-06T03:06:28.110 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-06T03:06:28.110 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e 2023-10-06T03:06:28.111 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-06T03:06:28.111 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx 2023-10-06T03:06:28.111 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-06T03:06:28.111 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-06T03:06:28.111 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom 2023-10-06T03:06:28.111 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-06T03:06:28.111 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-06T03:06:28.111 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-10-06T03:06:28.111 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-06T03:06:28.111 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-06T03:06:28.111 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet 2023-10-06T03:06:28.111 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-06T03:06:28.112 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-06T03:06:28.112 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade 2023-10-06T03:06:28.112 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna 2023-10-06T03:06:28.112 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-06T03:06:28.112 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio 2023-10-06T03:06:28.112 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-10-06T03:06:28.112 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-06T03:06:28.112 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-10-06T03:06:28.112 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-06T03:06:28.112 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-10-06T03:06:28.112 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-06T03:06:28.112 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-10-06T03:06:28.113 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-06T03:06:28.113 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-10-06T03:06:28.113 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-06T03:06:28.113 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco 2023-10-06T03:06:28.113 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic 2023-10-06T03:06:28.113 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-06T03:06:28.113 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec 2023-10-06T03:06:28.113 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip 2023-10-06T03:06:28.113 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-06T03:06:28.113 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-06T03:06:28.113 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-06T03:06:28.113 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-06T03:06:28.114 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-06T03:06:28.114 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-06T03:06:28.114 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink 2023-10-06T03:06:28.114 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-06T03:06:28.114 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-06T03:06:28.114 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dnet.ko 2023-10-06T03:06:28.114 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex 2023-10-06T03:06:28.114 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet 2023-10-06T03:06:28.114 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-06T03:06:28.114 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-06T03:06:28.114 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-06T03:06:28.114 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel 2023-10-06T03:06:28.115 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-06T03:06:28.115 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000 2023-10-06T03:06:28.115 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-06T03:06:28.115 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e 2023-10-06T03:06:28.115 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-06T03:06:28.115 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k 2023-10-06T03:06:28.115 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-06T03:06:28.115 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e 2023-10-06T03:06:28.115 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-06T03:06:28.115 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf 2023-10-06T03:06:28.115 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-06T03:06:28.115 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb 2023-10-06T03:06:28.116 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-06T03:06:28.116 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf 2023-10-06T03:06:28.116 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-06T03:06:28.116 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe 2023-10-06T03:06:28.116 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-06T03:06:28.116 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-10-06T03:06:28.116 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-06T03:06:28.116 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/jme.ko 2023-10-06T03:06:28.116 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell 2023-10-06T03:06:28.116 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-06T03:06:28.116 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-06T03:06:28.116 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-06T03:06:28.116 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox 2023-10-06T03:06:28.117 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-10-06T03:06:28.117 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-06T03:06:28.117 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-06T03:06:28.117 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-10-06T03:06:28.117 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-10-06T03:06:28.117 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-06T03:06:28.117 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel 2023-10-06T03:06:28.117 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-06T03:06:28.117 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom 2023-10-06T03:06:28.117 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-10-06T03:06:28.117 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-06T03:06:28.117 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi 2023-10-06T03:06:28.118 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-06T03:06:28.118 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-06T03:06:28.118 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion 2023-10-06T03:06:28.118 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-06T03:06:28.118 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia 2023-10-06T03:06:28.118 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-06T03:06:28.118 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines 2023-10-06T03:06:28.118 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-06T03:06:28.118 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-06T03:06:28.118 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic 2023-10-06T03:06:28.118 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen 2023-10-06T03:06:28.118 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-06T03:06:28.119 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-06T03:06:28.119 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-10-06T03:06:28.119 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-06T03:06:28.119 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc 2023-10-06T03:06:28.119 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-06T03:06:28.119 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek 2023-10-06T03:06:28.119 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-06T03:06:28.119 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-06T03:06:28.119 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-06T03:06:28.119 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-06T03:06:28.119 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker 2023-10-06T03:06:28.119 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-10-06T03:06:28.120 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc 2023-10-06T03:06:28.120 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-06T03:06:28.120 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan 2023-10-06T03:06:28.120 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-06T03:06:28.120 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis 2023-10-06T03:06:28.120 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-06T03:06:28.120 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-06T03:06:28.120 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc 2023-10-06T03:06:28.120 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-06T03:06:28.120 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-06T03:06:28.120 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-06T03:06:28.120 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-06T03:06:28.121 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro 2023-10-06T03:06:28.121 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-10-06T03:06:28.121 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-06T03:06:28.121 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-06T03:06:28.121 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun 2023-10-06T03:06:28.121 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-06T03:06:28.121 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-06T03:06:28.121 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-06T03:06:28.121 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-06T03:06:28.121 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti 2023-10-06T03:06:28.121 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-06T03:06:28.121 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti 2023-10-06T03:06:28.122 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-06T03:06:28.122 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via 2023-10-06T03:06:28.122 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-06T03:06:28.122 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-06T03:06:28.122 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet 2023-10-06T03:06:28.122 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-06T03:06:28.122 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-06T03:06:28.122 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom 2023-10-06T03:06:28.122 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-06T03:06:28.122 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/geneve.ko 2023-10-06T03:06:28.122 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv 2023-10-06T03:06:28.122 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-06T03:06:28.123 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154 2023-10-06T03:06:28.123 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-06T03:06:28.123 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ifb.ko 2023-10-06T03:06:28.123 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan 2023-10-06T03:06:28.123 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-06T03:06:28.123 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvlan.ko 2023-10-06T03:06:28.123 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvtap.ko 2023-10-06T03:06:28.123 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio 2023-10-06T03:06:28.123 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio.ko 2023-10-06T03:06:28.123 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-06T03:06:28.123 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-06T03:06:28.123 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-06T03:06:28.123 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mii.ko 2023-10-06T03:06:28.124 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/net_failover.ko 2023-10-06T03:06:28.124 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/netconsole.ko 2023-10-06T03:06:28.124 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/nlmon.ko 2023-10-06T03:06:28.124 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs 2023-10-06T03:06:28.124 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-06T03:06:28.124 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-06T03:06:28.124 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy 2023-10-06T03:06:28.124 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/amd.ko 2023-10-06T03:06:28.124 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-06T03:06:28.124 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-10-06T03:06:28.124 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-06T03:06:28.124 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-06T03:06:28.125 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/broadcom.ko 2023-10-06T03:06:28.125 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/cicada.ko 2023-10-06T03:06:28.125 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/davicom.ko 2023-10-06T03:06:28.125 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/dp83640.ko 2023-10-06T03:06:28.125 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/et1011c.ko 2023-10-06T03:06:28.125 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/icplus.ko 2023-10-06T03:06:28.125 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/lxt.ko 2023-10-06T03:06:28.125 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/marvell.ko 2023-10-06T03:06:28.125 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/micrel.ko 2023-10-06T03:06:28.125 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/national.ko 2023-10-06T03:06:28.125 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/phylink.ko 2023-10-06T03:06:28.125 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/qsemi.ko 2023-10-06T03:06:28.126 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/realtek.ko 2023-10-06T03:06:28.126 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/smsc.ko 2023-10-06T03:06:28.126 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-06T03:06:28.126 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/vitesse.ko 2023-10-06T03:06:28.126 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp 2023-10-06T03:06:28.126 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-06T03:06:28.126 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-06T03:06:28.126 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-06T03:06:28.126 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_generic.ko 2023-10-06T03:06:28.126 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-06T03:06:28.126 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-06T03:06:28.126 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppoe.ko 2023-10-06T03:06:28.126 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppox.ko 2023-10-06T03:06:28.127 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pptp.ko 2023-10-06T03:06:28.127 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip 2023-10-06T03:06:28.127 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slhc.ko 2023-10-06T03:06:28.127 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slip.ko 2023-10-06T03:06:28.127 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/sungem_phy.ko 2023-10-06T03:06:28.127 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tap.ko 2023-10-06T03:06:28.127 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team 2023-10-06T03:06:28.127 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team.ko 2023-10-06T03:06:28.127 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-06T03:06:28.127 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-06T03:06:28.127 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-06T03:06:28.129 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_random.ko 2023-10-06T03:06:28.129 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-06T03:06:28.129 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tun.ko 2023-10-06T03:06:28.129 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/veth.ko 2023-10-06T03:06:28.129 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/virtio_net.ko 2023-10-06T03:06:28.129 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3 2023-10-06T03:06:28.129 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-06T03:06:28.129 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan 2023-10-06T03:06:28.129 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-06T03:06:28.130 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback 2023-10-06T03:06:28.130 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-06T03:06:28.130 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netfront.ko 2023-10-06T03:06:28.130 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb 2023-10-06T03:06:28.130 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb/ntb.ko 2023-10-06T03:06:28.130 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme 2023-10-06T03:06:28.130 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host 2023-10-06T03:06:28.130 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-06T03:06:28.130 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme.ko 2023-10-06T03:06:28.130 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport 2023-10-06T03:06:28.130 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport.ko 2023-10-06T03:06:28.130 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_cs.ko 2023-10-06T03:06:28.131 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_pc.ko 2023-10-06T03:06:28.131 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_serial.ko 2023-10-06T03:06:28.131 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci 2023-10-06T03:06:28.131 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug 2023-10-06T03:06:28.131 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-06T03:06:28.131 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie 2023-10-06T03:06:28.131 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie/aer_inject.ko 2023-10-06T03:06:28.131 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/xen-pcifront.ko 2023-10-06T03:06:28.131 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia 2023-10-06T03:06:28.131 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/i82092.ko 2023-10-06T03:06:28.131 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pd6729.ko 2023-10-06T03:06:28.131 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-06T03:06:28.132 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl 2023-10-06T03:06:28.132 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel 2023-10-06T03:06:28.132 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-06T03:06:28.132 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform 2023-10-06T03:06:28.132 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86 2023-10-06T03:06:28.132 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-06T03:06:28.132 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-06T03:06:28.132 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-06T03:06:28.132 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-06T03:06:28.132 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-06T03:06:28.132 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-06T03:06:28.132 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-06T03:06:28.132 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-06T03:06:28.133 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-06T03:06:28.133 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-06T03:06:28.133 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-06T03:06:28.133 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/hdaps.ko 2023-10-06T03:06:28.133 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel 2023-10-06T03:06:28.133 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-06T03:06:28.133 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-06T03:06:28.133 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-06T03:06:28.133 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-06T03:06:28.133 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-06T03:06:28.133 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-06T03:06:28.133 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-06T03:06:28.134 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-06T03:06:28.134 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-06T03:06:28.134 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-06T03:06:28.134 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-06T03:06:28.134 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi.ko 2023-10-06T03:06:28.134 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap 2023-10-06T03:06:28.134 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-06T03:06:28.134 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-06T03:06:28.134 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps 2023-10-06T03:06:28.134 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients 2023-10-06T03:06:28.134 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-06T03:06:28.134 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-06T03:06:28.134 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-06T03:06:28.135 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/pps_core.ko 2023-10-06T03:06:28.135 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp 2023-10-06T03:06:28.135 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp.ko 2023-10-06T03:06:28.135 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-06T03:06:28.135 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc 2023-10-06T03:06:28.135 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-06T03:06:28.135 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq4802.ko 2023-10-06T03:06:28.135 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-06T03:06:28.135 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-06T03:06:28.135 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-06T03:06:28.135 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-06T03:06:28.135 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-06T03:06:28.136 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-06T03:06:28.136 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-06T03:06:28.136 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-06T03:06:28.136 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-06T03:06:28.136 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-06T03:06:28.136 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-06T03:06:28.136 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-06T03:06:28.136 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-06T03:06:28.136 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-06T03:06:28.136 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-06T03:06:28.136 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-06T03:06:28.136 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-06T03:06:28.137 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-06T03:06:28.137 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-06T03:06:28.137 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-06T03:06:28.137 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-06T03:06:28.137 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-06T03:06:28.137 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-06T03:06:28.137 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-06T03:06:28.137 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-06T03:06:28.137 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-06T03:06:28.137 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-06T03:06:28.137 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-06T03:06:28.137 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-06T03:06:28.137 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-06T03:06:28.138 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi 2023-10-06T03:06:28.138 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-06T03:06:28.138 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-sas.ko 2023-10-06T03:06:28.138 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-06T03:06:28.138 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/BusLogic.ko 2023-10-06T03:06:28.138 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/a100u2w.ko 2023-10-06T03:06:28.138 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid 2023-10-06T03:06:28.138 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-06T03:06:28.138 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/advansys.ko 2023-10-06T03:06:28.138 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx 2023-10-06T03:06:28.138 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-06T03:06:28.138 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-06T03:06:28.139 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/am53c974.ko 2023-10-06T03:06:28.139 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr 2023-10-06T03:06:28.139 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-06T03:06:28.139 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/atp870u.ko 2023-10-06T03:06:28.139 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi 2023-10-06T03:06:28.139 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-06T03:06:28.139 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa 2023-10-06T03:06:28.139 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-06T03:06:28.139 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc 2023-10-06T03:06:28.139 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-06T03:06:28.139 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i 2023-10-06T03:06:28.139 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-06T03:06:28.139 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ch.ko 2023-10-06T03:06:28.140 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor 2023-10-06T03:06:28.140 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-06T03:06:28.140 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi 2023-10-06T03:06:28.140 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-10-06T03:06:28.140 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-06T03:06:28.140 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-10-06T03:06:28.140 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-06T03:06:28.140 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-06T03:06:28.140 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dc395x.ko 2023-10-06T03:06:28.140 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler 2023-10-06T03:06:28.140 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-10-06T03:06:28.140 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-10-06T03:06:28.141 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-10-06T03:06:28.141 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-10-06T03:06:28.141 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dmx3191d.ko 2023-10-06T03:06:28.141 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r 2023-10-06T03:06:28.141 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-06T03:06:28.141 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esp_scsi.ko 2023-10-06T03:06:28.141 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe 2023-10-06T03:06:28.141 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-06T03:06:28.141 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-06T03:06:28.141 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic 2023-10-06T03:06:28.141 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-06T03:06:28.141 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hpsa.ko 2023-10-06T03:06:28.142 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hptiop.ko 2023-10-06T03:06:28.142 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-06T03:06:28.142 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/initio.ko 2023-10-06T03:06:28.142 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ipr.ko 2023-10-06T03:06:28.142 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ips.ko 2023-10-06T03:06:28.142 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci 2023-10-06T03:06:28.142 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci/isci.ko 2023-10-06T03:06:28.142 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-06T03:06:28.142 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-06T03:06:28.142 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc 2023-10-06T03:06:28.142 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-06T03:06:28.142 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi.ko 2023-10-06T03:06:28.143 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-06T03:06:28.143 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas 2023-10-06T03:06:28.143 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-06T03:06:28.143 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc 2023-10-06T03:06:28.143 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-06T03:06:28.143 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid 2023-10-06T03:06:28.143 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid.ko 2023-10-06T03:06:28.143 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-06T03:06:28.143 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-06T03:06:28.143 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-06T03:06:28.143 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas 2023-10-06T03:06:28.144 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-06T03:06:28.144 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas 2023-10-06T03:06:28.144 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-06T03:06:28.144 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvumi.ko 2023-10-06T03:06:28.144 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001 2023-10-06T03:06:28.144 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-06T03:06:28.144 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pmcraid.ko 2023-10-06T03:06:28.144 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla1280.ko 2023-10-06T03:06:28.144 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx 2023-10-06T03:06:28.144 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-06T03:06:28.144 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-06T03:06:28.144 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx 2023-10-06T03:06:28.145 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-06T03:06:28.145 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/raid_class.ko 2023-10-06T03:06:28.145 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_debug.ko 2023-10-06T03:06:28.145 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-06T03:06:28.145 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-06T03:06:28.145 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-06T03:06:28.145 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-06T03:06:28.145 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-06T03:06:28.145 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ses.ko 2023-10-06T03:06:28.145 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/st.ko 2023-10-06T03:06:28.145 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/stex.ko 2023-10-06T03:06:28.145 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2 2023-10-06T03:06:28.146 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-06T03:06:28.146 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-06T03:06:28.146 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-06T03:06:28.146 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/wd719x.ko 2023-10-06T03:06:28.146 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb 2023-10-06T03:06:28.146 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb/ssb.ko 2023-10-06T03:06:28.146 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target 2023-10-06T03:06:28.146 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi 2023-10-06T03:06:28.146 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-06T03:06:28.146 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback 2023-10-06T03:06:28.146 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-06T03:06:28.147 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_file.ko 2023-10-06T03:06:28.147 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_iblock.ko 2023-10-06T03:06:28.147 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_mod.ko 2023-10-06T03:06:28.147 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_pscsi.ko 2023-10-06T03:06:28.147 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_user.ko 2023-10-06T03:06:28.147 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc 2023-10-06T03:06:28.147 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-06T03:06:28.147 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal 2023-10-06T03:06:28.147 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel 2023-10-06T03:06:28.147 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal 2023-10-06T03:06:28.147 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-06T03:06:28.147 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-06T03:06:28.147 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-06T03:06:28.148 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-06T03:06:28.148 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-06T03:06:28.148 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-06T03:06:28.148 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-06T03:06:28.148 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-06T03:06:28.148 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-06T03:06:28.148 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-06T03:06:28.148 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-06T03:06:28.148 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-06T03:06:28.148 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-06T03:06:28.148 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-06T03:06:28.149 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-06T03:06:28.149 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty 2023-10-06T03:06:28.149 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless 2023-10-06T03:06:28.149 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-06T03:06:28.149 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_gsm.ko 2023-10-06T03:06:28.149 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_hdlc.ko 2023-10-06T03:06:28.149 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/nozomi.ko 2023-10-06T03:06:28.149 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial 2023-10-06T03:06:28.149 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250 2023-10-06T03:06:28.149 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-06T03:06:28.149 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-06T03:06:28.149 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm 2023-10-06T03:06:28.150 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-06T03:06:28.150 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/synclink_gt.ko 2023-10-06T03:06:28.150 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs 2023-10-06T03:06:28.150 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core 2023-10-06T03:06:28.150 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-06T03:06:28.150 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host 2023-10-06T03:06:28.150 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-06T03:06:28.150 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio 2023-10-06T03:06:28.150 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio.ko 2023-10-06T03:06:28.150 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_aec.ko 2023-10-06T03:06:28.150 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_cif.ko 2023-10-06T03:06:28.151 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-06T03:06:28.151 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_sercos3.ko 2023-10-06T03:06:28.151 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb 2023-10-06T03:06:28.151 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class 2023-10-06T03:06:28.151 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-06T03:06:28.151 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-06T03:06:28.151 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usblp.ko 2023-10-06T03:06:28.151 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usbtmc.ko 2023-10-06T03:06:28.151 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host 2023-10-06T03:06:28.151 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-06T03:06:28.151 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image 2023-10-06T03:06:28.151 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/mdc800.ko 2023-10-06T03:06:28.152 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/microtek.ko 2023-10-06T03:06:28.152 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc 2023-10-06T03:06:28.152 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/adutux.ko 2023-10-06T03:06:28.152 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-06T03:06:28.152 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi26.ko 2023-10-06T03:06:28.152 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi62.ko 2023-10-06T03:06:28.152 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ezusb.ko 2023-10-06T03:06:28.152 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/idmouse.ko 2023-10-06T03:06:28.152 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-06T03:06:28.152 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-06T03:06:28.152 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ldusb.ko 2023-10-06T03:06:28.152 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-06T03:06:28.153 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga 2023-10-06T03:06:28.153 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-06T03:06:28.153 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-06T03:06:28.153 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usb3503.ko 2023-10-06T03:06:28.153 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usblcd.ko 2023-10-06T03:06:28.153 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-06T03:06:28.153 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/uss720.ko 2023-10-06T03:06:28.153 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/yurex.ko 2023-10-06T03:06:28.153 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy 2023-10-06T03:06:28.153 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-06T03:06:28.153 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial 2023-10-06T03:06:28.153 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/aircable.ko 2023-10-06T03:06:28.154 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ark3116.ko 2023-10-06T03:06:28.154 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-06T03:06:28.154 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ch341.ko 2023-10-06T03:06:28.154 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cp210x.ko 2023-10-06T03:06:28.154 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-06T03:06:28.154 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-06T03:06:28.154 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-06T03:06:28.154 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/empeg.ko 2023-10-06T03:06:28.154 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-06T03:06:28.154 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-06T03:06:28.154 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-06T03:06:28.154 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_ti.ko 2023-10-06T03:06:28.155 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipaq.ko 2023-10-06T03:06:28.155 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipw.ko 2023-10-06T03:06:28.155 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-06T03:06:28.155 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-06T03:06:28.155 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan.ko 2023-10-06T03:06:28.155 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-06T03:06:28.155 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-06T03:06:28.155 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-06T03:06:28.155 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-06T03:06:28.155 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7720.ko 2023-10-06T03:06:28.155 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7840.ko 2023-10-06T03:06:28.155 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/navman.ko 2023-10-06T03:06:28.156 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/omninet.ko 2023-10-06T03:06:28.156 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/opticon.ko 2023-10-06T03:06:28.156 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/option.ko 2023-10-06T03:06:28.156 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/oti6858.ko 2023-10-06T03:06:28.156 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/pl2303.ko 2023-10-06T03:06:28.156 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcaux.ko 2023-10-06T03:06:28.156 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcserial.ko 2023-10-06T03:06:28.156 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/quatech2.ko 2023-10-06T03:06:28.156 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-06T03:06:28.156 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/sierra.ko 2023-10-06T03:06:28.156 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-06T03:06:28.157 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ssu100.ko 2023-10-06T03:06:28.157 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-06T03:06:28.157 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-06T03:06:28.157 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-06T03:06:28.157 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-06T03:06:28.157 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-06T03:06:28.157 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/visor.ko 2023-10-06T03:06:28.157 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-06T03:06:28.157 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-06T03:06:28.157 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage 2023-10-06T03:06:28.157 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/uas.ko 2023-10-06T03:06:28.157 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-06T03:06:28.158 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-06T03:06:28.158 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-06T03:06:28.158 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-06T03:06:28.158 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-06T03:06:28.158 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-06T03:06:28.158 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-06T03:06:28.158 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-06T03:06:28.158 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-06T03:06:28.158 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-06T03:06:28.158 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-06T03:06:28.158 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-06T03:06:28.158 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-06T03:06:28.159 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-06T03:06:28.159 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip 2023-10-06T03:06:28.159 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-06T03:06:28.159 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-06T03:06:28.159 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-06T03:06:28.159 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio 2023-10-06T03:06:28.159 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci 2023-10-06T03:06:28.159 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-06T03:06:28.159 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-06T03:06:28.159 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio.ko 2023-10-06T03:06:28.159 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-06T03:06:28.160 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost 2023-10-06T03:06:28.160 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost.ko 2023-10-06T03:06:28.160 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-06T03:06:28.160 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_net.ko 2023-10-06T03:06:28.160 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-06T03:06:28.160 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video 2023-10-06T03:06:28.160 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight 2023-10-06T03:06:28.160 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-06T03:06:28.160 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lcd.ko 2023-10-06T03:06:28.160 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-06T03:06:28.160 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio 2023-10-06T03:06:28.160 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio.ko 2023-10-06T03:06:28.160 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_balloon.ko 2023-10-06T03:06:28.161 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_mmio.ko 2023-10-06T03:06:28.161 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci.ko 2023-10-06T03:06:28.161 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-10-06T03:06:28.161 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-10-06T03:06:28.161 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_ring.ko 2023-10-06T03:06:28.161 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1 2023-10-06T03:06:28.161 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters 2023-10-06T03:06:28.161 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2482.ko 2023-10-06T03:06:28.161 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2490.ko 2023-10-06T03:06:28.161 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves 2023-10-06T03:06:28.161 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-06T03:06:28.162 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-06T03:06:28.162 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-06T03:06:28.162 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-06T03:06:28.162 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-06T03:06:28.162 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-06T03:06:28.162 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-06T03:06:28.162 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-06T03:06:28.162 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-06T03:06:28.162 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-06T03:06:28.162 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-06T03:06:28.162 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/wire.ko 2023-10-06T03:06:28.163 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog 2023-10-06T03:06:28.163 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-06T03:06:28.163 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-06T03:06:28.163 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-06T03:06:28.163 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/hpwdt.ko 2023-10-06T03:06:28.163 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/i6300esb.ko 2023-10-06T03:06:28.163 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-06T03:06:28.163 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-06T03:06:28.163 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-06T03:06:28.163 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ibmasr.ko 2023-10-06T03:06:28.163 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-06T03:06:28.163 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-06T03:06:28.164 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-06T03:06:28.164 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/machzwd.ko 2023-10-06T03:06:28.164 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/nv_tco.ko 2023-10-06T03:06:28.164 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-06T03:06:28.164 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-06T03:06:28.164 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-06T03:06:28.164 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-06T03:06:28.164 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/softdog.ko 2023-10-06T03:06:28.164 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-06T03:06:28.164 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/via_wdt.ko 2023-10-06T03:06:28.164 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-06T03:06:28.164 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-06T03:06:28.165 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-06T03:06:28.165 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-06T03:06:28.165 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-06T03:06:28.165 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen 2023-10-06T03:06:28.165 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-acpi-processor.ko 2023-10-06T03:06:28.165 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-evtchn.ko 2023-10-06T03:06:28.165 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-06T03:06:28.165 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntdev.ko 2023-10-06T03:06:28.165 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback 2023-10-06T03:06:28.165 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-06T03:06:28.165 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-privcmd.ko 2023-10-06T03:06:28.165 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs 2023-10-06T03:06:28.165 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-06T03:06:28.166 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs 2023-10-06T03:06:28.166 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p 2023-10-06T03:06:28.166 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p/9p.ko 2023-10-06T03:06:28.166 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs 2023-10-06T03:06:28.166 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs/affs.ko 2023-10-06T03:06:28.166 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs 2023-10-06T03:06:28.166 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs/befs.ko 2023-10-06T03:06:28.166 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/binfmt_misc.ko 2023-10-06T03:06:28.166 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs 2023-10-06T03:06:28.166 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs/btrfs.ko 2023-10-06T03:06:28.166 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles 2023-10-06T03:06:28.166 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles/cachefiles.ko 2023-10-06T03:06:28.167 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph 2023-10-06T03:06:28.167 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph/ceph.ko 2023-10-06T03:06:28.167 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda 2023-10-06T03:06:28.167 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda/coda.ko 2023-10-06T03:06:28.167 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs 2023-10-06T03:06:28.167 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs/cramfs.ko 2023-10-06T03:06:28.167 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm 2023-10-06T03:06:28.167 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm/dlm.ko 2023-10-06T03:06:28.167 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs 2023-10-06T03:06:28.167 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs/ecryptfs.ko 2023-10-06T03:06:28.167 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs 2023-10-06T03:06:28.167 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs/f2fs.ko 2023-10-06T03:06:28.167 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat 2023-10-06T03:06:28.168 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/fat.ko 2023-10-06T03:06:28.168 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/msdos.ko 2023-10-06T03:06:28.168 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/vfat.ko 2023-10-06T03:06:28.168 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache 2023-10-06T03:06:28.168 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache/fscache.ko 2023-10-06T03:06:28.168 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse 2023-10-06T03:06:28.168 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/cuse.ko 2023-10-06T03:06:28.168 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/fuse.ko 2023-10-06T03:06:28.168 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2 2023-10-06T03:06:28.168 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2/gfs2.ko 2023-10-06T03:06:28.168 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs 2023-10-06T03:06:28.168 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs/hfs.ko 2023-10-06T03:06:28.169 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus 2023-10-06T03:06:28.169 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus/hfsplus.ko 2023-10-06T03:06:28.169 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs 2023-10-06T03:06:28.169 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs/isofs.ko 2023-10-06T03:06:28.169 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs 2023-10-06T03:06:28.169 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs/jfs.ko 2023-10-06T03:06:28.169 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd 2023-10-06T03:06:28.169 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd/lockd.ko 2023-10-06T03:06:28.169 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix 2023-10-06T03:06:28.169 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix/minix.ko 2023-10-06T03:06:28.169 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs 2023-10-06T03:06:28.169 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs/netfs.ko 2023-10-06T03:06:28.170 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs 2023-10-06T03:06:28.170 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout 2023-10-06T03:06:28.170 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-06T03:06:28.170 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout 2023-10-06T03:06:28.170 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-06T03:06:28.170 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout 2023-10-06T03:06:28.170 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-06T03:06:28.170 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfs.ko 2023-10-06T03:06:28.170 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv3.ko 2023-10-06T03:06:28.170 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv4.ko 2023-10-06T03:06:28.170 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common 2023-10-06T03:06:28.170 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/grace.ko 2023-10-06T03:06:28.171 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-06T03:06:28.171 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd 2023-10-06T03:06:28.171 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd/nfsd.ko 2023-10-06T03:06:28.171 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2 2023-10-06T03:06:28.171 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2/nilfs2.ko 2023-10-06T03:06:28.171 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls 2023-10-06T03:06:28.171 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-celtic.ko 2023-10-06T03:06:28.171 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-centeuro.ko 2023-10-06T03:06:28.171 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-croatian.ko 2023-10-06T03:06:28.171 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-cyrillic.ko 2023-10-06T03:06:28.171 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-gaelic.ko 2023-10-06T03:06:28.171 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-greek.ko 2023-10-06T03:06:28.172 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-iceland.ko 2023-10-06T03:06:28.172 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-inuit.ko 2023-10-06T03:06:28.172 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-roman.ko 2023-10-06T03:06:28.172 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-romanian.ko 2023-10-06T03:06:28.172 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-turkish.ko 2023-10-06T03:06:28.172 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1250.ko 2023-10-06T03:06:28.172 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1251.ko 2023-10-06T03:06:28.172 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1255.ko 2023-10-06T03:06:28.172 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp737.ko 2023-10-06T03:06:28.172 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp775.ko 2023-10-06T03:06:28.172 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp850.ko 2023-10-06T03:06:28.172 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp852.ko 2023-10-06T03:06:28.173 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp855.ko 2023-10-06T03:06:28.173 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp857.ko 2023-10-06T03:06:28.173 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp860.ko 2023-10-06T03:06:28.173 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp861.ko 2023-10-06T03:06:28.173 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp862.ko 2023-10-06T03:06:28.173 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp863.ko 2023-10-06T03:06:28.173 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp864.ko 2023-10-06T03:06:28.173 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp865.ko 2023-10-06T03:06:28.173 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp866.ko 2023-10-06T03:06:28.173 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp869.ko 2023-10-06T03:06:28.173 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp874.ko 2023-10-06T03:06:28.173 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp932.ko 2023-10-06T03:06:28.174 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp936.ko 2023-10-06T03:06:28.174 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp949.ko 2023-10-06T03:06:28.174 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp950.ko 2023-10-06T03:06:28.174 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_euc-jp.ko 2023-10-06T03:06:28.174 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-06T03:06:28.174 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-06T03:06:28.174 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-06T03:06:28.174 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-06T03:06:28.174 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-06T03:06:28.174 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-06T03:06:28.174 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-06T03:06:28.175 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-06T03:06:28.175 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-06T03:06:28.175 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-06T03:06:28.175 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-06T03:06:28.175 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-r.ko 2023-10-06T03:06:28.175 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-06T03:06:28.175 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-u.ko 2023-10-06T03:06:28.175 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_utf8.ko 2023-10-06T03:06:28.175 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2 2023-10-06T03:06:28.175 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster 2023-10-06T03:06:28.175 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-06T03:06:28.175 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm 2023-10-06T03:06:28.176 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-06T03:06:28.176 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs 2023-10-06T03:06:28.176 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-06T03:06:28.176 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2.ko 2023-10-06T03:06:28.176 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-06T03:06:28.176 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-06T03:06:28.176 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-06T03:06:28.176 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs 2023-10-06T03:06:28.176 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs/overlay.ko 2023-10-06T03:06:28.176 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore 2023-10-06T03:06:28.176 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore/ramoops.ko 2023-10-06T03:06:28.177 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs 2023-10-06T03:06:28.177 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs/reiserfs.ko 2023-10-06T03:06:28.177 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs 2023-10-06T03:06:28.177 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs/romfs.ko 2023-10-06T03:06:28.177 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb 2023-10-06T03:06:28.177 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client 2023-10-06T03:06:28.177 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client/cifs.ko 2023-10-06T03:06:28.177 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common 2023-10-06T03:06:28.177 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-06T03:06:28.177 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_md4.ko 2023-10-06T03:06:28.177 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs 2023-10-06T03:06:28.177 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs/squashfs.ko 2023-10-06T03:06:28.178 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv 2023-10-06T03:06:28.178 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv/sysv.ko 2023-10-06T03:06:28.178 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf 2023-10-06T03:06:28.178 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf/udf.ko 2023-10-06T03:06:28.178 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs 2023-10-06T03:06:28.178 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs/ufs.ko 2023-10-06T03:06:28.178 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs 2023-10-06T03:06:28.178 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs/xfs.ko 2023-10-06T03:06:28.178 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel 2023-10-06T03:06:28.178 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu 2023-10-06T03:06:28.178 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu/rcutorture.ko 2023-10-06T03:06:28.178 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/torture.ko 2023-10-06T03:06:28.179 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace 2023-10-06T03:06:28.179 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-10-06T03:06:28.179 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib 2023-10-06T03:06:28.179 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/asn1_encoder.ko 2023-10-06T03:06:28.179 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc-itu-t.ko 2023-10-06T03:06:28.179 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc8.ko 2023-10-06T03:06:28.179 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto 2023-10-06T03:06:28.179 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libarc4.ko 2023-10-06T03:06:28.179 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libdes.ko 2023-10-06T03:06:28.179 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/libcrc32c.ko 2023-10-06T03:06:28.179 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lru_cache.ko 2023-10-06T03:06:28.180 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4 2023-10-06T03:06:28.180 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4_compress.ko 2023-10-06T03:06:28.180 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-06T03:06:28.180 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math 2023-10-06T03:06:28.180 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math/cordic.ko 2023-10-06T03:06:28.180 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6 2023-10-06T03:06:28.180 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6/raid6_pq.ko 2023-10-06T03:06:28.180 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon 2023-10-06T03:06:28.180 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-06T03:06:28.180 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_bm.ko 2023-10-06T03:06:28.180 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_fsm.ko 2023-10-06T03:06:28.180 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_kmp.ko 2023-10-06T03:06:28.181 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd 2023-10-06T03:06:28.181 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd/zstd_compress.ko 2023-10-06T03:06:28.181 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm 2023-10-06T03:06:28.181 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm/hwpoison-inject.ko 2023-10-06T03:06:28.181 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net 2023-10-06T03:06:28.181 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan 2023-10-06T03:06:28.181 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/6lowpan.ko 2023-10-06T03:06:28.181 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_dest.ko 2023-10-06T03:06:28.181 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-06T03:06:28.181 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_hop.ko 2023-10-06T03:06:28.181 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-06T03:06:28.181 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-06T03:06:28.182 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_routing.ko 2023-10-06T03:06:28.182 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_udp.ko 2023-10-06T03:06:28.182 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802 2023-10-06T03:06:28.182 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/garp.ko 2023-10-06T03:06:28.182 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/mrp.ko 2023-10-06T03:06:28.182 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/p8022.ko 2023-10-06T03:06:28.182 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/psnap.ko 2023-10-06T03:06:28.182 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/stp.ko 2023-10-06T03:06:28.182 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q 2023-10-06T03:06:28.182 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q/8021q.ko 2023-10-06T03:06:28.182 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p 2023-10-06T03:06:28.182 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet.ko 2023-10-06T03:06:28.183 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_fd.ko 2023-10-06T03:06:28.183 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_rdma.ko 2023-10-06T03:06:28.183 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_virtio.ko 2023-10-06T03:06:28.183 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv 2023-10-06T03:06:28.183 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv/batman-adv.ko 2023-10-06T03:06:28.183 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge 2023-10-06T03:06:28.183 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/br_netfilter.ko 2023-10-06T03:06:28.183 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/bridge.ko 2023-10-06T03:06:28.183 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter 2023-10-06T03:06:28.183 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-06T03:06:28.183 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-06T03:06:28.183 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-06T03:06:28.184 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-06T03:06:28.184 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-06T03:06:28.184 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-06T03:06:28.184 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-06T03:06:28.184 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-06T03:06:28.184 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-06T03:06:28.184 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-06T03:06:28.184 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-06T03:06:28.184 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-06T03:06:28.184 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-06T03:06:28.184 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-06T03:06:28.184 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-06T03:06:28.185 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-06T03:06:28.185 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-06T03:06:28.185 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-06T03:06:28.185 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-06T03:06:28.185 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-06T03:06:28.185 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-06T03:06:28.185 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-10-06T03:06:28.185 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-06T03:06:28.185 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-06T03:06:28.185 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph 2023-10-06T03:06:28.185 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph/libceph.ko 2023-10-06T03:06:28.185 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core 2023-10-06T03:06:28.186 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/failover.ko 2023-10-06T03:06:28.186 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/pktgen.ko 2023-10-06T03:06:28.186 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp 2023-10-06T03:06:28.186 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp.ko 2023-10-06T03:06:28.186 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_diag.ko 2023-10-06T03:06:28.186 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv4.ko 2023-10-06T03:06:28.186 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv6.ko 2023-10-06T03:06:28.186 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver 2023-10-06T03:06:28.186 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver/dns_resolver.ko 2023-10-06T03:06:28.186 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa 2023-10-06T03:06:28.186 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/dsa_core.ko 2023-10-06T03:06:28.186 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_brcm.ko 2023-10-06T03:06:28.187 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_dsa.ko 2023-10-06T03:06:28.187 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_none.ko 2023-10-06T03:06:28.187 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_trailer.ko 2023-10-06T03:06:28.187 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154 2023-10-06T03:06:28.187 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan 2023-10-06T03:06:28.187 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-06T03:06:28.187 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154.ko 2023-10-06T03:06:28.187 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-06T03:06:28.187 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4 2023-10-06T03:06:28.187 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ah4.ko 2023-10-06T03:06:28.187 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/esp4.ko 2023-10-06T03:06:28.187 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/fou.ko 2023-10-06T03:06:28.187 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/gre.ko 2023-10-06T03:06:28.188 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/inet_diag.ko 2023-10-06T03:06:28.188 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_gre.ko 2023-10-06T03:06:28.188 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_tunnel.ko 2023-10-06T03:06:28.188 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_vti.ko 2023-10-06T03:06:28.188 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipcomp.ko 2023-10-06T03:06:28.188 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipip.ko 2023-10-06T03:06:28.188 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter 2023-10-06T03:06:28.188 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-06T03:06:28.188 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-06T03:06:28.188 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-06T03:06:28.188 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-06T03:06:28.188 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-06T03:06:28.189 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-06T03:06:28.189 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-06T03:06:28.189 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-06T03:06:28.189 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-06T03:06:28.189 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-06T03:06:28.189 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-06T03:06:28.189 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-06T03:06:28.189 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-06T03:06:28.189 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-06T03:06:28.189 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-06T03:06:28.189 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-06T03:06:28.189 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-06T03:06:28.190 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-06T03:06:28.190 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-06T03:06:28.190 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-06T03:06:28.190 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-06T03:06:28.190 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_bic.ko 2023-10-06T03:06:28.190 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-06T03:06:28.190 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_diag.ko 2023-10-06T03:06:28.190 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-06T03:06:28.190 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_htcp.ko 2023-10-06T03:06:28.190 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_hybla.ko 2023-10-06T03:06:28.190 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_illinois.ko 2023-10-06T03:06:28.191 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_lp.ko 2023-10-06T03:06:28.191 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_scalable.ko 2023-10-06T03:06:28.191 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_vegas.ko 2023-10-06T03:06:28.191 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_veno.ko 2023-10-06T03:06:28.191 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_westwood.ko 2023-10-06T03:06:28.191 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_yeah.ko 2023-10-06T03:06:28.191 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tunnel4.ko 2023-10-06T03:06:28.191 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_diag.ko 2023-10-06T03:06:28.191 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_tunnel.ko 2023-10-06T03:06:28.191 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-06T03:06:28.191 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6 2023-10-06T03:06:28.191 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ah6.ko 2023-10-06T03:06:28.191 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/esp6.ko 2023-10-06T03:06:28.192 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/fou6.ko 2023-10-06T03:06:28.192 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-06T03:06:28.192 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-06T03:06:28.192 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_vti.ko 2023-10-06T03:06:28.192 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ipcomp6.ko 2023-10-06T03:06:28.192 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter 2023-10-06T03:06:28.192 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-06T03:06:28.192 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-06T03:06:28.192 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-06T03:06:28.192 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-06T03:06:28.192 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-06T03:06:28.192 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-06T03:06:28.193 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-06T03:06:28.193 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-06T03:06:28.193 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-06T03:06:28.193 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-06T03:06:28.193 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-06T03:06:28.193 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-06T03:06:28.193 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-06T03:06:28.193 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-06T03:06:28.193 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-06T03:06:28.193 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-06T03:06:28.193 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-06T03:06:28.193 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-06T03:06:28.194 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-06T03:06:28.194 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-06T03:06:28.194 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-06T03:06:28.194 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-06T03:06:28.194 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-06T03:06:28.194 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-06T03:06:28.194 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/sit.ko 2023-10-06T03:06:28.194 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/tunnel6.ko 2023-10-06T03:06:28.194 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-06T03:06:28.194 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key 2023-10-06T03:06:28.194 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key/af_key.ko 2023-10-06T03:06:28.194 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp 2023-10-06T03:06:28.195 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_core.ko 2023-10-06T03:06:28.195 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-06T03:06:28.195 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_eth.ko 2023-10-06T03:06:28.195 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip.ko 2023-10-06T03:06:28.195 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-06T03:06:28.195 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-06T03:06:28.195 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-06T03:06:28.195 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc 2023-10-06T03:06:28.195 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc/llc.ko 2023-10-06T03:06:28.195 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154 2023-10-06T03:06:28.195 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154/mac802154.ko 2023-10-06T03:06:28.195 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls 2023-10-06T03:06:28.196 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls/mpls_gso.ko 2023-10-06T03:06:28.196 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter 2023-10-06T03:06:28.196 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset 2023-10-06T03:06:28.196 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-06T03:06:28.196 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-06T03:06:28.196 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-06T03:06:28.196 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-06T03:06:28.196 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-06T03:06:28.196 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-06T03:06:28.196 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-06T03:06:28.196 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-06T03:06:28.196 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-06T03:06:28.197 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-06T03:06:28.197 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-06T03:06:28.197 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-06T03:06:28.197 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-06T03:06:28.197 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-06T03:06:28.197 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-06T03:06:28.197 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-06T03:06:28.197 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs 2023-10-06T03:06:28.197 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-06T03:06:28.197 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-06T03:06:28.197 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-06T03:06:28.197 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-06T03:06:28.198 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-06T03:06:28.198 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-06T03:06:28.198 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-06T03:06:28.198 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-06T03:06:28.198 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-06T03:06:28.198 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-06T03:06:28.198 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-06T03:06:28.198 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-06T03:06:28.198 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-06T03:06:28.198 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-06T03:06:28.198 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conncount.ko 2023-10-06T03:06:28.198 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack.ko 2023-10-06T03:06:28.199 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-06T03:06:28.199 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-06T03:06:28.199 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-06T03:06:28.199 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-06T03:06:28.199 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-06T03:06:28.199 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-06T03:06:28.199 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-06T03:06:28.199 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-06T03:06:28.199 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-06T03:06:28.199 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-06T03:06:28.199 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-06T03:06:28.199 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-06T03:06:28.200 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-06T03:06:28.200 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table.ko 2023-10-06T03:06:28.200 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-06T03:06:28.200 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-06T03:06:28.200 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat.ko 2023-10-06T03:06:28.200 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-06T03:06:28.200 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-06T03:06:28.200 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-06T03:06:28.200 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-06T03:06:28.200 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-06T03:06:28.200 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-06T03:06:28.200 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_tables.ko 2023-10-06T03:06:28.201 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink.ko 2023-10-06T03:06:28.201 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-06T03:06:28.201 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-06T03:06:28.201 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-06T03:06:28.201 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-06T03:06:28.201 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-06T03:06:28.201 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_compat.ko 2023-10-06T03:06:28.201 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_ct.ko 2023-10-06T03:06:28.201 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-06T03:06:28.201 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fib.ko 2023-10-06T03:06:28.201 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-06T03:06:28.201 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_hash.ko 2023-10-06T03:06:28.202 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_limit.ko 2023-10-06T03:06:28.202 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_log.ko 2023-10-06T03:06:28.202 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_masq.ko 2023-10-06T03:06:28.202 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_nat.ko 2023-10-06T03:06:28.202 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_numgen.ko 2023-10-06T03:06:28.202 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_queue.ko 2023-10-06T03:06:28.202 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_quota.ko 2023-10-06T03:06:28.202 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_redir.ko 2023-10-06T03:06:28.202 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject.ko 2023-10-06T03:06:28.202 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-06T03:06:28.202 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_socket.ko 2023-10-06T03:06:28.203 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_tunnel.ko 2023-10-06T03:06:28.203 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-06T03:06:28.203 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-06T03:06:28.203 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-06T03:06:28.203 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-06T03:06:28.203 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CT.ko 2023-10-06T03:06:28.203 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_DSCP.ko 2023-10-06T03:06:28.203 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HL.ko 2023-10-06T03:06:28.203 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HMARK.ko 2023-10-06T03:06:28.203 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-06T03:06:28.203 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LED.ko 2023-10-06T03:06:28.203 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LOG.ko 2023-10-06T03:06:28.204 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-06T03:06:28.204 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-06T03:06:28.204 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-06T03:06:28.204 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-06T03:06:28.204 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-06T03:06:28.204 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-06T03:06:28.204 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-06T03:06:28.204 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-06T03:06:28.204 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-06T03:06:28.204 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TEE.ko 2023-10-06T03:06:28.204 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-06T03:06:28.204 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TRACE.ko 2023-10-06T03:06:28.205 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_addrtype.ko 2023-10-06T03:06:28.205 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_bpf.ko 2023-10-06T03:06:28.205 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cgroup.ko 2023-10-06T03:06:28.205 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cluster.ko 2023-10-06T03:06:28.205 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_comment.ko 2023-10-06T03:06:28.205 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connbytes.ko 2023-10-06T03:06:28.205 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlabel.ko 2023-10-06T03:06:28.205 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlimit.ko 2023-10-06T03:06:28.205 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connmark.ko 2023-10-06T03:06:28.205 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_conntrack.ko 2023-10-06T03:06:28.205 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cpu.ko 2023-10-06T03:06:28.205 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dccp.ko 2023-10-06T03:06:28.206 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_devgroup.ko 2023-10-06T03:06:28.206 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dscp.ko 2023-10-06T03:06:28.206 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ecn.ko 2023-10-06T03:06:28.206 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_esp.ko 2023-10-06T03:06:28.206 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-06T03:06:28.206 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_helper.ko 2023-10-06T03:06:28.206 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hl.ko 2023-10-06T03:06:28.206 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-06T03:06:28.206 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_iprange.ko 2023-10-06T03:06:28.206 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipvs.ko 2023-10-06T03:06:28.206 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_l2tp.ko 2023-10-06T03:06:28.206 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_length.ko 2023-10-06T03:06:28.206 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_limit.ko 2023-10-06T03:06:28.207 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mac.ko 2023-10-06T03:06:28.207 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mark.ko 2023-10-06T03:06:28.207 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_multiport.ko 2023-10-06T03:06:28.207 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nat.ko 2023-10-06T03:06:28.207 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nfacct.ko 2023-10-06T03:06:28.207 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_osf.ko 2023-10-06T03:06:28.207 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_owner.ko 2023-10-06T03:06:28.207 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_physdev.ko 2023-10-06T03:06:28.207 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_pkttype.ko 2023-10-06T03:06:28.207 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_policy.ko 2023-10-06T03:06:28.207 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_quota.ko 2023-10-06T03:06:28.207 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_rateest.ko 2023-10-06T03:06:28.208 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_realm.ko 2023-10-06T03:06:28.208 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_recent.ko 2023-10-06T03:06:28.208 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_sctp.ko 2023-10-06T03:06:28.208 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_set.ko 2023-10-06T03:06:28.208 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_socket.ko 2023-10-06T03:06:28.208 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_state.ko 2023-10-06T03:06:28.208 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_statistic.ko 2023-10-06T03:06:28.208 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_string.ko 2023-10-06T03:06:28.208 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-06T03:06:28.208 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_time.ko 2023-10-06T03:06:28.208 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_u32.ko 2023-10-06T03:06:28.208 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink 2023-10-06T03:06:28.208 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink/netlink_diag.ko 2023-10-06T03:06:28.209 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh 2023-10-06T03:06:28.209 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh/nsh.ko 2023-10-06T03:06:28.209 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch 2023-10-06T03:06:28.209 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/openvswitch.ko 2023-10-06T03:06:28.209 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-geneve.ko 2023-10-06T03:06:28.209 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-gre.ko 2023-10-06T03:06:28.209 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-06T03:06:28.209 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet 2023-10-06T03:06:28.209 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet/af_packet_diag.ko 2023-10-06T03:06:28.209 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds 2023-10-06T03:06:28.209 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds.ko 2023-10-06T03:06:28.209 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_rdma.ko 2023-10-06T03:06:28.210 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_tcp.ko 2023-10-06T03:06:28.210 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched 2023-10-06T03:06:28.210 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_csum.ko 2023-10-06T03:06:28.210 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_gact.ko 2023-10-06T03:06:28.210 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_ipt.ko 2023-10-06T03:06:28.210 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_mirred.ko 2023-10-06T03:06:28.210 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_nat.ko 2023-10-06T03:06:28.210 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_pedit.ko 2023-10-06T03:06:28.210 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_police.ko 2023-10-06T03:06:28.210 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_simple.ko 2023-10-06T03:06:28.210 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_skbedit.ko 2023-10-06T03:06:28.210 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_vlan.ko 2023-10-06T03:06:28.211 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_basic.ko 2023-10-06T03:06:28.211 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_bpf.ko 2023-10-06T03:06:28.211 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_flow.ko 2023-10-06T03:06:28.211 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_fw.ko 2023-10-06T03:06:28.211 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_route.ko 2023-10-06T03:06:28.211 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_u32.ko 2023-10-06T03:06:28.211 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_cmp.ko 2023-10-06T03:06:28.211 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_ipset.ko 2023-10-06T03:06:28.211 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_meta.ko 2023-10-06T03:06:28.211 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_nbyte.ko 2023-10-06T03:06:28.211 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_text.ko 2023-10-06T03:06:28.211 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_u32.ko 2023-10-06T03:06:28.212 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_choke.ko 2023-10-06T03:06:28.212 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_codel.ko 2023-10-06T03:06:28.212 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_drr.ko 2023-10-06T03:06:28.212 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_fq.ko 2023-10-06T03:06:28.212 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_gred.ko 2023-10-06T03:06:28.212 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hfsc.ko 2023-10-06T03:06:28.212 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hhf.ko 2023-10-06T03:06:28.212 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_htb.ko 2023-10-06T03:06:28.212 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_ingress.ko 2023-10-06T03:06:28.212 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio.ko 2023-10-06T03:06:28.212 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-06T03:06:28.212 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_multiq.ko 2023-10-06T03:06:28.212 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_netem.ko 2023-10-06T03:06:28.213 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_pie.ko 2023-10-06T03:06:28.213 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_plug.ko 2023-10-06T03:06:28.213 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_prio.ko 2023-10-06T03:06:28.213 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_qfq.ko 2023-10-06T03:06:28.213 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_red.ko 2023-10-06T03:06:28.213 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfb.ko 2023-10-06T03:06:28.213 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfq.ko 2023-10-06T03:06:28.213 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_tbf.ko 2023-10-06T03:06:28.213 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_teql.ko 2023-10-06T03:06:28.213 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp 2023-10-06T03:06:28.213 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp.ko 2023-10-06T03:06:28.213 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp_diag.ko 2023-10-06T03:06:28.214 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc 2023-10-06T03:06:28.214 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss 2023-10-06T03:06:28.214 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-06T03:06:28.214 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-06T03:06:28.214 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/sunrpc.ko 2023-10-06T03:06:28.214 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma 2023-10-06T03:06:28.214 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-06T03:06:28.214 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc 2023-10-06T03:06:28.214 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/diag.ko 2023-10-06T03:06:28.214 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/tipc.ko 2023-10-06T03:06:28.214 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix 2023-10-06T03:06:28.214 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix/unix_diag.ko 2023-10-06T03:06:28.215 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock 2023-10-06T03:06:28.215 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-06T03:06:28.215 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-06T03:06:28.215 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock.ko 2023-10-06T03:06:28.215 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-06T03:06:28.215 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-06T03:06:28.215 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm 2023-10-06T03:06:28.215 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-06T03:06:28.215 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security 2023-10-06T03:06:28.215 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys 2023-10-06T03:06:28.215 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys 2023-10-06T03:06:28.215 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-10-06T03:06:28.215 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys 2023-10-06T03:06:28.216 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys/trusted.ko 2023-10-06T03:06:28.216 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt 2023-10-06T03:06:28.216 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib 2023-10-06T03:06:28.216 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib/irqbypass.ko 2023-10-06T03:06:28.216 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias 2023-10-06T03:06:28.216 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias.bin 2023-10-06T03:06:28.216 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin 2023-10-06T03:06:28.216 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.bin 2023-10-06T03:06:28.216 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.modinfo 2023-10-06T03:06:28.216 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep 2023-10-06T03:06:28.216 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep.bin 2023-10-06T03:06:28.216 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.devname 2023-10-06T03:06:28.216 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.order 2023-10-06T03:06:28.217 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.softdep 2023-10-06T03:06:28.217 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols 2023-10-06T03:06:28.217 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols.bin 2023-10-06T03:06:28.217 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc7-gfef64f93da2b 2023-10-06T03:06:28.217 DEBUG:teuthology.orchestra.run.smithi081:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-10-06T03:06:28.239 INFO:teuthology.orchestra.run.smithi081.stdout:postinstall scriptlet (using /bin/sh): 2023-10-06T03:06:28.239 INFO:teuthology.orchestra.run.smithi081.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b -a -r /boot/System.map-6.5.0-rc7-gfef64f93da2b ]; then 2023-10-06T03:06:28.239 INFO:teuthology.orchestra.run.smithi081.stdout:cp /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T03:06:28.239 INFO:teuthology.orchestra.run.smithi081.stdout:cp /boot/System.map-6.5.0-rc7-gfef64f93da2b /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T03:06:28.239 INFO:teuthology.orchestra.run.smithi081.stdout:rm -f /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-06T03:06:28.239 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/installkernel 6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T03:06:28.239 INFO:teuthology.orchestra.run.smithi081.stdout:rm -f /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T03:06:28.239 INFO:teuthology.orchestra.run.smithi081.stdout:fi 2023-10-06T03:06:28.240 INFO:teuthology.orchestra.run.smithi081.stdout:preuninstall scriptlet (using /bin/sh): 2023-10-06T03:06:28.240 INFO:teuthology.orchestra.run.smithi081.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-10-06T03:06:28.240 INFO:teuthology.orchestra.run.smithi081.stdout:new-kernel-pkg --remove 6.5.0-rc7-gfef64f93da2b --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc7-gfef64f93da2b.img 2023-10-06T03:06:28.240 INFO:teuthology.orchestra.run.smithi081.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-10-06T03:06:28.240 INFO:teuthology.orchestra.run.smithi081.stdout:kernel-install remove 6.5.0-rc7-gfef64f93da2b 2023-10-06T03:06:28.240 INFO:teuthology.orchestra.run.smithi081.stdout:fi 2023-10-06T03:06:28.240 INFO:teuthology.orchestra.run.smithi081.stdout:postuninstall scriptlet (using /bin/sh): 2023-10-06T03:06:28.240 INFO:teuthology.orchestra.run.smithi081.stdout:if [ -x /sbin/update-bootloader ]; then 2023-10-06T03:06:28.240 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/update-bootloader --remove 6.5.0-rc7-gfef64f93da2b 2023-10-06T03:06:28.240 INFO:teuthology.orchestra.run.smithi081.stdout:fi 2023-10-06T03:06:28.241 DEBUG:teuthology.orchestra.run.smithi081:> sudo rpm -qi grub2-tools 2023-10-06T03:06:28.313 INFO:teuthology.orchestra.run.smithi081.stdout:Name : grub2-tools 2023-10-06T03:06:28.314 INFO:teuthology.orchestra.run.smithi081.stdout:Epoch : 1 2023-10-06T03:06:28.314 INFO:teuthology.orchestra.run.smithi081.stdout:Version : 2.02 2023-10-06T03:06:28.314 INFO:teuthology.orchestra.run.smithi081.stdout:Release : 99.el8_4.1 2023-10-06T03:06:28.314 INFO:teuthology.orchestra.run.smithi081.stdout:Architecture: x86_64 2023-10-06T03:06:28.314 INFO:teuthology.orchestra.run.smithi081.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-06T03:06:28.314 INFO:teuthology.orchestra.run.smithi081.stdout:Group : System Environment/Base 2023-10-06T03:06:28.314 INFO:teuthology.orchestra.run.smithi081.stdout:Size : 9264631 2023-10-06T03:06:28.314 INFO:teuthology.orchestra.run.smithi081.stdout:License : GPLv3+ 2023-10-06T03:06:28.314 INFO:teuthology.orchestra.run.smithi081.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-06T03:06:28.314 INFO:teuthology.orchestra.run.smithi081.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-06T03:06:28.315 INFO:teuthology.orchestra.run.smithi081.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-06T03:06:28.315 INFO:teuthology.orchestra.run.smithi081.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-06T03:06:28.315 INFO:teuthology.orchestra.run.smithi081.stdout:Relocations : (not relocatable) 2023-10-06T03:06:28.315 INFO:teuthology.orchestra.run.smithi081.stdout:Packager : Red Hat, Inc. 2023-10-06T03:06:28.315 INFO:teuthology.orchestra.run.smithi081.stdout:Vendor : Red Hat, Inc. 2023-10-06T03:06:28.315 INFO:teuthology.orchestra.run.smithi081.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-06T03:06:28.315 INFO:teuthology.orchestra.run.smithi081.stdout:Summary : Support tools for GRUB. 2023-10-06T03:06:28.315 INFO:teuthology.orchestra.run.smithi081.stdout:Description : 2023-10-06T03:06:28.315 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:06:28.315 INFO:teuthology.orchestra.run.smithi081.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-06T03:06:28.315 INFO:teuthology.orchestra.run.smithi081.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-06T03:06:28.316 INFO:teuthology.orchestra.run.smithi081.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-06T03:06:28.316 INFO:teuthology.orchestra.run.smithi081.stdout:hardware devices. 2023-10-06T03:06:28.316 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:06:28.316 INFO:teuthology.orchestra.run.smithi081.stdout:This subpackage provides tools for support of all platforms. 2023-10-06T03:06:28.317 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-06T03:06:28.317 INFO:teuthology.task.kernel:Updating grub on smithi081 to boot 6.5.0-rc7-gfef64f93da2b 2023-10-06T03:06:28.317 DEBUG:teuthology.orchestra.run.smithi081:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-06T03:06:33.278 INFO:teuthology.orchestra.run.smithi081.stderr:Generating grub configuration file ... 2023-10-06T03:06:35.608 INFO:teuthology.orchestra.run.smithi081.stderr:done 2023-10-06T03:06:35.610 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2023-10-06T03:06:35.623 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.WVmnSaSyaz 2023-10-06T03:06:35.623 DEBUG:teuthology.orchestra.run.smithi081:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.WVmnSaSyaz 2023-10-06T03:06:35.693 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.WVmnSaSyaz 2023-10-06T03:06:35.852 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.WVmnSaSyaz is 6KB 2023-10-06T03:06:35.900 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.WVmnSaSyaz 2023-10-06T03:06:35.913 DEBUG:teuthology.orchestra.run.smithi081:> sudo /bin/ls /boot/loader/entries || true 2023-10-06T03:06:35.974 INFO:teuthology.orchestra.run.smithi081.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-06T03:06:35.974 INFO:teuthology.orchestra.run.smithi081.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-06T03:06:35.974 INFO:teuthology.orchestra.run.smithi081.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-06T03:06:35.975 INFO:teuthology.orchestra.run.smithi081.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-06T03:06:35.975 INFO:teuthology.orchestra.run.smithi081.stdout:298e228f3b5e401e8ac0f5ae159a2e06-6.5.0-rc7-gfef64f93da2b.conf 2023-10-06T03:06:35.976 DEBUG:teuthology.orchestra.run.smithi081:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-6.5.0-rc7-gfef64f93da2b 2023-10-06T03:06:36.128 DEBUG:teuthology.orchestra.run.smithi081:> sudo shutdown -r now 2023-10-06T03:06:57.327 INFO:teuthology.orchestra.run.smithi083.stdout:kernel-6.5.0_rc7_gfef64f93da2b-1 ######################################## 2023-10-06T03:07:06.132 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-06T03:07:06.132 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-10-06T03:07:06.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T03:07:20.876 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi083.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-10-06T03:07:20.876 DEBUG:teuthology.orchestra.run.smithi083:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-10-06T03:07:20.927 INFO:teuthology.orchestra.run.smithi083.stdout:/boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-06T03:07:20.927 INFO:teuthology.orchestra.run.smithi083.stdout:/boot/config-6.5.0-rc7-gfef64f93da2b 2023-10-06T03:07:20.927 INFO:teuthology.orchestra.run.smithi083.stdout:/boot/vmlinuz-6.5.0-rc7-gfef64f93da2b 2023-10-06T03:07:20.927 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b 2023-10-06T03:07:20.927 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel 2023-10-06T03:07:20.928 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch 2023-10-06T03:07:20.928 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86 2023-10-06T03:07:20.928 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto 2023-10-06T03:07:20.928 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-06T03:07:20.928 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-06T03:07:20.928 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-06T03:07:20.928 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-06T03:07:20.928 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-06T03:07:20.928 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-06T03:07:20.928 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-06T03:07:20.928 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-10-06T03:07:20.928 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-06T03:07:20.929 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-06T03:07:20.929 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-06T03:07:20.929 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-06T03:07:20.929 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-06T03:07:20.929 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-06T03:07:20.929 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-06T03:07:20.929 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-06T03:07:20.929 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-06T03:07:20.929 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-06T03:07:20.929 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-06T03:07:20.930 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-06T03:07:20.930 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel 2023-10-06T03:07:20.930 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu 2023-10-06T03:07:20.930 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce 2023-10-06T03:07:20.930 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-06T03:07:20.930 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm 2023-10-06T03:07:20.930 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-06T03:07:20.930 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-06T03:07:20.930 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm.ko 2023-10-06T03:07:20.930 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto 2023-10-06T03:07:20.930 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ansi_cprng.ko 2023-10-06T03:07:20.931 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/anubis.ko 2023-10-06T03:07:20.931 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/arc4.ko 2023-10-06T03:07:20.931 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx 2023-10-06T03:07:20.931 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-06T03:07:20.931 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_pq.ko 2023-10-06T03:07:20.931 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-06T03:07:20.931 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_tx.ko 2023-10-06T03:07:20.931 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_xor.ko 2023-10-06T03:07:20.931 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/raid6test.ko 2023-10-06T03:07:20.931 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authenc.ko 2023-10-06T03:07:20.932 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authencesn.ko 2023-10-06T03:07:20.932 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blake2b_generic.ko 2023-10-06T03:07:20.932 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_common.ko 2023-10-06T03:07:20.932 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_generic.ko 2023-10-06T03:07:20.932 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/camellia_generic.ko 2023-10-06T03:07:20.932 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast5_generic.ko 2023-10-06T03:07:20.932 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast6_generic.ko 2023-10-06T03:07:20.932 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast_common.ko 2023-10-06T03:07:20.932 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ccm.ko 2023-10-06T03:07:20.932 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cmac.ko 2023-10-06T03:07:20.933 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crc32_generic.ko 2023-10-06T03:07:20.933 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_engine.ko 2023-10-06T03:07:20.933 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_user.ko 2023-10-06T03:07:20.933 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cts.ko 2023-10-06T03:07:20.933 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/des_generic.ko 2023-10-06T03:07:20.933 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/dh_generic.ko 2023-10-06T03:07:20.933 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/echainiv.ko 2023-10-06T03:07:20.933 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/essiv.ko 2023-10-06T03:07:20.933 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/fcrypt.ko 2023-10-06T03:07:20.933 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/khazad.ko 2023-10-06T03:07:20.934 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4.ko 2023-10-06T03:07:20.934 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4hc.ko 2023-10-06T03:07:20.934 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/md4.ko 2023-10-06T03:07:20.934 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/michael_mic.ko 2023-10-06T03:07:20.934 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcbc.ko 2023-10-06T03:07:20.934 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcrypt.ko 2023-10-06T03:07:20.934 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/rmd160.ko 2023-10-06T03:07:20.934 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/seed.ko 2023-10-06T03:07:20.934 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/serpent_generic.ko 2023-10-06T03:07:20.934 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tcrypt.ko 2023-10-06T03:07:20.935 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tea.ko 2023-10-06T03:07:20.935 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_common.ko 2023-10-06T03:07:20.935 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_generic.ko 2023-10-06T03:07:20.935 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/vmac.ko 2023-10-06T03:07:20.935 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/wp512.ko 2023-10-06T03:07:20.935 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xcbc.ko 2023-10-06T03:07:20.935 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xor.ko 2023-10-06T03:07:20.935 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xxhash_generic.ko 2023-10-06T03:07:20.936 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers 2023-10-06T03:07:20.936 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi 2023-10-06T03:07:20.936 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-06T03:07:20.936 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_pad.ko 2023-10-06T03:07:20.936 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/custom_method.ko 2023-10-06T03:07:20.936 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/ec_sys.ko 2023-10-06T03:07:20.936 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/platform_profile.ko 2023-10-06T03:07:20.936 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbs.ko 2023-10-06T03:07:20.937 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbshc.ko 2023-10-06T03:07:20.937 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/video.ko 2023-10-06T03:07:20.937 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata 2023-10-06T03:07:20.937 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/acard-ahci.ko 2023-10-06T03:07:20.937 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ahci_platform.ko 2023-10-06T03:07:20.937 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ata_generic.ko 2023-10-06T03:07:20.937 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/libahci_platform.ko 2023-10-06T03:07:20.937 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_acpi.ko 2023-10-06T03:07:20.937 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ali.ko 2023-10-06T03:07:20.937 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_amd.ko 2023-10-06T03:07:20.938 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_artop.ko 2023-10-06T03:07:20.938 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atiixp.ko 2023-10-06T03:07:20.938 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atp867x.ko 2023-10-06T03:07:20.938 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd640.ko 2023-10-06T03:07:20.938 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-06T03:07:20.938 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cypress.ko 2023-10-06T03:07:20.938 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_efar.ko 2023-10-06T03:07:20.938 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt366.ko 2023-10-06T03:07:20.938 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-06T03:07:20.938 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-06T03:07:20.938 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-06T03:07:20.938 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it8213.ko 2023-10-06T03:07:20.939 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it821x.ko 2023-10-06T03:07:20.939 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_jmicron.ko 2023-10-06T03:07:20.939 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_marvell.ko 2023-10-06T03:07:20.939 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_mpiix.ko 2023-10-06T03:07:20.939 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_netcell.ko 2023-10-06T03:07:20.939 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ninja32.ko 2023-10-06T03:07:20.939 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87410.ko 2023-10-06T03:07:20.939 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87415.ko 2023-10-06T03:07:20.939 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-06T03:07:20.939 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_opti.ko 2023-10-06T03:07:20.939 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_optidma.ko 2023-10-06T03:07:20.939 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-06T03:07:20.940 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-06T03:07:20.940 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-06T03:07:20.940 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_piccolo.ko 2023-10-06T03:07:20.940 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_rdc.ko 2023-10-06T03:07:20.940 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sch.ko 2023-10-06T03:07:20.940 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_serverworks.ko 2023-10-06T03:07:20.940 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sil680.ko 2023-10-06T03:07:20.940 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sis.ko 2023-10-06T03:07:20.940 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-06T03:07:20.940 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_triflex.ko 2023-10-06T03:07:20.940 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_via.ko 2023-10-06T03:07:20.940 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pdc_adma.ko 2023-10-06T03:07:20.941 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_inic162x.ko 2023-10-06T03:07:20.941 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_mv.ko 2023-10-06T03:07:20.941 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_nv.ko 2023-10-06T03:07:20.941 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_promise.ko 2023-10-06T03:07:20.941 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_qstor.ko 2023-10-06T03:07:20.941 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil.ko 2023-10-06T03:07:20.941 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil24.ko 2023-10-06T03:07:20.941 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sis.ko 2023-10-06T03:07:20.941 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_svw.ko 2023-10-06T03:07:20.941 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sx4.ko 2023-10-06T03:07:20.941 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_uli.ko 2023-10-06T03:07:20.942 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_via.ko 2023-10-06T03:07:20.942 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_vsc.ko 2023-10-06T03:07:20.942 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay 2023-10-06T03:07:20.942 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-06T03:07:20.942 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base 2023-10-06T03:07:20.942 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap 2023-10-06T03:07:20.942 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-10-06T03:07:20.942 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-10-06T03:07:20.942 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma 2023-10-06T03:07:20.942 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma/bcma.ko 2023-10-06T03:07:20.942 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block 2023-10-06T03:07:20.942 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe 2023-10-06T03:07:20.943 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe/aoe.ko 2023-10-06T03:07:20.943 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/brd.ko 2023-10-06T03:07:20.943 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd 2023-10-06T03:07:20.943 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd/drbd.ko 2023-10-06T03:07:20.943 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/floppy.ko 2023-10-06T03:07:20.943 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/loop.ko 2023-10-06T03:07:20.943 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx 2023-10-06T03:07:20.943 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-06T03:07:20.943 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/nbd.ko 2023-10-06T03:07:20.943 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk 2023-10-06T03:07:20.943 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-06T03:07:20.943 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/pktcdvd.ko 2023-10-06T03:07:20.944 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/rbd.ko 2023-10-06T03:07:20.944 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/virtio_blk.ko 2023-10-06T03:07:20.944 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback 2023-10-06T03:07:20.944 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-06T03:07:20.944 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkfront.ko 2023-10-06T03:07:20.944 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram 2023-10-06T03:07:20.944 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram/zram.ko 2023-10-06T03:07:20.944 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char 2023-10-06T03:07:20.944 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hangcheck-timer.ko 2023-10-06T03:07:20.944 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random 2023-10-06T03:07:20.944 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-06T03:07:20.944 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-06T03:07:20.945 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-06T03:07:20.945 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-06T03:07:20.945 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-06T03:07:20.945 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi 2023-10-06T03:07:20.945 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-06T03:07:20.945 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-06T03:07:20.945 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-06T03:07:20.945 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-06T03:07:20.945 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-06T03:07:20.945 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-06T03:07:20.945 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/lp.ko 2023-10-06T03:07:20.945 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave 2023-10-06T03:07:20.946 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave/mwave.ko 2023-10-06T03:07:20.946 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ppdev.ko 2023-10-06T03:07:20.946 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tlclk.ko 2023-10-06T03:07:20.946 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm 2023-10-06T03:07:20.946 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm.ko 2023-10-06T03:07:20.946 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-06T03:07:20.946 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-06T03:07:20.946 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-06T03:07:20.946 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis.ko 2023-10-06T03:07:20.946 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-10-06T03:07:20.946 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/uv_mmtimer.ko 2023-10-06T03:07:20.947 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/virtio_console.ko 2023-10-06T03:07:20.947 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq 2023-10-06T03:07:20.947 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-10-06T03:07:20.947 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-06T03:07:20.947 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-06T03:07:20.947 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-10-06T03:07:20.947 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/powernow-k8.ko 2023-10-06T03:07:20.947 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-06T03:07:20.947 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto 2023-10-06T03:07:20.947 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp 2023-10-06T03:07:20.947 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-06T03:07:20.947 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-06T03:07:20.948 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel 2023-10-06T03:07:20.948 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat 2023-10-06T03:07:20.948 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common 2023-10-06T03:07:20.948 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-06T03:07:20.948 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-10-06T03:07:20.948 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-06T03:07:20.948 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-aes.ko 2023-10-06T03:07:20.948 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-sha.ko 2023-10-06T03:07:20.948 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio 2023-10-06T03:07:20.948 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-06T03:07:20.948 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca 2023-10-06T03:07:20.948 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca/dca.ko 2023-10-06T03:07:20.949 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq 2023-10-06T03:07:20.949 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-10-06T03:07:20.949 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma 2023-10-06T03:07:20.949 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw 2023-10-06T03:07:20.949 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-06T03:07:20.949 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat 2023-10-06T03:07:20.949 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-06T03:07:20.949 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac 2023-10-06T03:07:20.949 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/amd64_edac.ko 2023-10-06T03:07:20.949 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/e752x_edac.ko 2023-10-06T03:07:20.949 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-06T03:07:20.949 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3000_edac.ko 2023-10-06T03:07:20.950 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3200_edac.ko 2023-10-06T03:07:20.950 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5100_edac.ko 2023-10-06T03:07:20.950 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5400_edac.ko 2023-10-06T03:07:20.950 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7300_edac.ko 2023-10-06T03:07:20.950 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7core_edac.ko 2023-10-06T03:07:20.950 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i82975x_edac.ko 2023-10-06T03:07:20.950 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/ie31200_edac.ko 2023-10-06T03:07:20.950 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/sb_edac.ko 2023-10-06T03:07:20.950 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/x38_edac.ko 2023-10-06T03:07:20.950 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware 2023-10-06T03:07:20.950 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/edd.ko 2023-10-06T03:07:20.951 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-06T03:07:20.951 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio 2023-10-06T03:07:20.951 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-ich.ko 2023-10-06T03:07:20.951 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-06T03:07:20.951 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid 2023-10-06T03:07:20.951 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-appleir.ko 2023-10-06T03:07:20.951 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-aureal.ko 2023-10-06T03:07:20.951 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-axff.ko 2023-10-06T03:07:20.951 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-dr.ko 2023-10-06T03:07:20.951 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elecom.ko 2023-10-06T03:07:20.951 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elo.ko 2023-10-06T03:07:20.951 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-emsff.ko 2023-10-06T03:07:20.952 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gaff.ko 2023-10-06T03:07:20.952 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gt683r.ko 2023-10-06T03:07:20.952 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gyration.ko 2023-10-06T03:07:20.952 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-06T03:07:20.952 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-06T03:07:20.952 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtekff.ko 2023-10-06T03:07:20.952 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-hyperv.ko 2023-10-06T03:07:20.952 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-icade.ko 2023-10-06T03:07:20.952 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-keytouch.ko 2023-10-06T03:07:20.952 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-kye.ko 2023-10-06T03:07:20.952 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lcpower.ko 2023-10-06T03:07:20.952 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-led.ko 2023-10-06T03:07:20.953 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lenovo.ko 2023-10-06T03:07:20.953 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-06T03:07:20.953 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-06T03:07:20.953 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-multitouch.ko 2023-10-06T03:07:20.953 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-ortek.ko 2023-10-06T03:07:20.953 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-penmount.ko 2023-10-06T03:07:20.953 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-petalynx.ko 2023-10-06T03:07:20.953 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-picolcd.ko 2023-10-06T03:07:20.953 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-pl.ko 2023-10-06T03:07:20.953 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-plantronics.ko 2023-10-06T03:07:20.953 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-primax.ko 2023-10-06T03:07:20.953 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-rmi.ko 2023-10-06T03:07:20.954 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-06T03:07:20.954 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-06T03:07:20.954 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-06T03:07:20.954 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-06T03:07:20.954 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-06T03:07:20.954 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-06T03:07:20.954 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-06T03:07:20.954 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-06T03:07:20.954 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-06T03:07:20.954 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-06T03:07:20.954 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-06T03:07:20.955 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat.ko 2023-10-06T03:07:20.955 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-saitek.ko 2023-10-06T03:07:20.955 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-samsung.ko 2023-10-06T03:07:20.955 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-06T03:07:20.955 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sjoy.ko 2023-10-06T03:07:20.955 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sony.ko 2023-10-06T03:07:20.955 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-speedlink.ko 2023-10-06T03:07:20.955 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-steelseries.ko 2023-10-06T03:07:20.955 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sunplus.ko 2023-10-06T03:07:20.955 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-06T03:07:20.955 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tivo.ko 2023-10-06T03:07:20.955 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tmff.ko 2023-10-06T03:07:20.956 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-topseed.ko 2023-10-06T03:07:20.956 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-twinhan.ko 2023-10-06T03:07:20.956 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-uclogic.ko 2023-10-06T03:07:20.956 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-waltop.ko 2023-10-06T03:07:20.956 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-wiimote.ko 2023-10-06T03:07:20.956 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-xinmo.ko 2023-10-06T03:07:20.956 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zpff.ko 2023-10-06T03:07:20.956 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zydacron.ko 2023-10-06T03:07:20.956 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/uhid.ko 2023-10-06T03:07:20.956 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/wacom.ko 2023-10-06T03:07:20.956 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv 2023-10-06T03:07:20.956 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_balloon.ko 2023-10-06T03:07:20.957 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_utils.ko 2023-10-06T03:07:20.957 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_vmbus.ko 2023-10-06T03:07:20.957 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon 2023-10-06T03:07:20.957 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru.ko 2023-10-06T03:07:20.957 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru3.ko 2023-10-06T03:07:20.957 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-06T03:07:20.957 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7414.ko 2023-10-06T03:07:20.957 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7418.ko 2023-10-06T03:07:20.957 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adc128d818.ko 2023-10-06T03:07:20.957 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1025.ko 2023-10-06T03:07:20.957 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1026.ko 2023-10-06T03:07:20.957 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1029.ko 2023-10-06T03:07:20.958 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1031.ko 2023-10-06T03:07:20.958 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm9240.ko 2023-10-06T03:07:20.958 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ads7828.ko 2023-10-06T03:07:20.958 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7410.ko 2023-10-06T03:07:20.958 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7411.ko 2023-10-06T03:07:20.958 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7462.ko 2023-10-06T03:07:20.958 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7470.ko 2023-10-06T03:07:20.958 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7475.ko 2023-10-06T03:07:20.958 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7x10.ko 2023-10-06T03:07:20.958 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/amc6821.ko 2023-10-06T03:07:20.958 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/applesmc.ko 2023-10-06T03:07:20.958 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asb100.ko 2023-10-06T03:07:20.959 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asc7621.ko 2023-10-06T03:07:20.959 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-06T03:07:20.959 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/atxp1.ko 2023-10-06T03:07:20.959 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/coretemp.ko 2023-10-06T03:07:20.959 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-06T03:07:20.959 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dme1737.ko 2023-10-06T03:07:20.959 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds1621.ko 2023-10-06T03:07:20.959 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds620.ko 2023-10-06T03:07:20.959 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc1403.ko 2023-10-06T03:07:20.959 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc6w201.ko 2023-10-06T03:07:20.959 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71805f.ko 2023-10-06T03:07:20.959 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71882fg.ko 2023-10-06T03:07:20.960 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f75375s.ko 2023-10-06T03:07:20.960 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-06T03:07:20.960 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fschmd.ko 2023-10-06T03:07:20.960 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g760a.ko 2023-10-06T03:07:20.960 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g762.ko 2023-10-06T03:07:20.960 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl518sm.ko 2023-10-06T03:07:20.960 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl520sm.ko 2023-10-06T03:07:20.960 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-06T03:07:20.960 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-06T03:07:20.960 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-06T03:07:20.960 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmaem.ko 2023-10-06T03:07:20.960 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmpex.ko 2023-10-06T03:07:20.961 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina209.ko 2023-10-06T03:07:20.961 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina2xx.ko 2023-10-06T03:07:20.961 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/it87.ko 2023-10-06T03:07:20.961 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k10temp.ko 2023-10-06T03:07:20.961 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k8temp.ko 2023-10-06T03:07:20.961 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-06T03:07:20.961 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm63.ko 2023-10-06T03:07:20.961 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm73.ko 2023-10-06T03:07:20.961 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm75.ko 2023-10-06T03:07:20.961 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm77.ko 2023-10-06T03:07:20.961 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm78.ko 2023-10-06T03:07:20.962 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm80.ko 2023-10-06T03:07:20.962 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm83.ko 2023-10-06T03:07:20.962 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm85.ko 2023-10-06T03:07:20.962 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm87.ko 2023-10-06T03:07:20.962 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm90.ko 2023-10-06T03:07:20.962 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm92.ko 2023-10-06T03:07:20.962 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm93.ko 2023-10-06T03:07:20.962 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95234.ko 2023-10-06T03:07:20.962 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95241.ko 2023-10-06T03:07:20.962 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95245.ko 2023-10-06T03:07:20.962 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc2945.ko 2023-10-06T03:07:20.963 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4151.ko 2023-10-06T03:07:20.963 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4215.ko 2023-10-06T03:07:20.963 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4222.ko 2023-10-06T03:07:20.963 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4245.ko 2023-10-06T03:07:20.963 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4260.ko 2023-10-06T03:07:20.963 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4261.ko 2023-10-06T03:07:20.963 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max16065.ko 2023-10-06T03:07:20.963 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1619.ko 2023-10-06T03:07:20.963 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1668.ko 2023-10-06T03:07:20.963 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max197.ko 2023-10-06T03:07:20.963 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6639.ko 2023-10-06T03:07:20.963 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6650.ko 2023-10-06T03:07:20.964 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6697.ko 2023-10-06T03:07:20.964 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/mcp3021.ko 2023-10-06T03:07:20.964 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6683.ko 2023-10-06T03:07:20.964 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-06T03:07:20.964 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775.ko 2023-10-06T03:07:20.964 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct7802.ko 2023-10-06T03:07:20.964 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87360.ko 2023-10-06T03:07:20.964 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87427.ko 2023-10-06T03:07:20.964 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pcf8591.ko 2023-10-06T03:07:20.964 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus 2023-10-06T03:07:20.964 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-06T03:07:20.964 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-06T03:07:20.965 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-06T03:07:20.965 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-06T03:07:20.965 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-06T03:07:20.965 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-06T03:07:20.965 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-06T03:07:20.965 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-06T03:07:20.965 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-06T03:07:20.965 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-06T03:07:20.965 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-06T03:07:20.965 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-06T03:07:20.965 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/powr1220.ko 2023-10-06T03:07:20.965 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5627.ko 2023-10-06T03:07:20.966 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5636.ko 2023-10-06T03:07:20.966 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-06T03:07:20.966 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht15.ko 2023-10-06T03:07:20.966 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht21.ko 2023-10-06T03:07:20.966 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/shtc1.ko 2023-10-06T03:07:20.966 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sis5595.ko 2023-10-06T03:07:20.966 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-06T03:07:20.966 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-06T03:07:20.966 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-06T03:07:20.966 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/thmc50.ko 2023-10-06T03:07:20.966 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp102.ko 2023-10-06T03:07:20.966 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp103.ko 2023-10-06T03:07:20.967 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp401.ko 2023-10-06T03:07:20.967 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp421.ko 2023-10-06T03:07:20.967 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-06T03:07:20.967 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via686a.ko 2023-10-06T03:07:20.967 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt1211.ko 2023-10-06T03:07:20.967 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt8231.ko 2023-10-06T03:07:20.967 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-06T03:07:20.967 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627hf.ko 2023-10-06T03:07:20.967 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83781d.ko 2023-10-06T03:07:20.967 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83791d.ko 2023-10-06T03:07:20.967 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83792d.ko 2023-10-06T03:07:20.968 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83793.ko 2023-10-06T03:07:20.968 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83795.ko 2023-10-06T03:07:20.968 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-06T03:07:20.968 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-06T03:07:20.968 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c 2023-10-06T03:07:20.968 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos 2023-10-06T03:07:20.968 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-06T03:07:20.968 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-06T03:07:20.968 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses 2023-10-06T03:07:20.968 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-06T03:07:20.968 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-06T03:07:20.968 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-06T03:07:20.969 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-06T03:07:20.969 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-06T03:07:20.969 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-06T03:07:20.969 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-06T03:07:20.969 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-06T03:07:20.969 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-06T03:07:20.969 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-06T03:07:20.969 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-06T03:07:20.969 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-06T03:07:20.969 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-06T03:07:20.969 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-06T03:07:20.969 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-06T03:07:20.970 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-06T03:07:20.970 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-06T03:07:20.970 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-06T03:07:20.970 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-06T03:07:20.970 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-06T03:07:20.970 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-06T03:07:20.970 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-06T03:07:20.970 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-06T03:07:20.970 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-dev.ko 2023-10-06T03:07:20.970 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-mux.ko 2023-10-06T03:07:20.971 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-10-06T03:07:20.971 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-06T03:07:20.971 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-stub.ko 2023-10-06T03:07:20.971 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband 2023-10-06T03:07:20.971 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core 2023-10-06T03:07:20.971 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-06T03:07:20.971 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-06T03:07:20.971 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-06T03:07:20.971 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-06T03:07:20.971 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-06T03:07:20.971 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-06T03:07:20.972 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-06T03:07:20.972 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw 2023-10-06T03:07:20.972 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4 2023-10-06T03:07:20.972 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-06T03:07:20.972 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4 2023-10-06T03:07:20.972 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-06T03:07:20.972 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5 2023-10-06T03:07:20.972 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-06T03:07:20.972 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca 2023-10-06T03:07:20.972 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-06T03:07:20.972 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp 2023-10-06T03:07:20.972 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib 2023-10-06T03:07:20.973 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-06T03:07:20.973 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser 2023-10-06T03:07:20.973 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-06T03:07:20.973 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert 2023-10-06T03:07:20.973 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-06T03:07:20.973 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp 2023-10-06T03:07:20.973 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-06T03:07:20.973 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt 2023-10-06T03:07:20.973 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-06T03:07:20.973 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input 2023-10-06T03:07:20.973 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport 2023-10-06T03:07:20.973 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-06T03:07:20.974 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-06T03:07:20.974 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/gameport.ko 2023-10-06T03:07:20.974 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/lightning.ko 2023-10-06T03:07:20.974 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/ns558.ko 2023-10-06T03:07:20.974 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/joydev.ko 2023-10-06T03:07:20.974 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard 2023-10-06T03:07:20.974 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-06T03:07:20.974 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse 2023-10-06T03:07:20.974 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/appletouch.ko 2023-10-06T03:07:20.974 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-06T03:07:20.975 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-06T03:07:20.975 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-06T03:07:20.975 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/sermouse.ko 2023-10-06T03:07:20.975 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-06T03:07:20.975 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-06T03:07:20.975 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-06T03:07:20.975 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4 2023-10-06T03:07:20.975 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-06T03:07:20.975 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio 2023-10-06T03:07:20.975 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-06T03:07:20.976 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-06T03:07:20.976 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-06T03:07:20.976 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/serio_raw.ko 2023-10-06T03:07:20.976 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/sparse-keymap.ko 2023-10-06T03:07:20.976 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu 2023-10-06T03:07:20.976 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd 2023-10-06T03:07:20.976 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-06T03:07:20.976 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds 2023-10-06T03:07:20.976 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-blinkm.ko 2023-10-06T03:07:20.976 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm3530.ko 2023-10-06T03:07:20.976 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lp3944.ko 2023-10-06T03:07:20.976 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-ss4200.ko 2023-10-06T03:07:20.977 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger 2023-10-06T03:07:20.977 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-06T03:07:20.977 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-06T03:07:20.977 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-06T03:07:20.977 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-06T03:07:20.977 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-06T03:07:20.977 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-06T03:07:20.977 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-06T03:07:20.977 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-06T03:07:20.977 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md 2023-10-06T03:07:20.977 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache 2023-10-06T03:07:20.977 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache/bcache.ko 2023-10-06T03:07:20.978 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-bio-prison.ko 2023-10-06T03:07:20.978 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache-smq.ko 2023-10-06T03:07:20.978 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache.ko 2023-10-06T03:07:20.978 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-crypt.ko 2023-10-06T03:07:20.978 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-delay.ko 2023-10-06T03:07:20.978 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-flakey.ko 2023-10-06T03:07:20.978 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-log-userspace.ko 2023-10-06T03:07:20.978 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-multipath.ko 2023-10-06T03:07:20.978 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-queue-length.ko 2023-10-06T03:07:20.978 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-raid.ko 2023-10-06T03:07:20.978 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-round-robin.ko 2023-10-06T03:07:20.978 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-service-time.ko 2023-10-06T03:07:20.979 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-switch.ko 2023-10-06T03:07:20.979 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-thin-pool.ko 2023-10-06T03:07:20.979 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-verity.ko 2023-10-06T03:07:20.979 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/faulty.ko 2023-10-06T03:07:20.979 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/linear.ko 2023-10-06T03:07:20.979 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/multipath.ko 2023-10-06T03:07:20.979 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data 2023-10-06T03:07:20.979 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-06T03:07:20.979 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid0.ko 2023-10-06T03:07:20.979 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid1.ko 2023-10-06T03:07:20.979 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid10.ko 2023-10-06T03:07:20.980 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid456.ko 2023-10-06T03:07:20.980 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message 2023-10-06T03:07:20.980 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion 2023-10-06T03:07:20.980 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptbase.ko 2023-10-06T03:07:20.980 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptctl.ko 2023-10-06T03:07:20.980 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptfc.ko 2023-10-06T03:07:20.980 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptlan.ko 2023-10-06T03:07:20.980 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptsas.ko 2023-10-06T03:07:20.980 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-06T03:07:20.980 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptspi.ko 2023-10-06T03:07:20.980 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd 2023-10-06T03:07:20.981 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_ich.ko 2023-10-06T03:07:20.981 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_sch.ko 2023-10-06T03:07:20.981 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/mfd-core.ko 2023-10-06T03:07:20.981 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/sm501.ko 2023-10-06T03:07:20.981 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/viperboard.ko 2023-10-06T03:07:20.981 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/vx855.ko 2023-10-06T03:07:20.981 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/wl1273-core.ko 2023-10-06T03:07:20.981 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc 2023-10-06T03:07:20.981 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl 2023-10-06T03:07:20.981 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-06T03:07:20.981 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds9802als.ko 2023-10-06T03:07:20.981 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds990x.ko 2023-10-06T03:07:20.981 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/bh1770glc.ko 2023-10-06T03:07:20.982 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710 2023-10-06T03:07:20.982 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710/cb710.ko 2023-10-06T03:07:20.982 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom 2023-10-06T03:07:20.982 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/at24.ko 2023-10-06T03:07:20.982 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-06T03:07:20.982 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-06T03:07:20.982 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-06T03:07:20.982 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/enclosure.ko 2023-10-06T03:07:20.982 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/hpilo.ko 2023-10-06T03:07:20.982 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29003.ko 2023-10-06T03:07:20.982 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29020.ko 2023-10-06T03:07:20.983 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d 2023-10-06T03:07:20.983 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-06T03:07:20.983 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-06T03:07:20.983 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei 2023-10-06T03:07:20.983 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-me.ko 2023-10-06T03:07:20.983 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-06T03:07:20.983 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei.ko 2023-10-06T03:07:20.983 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru 2023-10-06T03:07:20.983 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru/gru.ko 2023-10-06T03:07:20.983 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp 2023-10-06T03:07:20.983 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xp.ko 2023-10-06T03:07:20.983 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-10-06T03:07:20.984 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-10-06T03:07:20.984 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-06T03:07:20.984 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_core.ko 2023-10-06T03:07:20.984 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tsl2550.ko 2023-10-06T03:07:20.984 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_balloon.ko 2023-10-06T03:07:20.984 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci 2023-10-06T03:07:20.984 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-06T03:07:20.984 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net 2023-10-06T03:07:20.984 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding 2023-10-06T03:07:20.984 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding/bonding.ko 2023-10-06T03:07:20.984 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa 2023-10-06T03:07:20.984 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53 2023-10-06T03:07:20.984 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-06T03:07:20.985 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-06T03:07:20.985 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-06T03:07:20.985 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx 2023-10-06T03:07:20.985 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-06T03:07:20.985 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dummy.ko 2023-10-06T03:07:20.985 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/eql.ko 2023-10-06T03:07:20.985 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet 2023-10-06T03:07:20.985 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com 2023-10-06T03:07:20.985 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-06T03:07:20.985 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-06T03:07:20.985 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-06T03:07:20.985 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-06T03:07:20.985 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390 2023-10-06T03:07:20.986 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-06T03:07:20.986 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-06T03:07:20.986 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-06T03:07:20.986 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-06T03:07:20.986 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec 2023-10-06T03:07:20.986 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-06T03:07:20.986 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere 2023-10-06T03:07:20.986 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-06T03:07:20.986 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon 2023-10-06T03:07:20.986 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-06T03:07:20.986 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera 2023-10-06T03:07:20.986 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-06T03:07:20.987 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd 2023-10-06T03:07:20.987 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-06T03:07:20.987 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-06T03:07:20.987 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-06T03:07:20.987 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros 2023-10-06T03:07:20.987 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx 2023-10-06T03:07:20.987 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-06T03:07:20.987 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c 2023-10-06T03:07:20.987 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-06T03:07:20.987 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e 2023-10-06T03:07:20.987 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-06T03:07:20.987 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx 2023-10-06T03:07:20.988 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-06T03:07:20.988 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-06T03:07:20.988 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom 2023-10-06T03:07:20.988 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-06T03:07:20.988 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-06T03:07:20.988 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-10-06T03:07:20.988 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-06T03:07:20.988 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-06T03:07:20.988 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet 2023-10-06T03:07:20.988 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-06T03:07:20.988 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-06T03:07:20.988 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade 2023-10-06T03:07:20.989 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna 2023-10-06T03:07:20.989 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-06T03:07:20.989 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio 2023-10-06T03:07:20.989 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-10-06T03:07:20.989 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-06T03:07:20.989 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-10-06T03:07:20.989 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-06T03:07:20.989 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-10-06T03:07:20.989 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-06T03:07:20.989 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-10-06T03:07:20.989 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-06T03:07:20.990 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-10-06T03:07:20.990 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-06T03:07:20.990 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco 2023-10-06T03:07:20.990 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic 2023-10-06T03:07:20.990 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-06T03:07:20.990 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec 2023-10-06T03:07:20.990 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip 2023-10-06T03:07:20.990 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-06T03:07:20.990 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-06T03:07:20.990 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-06T03:07:20.990 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-06T03:07:20.990 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-06T03:07:20.990 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-06T03:07:20.991 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink 2023-10-06T03:07:20.991 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-06T03:07:20.991 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-06T03:07:20.991 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dnet.ko 2023-10-06T03:07:20.991 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex 2023-10-06T03:07:20.991 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet 2023-10-06T03:07:20.991 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-06T03:07:20.991 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-06T03:07:20.991 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-06T03:07:20.991 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel 2023-10-06T03:07:20.991 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-06T03:07:20.991 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000 2023-10-06T03:07:20.992 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-06T03:07:20.992 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e 2023-10-06T03:07:20.992 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-06T03:07:20.992 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k 2023-10-06T03:07:20.992 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-06T03:07:20.992 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e 2023-10-06T03:07:20.992 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-06T03:07:20.992 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf 2023-10-06T03:07:20.992 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-06T03:07:20.992 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb 2023-10-06T03:07:20.992 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-06T03:07:20.993 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf 2023-10-06T03:07:20.993 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-06T03:07:20.993 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe 2023-10-06T03:07:20.993 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-06T03:07:20.993 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-10-06T03:07:20.993 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-06T03:07:20.993 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/jme.ko 2023-10-06T03:07:20.993 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell 2023-10-06T03:07:20.993 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-06T03:07:20.993 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-06T03:07:20.993 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-06T03:07:20.993 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox 2023-10-06T03:07:20.994 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-10-06T03:07:20.994 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-06T03:07:20.994 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-06T03:07:20.994 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-10-06T03:07:20.994 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-10-06T03:07:20.994 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-06T03:07:20.994 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel 2023-10-06T03:07:20.994 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-06T03:07:20.994 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom 2023-10-06T03:07:20.994 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-10-06T03:07:20.994 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-06T03:07:20.994 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi 2023-10-06T03:07:20.995 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-06T03:07:20.995 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-06T03:07:20.995 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion 2023-10-06T03:07:20.995 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-06T03:07:20.995 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia 2023-10-06T03:07:20.995 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-06T03:07:20.995 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines 2023-10-06T03:07:20.995 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-06T03:07:20.995 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-06T03:07:20.995 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic 2023-10-06T03:07:20.995 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen 2023-10-06T03:07:20.995 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-06T03:07:20.995 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-06T03:07:20.996 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-10-06T03:07:20.996 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-06T03:07:20.996 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc 2023-10-06T03:07:20.996 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-06T03:07:20.996 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek 2023-10-06T03:07:20.996 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-06T03:07:20.996 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-06T03:07:20.996 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-06T03:07:20.996 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-06T03:07:20.996 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker 2023-10-06T03:07:20.996 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-10-06T03:07:20.996 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc 2023-10-06T03:07:20.997 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-06T03:07:20.997 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan 2023-10-06T03:07:20.997 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-06T03:07:20.997 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis 2023-10-06T03:07:20.997 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-06T03:07:20.997 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-06T03:07:20.997 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc 2023-10-06T03:07:20.997 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-06T03:07:20.997 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-06T03:07:20.997 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-06T03:07:20.997 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-06T03:07:20.997 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro 2023-10-06T03:07:20.998 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-10-06T03:07:20.998 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-06T03:07:20.998 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-06T03:07:20.998 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun 2023-10-06T03:07:20.998 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-06T03:07:20.998 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-06T03:07:20.998 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-06T03:07:20.998 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-06T03:07:20.998 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti 2023-10-06T03:07:20.998 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-06T03:07:20.998 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti 2023-10-06T03:07:20.998 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-06T03:07:20.999 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via 2023-10-06T03:07:20.999 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-06T03:07:20.999 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-06T03:07:20.999 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet 2023-10-06T03:07:20.999 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-06T03:07:20.999 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-06T03:07:20.999 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom 2023-10-06T03:07:20.999 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-06T03:07:20.999 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/geneve.ko 2023-10-06T03:07:20.999 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv 2023-10-06T03:07:20.999 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-06T03:07:20.999 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154 2023-10-06T03:07:21.000 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-06T03:07:21.000 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ifb.ko 2023-10-06T03:07:21.000 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan 2023-10-06T03:07:21.000 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-06T03:07:21.000 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvlan.ko 2023-10-06T03:07:21.000 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvtap.ko 2023-10-06T03:07:21.000 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio 2023-10-06T03:07:21.000 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio.ko 2023-10-06T03:07:21.000 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-06T03:07:21.000 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-06T03:07:21.000 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-06T03:07:21.000 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mii.ko 2023-10-06T03:07:21.001 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/net_failover.ko 2023-10-06T03:07:21.001 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/netconsole.ko 2023-10-06T03:07:21.001 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/nlmon.ko 2023-10-06T03:07:21.001 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs 2023-10-06T03:07:21.001 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-06T03:07:21.001 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-06T03:07:21.001 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy 2023-10-06T03:07:21.001 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/amd.ko 2023-10-06T03:07:21.001 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-06T03:07:21.001 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-10-06T03:07:21.001 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-06T03:07:21.001 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-06T03:07:21.001 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/broadcom.ko 2023-10-06T03:07:21.002 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/cicada.ko 2023-10-06T03:07:21.002 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/davicom.ko 2023-10-06T03:07:21.002 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/dp83640.ko 2023-10-06T03:07:21.002 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/et1011c.ko 2023-10-06T03:07:21.002 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/icplus.ko 2023-10-06T03:07:21.002 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/lxt.ko 2023-10-06T03:07:21.002 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/marvell.ko 2023-10-06T03:07:21.002 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/micrel.ko 2023-10-06T03:07:21.002 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/national.ko 2023-10-06T03:07:21.002 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/phylink.ko 2023-10-06T03:07:21.002 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/qsemi.ko 2023-10-06T03:07:21.003 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/realtek.ko 2023-10-06T03:07:21.003 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/smsc.ko 2023-10-06T03:07:21.003 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-06T03:07:21.003 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/vitesse.ko 2023-10-06T03:07:21.003 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp 2023-10-06T03:07:21.003 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-06T03:07:21.003 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-06T03:07:21.003 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-06T03:07:21.003 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_generic.ko 2023-10-06T03:07:21.003 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-06T03:07:21.003 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-06T03:07:21.003 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppoe.ko 2023-10-06T03:07:21.004 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppox.ko 2023-10-06T03:07:21.004 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pptp.ko 2023-10-06T03:07:21.004 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip 2023-10-06T03:07:21.004 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slhc.ko 2023-10-06T03:07:21.004 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slip.ko 2023-10-06T03:07:21.004 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/sungem_phy.ko 2023-10-06T03:07:21.004 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tap.ko 2023-10-06T03:07:21.004 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team 2023-10-06T03:07:21.004 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team.ko 2023-10-06T03:07:21.004 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-06T03:07:21.004 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-06T03:07:21.004 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-06T03:07:21.005 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_random.ko 2023-10-06T03:07:21.005 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-06T03:07:21.005 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tun.ko 2023-10-06T03:07:21.005 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/veth.ko 2023-10-06T03:07:21.005 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/virtio_net.ko 2023-10-06T03:07:21.005 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3 2023-10-06T03:07:21.005 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-06T03:07:21.005 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan 2023-10-06T03:07:21.005 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-06T03:07:21.005 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback 2023-10-06T03:07:21.005 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-06T03:07:21.005 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netfront.ko 2023-10-06T03:07:21.006 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb 2023-10-06T03:07:21.006 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb/ntb.ko 2023-10-06T03:07:21.006 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme 2023-10-06T03:07:21.006 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host 2023-10-06T03:07:21.006 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-06T03:07:21.006 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme.ko 2023-10-06T03:07:21.006 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport 2023-10-06T03:07:21.006 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport.ko 2023-10-06T03:07:21.006 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_cs.ko 2023-10-06T03:07:21.006 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_pc.ko 2023-10-06T03:07:21.006 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_serial.ko 2023-10-06T03:07:21.006 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci 2023-10-06T03:07:21.007 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug 2023-10-06T03:07:21.007 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-06T03:07:21.007 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie 2023-10-06T03:07:21.007 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie/aer_inject.ko 2023-10-06T03:07:21.007 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/xen-pcifront.ko 2023-10-06T03:07:21.007 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia 2023-10-06T03:07:21.007 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/i82092.ko 2023-10-06T03:07:21.007 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pd6729.ko 2023-10-06T03:07:21.007 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-06T03:07:21.007 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl 2023-10-06T03:07:21.007 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel 2023-10-06T03:07:21.007 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-06T03:07:21.008 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform 2023-10-06T03:07:21.008 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86 2023-10-06T03:07:21.008 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-06T03:07:21.008 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-06T03:07:21.008 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-06T03:07:21.008 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-06T03:07:21.008 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-06T03:07:21.008 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-06T03:07:21.008 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-06T03:07:21.008 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-06T03:07:21.008 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-06T03:07:21.008 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-06T03:07:21.009 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-06T03:07:21.009 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/hdaps.ko 2023-10-06T03:07:21.009 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel 2023-10-06T03:07:21.009 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-06T03:07:21.009 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-06T03:07:21.009 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-06T03:07:21.009 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-06T03:07:21.009 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-06T03:07:21.009 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-06T03:07:21.009 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-06T03:07:21.009 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-06T03:07:21.009 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-06T03:07:21.009 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-06T03:07:21.010 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-06T03:07:21.010 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi.ko 2023-10-06T03:07:21.010 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap 2023-10-06T03:07:21.010 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-06T03:07:21.010 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-06T03:07:21.010 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps 2023-10-06T03:07:21.010 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients 2023-10-06T03:07:21.010 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-06T03:07:21.010 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-06T03:07:21.010 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-06T03:07:21.010 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/pps_core.ko 2023-10-06T03:07:21.010 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp 2023-10-06T03:07:21.011 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp.ko 2023-10-06T03:07:21.011 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-06T03:07:21.011 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc 2023-10-06T03:07:21.011 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-06T03:07:21.011 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq4802.ko 2023-10-06T03:07:21.011 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-06T03:07:21.011 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-06T03:07:21.011 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-06T03:07:21.011 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-06T03:07:21.011 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-06T03:07:21.011 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-06T03:07:21.012 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-06T03:07:21.012 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-06T03:07:21.012 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-06T03:07:21.012 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-06T03:07:21.012 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-06T03:07:21.012 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-06T03:07:21.012 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-06T03:07:21.012 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-06T03:07:21.012 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-06T03:07:21.012 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-06T03:07:21.012 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-06T03:07:21.012 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-06T03:07:21.012 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-06T03:07:21.013 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-06T03:07:21.013 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-06T03:07:21.013 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-06T03:07:21.013 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-06T03:07:21.013 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-06T03:07:21.013 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-06T03:07:21.013 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-06T03:07:21.013 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-06T03:07:21.013 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-06T03:07:21.013 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-06T03:07:21.013 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-06T03:07:21.013 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi 2023-10-06T03:07:21.014 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-06T03:07:21.014 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-sas.ko 2023-10-06T03:07:21.014 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-06T03:07:21.014 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/BusLogic.ko 2023-10-06T03:07:21.014 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/a100u2w.ko 2023-10-06T03:07:21.014 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid 2023-10-06T03:07:21.014 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-06T03:07:21.014 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/advansys.ko 2023-10-06T03:07:21.014 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx 2023-10-06T03:07:21.014 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-06T03:07:21.014 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-06T03:07:21.014 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/am53c974.ko 2023-10-06T03:07:21.015 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr 2023-10-06T03:07:21.015 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-06T03:07:21.015 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/atp870u.ko 2023-10-06T03:07:21.015 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi 2023-10-06T03:07:21.015 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-06T03:07:21.015 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa 2023-10-06T03:07:21.015 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-06T03:07:21.015 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc 2023-10-06T03:07:21.015 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-06T03:07:21.015 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i 2023-10-06T03:07:21.015 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-06T03:07:21.015 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ch.ko 2023-10-06T03:07:21.016 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor 2023-10-06T03:07:21.016 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-06T03:07:21.016 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi 2023-10-06T03:07:21.016 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-10-06T03:07:21.016 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-06T03:07:21.016 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-10-06T03:07:21.016 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-06T03:07:21.016 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-06T03:07:21.016 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dc395x.ko 2023-10-06T03:07:21.016 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler 2023-10-06T03:07:21.016 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-10-06T03:07:21.016 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-10-06T03:07:21.017 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-10-06T03:07:21.017 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-10-06T03:07:21.017 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dmx3191d.ko 2023-10-06T03:07:21.017 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r 2023-10-06T03:07:21.017 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-06T03:07:21.017 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esp_scsi.ko 2023-10-06T03:07:21.017 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe 2023-10-06T03:07:21.017 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-06T03:07:21.017 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-06T03:07:21.017 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic 2023-10-06T03:07:21.017 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-06T03:07:21.018 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hpsa.ko 2023-10-06T03:07:21.018 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hptiop.ko 2023-10-06T03:07:21.018 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-06T03:07:21.018 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/initio.ko 2023-10-06T03:07:21.018 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ipr.ko 2023-10-06T03:07:21.018 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ips.ko 2023-10-06T03:07:21.018 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci 2023-10-06T03:07:21.018 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci/isci.ko 2023-10-06T03:07:21.018 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-06T03:07:21.018 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-06T03:07:21.018 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc 2023-10-06T03:07:21.018 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-06T03:07:21.018 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi.ko 2023-10-06T03:07:21.019 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-06T03:07:21.019 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas 2023-10-06T03:07:21.019 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-06T03:07:21.019 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc 2023-10-06T03:07:21.019 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-06T03:07:21.019 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid 2023-10-06T03:07:21.019 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid.ko 2023-10-06T03:07:21.019 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-06T03:07:21.019 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-06T03:07:21.019 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-06T03:07:21.019 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas 2023-10-06T03:07:21.019 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-06T03:07:21.021 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas 2023-10-06T03:07:21.022 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-06T03:07:21.022 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvumi.ko 2023-10-06T03:07:21.022 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001 2023-10-06T03:07:21.022 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-06T03:07:21.022 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pmcraid.ko 2023-10-06T03:07:21.022 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla1280.ko 2023-10-06T03:07:21.023 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx 2023-10-06T03:07:21.023 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-06T03:07:21.023 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-06T03:07:21.023 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx 2023-10-06T03:07:21.023 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-06T03:07:21.023 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/raid_class.ko 2023-10-06T03:07:21.023 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_debug.ko 2023-10-06T03:07:21.023 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-06T03:07:21.023 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-06T03:07:21.023 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-06T03:07:21.023 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-06T03:07:21.024 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-06T03:07:21.024 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ses.ko 2023-10-06T03:07:21.024 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/st.ko 2023-10-06T03:07:21.024 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/stex.ko 2023-10-06T03:07:21.024 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2 2023-10-06T03:07:21.024 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-06T03:07:21.024 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-06T03:07:21.024 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-06T03:07:21.024 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/wd719x.ko 2023-10-06T03:07:21.024 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb 2023-10-06T03:07:21.024 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb/ssb.ko 2023-10-06T03:07:21.024 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target 2023-10-06T03:07:21.025 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi 2023-10-06T03:07:21.025 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-06T03:07:21.025 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback 2023-10-06T03:07:21.025 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-06T03:07:21.025 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_file.ko 2023-10-06T03:07:21.025 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_iblock.ko 2023-10-06T03:07:21.025 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_mod.ko 2023-10-06T03:07:21.025 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_pscsi.ko 2023-10-06T03:07:21.025 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_user.ko 2023-10-06T03:07:21.025 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc 2023-10-06T03:07:21.025 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-06T03:07:21.025 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal 2023-10-06T03:07:21.026 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel 2023-10-06T03:07:21.026 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal 2023-10-06T03:07:21.026 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-06T03:07:21.026 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-06T03:07:21.026 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-06T03:07:21.026 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-06T03:07:21.026 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-06T03:07:21.026 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-06T03:07:21.026 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-06T03:07:21.026 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-06T03:07:21.027 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-06T03:07:21.027 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-06T03:07:21.027 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-06T03:07:21.027 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-06T03:07:21.027 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-06T03:07:21.027 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-06T03:07:21.027 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-06T03:07:21.027 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty 2023-10-06T03:07:21.027 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless 2023-10-06T03:07:21.027 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-06T03:07:21.027 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_gsm.ko 2023-10-06T03:07:21.028 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_hdlc.ko 2023-10-06T03:07:21.028 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/nozomi.ko 2023-10-06T03:07:21.028 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial 2023-10-06T03:07:21.028 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250 2023-10-06T03:07:21.028 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-06T03:07:21.028 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-06T03:07:21.028 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm 2023-10-06T03:07:21.028 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-06T03:07:21.028 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/synclink_gt.ko 2023-10-06T03:07:21.028 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs 2023-10-06T03:07:21.028 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core 2023-10-06T03:07:21.029 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-06T03:07:21.029 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host 2023-10-06T03:07:21.029 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-06T03:07:21.029 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio 2023-10-06T03:07:21.029 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio.ko 2023-10-06T03:07:21.029 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_aec.ko 2023-10-06T03:07:21.029 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_cif.ko 2023-10-06T03:07:21.029 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-06T03:07:21.029 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_sercos3.ko 2023-10-06T03:07:21.029 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb 2023-10-06T03:07:21.029 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class 2023-10-06T03:07:21.030 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-06T03:07:21.030 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-06T03:07:21.030 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usblp.ko 2023-10-06T03:07:21.030 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usbtmc.ko 2023-10-06T03:07:21.030 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host 2023-10-06T03:07:21.030 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-06T03:07:21.030 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image 2023-10-06T03:07:21.030 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/mdc800.ko 2023-10-06T03:07:21.030 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/microtek.ko 2023-10-06T03:07:21.030 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc 2023-10-06T03:07:21.030 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/adutux.ko 2023-10-06T03:07:21.031 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-06T03:07:21.031 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi26.ko 2023-10-06T03:07:21.031 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi62.ko 2023-10-06T03:07:21.031 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ezusb.ko 2023-10-06T03:07:21.031 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/idmouse.ko 2023-10-06T03:07:21.031 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-06T03:07:21.031 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-06T03:07:21.031 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ldusb.ko 2023-10-06T03:07:21.031 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-06T03:07:21.031 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga 2023-10-06T03:07:21.031 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-06T03:07:21.031 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-06T03:07:21.032 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usb3503.ko 2023-10-06T03:07:21.032 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usblcd.ko 2023-10-06T03:07:21.032 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-06T03:07:21.032 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/uss720.ko 2023-10-06T03:07:21.032 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/yurex.ko 2023-10-06T03:07:21.032 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy 2023-10-06T03:07:21.032 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-06T03:07:21.032 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial 2023-10-06T03:07:21.032 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/aircable.ko 2023-10-06T03:07:21.032 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ark3116.ko 2023-10-06T03:07:21.032 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-06T03:07:21.032 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ch341.ko 2023-10-06T03:07:21.032 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cp210x.ko 2023-10-06T03:07:21.033 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-06T03:07:21.033 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-06T03:07:21.033 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-06T03:07:21.033 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/empeg.ko 2023-10-06T03:07:21.033 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-06T03:07:21.033 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-06T03:07:21.033 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-06T03:07:21.033 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_ti.ko 2023-10-06T03:07:21.033 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipaq.ko 2023-10-06T03:07:21.033 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipw.ko 2023-10-06T03:07:21.033 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-06T03:07:21.033 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-06T03:07:21.034 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan.ko 2023-10-06T03:07:21.034 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-06T03:07:21.034 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-06T03:07:21.034 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-06T03:07:21.034 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-06T03:07:21.034 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7720.ko 2023-10-06T03:07:21.034 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7840.ko 2023-10-06T03:07:21.034 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/navman.ko 2023-10-06T03:07:21.034 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/omninet.ko 2023-10-06T03:07:21.034 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/opticon.ko 2023-10-06T03:07:21.034 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/option.ko 2023-10-06T03:07:21.034 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/oti6858.ko 2023-10-06T03:07:21.035 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/pl2303.ko 2023-10-06T03:07:21.035 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcaux.ko 2023-10-06T03:07:21.035 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcserial.ko 2023-10-06T03:07:21.035 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/quatech2.ko 2023-10-06T03:07:21.035 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-06T03:07:21.035 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/sierra.ko 2023-10-06T03:07:21.035 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-06T03:07:21.035 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ssu100.ko 2023-10-06T03:07:21.035 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-06T03:07:21.035 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-06T03:07:21.035 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-06T03:07:21.035 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-06T03:07:21.036 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-06T03:07:21.036 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/visor.ko 2023-10-06T03:07:21.036 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-06T03:07:21.036 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-06T03:07:21.036 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage 2023-10-06T03:07:21.036 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/uas.ko 2023-10-06T03:07:21.036 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-06T03:07:21.036 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-06T03:07:21.036 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-06T03:07:21.036 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-06T03:07:21.036 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-06T03:07:21.036 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-06T03:07:21.036 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-06T03:07:21.037 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-06T03:07:21.037 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-06T03:07:21.037 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-06T03:07:21.037 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-06T03:07:21.037 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-06T03:07:21.037 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-06T03:07:21.037 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-06T03:07:21.037 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip 2023-10-06T03:07:21.037 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-06T03:07:21.037 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-06T03:07:21.037 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-06T03:07:21.037 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio 2023-10-06T03:07:21.038 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci 2023-10-06T03:07:21.038 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-06T03:07:21.038 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-06T03:07:21.038 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio.ko 2023-10-06T03:07:21.038 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-06T03:07:21.038 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost 2023-10-06T03:07:21.038 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost.ko 2023-10-06T03:07:21.038 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-06T03:07:21.038 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_net.ko 2023-10-06T03:07:21.038 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-06T03:07:21.038 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video 2023-10-06T03:07:21.039 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight 2023-10-06T03:07:21.039 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-06T03:07:21.039 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lcd.ko 2023-10-06T03:07:21.039 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-06T03:07:21.039 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio 2023-10-06T03:07:21.039 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio.ko 2023-10-06T03:07:21.039 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_balloon.ko 2023-10-06T03:07:21.039 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_mmio.ko 2023-10-06T03:07:21.039 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci.ko 2023-10-06T03:07:21.039 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-10-06T03:07:21.039 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-10-06T03:07:21.039 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_ring.ko 2023-10-06T03:07:21.040 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1 2023-10-06T03:07:21.040 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters 2023-10-06T03:07:21.040 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2482.ko 2023-10-06T03:07:21.040 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2490.ko 2023-10-06T03:07:21.040 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves 2023-10-06T03:07:21.040 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-06T03:07:21.040 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-06T03:07:21.040 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-06T03:07:21.040 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-06T03:07:21.040 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-06T03:07:21.040 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-06T03:07:21.040 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-06T03:07:21.040 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-06T03:07:21.041 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-06T03:07:21.041 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-06T03:07:21.041 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-06T03:07:21.041 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/wire.ko 2023-10-06T03:07:21.041 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog 2023-10-06T03:07:21.041 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-06T03:07:21.041 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-06T03:07:21.041 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-06T03:07:21.041 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/hpwdt.ko 2023-10-06T03:07:21.041 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/i6300esb.ko 2023-10-06T03:07:21.041 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-06T03:07:21.042 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-06T03:07:21.042 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-06T03:07:21.042 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ibmasr.ko 2023-10-06T03:07:21.042 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-06T03:07:21.042 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-06T03:07:21.042 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-06T03:07:21.042 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/machzwd.ko 2023-10-06T03:07:21.042 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/nv_tco.ko 2023-10-06T03:07:21.042 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-06T03:07:21.042 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-06T03:07:21.042 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-06T03:07:21.043 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-06T03:07:21.043 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/softdog.ko 2023-10-06T03:07:21.043 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-06T03:07:21.043 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/via_wdt.ko 2023-10-06T03:07:21.043 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-06T03:07:21.043 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-06T03:07:21.043 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-06T03:07:21.043 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-06T03:07:21.043 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-06T03:07:21.043 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen 2023-10-06T03:07:21.043 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-acpi-processor.ko 2023-10-06T03:07:21.043 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-evtchn.ko 2023-10-06T03:07:21.044 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-06T03:07:21.044 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntdev.ko 2023-10-06T03:07:21.044 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback 2023-10-06T03:07:21.044 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-06T03:07:21.044 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-privcmd.ko 2023-10-06T03:07:21.044 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs 2023-10-06T03:07:21.044 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-06T03:07:21.044 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs 2023-10-06T03:07:21.044 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p 2023-10-06T03:07:21.044 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p/9p.ko 2023-10-06T03:07:21.044 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs 2023-10-06T03:07:21.044 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs/affs.ko 2023-10-06T03:07:21.045 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs 2023-10-06T03:07:21.045 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs/befs.ko 2023-10-06T03:07:21.045 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/binfmt_misc.ko 2023-10-06T03:07:21.045 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs 2023-10-06T03:07:21.045 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs/btrfs.ko 2023-10-06T03:07:21.045 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles 2023-10-06T03:07:21.045 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles/cachefiles.ko 2023-10-06T03:07:21.045 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph 2023-10-06T03:07:21.045 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph/ceph.ko 2023-10-06T03:07:21.045 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda 2023-10-06T03:07:21.045 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda/coda.ko 2023-10-06T03:07:21.045 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs 2023-10-06T03:07:21.046 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs/cramfs.ko 2023-10-06T03:07:21.046 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm 2023-10-06T03:07:21.046 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm/dlm.ko 2023-10-06T03:07:21.046 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs 2023-10-06T03:07:21.046 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs/ecryptfs.ko 2023-10-06T03:07:21.046 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs 2023-10-06T03:07:21.046 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs/f2fs.ko 2023-10-06T03:07:21.046 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat 2023-10-06T03:07:21.046 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/fat.ko 2023-10-06T03:07:21.046 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/msdos.ko 2023-10-06T03:07:21.046 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/vfat.ko 2023-10-06T03:07:21.046 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache 2023-10-06T03:07:21.047 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache/fscache.ko 2023-10-06T03:07:21.047 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse 2023-10-06T03:07:21.047 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/cuse.ko 2023-10-06T03:07:21.047 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/fuse.ko 2023-10-06T03:07:21.047 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2 2023-10-06T03:07:21.047 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2/gfs2.ko 2023-10-06T03:07:21.047 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs 2023-10-06T03:07:21.047 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs/hfs.ko 2023-10-06T03:07:21.047 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus 2023-10-06T03:07:21.047 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus/hfsplus.ko 2023-10-06T03:07:21.047 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs 2023-10-06T03:07:21.047 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs/isofs.ko 2023-10-06T03:07:21.048 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs 2023-10-06T03:07:21.048 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs/jfs.ko 2023-10-06T03:07:21.048 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd 2023-10-06T03:07:21.048 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd/lockd.ko 2023-10-06T03:07:21.048 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix 2023-10-06T03:07:21.048 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix/minix.ko 2023-10-06T03:07:21.048 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs 2023-10-06T03:07:21.048 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs/netfs.ko 2023-10-06T03:07:21.048 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs 2023-10-06T03:07:21.048 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout 2023-10-06T03:07:21.048 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-06T03:07:21.048 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout 2023-10-06T03:07:21.049 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-06T03:07:21.049 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout 2023-10-06T03:07:21.049 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-06T03:07:21.049 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfs.ko 2023-10-06T03:07:21.049 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv3.ko 2023-10-06T03:07:21.049 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv4.ko 2023-10-06T03:07:21.049 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common 2023-10-06T03:07:21.049 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/grace.ko 2023-10-06T03:07:21.049 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-06T03:07:21.049 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd 2023-10-06T03:07:21.049 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd/nfsd.ko 2023-10-06T03:07:21.049 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2 2023-10-06T03:07:21.050 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2/nilfs2.ko 2023-10-06T03:07:21.050 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls 2023-10-06T03:07:21.050 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-celtic.ko 2023-10-06T03:07:21.050 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-centeuro.ko 2023-10-06T03:07:21.050 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-croatian.ko 2023-10-06T03:07:21.050 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-cyrillic.ko 2023-10-06T03:07:21.050 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-gaelic.ko 2023-10-06T03:07:21.050 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-greek.ko 2023-10-06T03:07:21.050 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-iceland.ko 2023-10-06T03:07:21.050 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-inuit.ko 2023-10-06T03:07:21.050 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-roman.ko 2023-10-06T03:07:21.051 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-romanian.ko 2023-10-06T03:07:21.051 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-turkish.ko 2023-10-06T03:07:21.051 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1250.ko 2023-10-06T03:07:21.051 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1251.ko 2023-10-06T03:07:21.051 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1255.ko 2023-10-06T03:07:21.051 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp737.ko 2023-10-06T03:07:21.051 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp775.ko 2023-10-06T03:07:21.051 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp850.ko 2023-10-06T03:07:21.051 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp852.ko 2023-10-06T03:07:21.051 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp855.ko 2023-10-06T03:07:21.051 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp857.ko 2023-10-06T03:07:21.051 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp860.ko 2023-10-06T03:07:21.052 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp861.ko 2023-10-06T03:07:21.052 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp862.ko 2023-10-06T03:07:21.052 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp863.ko 2023-10-06T03:07:21.052 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp864.ko 2023-10-06T03:07:21.052 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp865.ko 2023-10-06T03:07:21.052 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp866.ko 2023-10-06T03:07:21.052 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp869.ko 2023-10-06T03:07:21.052 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp874.ko 2023-10-06T03:07:21.052 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp932.ko 2023-10-06T03:07:21.052 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp936.ko 2023-10-06T03:07:21.052 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp949.ko 2023-10-06T03:07:21.052 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp950.ko 2023-10-06T03:07:21.052 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_euc-jp.ko 2023-10-06T03:07:21.053 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-06T03:07:21.053 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-06T03:07:21.053 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-06T03:07:21.053 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-06T03:07:21.053 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-06T03:07:21.053 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-06T03:07:21.053 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-06T03:07:21.053 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-06T03:07:21.053 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-06T03:07:21.053 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-06T03:07:21.053 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-06T03:07:21.053 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-r.ko 2023-10-06T03:07:21.054 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-06T03:07:21.054 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-u.ko 2023-10-06T03:07:21.054 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_utf8.ko 2023-10-06T03:07:21.054 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2 2023-10-06T03:07:21.054 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster 2023-10-06T03:07:21.054 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-06T03:07:21.054 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm 2023-10-06T03:07:21.054 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-06T03:07:21.054 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs 2023-10-06T03:07:21.054 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-06T03:07:21.054 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2.ko 2023-10-06T03:07:21.054 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-06T03:07:21.055 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-06T03:07:21.055 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-06T03:07:21.055 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs 2023-10-06T03:07:21.055 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs/overlay.ko 2023-10-06T03:07:21.055 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore 2023-10-06T03:07:21.055 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore/ramoops.ko 2023-10-06T03:07:21.055 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs 2023-10-06T03:07:21.055 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs/reiserfs.ko 2023-10-06T03:07:21.055 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs 2023-10-06T03:07:21.055 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs/romfs.ko 2023-10-06T03:07:21.055 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb 2023-10-06T03:07:21.055 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client 2023-10-06T03:07:21.055 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client/cifs.ko 2023-10-06T03:07:21.056 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common 2023-10-06T03:07:21.056 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-06T03:07:21.056 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_md4.ko 2023-10-06T03:07:21.056 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs 2023-10-06T03:07:21.056 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs/squashfs.ko 2023-10-06T03:07:21.056 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv 2023-10-06T03:07:21.056 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv/sysv.ko 2023-10-06T03:07:21.056 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf 2023-10-06T03:07:21.056 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf/udf.ko 2023-10-06T03:07:21.056 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs 2023-10-06T03:07:21.056 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs/ufs.ko 2023-10-06T03:07:21.056 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs 2023-10-06T03:07:21.057 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs/xfs.ko 2023-10-06T03:07:21.057 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel 2023-10-06T03:07:21.057 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu 2023-10-06T03:07:21.057 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu/rcutorture.ko 2023-10-06T03:07:21.057 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/torture.ko 2023-10-06T03:07:21.057 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace 2023-10-06T03:07:21.057 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-10-06T03:07:21.057 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib 2023-10-06T03:07:21.057 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/asn1_encoder.ko 2023-10-06T03:07:21.057 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc-itu-t.ko 2023-10-06T03:07:21.057 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc8.ko 2023-10-06T03:07:21.058 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto 2023-10-06T03:07:21.058 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libarc4.ko 2023-10-06T03:07:21.058 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libdes.ko 2023-10-06T03:07:21.058 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/libcrc32c.ko 2023-10-06T03:07:21.058 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lru_cache.ko 2023-10-06T03:07:21.058 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4 2023-10-06T03:07:21.058 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4_compress.ko 2023-10-06T03:07:21.058 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-06T03:07:21.058 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math 2023-10-06T03:07:21.058 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math/cordic.ko 2023-10-06T03:07:21.058 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6 2023-10-06T03:07:21.058 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6/raid6_pq.ko 2023-10-06T03:07:21.059 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon 2023-10-06T03:07:21.059 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-06T03:07:21.059 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_bm.ko 2023-10-06T03:07:21.059 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_fsm.ko 2023-10-06T03:07:21.059 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_kmp.ko 2023-10-06T03:07:21.059 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd 2023-10-06T03:07:21.059 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd/zstd_compress.ko 2023-10-06T03:07:21.059 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm 2023-10-06T03:07:21.059 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm/hwpoison-inject.ko 2023-10-06T03:07:21.059 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net 2023-10-06T03:07:21.059 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan 2023-10-06T03:07:21.059 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/6lowpan.ko 2023-10-06T03:07:21.060 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_dest.ko 2023-10-06T03:07:21.060 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-06T03:07:21.060 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_hop.ko 2023-10-06T03:07:21.060 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-06T03:07:21.060 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-06T03:07:21.060 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_routing.ko 2023-10-06T03:07:21.060 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_udp.ko 2023-10-06T03:07:21.060 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802 2023-10-06T03:07:21.060 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/garp.ko 2023-10-06T03:07:21.060 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/mrp.ko 2023-10-06T03:07:21.060 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/p8022.ko 2023-10-06T03:07:21.060 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/psnap.ko 2023-10-06T03:07:21.060 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/stp.ko 2023-10-06T03:07:21.061 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q 2023-10-06T03:07:21.061 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q/8021q.ko 2023-10-06T03:07:21.061 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p 2023-10-06T03:07:21.061 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet.ko 2023-10-06T03:07:21.061 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_fd.ko 2023-10-06T03:07:21.061 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_rdma.ko 2023-10-06T03:07:21.061 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_virtio.ko 2023-10-06T03:07:21.061 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv 2023-10-06T03:07:21.061 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv/batman-adv.ko 2023-10-06T03:07:21.061 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge 2023-10-06T03:07:21.061 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/br_netfilter.ko 2023-10-06T03:07:21.062 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/bridge.ko 2023-10-06T03:07:21.062 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter 2023-10-06T03:07:21.062 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-06T03:07:21.062 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-06T03:07:21.062 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-06T03:07:21.062 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-06T03:07:21.062 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-06T03:07:21.062 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-06T03:07:21.062 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-06T03:07:21.062 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-06T03:07:21.062 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-06T03:07:21.062 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-06T03:07:21.063 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-06T03:07:21.063 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-06T03:07:21.063 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-06T03:07:21.063 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-06T03:07:21.063 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-06T03:07:21.063 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-06T03:07:21.063 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-06T03:07:21.063 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-06T03:07:21.063 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-06T03:07:21.063 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-06T03:07:21.063 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-06T03:07:21.063 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-10-06T03:07:21.064 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-06T03:07:21.064 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-06T03:07:21.064 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph 2023-10-06T03:07:21.064 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph/libceph.ko 2023-10-06T03:07:21.064 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core 2023-10-06T03:07:21.064 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/failover.ko 2023-10-06T03:07:21.064 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/pktgen.ko 2023-10-06T03:07:21.064 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp 2023-10-06T03:07:21.064 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp.ko 2023-10-06T03:07:21.064 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_diag.ko 2023-10-06T03:07:21.064 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv4.ko 2023-10-06T03:07:21.064 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv6.ko 2023-10-06T03:07:21.065 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver 2023-10-06T03:07:21.065 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver/dns_resolver.ko 2023-10-06T03:07:21.065 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa 2023-10-06T03:07:21.065 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/dsa_core.ko 2023-10-06T03:07:21.065 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_brcm.ko 2023-10-06T03:07:21.065 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_dsa.ko 2023-10-06T03:07:21.065 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_none.ko 2023-10-06T03:07:21.065 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_trailer.ko 2023-10-06T03:07:21.065 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154 2023-10-06T03:07:21.065 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan 2023-10-06T03:07:21.065 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-06T03:07:21.065 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154.ko 2023-10-06T03:07:21.065 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-06T03:07:21.066 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4 2023-10-06T03:07:21.066 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ah4.ko 2023-10-06T03:07:21.066 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/esp4.ko 2023-10-06T03:07:21.066 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/fou.ko 2023-10-06T03:07:21.066 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/gre.ko 2023-10-06T03:07:21.066 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/inet_diag.ko 2023-10-06T03:07:21.066 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_gre.ko 2023-10-06T03:07:21.066 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_tunnel.ko 2023-10-06T03:07:21.066 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_vti.ko 2023-10-06T03:07:21.066 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipcomp.ko 2023-10-06T03:07:21.066 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipip.ko 2023-10-06T03:07:21.066 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter 2023-10-06T03:07:21.067 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-06T03:07:21.067 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-06T03:07:21.067 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-06T03:07:21.067 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-06T03:07:21.067 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-06T03:07:21.067 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-06T03:07:21.067 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-06T03:07:21.067 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-06T03:07:21.067 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-06T03:07:21.067 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-06T03:07:21.067 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-06T03:07:21.067 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-06T03:07:21.068 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-06T03:07:21.068 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-06T03:07:21.068 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-06T03:07:21.068 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-06T03:07:21.068 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-06T03:07:21.068 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-06T03:07:21.068 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-06T03:07:21.068 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-06T03:07:21.068 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-06T03:07:21.068 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_bic.ko 2023-10-06T03:07:21.068 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-06T03:07:21.068 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_diag.ko 2023-10-06T03:07:21.069 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-06T03:07:21.069 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_htcp.ko 2023-10-06T03:07:21.069 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_hybla.ko 2023-10-06T03:07:21.069 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_illinois.ko 2023-10-06T03:07:21.069 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_lp.ko 2023-10-06T03:07:21.069 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_scalable.ko 2023-10-06T03:07:21.069 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_vegas.ko 2023-10-06T03:07:21.069 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_veno.ko 2023-10-06T03:07:21.069 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_westwood.ko 2023-10-06T03:07:21.069 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_yeah.ko 2023-10-06T03:07:21.069 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tunnel4.ko 2023-10-06T03:07:21.069 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_diag.ko 2023-10-06T03:07:21.070 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_tunnel.ko 2023-10-06T03:07:21.070 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-06T03:07:21.070 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6 2023-10-06T03:07:21.070 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ah6.ko 2023-10-06T03:07:21.070 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/esp6.ko 2023-10-06T03:07:21.070 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/fou6.ko 2023-10-06T03:07:21.070 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-06T03:07:21.070 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-06T03:07:21.070 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_vti.ko 2023-10-06T03:07:21.070 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ipcomp6.ko 2023-10-06T03:07:21.070 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter 2023-10-06T03:07:21.071 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-06T03:07:21.071 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-06T03:07:21.071 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-06T03:07:21.071 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-06T03:07:21.071 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-06T03:07:21.071 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-06T03:07:21.071 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-06T03:07:21.071 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-06T03:07:21.071 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-06T03:07:21.071 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-06T03:07:21.071 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-06T03:07:21.071 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-06T03:07:21.071 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-06T03:07:21.072 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-06T03:07:21.072 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-06T03:07:21.072 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-06T03:07:21.072 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-06T03:07:21.072 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-06T03:07:21.072 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-06T03:07:21.072 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-06T03:07:21.072 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-06T03:07:21.072 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-06T03:07:21.072 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-06T03:07:21.072 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-06T03:07:21.072 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/sit.ko 2023-10-06T03:07:21.073 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/tunnel6.ko 2023-10-06T03:07:21.073 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-06T03:07:21.073 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key 2023-10-06T03:07:21.073 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key/af_key.ko 2023-10-06T03:07:21.073 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp 2023-10-06T03:07:21.073 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_core.ko 2023-10-06T03:07:21.073 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-06T03:07:21.073 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_eth.ko 2023-10-06T03:07:21.073 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip.ko 2023-10-06T03:07:21.073 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-06T03:07:21.073 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-06T03:07:21.073 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-06T03:07:21.073 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc 2023-10-06T03:07:21.074 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc/llc.ko 2023-10-06T03:07:21.074 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154 2023-10-06T03:07:21.074 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154/mac802154.ko 2023-10-06T03:07:21.074 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls 2023-10-06T03:07:21.074 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls/mpls_gso.ko 2023-10-06T03:07:21.074 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter 2023-10-06T03:07:21.074 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset 2023-10-06T03:07:21.074 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-06T03:07:21.074 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-06T03:07:21.074 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-06T03:07:21.074 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-06T03:07:21.074 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-06T03:07:21.075 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-06T03:07:21.075 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-06T03:07:21.075 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-06T03:07:21.075 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-06T03:07:21.075 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-06T03:07:21.075 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-06T03:07:21.075 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-06T03:07:21.075 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-06T03:07:21.075 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-06T03:07:21.075 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-06T03:07:21.075 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-06T03:07:21.076 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs 2023-10-06T03:07:21.076 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-06T03:07:21.076 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-06T03:07:21.076 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-06T03:07:21.076 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-06T03:07:21.076 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-06T03:07:21.076 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-06T03:07:21.076 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-06T03:07:21.076 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-06T03:07:21.076 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-06T03:07:21.076 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-06T03:07:21.076 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-06T03:07:21.077 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-06T03:07:21.077 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-06T03:07:21.077 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-06T03:07:21.077 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conncount.ko 2023-10-06T03:07:21.077 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack.ko 2023-10-06T03:07:21.077 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-06T03:07:21.077 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-06T03:07:21.077 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-06T03:07:21.077 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-06T03:07:21.077 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-06T03:07:21.077 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-06T03:07:21.077 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-06T03:07:21.078 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-06T03:07:21.078 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-06T03:07:21.078 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-06T03:07:21.078 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-06T03:07:21.078 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-06T03:07:21.078 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-06T03:07:21.078 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table.ko 2023-10-06T03:07:21.078 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-06T03:07:21.078 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-06T03:07:21.078 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat.ko 2023-10-06T03:07:21.078 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-06T03:07:21.079 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-06T03:07:21.079 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-06T03:07:21.079 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-06T03:07:21.079 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-06T03:07:21.079 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-06T03:07:21.079 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_tables.ko 2023-10-06T03:07:21.079 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink.ko 2023-10-06T03:07:21.079 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-06T03:07:21.079 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-06T03:07:21.079 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-06T03:07:21.079 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-06T03:07:21.079 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-06T03:07:21.080 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_compat.ko 2023-10-06T03:07:21.080 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_ct.ko 2023-10-06T03:07:21.080 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-06T03:07:21.080 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fib.ko 2023-10-06T03:07:21.080 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-06T03:07:21.080 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_hash.ko 2023-10-06T03:07:21.080 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_limit.ko 2023-10-06T03:07:21.080 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_log.ko 2023-10-06T03:07:21.080 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_masq.ko 2023-10-06T03:07:21.080 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_nat.ko 2023-10-06T03:07:21.080 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_numgen.ko 2023-10-06T03:07:21.081 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_queue.ko 2023-10-06T03:07:21.081 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_quota.ko 2023-10-06T03:07:21.081 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_redir.ko 2023-10-06T03:07:21.081 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject.ko 2023-10-06T03:07:21.081 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-06T03:07:21.081 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_socket.ko 2023-10-06T03:07:21.081 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_tunnel.ko 2023-10-06T03:07:21.081 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-06T03:07:21.081 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-06T03:07:21.081 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-06T03:07:21.081 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-06T03:07:21.082 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CT.ko 2023-10-06T03:07:21.082 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_DSCP.ko 2023-10-06T03:07:21.082 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HL.ko 2023-10-06T03:07:21.082 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HMARK.ko 2023-10-06T03:07:21.082 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-06T03:07:21.082 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LED.ko 2023-10-06T03:07:21.082 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LOG.ko 2023-10-06T03:07:21.082 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-06T03:07:21.082 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-06T03:07:21.082 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-06T03:07:21.082 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-06T03:07:21.083 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-06T03:07:21.083 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-06T03:07:21.083 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-06T03:07:21.083 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-06T03:07:21.083 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-06T03:07:21.083 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TEE.ko 2023-10-06T03:07:21.083 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-06T03:07:21.083 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TRACE.ko 2023-10-06T03:07:21.083 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_addrtype.ko 2023-10-06T03:07:21.083 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_bpf.ko 2023-10-06T03:07:21.083 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cgroup.ko 2023-10-06T03:07:21.083 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cluster.ko 2023-10-06T03:07:21.083 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_comment.ko 2023-10-06T03:07:21.084 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connbytes.ko 2023-10-06T03:07:21.084 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlabel.ko 2023-10-06T03:07:21.084 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlimit.ko 2023-10-06T03:07:21.084 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connmark.ko 2023-10-06T03:07:21.084 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_conntrack.ko 2023-10-06T03:07:21.084 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cpu.ko 2023-10-06T03:07:21.084 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dccp.ko 2023-10-06T03:07:21.084 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_devgroup.ko 2023-10-06T03:07:21.084 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dscp.ko 2023-10-06T03:07:21.084 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ecn.ko 2023-10-06T03:07:21.084 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_esp.ko 2023-10-06T03:07:21.084 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-06T03:07:21.085 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_helper.ko 2023-10-06T03:07:21.085 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hl.ko 2023-10-06T03:07:21.085 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-06T03:07:21.085 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_iprange.ko 2023-10-06T03:07:21.085 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipvs.ko 2023-10-06T03:07:21.085 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_l2tp.ko 2023-10-06T03:07:21.085 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_length.ko 2023-10-06T03:07:21.085 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_limit.ko 2023-10-06T03:07:21.085 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mac.ko 2023-10-06T03:07:21.085 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mark.ko 2023-10-06T03:07:21.085 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_multiport.ko 2023-10-06T03:07:21.086 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nat.ko 2023-10-06T03:07:21.086 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nfacct.ko 2023-10-06T03:07:21.086 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_osf.ko 2023-10-06T03:07:21.086 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_owner.ko 2023-10-06T03:07:21.086 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_physdev.ko 2023-10-06T03:07:21.086 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_pkttype.ko 2023-10-06T03:07:21.086 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_policy.ko 2023-10-06T03:07:21.086 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_quota.ko 2023-10-06T03:07:21.086 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_rateest.ko 2023-10-06T03:07:21.086 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_realm.ko 2023-10-06T03:07:21.087 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_recent.ko 2023-10-06T03:07:21.087 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_sctp.ko 2023-10-06T03:07:21.087 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_set.ko 2023-10-06T03:07:21.087 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_socket.ko 2023-10-06T03:07:21.087 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_state.ko 2023-10-06T03:07:21.087 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_statistic.ko 2023-10-06T03:07:21.087 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_string.ko 2023-10-06T03:07:21.087 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-06T03:07:21.087 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_time.ko 2023-10-06T03:07:21.087 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_u32.ko 2023-10-06T03:07:21.087 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink 2023-10-06T03:07:21.088 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink/netlink_diag.ko 2023-10-06T03:07:21.088 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh 2023-10-06T03:07:21.088 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh/nsh.ko 2023-10-06T03:07:21.088 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch 2023-10-06T03:07:21.088 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/openvswitch.ko 2023-10-06T03:07:21.088 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-geneve.ko 2023-10-06T03:07:21.088 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-gre.ko 2023-10-06T03:07:21.088 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-06T03:07:21.088 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet 2023-10-06T03:07:21.088 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet/af_packet_diag.ko 2023-10-06T03:07:21.088 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds 2023-10-06T03:07:21.088 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds.ko 2023-10-06T03:07:21.089 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_rdma.ko 2023-10-06T03:07:21.089 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_tcp.ko 2023-10-06T03:07:21.089 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched 2023-10-06T03:07:21.089 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_csum.ko 2023-10-06T03:07:21.089 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_gact.ko 2023-10-06T03:07:21.089 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_ipt.ko 2023-10-06T03:07:21.089 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_mirred.ko 2023-10-06T03:07:21.089 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_nat.ko 2023-10-06T03:07:21.089 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_pedit.ko 2023-10-06T03:07:21.089 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_police.ko 2023-10-06T03:07:21.089 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_simple.ko 2023-10-06T03:07:21.089 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_skbedit.ko 2023-10-06T03:07:21.090 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_vlan.ko 2023-10-06T03:07:21.090 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_basic.ko 2023-10-06T03:07:21.090 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_bpf.ko 2023-10-06T03:07:21.090 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_flow.ko 2023-10-06T03:07:21.090 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_fw.ko 2023-10-06T03:07:21.090 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_route.ko 2023-10-06T03:07:21.090 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_u32.ko 2023-10-06T03:07:21.090 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_cmp.ko 2023-10-06T03:07:21.090 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_ipset.ko 2023-10-06T03:07:21.090 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_meta.ko 2023-10-06T03:07:21.090 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_nbyte.ko 2023-10-06T03:07:21.090 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_text.ko 2023-10-06T03:07:21.091 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_u32.ko 2023-10-06T03:07:21.091 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_choke.ko 2023-10-06T03:07:21.091 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_codel.ko 2023-10-06T03:07:21.091 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_drr.ko 2023-10-06T03:07:21.091 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_fq.ko 2023-10-06T03:07:21.091 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_gred.ko 2023-10-06T03:07:21.091 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hfsc.ko 2023-10-06T03:07:21.091 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hhf.ko 2023-10-06T03:07:21.091 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_htb.ko 2023-10-06T03:07:21.091 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_ingress.ko 2023-10-06T03:07:21.091 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio.ko 2023-10-06T03:07:21.091 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-06T03:07:21.092 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_multiq.ko 2023-10-06T03:07:21.092 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_netem.ko 2023-10-06T03:07:21.092 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_pie.ko 2023-10-06T03:07:21.092 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_plug.ko 2023-10-06T03:07:21.092 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_prio.ko 2023-10-06T03:07:21.092 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_qfq.ko 2023-10-06T03:07:21.092 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_red.ko 2023-10-06T03:07:21.092 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfb.ko 2023-10-06T03:07:21.092 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfq.ko 2023-10-06T03:07:21.092 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_tbf.ko 2023-10-06T03:07:21.092 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_teql.ko 2023-10-06T03:07:21.092 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp 2023-10-06T03:07:21.093 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp.ko 2023-10-06T03:07:21.093 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp_diag.ko 2023-10-06T03:07:21.093 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc 2023-10-06T03:07:21.093 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss 2023-10-06T03:07:21.093 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-06T03:07:21.093 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-06T03:07:21.093 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/sunrpc.ko 2023-10-06T03:07:21.093 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma 2023-10-06T03:07:21.093 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-06T03:07:21.093 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc 2023-10-06T03:07:21.093 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/diag.ko 2023-10-06T03:07:21.093 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/tipc.ko 2023-10-06T03:07:21.093 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix 2023-10-06T03:07:21.094 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix/unix_diag.ko 2023-10-06T03:07:21.094 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock 2023-10-06T03:07:21.094 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-06T03:07:21.094 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-06T03:07:21.094 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock.ko 2023-10-06T03:07:21.094 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-06T03:07:21.094 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-06T03:07:21.094 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm 2023-10-06T03:07:21.094 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-06T03:07:21.094 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security 2023-10-06T03:07:21.094 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys 2023-10-06T03:07:21.094 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys 2023-10-06T03:07:21.095 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-10-06T03:07:21.095 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys 2023-10-06T03:07:21.095 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys/trusted.ko 2023-10-06T03:07:21.095 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt 2023-10-06T03:07:21.095 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib 2023-10-06T03:07:21.095 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib/irqbypass.ko 2023-10-06T03:07:21.095 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias 2023-10-06T03:07:21.095 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias.bin 2023-10-06T03:07:21.095 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin 2023-10-06T03:07:21.095 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.bin 2023-10-06T03:07:21.095 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.modinfo 2023-10-06T03:07:21.095 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep 2023-10-06T03:07:21.096 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep.bin 2023-10-06T03:07:21.096 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.devname 2023-10-06T03:07:21.096 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.order 2023-10-06T03:07:21.096 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.softdep 2023-10-06T03:07:21.096 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols 2023-10-06T03:07:21.096 INFO:teuthology.orchestra.run.smithi083.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols.bin 2023-10-06T03:07:21.097 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc7-gfef64f93da2b 2023-10-06T03:07:21.097 DEBUG:teuthology.orchestra.run.smithi083:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-10-06T03:07:21.118 INFO:teuthology.orchestra.run.smithi083.stdout:postinstall scriptlet (using /bin/sh): 2023-10-06T03:07:21.118 INFO:teuthology.orchestra.run.smithi083.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b -a -r /boot/System.map-6.5.0-rc7-gfef64f93da2b ]; then 2023-10-06T03:07:21.118 INFO:teuthology.orchestra.run.smithi083.stdout:cp /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T03:07:21.118 INFO:teuthology.orchestra.run.smithi083.stdout:cp /boot/System.map-6.5.0-rc7-gfef64f93da2b /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T03:07:21.118 INFO:teuthology.orchestra.run.smithi083.stdout:rm -f /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-06T03:07:21.118 INFO:teuthology.orchestra.run.smithi083.stdout:/sbin/installkernel 6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T03:07:21.118 INFO:teuthology.orchestra.run.smithi083.stdout:rm -f /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T03:07:21.118 INFO:teuthology.orchestra.run.smithi083.stdout:fi 2023-10-06T03:07:21.119 INFO:teuthology.orchestra.run.smithi083.stdout:preuninstall scriptlet (using /bin/sh): 2023-10-06T03:07:21.119 INFO:teuthology.orchestra.run.smithi083.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-10-06T03:07:21.119 INFO:teuthology.orchestra.run.smithi083.stdout:new-kernel-pkg --remove 6.5.0-rc7-gfef64f93da2b --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc7-gfef64f93da2b.img 2023-10-06T03:07:21.119 INFO:teuthology.orchestra.run.smithi083.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-10-06T03:07:21.119 INFO:teuthology.orchestra.run.smithi083.stdout:kernel-install remove 6.5.0-rc7-gfef64f93da2b 2023-10-06T03:07:21.119 INFO:teuthology.orchestra.run.smithi083.stdout:fi 2023-10-06T03:07:21.119 INFO:teuthology.orchestra.run.smithi083.stdout:postuninstall scriptlet (using /bin/sh): 2023-10-06T03:07:21.119 INFO:teuthology.orchestra.run.smithi083.stdout:if [ -x /sbin/update-bootloader ]; then 2023-10-06T03:07:21.119 INFO:teuthology.orchestra.run.smithi083.stdout:/sbin/update-bootloader --remove 6.5.0-rc7-gfef64f93da2b 2023-10-06T03:07:21.119 INFO:teuthology.orchestra.run.smithi083.stdout:fi 2023-10-06T03:07:21.120 DEBUG:teuthology.orchestra.run.smithi083:> sudo rpm -qi grub2-tools 2023-10-06T03:07:21.192 INFO:teuthology.orchestra.run.smithi083.stdout:Name : grub2-tools 2023-10-06T03:07:21.192 INFO:teuthology.orchestra.run.smithi083.stdout:Epoch : 1 2023-10-06T03:07:21.192 INFO:teuthology.orchestra.run.smithi083.stdout:Version : 2.02 2023-10-06T03:07:21.192 INFO:teuthology.orchestra.run.smithi083.stdout:Release : 99.el8_4.1 2023-10-06T03:07:21.192 INFO:teuthology.orchestra.run.smithi083.stdout:Architecture: x86_64 2023-10-06T03:07:21.193 INFO:teuthology.orchestra.run.smithi083.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-06T03:07:21.193 INFO:teuthology.orchestra.run.smithi083.stdout:Group : System Environment/Base 2023-10-06T03:07:21.193 INFO:teuthology.orchestra.run.smithi083.stdout:Size : 9264631 2023-10-06T03:07:21.193 INFO:teuthology.orchestra.run.smithi083.stdout:License : GPLv3+ 2023-10-06T03:07:21.193 INFO:teuthology.orchestra.run.smithi083.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-06T03:07:21.193 INFO:teuthology.orchestra.run.smithi083.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-06T03:07:21.193 INFO:teuthology.orchestra.run.smithi083.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-06T03:07:21.193 INFO:teuthology.orchestra.run.smithi083.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-06T03:07:21.193 INFO:teuthology.orchestra.run.smithi083.stdout:Relocations : (not relocatable) 2023-10-06T03:07:21.193 INFO:teuthology.orchestra.run.smithi083.stdout:Packager : Red Hat, Inc. 2023-10-06T03:07:21.193 INFO:teuthology.orchestra.run.smithi083.stdout:Vendor : Red Hat, Inc. 2023-10-06T03:07:21.193 INFO:teuthology.orchestra.run.smithi083.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-06T03:07:21.194 INFO:teuthology.orchestra.run.smithi083.stdout:Summary : Support tools for GRUB. 2023-10-06T03:07:21.194 INFO:teuthology.orchestra.run.smithi083.stdout:Description : 2023-10-06T03:07:21.194 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T03:07:21.194 INFO:teuthology.orchestra.run.smithi083.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-06T03:07:21.194 INFO:teuthology.orchestra.run.smithi083.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-06T03:07:21.194 INFO:teuthology.orchestra.run.smithi083.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-06T03:07:21.194 INFO:teuthology.orchestra.run.smithi083.stdout:hardware devices. 2023-10-06T03:07:21.194 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T03:07:21.194 INFO:teuthology.orchestra.run.smithi083.stdout:This subpackage provides tools for support of all platforms. 2023-10-06T03:07:21.195 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-06T03:07:21.195 INFO:teuthology.task.kernel:Updating grub on smithi083 to boot 6.5.0-rc7-gfef64f93da2b 2023-10-06T03:07:21.195 DEBUG:teuthology.orchestra.run.smithi083:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-06T03:07:24.670 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-10-06T03:07:25.316 INFO:teuthology.orchestra.run.smithi083.stderr:Generating grub configuration file ... 2023-10-06T03:07:27.578 INFO:teuthology.orchestra.run.smithi083.stderr:done 2023-10-06T03:07:27.580 DEBUG:teuthology.orchestra.run.smithi083:> mktemp 2023-10-06T03:07:27.594 INFO:teuthology.orchestra.run.smithi083.stdout:/tmp/tmp.SDI8aW0mDx 2023-10-06T03:07:27.594 DEBUG:teuthology.orchestra.run.smithi083:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.SDI8aW0mDx 2023-10-06T03:07:27.663 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 0666 /tmp/tmp.SDI8aW0mDx 2023-10-06T03:07:27.815 DEBUG:teuthology.orchestra.remote:smithi083:/tmp/tmp.SDI8aW0mDx is 6KB 2023-10-06T03:07:27.863 DEBUG:teuthology.orchestra.run.smithi083:> rm -fr /tmp/tmp.SDI8aW0mDx 2023-10-06T03:07:27.877 DEBUG:teuthology.orchestra.run.smithi083:> sudo /bin/ls /boot/loader/entries || true 2023-10-06T03:07:27.958 INFO:teuthology.orchestra.run.smithi083.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-06T03:07:27.958 INFO:teuthology.orchestra.run.smithi083.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-06T03:07:27.958 INFO:teuthology.orchestra.run.smithi083.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-06T03:07:27.958 INFO:teuthology.orchestra.run.smithi083.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-06T03:07:27.958 INFO:teuthology.orchestra.run.smithi083.stdout:298e228f3b5e401e8ac0f5ae159a2e06-6.5.0-rc7-gfef64f93da2b.conf 2023-10-06T03:07:27.959 DEBUG:teuthology.orchestra.run.smithi083:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-6.5.0-rc7-gfef64f93da2b 2023-10-06T03:07:28.105 DEBUG:teuthology.orchestra.run.smithi083:> sudo shutdown -r now 2023-10-06T03:07:33.674 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-10-06T03:07:33.675 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T03:07:36.734 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-10-06T03:07:48.746 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-10-06T03:07:48.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T03:07:58.115 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-10-06T03:07:58.118 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2023-10-06T03:07:58.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T03:08:16.634 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-10-06T03:08:20.821 DEBUG:teuthology.orchestra.run.smithi081:> true 2023-10-06T03:08:21.295 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-10-06T03:08:21.295 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.5.0-rc7-gfef64f93da2b"... 2023-10-06T03:08:21.296 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2023-10-06T03:08:21.330 INFO:teuthology.orchestra.run.smithi081.stdout:6.5.0-rc7-gfef64f93da2b 2023-10-06T03:08:21.331 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc7-gfef64f93da2b vs 6.5.0-rc7-gfef64f93da2b 2023-10-06T03:08:21.331 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T03:08:21.331 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-06T03:08:22.332 DEBUG:teuthology.parallel:result is None 2023-10-06T03:08:25.635 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2023-10-06T03:08:25.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T03:08:28.698 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-10-06T03:08:40.699 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2023-10-06T03:08:40.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T03:09:12.612 DEBUG:teuthology.orchestra.run.smithi083:> true 2023-10-06T03:09:13.104 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi083.front.sepia.ceph.com' 2023-10-06T03:09:13.104 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.5.0-rc7-gfef64f93da2b"... 2023-10-06T03:09:13.104 DEBUG:teuthology.orchestra.run.smithi083:> uname -r 2023-10-06T03:09:13.144 INFO:teuthology.orchestra.run.smithi083.stdout:6.5.0-rc7-gfef64f93da2b 2023-10-06T03:09:13.144 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc7-gfef64f93da2b vs 6.5.0-rc7-gfef64f93da2b 2023-10-06T03:09:13.144 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T03:09:13.144 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-06T03:09:14.146 DEBUG:teuthology.parallel:result is None 2023-10-06T03:09:14.146 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-06T03:09:14.153 INFO:teuthology.task.internal:Creating test directory... 2023-10-06T03:09:14.153 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T03:09:14.159 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T03:09:14.196 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-06T03:09:14.204 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-06T03:09:14.210 INFO:teuthology.task.internal:Creating archive directory... 2023-10-06T03:09:14.210 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T03:09:14.240 DEBUG:teuthology.orchestra.run.smithi083:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T03:09:14.294 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-06T03:09:14.300 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-06T03:09:14.300 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T03:09:14.304 DEBUG:teuthology.orchestra.run.smithi083:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T03:09:14.450 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T03:09:14.455 INFO:teuthology.orchestra.run.smithi083.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T03:09:14.480 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T03:09:14.491 INFO:teuthology.orchestra.run.smithi083.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T03:09:14.494 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-06T03:09:14.501 INFO:teuthology.task.internal:Configuring sudo... 2023-10-06T03:09:14.501 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T03:09:14.506 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T03:09:14.568 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-06T03:09:14.577 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-06T03:09:14.577 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T03:09:14.581 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T03:09:14.617 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T03:09:14.718 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T03:09:14.821 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T03:09:14.887 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T03:09:14.961 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-06T03:09:14.962 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T03:09:15.026 DEBUG:teuthology.orchestra.run.smithi083:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T03:09:15.091 DEBUG:teuthology.orchestra.run.smithi083:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T03:09:15.172 DEBUG:teuthology.orchestra.run.smithi083:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T03:09:15.234 DEBUG:teuthology.orchestra.run.smithi083:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T03:09:15.316 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T03:09:15.316 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T03:09:15.386 DEBUG:teuthology.orchestra.run.smithi081:> sudo service rsyslog restart 2023-10-06T03:09:15.391 DEBUG:teuthology.orchestra.run.smithi083:> sudo service rsyslog restart 2023-10-06T03:09:15.501 INFO:teuthology.orchestra.run.smithi081.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T03:09:15.537 INFO:teuthology.orchestra.run.smithi083.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T03:09:15.977 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-06T03:09:16.145 INFO:teuthology.task.internal:Starting timer... 2023-10-06T03:09:16.145 INFO:teuthology.run_tasks:Running task pcp... 2023-10-06T03:09:16.386 INFO:teuthology.run_tasks:Running task selinux... 2023-10-06T03:09:16.587 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-06T03:09:16.588 DEBUG:teuthology.orchestra.run.smithi081:> sudo service auditd rotate 2023-10-06T03:09:16.693 INFO:teuthology.orchestra.run.smithi081.stdout:Rotating logs: [ OK ] 2023-10-06T03:09:16.697 DEBUG:teuthology.orchestra.run.smithi083:> sudo service auditd rotate 2023-10-06T03:09:16.817 INFO:teuthology.orchestra.run.smithi083.stdout:Rotating logs: [ OK ] 2023-10-06T03:09:16.820 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-06T03:09:16.821 DEBUG:teuthology.orchestra.run.smithi081:> /usr/sbin/getenforce 2023-10-06T03:09:16.872 INFO:teuthology.orchestra.run.smithi081.stdout:Permissive 2023-10-06T03:09:16.872 DEBUG:teuthology.orchestra.run.smithi083:> /usr/sbin/getenforce 2023-10-06T03:09:16.921 INFO:teuthology.orchestra.run.smithi083.stdout:Permissive 2023-10-06T03:09:16.921 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi081.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi083.front.sepia.ceph.com': 'permissive'} 2023-10-06T03:09:16.921 DEBUG:teuthology.orchestra.run.smithi081:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T03:09:16.984 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:09:16.984 DEBUG:teuthology.orchestra.run.smithi083:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T03:09:17.044 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:09:17.045 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-06T03:09:17.045 DEBUG:teuthology.orchestra.run.smithi081:> sudo /usr/sbin/setenforce permissive 2023-10-06T03:09:17.108 DEBUG:teuthology.orchestra.run.smithi083:> sudo /usr/sbin/setenforce permissive 2023-10-06T03:09:17.169 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-06T03:09:17.179 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-10-06T03:09:17.179 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-06T03:09:17.195 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-06T03:09:17.196 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi081.front.sepia.ceph.com,smithi083.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-06T03:20:24.512 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi081.front.sepia.ceph.com'), Remote(name='ubuntu@smithi083.front.sepia.ceph.com')] 2023-10-06T03:20:24.513 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-10-06T03:20:24.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T03:20:24.603 DEBUG:teuthology.orchestra.run.smithi081:> true 2023-10-06T03:20:24.710 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-10-06T03:20:24.710 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2023-10-06T03:20:24.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T03:20:24.801 DEBUG:teuthology.orchestra.run.smithi083:> true 2023-10-06T03:20:24.906 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi083.front.sepia.ceph.com' 2023-10-06T03:20:24.906 INFO:teuthology.run_tasks:Running task clock... 2023-10-06T03:20:24.916 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-06T03:20:24.917 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T03:20:24.917 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T03:20:24.921 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T03:20:24.922 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T03:20:24.984 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-06T03:20:25.013 INFO:teuthology.orchestra.run.smithi083.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-06T03:20:25.019 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-06T03:20:25.049 INFO:teuthology.orchestra.run.smithi083.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-06T03:20:25.078 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: ntpd: command not found 2023-10-06T03:20:25.105 INFO:teuthology.orchestra.run.smithi081.stdout:506 Cannot talk to daemon 2023-10-06T03:20:25.107 INFO:teuthology.orchestra.run.smithi083.stderr:sudo: ntpd: command not found 2023-10-06T03:20:25.133 INFO:teuthology.orchestra.run.smithi083.stdout:506 Cannot talk to daemon 2023-10-06T03:20:25.138 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-06T03:20:25.166 INFO:teuthology.orchestra.run.smithi083.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-06T03:20:25.172 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-06T03:20:25.200 INFO:teuthology.orchestra.run.smithi083.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-06T03:20:25.257 INFO:teuthology.orchestra.run.smithi081.stderr:bash: ntpq: command not found 2023-10-06T03:20:25.262 INFO:teuthology.orchestra.run.smithi081.stdout:210 Number of sources = 4 2023-10-06T03:20:25.262 INFO:teuthology.orchestra.run.smithi081.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T03:20:25.262 INFO:teuthology.orchestra.run.smithi081.stdout:=============================================================================== 2023-10-06T03:20:25.262 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T03:20:25.263 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T03:20:25.263 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T03:20:25.263 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T03:20:25.283 INFO:teuthology.orchestra.run.smithi083.stderr:bash: ntpq: command not found 2023-10-06T03:20:25.288 INFO:teuthology.orchestra.run.smithi083.stdout:210 Number of sources = 4 2023-10-06T03:20:25.288 INFO:teuthology.orchestra.run.smithi083.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T03:20:25.288 INFO:teuthology.orchestra.run.smithi083.stdout:=============================================================================== 2023-10-06T03:20:25.288 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T03:20:25.288 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T03:20:25.288 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T03:20:25.289 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T03:20:25.289 INFO:teuthology.run_tasks:Running task install... 2023-10-06T03:20:25.299 DEBUG:teuthology.task.install:project ceph 2023-10-06T03:20:25.299 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}} 2023-10-06T03:20:25.299 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'} 2023-10-06T03:20:25.299 INFO:teuthology.task.install:Using flavor: default 2023-10-06T03:20:25.305 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-06T03:20:25.306 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-06T03:20:25.306 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2', 'tag': None, 'wait_for_package': False} 2023-10-06T03:20:25.306 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T03:20:25.308 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2', 'tag': None, 'wait_for_package': False} 2023-10-06T03:20:25.308 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T03:20:25.450 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/ 2023-10-06T03:20:25.451 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1296.g736ac5ba 2023-10-06T03:20:25.521 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/ 2023-10-06T03:20:25.522 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1296.g736ac5ba 2023-10-06T03:20:25.562 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-06T03:20:25.562 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T03:20:25.562 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-06T03:20:25.629 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-06T03:20:25.630 DEBUG:teuthology.orchestra.run.smithi083:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-06T03:20:25.689 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-06T03:20:25.689 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-06T03:20:25.689 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-06T03:20:25.732 DEBUG:teuthology.orchestra.run.smithi083:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-06T03:20:25.751 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-06T03:20:25.751 DEBUG:teuthology.orchestra.run.smithi081:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-06T03:20:25.819 DEBUG:teuthology.orchestra.run.smithi083:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-06T03:20:25.853 DEBUG:teuthology.orchestra.run.smithi081:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-06T03:20:25.880 INFO:teuthology.orchestra.run.smithi083.stdout:check_obsoletes = 1 2023-10-06T03:20:25.883 DEBUG:teuthology.orchestra.run.smithi083:> sudo yum clean all 2023-10-06T03:20:25.941 DEBUG:teuthology.orchestra.run.smithi081:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-06T03:20:26.001 INFO:teuthology.orchestra.run.smithi081.stdout:check_obsoletes = 1 2023-10-06T03:20:26.004 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum clean all 2023-10-06T03:20:26.345 INFO:teuthology.orchestra.run.smithi083.stdout:Updating Subscription Management repositories. 2023-10-06T03:20:26.459 INFO:teuthology.orchestra.run.smithi081.stdout:Updating Subscription Management repositories. 2023-10-06T03:20:26.707 INFO:teuthology.orchestra.run.smithi083.stdout:44 files removed 2023-10-06T03:20:26.766 DEBUG:teuthology.orchestra.run.smithi083:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-06T03:20:26.815 INFO:teuthology.orchestra.run.smithi081.stdout:44 files removed 2023-10-06T03:20:26.874 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-06T03:20:27.226 INFO:teuthology.orchestra.run.smithi083.stdout:Updating Subscription Management repositories. 2023-10-06T03:20:27.330 INFO:teuthology.orchestra.run.smithi081.stdout:Updating Subscription Management repositories. 2023-10-06T03:20:28.110 INFO:teuthology.orchestra.run.smithi083.stdout:ceph packages for x86_64 249 kB/s | 78 kB 00:00 2023-10-06T03:20:28.286 INFO:teuthology.orchestra.run.smithi081.stdout:ceph packages for x86_64 276 kB/s | 78 kB 00:00 2023-10-06T03:20:28.398 INFO:teuthology.orchestra.run.smithi083.stdout:ceph noarch packages 37 kB/s | 9.2 kB 00:00 2023-10-06T03:20:28.460 INFO:teuthology.orchestra.run.smithi081.stdout:ceph noarch packages 38 kB/s | 9.2 kB 00:00 2023-10-06T03:20:28.675 INFO:teuthology.orchestra.run.smithi083.stdout:ceph source packages 5.9 kB/s | 1.4 kB 00:00 2023-10-06T03:20:28.677 INFO:teuthology.orchestra.run.smithi081.stdout:ceph source packages 7.8 kB/s | 1.4 kB 00:00 2023-10-06T03:20:28.787 INFO:teuthology.orchestra.run.smithi083.stdout:Copr repo for python3-asyncssh owned by ceph 42 kB/s | 3.5 kB 00:00 2023-10-06T03:20:28.796 INFO:teuthology.orchestra.run.smithi081.stdout:Copr repo for python3-asyncssh owned by ceph 39 kB/s | 3.5 kB 00:00 2023-10-06T03:20:29.512 INFO:teuthology.orchestra.run.smithi081.stdout:Extra Packages for Enterprise Linux 23 MB/s | 16 MB 00:00 2023-10-06T03:20:30.233 INFO:teuthology.orchestra.run.smithi083.stdout:Extra Packages for Enterprise Linux 11 MB/s | 16 MB 00:01 2023-10-06T03:20:32.981 INFO:teuthology.orchestra.run.smithi081.stdout:lab-extras 3.9 MB/s | 24 kB 00:00 2023-10-06T03:20:33.446 INFO:teuthology.orchestra.run.smithi081.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 86 MB/s | 33 MB 00:00 2023-10-06T03:20:33.724 INFO:teuthology.orchestra.run.smithi083.stdout:lab-extras 4.1 MB/s | 24 kB 00:00 2023-10-06T03:20:34.257 INFO:teuthology.orchestra.run.smithi083.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 85 MB/s | 38 MB 00:00 2023-10-06T03:20:39.007 INFO:teuthology.orchestra.run.smithi081.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 83 MB/s | 38 MB 00:00 2023-10-06T03:20:40.095 INFO:teuthology.orchestra.run.smithi083.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 81 MB/s | 33 MB 00:00 2023-10-06T03:20:47.678 INFO:teuthology.orchestra.run.smithi081.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T03:20:47.679 INFO:teuthology.orchestra.run.smithi081.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T03:20:47.690 INFO:teuthology.orchestra.run.smithi081.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-06T03:20:47.690 INFO:teuthology.orchestra.run.smithi081.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-06T03:20:47.691 INFO:teuthology.orchestra.run.smithi081.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-06T03:20:47.692 INFO:teuthology.orchestra.run.smithi081.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-06T03:20:47.694 INFO:teuthology.orchestra.run.smithi081.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-06T03:20:47.696 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-06T03:20:47.697 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-06T03:20:48.197 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2023-10-06T03:20:48.208 INFO:teuthology.orchestra.run.smithi081.stdout:====================================================================================================================== 2023-10-06T03:20:48.209 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2023-10-06T03:20:48.209 INFO:teuthology.orchestra.run.smithi081.stdout:====================================================================================================================== 2023-10-06T03:20:48.209 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2023-10-06T03:20:48.209 INFO:teuthology.orchestra.run.smithi081.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-06T03:20:48.209 INFO:teuthology.orchestra.run.smithi081.stdout: ceph x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 6.4 k 2023-10-06T03:20:48.209 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 5.2 M 2023-10-06T03:20:48.209 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-fuse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 876 k 2023-10-06T03:20:48.210 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 162 k 2023-10-06T03:20:48.210 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 1.6 M 2023-10-06T03:20:48.210 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 121 k 2023-10-06T03:20:48.210 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 1.7 M 2023-10-06T03:20:48.210 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 7.4 M 2023-10-06T03:20:48.210 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-rook noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 47 k 2023-10-06T03:20:48.210 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-radosgw x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 17 M 2023-10-06T03:20:48.210 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-test x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 52 M 2023-10-06T03:20:48.210 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-volume noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 267 k 2023-10-06T03:20:48.211 INFO:teuthology.orchestra.run.smithi081.stdout: cephadm noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 80 k 2023-10-06T03:20:48.211 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-mirror x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 255 k 2023-10-06T03:20:48.211 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-top noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 18 k 2023-10-06T03:20:48.211 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-06T03:20:48.211 INFO:teuthology.orchestra.run.smithi081.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-06T03:20:48.211 INFO:teuthology.orchestra.run.smithi081.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-06T03:20:48.211 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-devel x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 25 k 2023-10-06T03:20:48.211 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 797 k 2023-10-06T03:20:48.211 INFO:teuthology.orchestra.run.smithi081.stdout: librados-devel x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 130 k 2023-10-06T03:20:48.211 INFO:teuthology.orchestra.run.smithi081.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-06T03:20:48.212 INFO:teuthology.orchestra.run.smithi081.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-06T03:20:48.212 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-06T03:20:48.212 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cephfs x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 190 k 2023-10-06T03:20:48.212 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 371 k 2023-10-06T03:20:48.212 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rbd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 358 k 2023-10-06T03:20:48.212 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rgw x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 107 k 2023-10-06T03:20:48.212 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-fuse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 90 k 2023-10-06T03:20:48.212 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-mirror x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.5 M 2023-10-06T03:20:48.212 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-nbd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 173 k 2023-10-06T03:20:48.212 INFO:teuthology.orchestra.run.smithi081.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-06T03:20:48.213 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrading: 2023-10-06T03:20:48.213 INFO:teuthology.orchestra.run.smithi081.stdout: librados2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.5 M 2023-10-06T03:20:48.213 INFO:teuthology.orchestra.run.smithi081.stdout: librbd1 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.6 M 2023-10-06T03:20:48.213 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2023-10-06T03:20:48.213 INFO:teuthology.orchestra.run.smithi081.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-06T03:20:48.213 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-common x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 23 M 2023-10-06T03:20:48.213 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 23 k 2023-10-06T03:20:48.213 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mds x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 2.3 M 2023-10-06T03:20:48.213 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 238 k 2023-10-06T03:20:48.213 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mon x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.9 M 2023-10-06T03:20:48.214 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-osd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 17 M 2023-10-06T03:20:48.214 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 14 k 2023-10-06T03:20:48.214 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-selinux x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 24 k 2023-10-06T03:20:48.214 INFO:teuthology.orchestra.run.smithi081.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-06T03:20:48.214 INFO:teuthology.orchestra.run.smithi081.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-06T03:20:48.214 INFO:teuthology.orchestra.run.smithi081.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-06T03:20:48.214 INFO:teuthology.orchestra.run.smithi081.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-06T03:20:48.214 INFO:teuthology.orchestra.run.smithi081.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-06T03:20:48.214 INFO:teuthology.orchestra.run.smithi081.stdout: libcephsqlite x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 174 k 2023-10-06T03:20:48.214 INFO:teuthology.orchestra.run.smithi081.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-06T03:20:48.214 INFO:teuthology.orchestra.run.smithi081.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-06T03:20:48.214 INFO:teuthology.orchestra.run.smithi081.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-06T03:20:48.215 INFO:teuthology.orchestra.run.smithi081.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-06T03:20:48.215 INFO:teuthology.orchestra.run.smithi081.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-06T03:20:48.215 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 507 k 2023-10-06T03:20:48.215 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-06T03:20:48.215 INFO:teuthology.orchestra.run.smithi081.stdout: librgw2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 5.6 M 2023-10-06T03:20:48.215 INFO:teuthology.orchestra.run.smithi081.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-06T03:20:48.215 INFO:teuthology.orchestra.run.smithi081.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-06T03:20:48.215 INFO:teuthology.orchestra.run.smithi081.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-06T03:20:48.215 INFO:teuthology.orchestra.run.smithi081.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-06T03:20:48.215 INFO:teuthology.orchestra.run.smithi081.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-06T03:20:48.215 INFO:teuthology.orchestra.run.smithi081.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-06T03:20:48.215 INFO:teuthology.orchestra.run.smithi081.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-06T03:20:48.216 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-06T03:20:48.216 INFO:teuthology.orchestra.run.smithi081.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-06T03:20:48.216 INFO:teuthology.orchestra.run.smithi081.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-06T03:20:48.216 INFO:teuthology.orchestra.run.smithi081.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-06T03:20:48.216 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-06T03:20:48.216 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-06T03:20:48.216 INFO:teuthology.orchestra.run.smithi081.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-06T03:20:48.216 INFO:teuthology.orchestra.run.smithi081.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-06T03:20:48.216 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-06T03:20:48.216 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 45 k 2023-10-06T03:20:48.216 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 115 k 2023-10-06T03:20:48.217 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-06T03:20:48.217 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-06T03:20:48.217 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-06T03:20:48.217 INFO:teuthology.orchestra.run.smithi081.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-06T03:20:48.217 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-06T03:20:48.217 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-06T03:20:48.217 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-06T03:20:48.217 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-06T03:20:48.217 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-06T03:20:48.217 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T03:20:48.217 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-06T03:20:48.217 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-06T03:20:48.218 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-06T03:20:48.218 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-06T03:20:48.218 INFO:teuthology.orchestra.run.smithi081.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-06T03:20:48.218 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-06T03:20:48.218 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-06T03:20:48.218 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-06T03:20:48.218 INFO:teuthology.orchestra.run.smithi081.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-06T03:20:48.218 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-06T03:20:48.218 INFO:teuthology.orchestra.run.smithi081.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-06T03:20:48.218 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-06T03:20:48.218 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-06T03:20:48.219 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-06T03:20:48.219 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-06T03:20:48.219 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-06T03:20:48.219 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T03:20:48.219 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-06T03:20:48.219 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-06T03:20:48.219 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-06T03:20:48.219 INFO:teuthology.orchestra.run.smithi081.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-06T03:20:48.219 INFO:teuthology.orchestra.run.smithi081.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-06T03:20:48.219 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-06T03:20:48.219 INFO:teuthology.orchestra.run.smithi081.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-06T03:20:48.219 INFO:teuthology.orchestra.run.smithi081.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-06T03:20:48.220 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-06T03:20:48.220 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-06T03:20:48.220 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-06T03:20:48.220 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-06T03:20:48.220 INFO:teuthology.orchestra.run.smithi081.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-06T03:20:48.220 INFO:teuthology.orchestra.run.smithi081.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-06T03:20:48.220 INFO:teuthology.orchestra.run.smithi081.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-06T03:20:48.220 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-06T03:20:48.220 INFO:teuthology.orchestra.run.smithi081.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-06T03:20:48.220 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:20:48.220 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2023-10-06T03:20:48.220 INFO:teuthology.orchestra.run.smithi081.stdout:====================================================================================================================== 2023-10-06T03:20:48.221 INFO:teuthology.orchestra.run.smithi081.stdout:Install 118 Packages 2023-10-06T03:20:48.221 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrade 2 Packages 2023-10-06T03:20:48.221 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:20:48.221 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 201 M 2023-10-06T03:20:48.221 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2023-10-06T03:20:48.366 INFO:teuthology.orchestra.run.smithi083.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T03:20:48.367 INFO:teuthology.orchestra.run.smithi083.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T03:20:48.378 INFO:teuthology.orchestra.run.smithi083.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-06T03:20:48.379 INFO:teuthology.orchestra.run.smithi083.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-06T03:20:48.379 INFO:teuthology.orchestra.run.smithi083.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-06T03:20:48.381 INFO:teuthology.orchestra.run.smithi083.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-06T03:20:48.382 INFO:teuthology.orchestra.run.smithi083.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-06T03:20:48.385 INFO:teuthology.orchestra.run.smithi083.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-06T03:20:48.386 INFO:teuthology.orchestra.run.smithi083.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-06T03:20:48.467 INFO:teuthology.orchestra.run.smithi081.stdout:(1/120): ceph-17.2.6-1296.g736ac5ba.el8.x86_64. 41 kB/s | 6.4 kB 00:00 2023-10-06T03:20:48.862 INFO:teuthology.orchestra.run.smithi081.stdout:(2/120): ceph-base-17.2.6-1296.g736ac5ba.el8.x8 9.3 MB/s | 5.2 MB 00:00 2023-10-06T03:20:48.895 INFO:teuthology.orchestra.run.smithi083.stdout:Dependencies resolved. 2023-10-06T03:20:48.903 INFO:teuthology.orchestra.run.smithi081.stdout:(3/120): ceph-immutable-object-cache-17.2.6-129 3.9 MB/s | 162 kB 00:00 2023-10-06T03:20:48.907 INFO:teuthology.orchestra.run.smithi083.stdout:====================================================================================================================== 2023-10-06T03:20:48.907 INFO:teuthology.orchestra.run.smithi083.stdout: Package Arch Version Repository Size 2023-10-06T03:20:48.907 INFO:teuthology.orchestra.run.smithi083.stdout:====================================================================================================================== 2023-10-06T03:20:48.907 INFO:teuthology.orchestra.run.smithi083.stdout:Installing: 2023-10-06T03:20:48.907 INFO:teuthology.orchestra.run.smithi083.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-06T03:20:48.907 INFO:teuthology.orchestra.run.smithi083.stdout: ceph x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 6.4 k 2023-10-06T03:20:48.907 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-base x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 5.2 M 2023-10-06T03:20:48.907 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-fuse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 876 k 2023-10-06T03:20:48.908 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 162 k 2023-10-06T03:20:48.908 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 1.6 M 2023-10-06T03:20:48.908 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 121 k 2023-10-06T03:20:48.908 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 1.7 M 2023-10-06T03:20:48.908 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 7.4 M 2023-10-06T03:20:48.908 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-rook noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 47 k 2023-10-06T03:20:48.908 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-radosgw x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 17 M 2023-10-06T03:20:48.908 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-test x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 52 M 2023-10-06T03:20:48.908 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-volume noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 267 k 2023-10-06T03:20:48.908 INFO:teuthology.orchestra.run.smithi083.stdout: cephadm noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 80 k 2023-10-06T03:20:48.908 INFO:teuthology.orchestra.run.smithi083.stdout: cephfs-mirror x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 255 k 2023-10-06T03:20:48.909 INFO:teuthology.orchestra.run.smithi083.stdout: cephfs-top noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 18 k 2023-10-06T03:20:48.909 INFO:teuthology.orchestra.run.smithi083.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-06T03:20:48.909 INFO:teuthology.orchestra.run.smithi083.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-06T03:20:48.909 INFO:teuthology.orchestra.run.smithi083.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-06T03:20:48.909 INFO:teuthology.orchestra.run.smithi083.stdout: libcephfs-devel x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 25 k 2023-10-06T03:20:48.909 INFO:teuthology.orchestra.run.smithi083.stdout: libcephfs2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 797 k 2023-10-06T03:20:48.909 INFO:teuthology.orchestra.run.smithi083.stdout: librados-devel x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 130 k 2023-10-06T03:20:48.909 INFO:teuthology.orchestra.run.smithi083.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-06T03:20:48.909 INFO:teuthology.orchestra.run.smithi083.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-06T03:20:48.909 INFO:teuthology.orchestra.run.smithi083.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-06T03:20:48.909 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cephfs x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 190 k 2023-10-06T03:20:48.910 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rados x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 371 k 2023-10-06T03:20:48.910 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rbd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 358 k 2023-10-06T03:20:48.910 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rgw x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 107 k 2023-10-06T03:20:48.910 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-fuse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 90 k 2023-10-06T03:20:48.910 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-mirror x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.5 M 2023-10-06T03:20:48.910 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-nbd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 173 k 2023-10-06T03:20:48.910 INFO:teuthology.orchestra.run.smithi083.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-06T03:20:48.910 INFO:teuthology.orchestra.run.smithi083.stdout:Upgrading: 2023-10-06T03:20:48.910 INFO:teuthology.orchestra.run.smithi083.stdout: librados2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.5 M 2023-10-06T03:20:48.910 INFO:teuthology.orchestra.run.smithi083.stdout: librbd1 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.6 M 2023-10-06T03:20:48.910 INFO:teuthology.orchestra.run.smithi083.stdout:Installing dependencies: 2023-10-06T03:20:48.911 INFO:teuthology.orchestra.run.smithi083.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-06T03:20:48.911 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-common x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 23 M 2023-10-06T03:20:48.911 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 23 k 2023-10-06T03:20:48.911 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mds x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 2.3 M 2023-10-06T03:20:48.911 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 238 k 2023-10-06T03:20:48.911 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mon x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.9 M 2023-10-06T03:20:48.911 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-osd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 17 M 2023-10-06T03:20:48.911 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 14 k 2023-10-06T03:20:48.911 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-selinux x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 24 k 2023-10-06T03:20:48.911 INFO:teuthology.orchestra.run.smithi083.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-06T03:20:48.911 INFO:teuthology.orchestra.run.smithi083.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-06T03:20:48.912 INFO:teuthology.orchestra.run.smithi083.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-06T03:20:48.912 INFO:teuthology.orchestra.run.smithi083.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-06T03:20:48.912 INFO:teuthology.orchestra.run.smithi083.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-06T03:20:48.912 INFO:teuthology.orchestra.run.smithi083.stdout: libcephsqlite x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 174 k 2023-10-06T03:20:48.912 INFO:teuthology.orchestra.run.smithi083.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-06T03:20:48.912 INFO:teuthology.orchestra.run.smithi083.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-06T03:20:48.912 INFO:teuthology.orchestra.run.smithi083.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-06T03:20:48.912 INFO:teuthology.orchestra.run.smithi083.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-06T03:20:48.912 INFO:teuthology.orchestra.run.smithi083.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-06T03:20:48.912 INFO:teuthology.orchestra.run.smithi083.stdout: libradosstriper1 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 507 k 2023-10-06T03:20:48.912 INFO:teuthology.orchestra.run.smithi083.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-06T03:20:48.913 INFO:teuthology.orchestra.run.smithi083.stdout: librgw2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 5.6 M 2023-10-06T03:20:48.913 INFO:teuthology.orchestra.run.smithi083.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-06T03:20:48.913 INFO:teuthology.orchestra.run.smithi083.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-06T03:20:48.913 INFO:teuthology.orchestra.run.smithi083.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-06T03:20:48.913 INFO:teuthology.orchestra.run.smithi083.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-06T03:20:48.913 INFO:teuthology.orchestra.run.smithi083.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-06T03:20:48.913 INFO:teuthology.orchestra.run.smithi083.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-06T03:20:48.913 INFO:teuthology.orchestra.run.smithi083.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-06T03:20:48.913 INFO:teuthology.orchestra.run.smithi083.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-06T03:20:48.913 INFO:teuthology.orchestra.run.smithi083.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-06T03:20:48.913 INFO:teuthology.orchestra.run.smithi083.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-06T03:20:48.913 INFO:teuthology.orchestra.run.smithi083.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-06T03:20:48.914 INFO:teuthology.orchestra.run.smithi083.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-06T03:20:48.914 INFO:teuthology.orchestra.run.smithi083.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-06T03:20:48.914 INFO:teuthology.orchestra.run.smithi083.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-06T03:20:48.914 INFO:teuthology.orchestra.run.smithi083.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-06T03:20:48.914 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-06T03:20:48.914 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ceph-argparse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 45 k 2023-10-06T03:20:48.914 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ceph-common x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 115 k 2023-10-06T03:20:48.914 INFO:teuthology.orchestra.run.smithi083.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-06T03:20:48.914 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-06T03:20:48.914 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-06T03:20:48.914 INFO:teuthology.orchestra.run.smithi083.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-06T03:20:48.914 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-06T03:20:48.915 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-06T03:20:48.915 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-06T03:20:48.915 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-06T03:20:48.915 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-06T03:20:48.915 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T03:20:48.915 INFO:teuthology.orchestra.run.smithi083.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-06T03:20:48.915 INFO:teuthology.orchestra.run.smithi083.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-06T03:20:48.915 INFO:teuthology.orchestra.run.smithi083.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-06T03:20:48.915 INFO:teuthology.orchestra.run.smithi083.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-06T03:20:48.915 INFO:teuthology.orchestra.run.smithi083.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-06T03:20:48.915 INFO:teuthology.orchestra.run.smithi083.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-06T03:20:48.915 INFO:teuthology.orchestra.run.smithi083.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-06T03:20:48.916 INFO:teuthology.orchestra.run.smithi083.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-06T03:20:48.916 INFO:teuthology.orchestra.run.smithi083.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-06T03:20:48.916 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-06T03:20:48.916 INFO:teuthology.orchestra.run.smithi083.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-06T03:20:48.916 INFO:teuthology.orchestra.run.smithi083.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-06T03:20:48.916 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-06T03:20:48.916 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-06T03:20:48.916 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-06T03:20:48.916 INFO:teuthology.orchestra.run.smithi083.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-06T03:20:48.916 INFO:teuthology.orchestra.run.smithi083.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T03:20:48.916 INFO:teuthology.orchestra.run.smithi083.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-06T03:20:48.916 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-06T03:20:48.916 INFO:teuthology.orchestra.run.smithi083.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-06T03:20:48.917 INFO:teuthology.orchestra.run.smithi083.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-06T03:20:48.917 INFO:teuthology.orchestra.run.smithi083.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-06T03:20:48.917 INFO:teuthology.orchestra.run.smithi083.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-06T03:20:48.917 INFO:teuthology.orchestra.run.smithi083.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-06T03:20:48.917 INFO:teuthology.orchestra.run.smithi083.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-06T03:20:48.917 INFO:teuthology.orchestra.run.smithi083.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-06T03:20:48.917 INFO:teuthology.orchestra.run.smithi083.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-06T03:20:48.917 INFO:teuthology.orchestra.run.smithi083.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-06T03:20:48.917 INFO:teuthology.orchestra.run.smithi083.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-06T03:20:48.917 INFO:teuthology.orchestra.run.smithi083.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-06T03:20:48.917 INFO:teuthology.orchestra.run.smithi083.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-06T03:20:48.917 INFO:teuthology.orchestra.run.smithi083.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-06T03:20:48.918 INFO:teuthology.orchestra.run.smithi083.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-06T03:20:48.918 INFO:teuthology.orchestra.run.smithi083.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-06T03:20:48.918 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T03:20:48.918 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction Summary 2023-10-06T03:20:48.918 INFO:teuthology.orchestra.run.smithi083.stdout:====================================================================================================================== 2023-10-06T03:20:48.918 INFO:teuthology.orchestra.run.smithi083.stdout:Install 118 Packages 2023-10-06T03:20:48.918 INFO:teuthology.orchestra.run.smithi083.stdout:Upgrade 2 Packages 2023-10-06T03:20:48.918 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T03:20:48.919 INFO:teuthology.orchestra.run.smithi083.stdout:Total download size: 201 M 2023-10-06T03:20:48.919 INFO:teuthology.orchestra.run.smithi083.stdout:Downloading Packages: 2023-10-06T03:20:49.114 INFO:teuthology.orchestra.run.smithi081.stdout:(4/120): ceph-mds-17.2.6-1296.g736ac5ba.el8.x86 11 MB/s | 2.3 MB 00:00 2023-10-06T03:20:49.250 INFO:teuthology.orchestra.run.smithi081.stdout:(5/120): ceph-mgr-17.2.6-1296.g736ac5ba.el8.x86 12 MB/s | 1.6 MB 00:00 2023-10-06T03:20:49.492 INFO:teuthology.orchestra.run.smithi083.stdout:(1/120): ceph-17.2.6-1296.g736ac5ba.el8.x86_64. 18 kB/s | 6.4 kB 00:00 2023-10-06T03:20:49.618 INFO:teuthology.orchestra.run.smithi081.stdout:(6/120): ceph-fuse-17.2.6-1296.g736ac5ba.el8.x8 761 kB/s | 876 kB 00:01 2023-10-06T03:20:49.649 INFO:teuthology.orchestra.run.smithi081.stdout:(7/120): ceph-mon-17.2.6-1296.g736ac5ba.el8.x86 9.9 MB/s | 3.9 MB 00:00 2023-10-06T03:20:49.904 INFO:teuthology.orchestra.run.smithi081.stdout:(8/120): ceph-common-17.2.6-1296.g736ac5ba.el8. 15 MB/s | 23 MB 00:01 2023-10-06T03:20:49.930 INFO:teuthology.orchestra.run.smithi081.stdout:(9/120): ceph-selinux-17.2.6-1296.g736ac5ba.el8 976 kB/s | 24 kB 00:00 2023-10-06T03:20:49.945 INFO:teuthology.orchestra.run.smithi083.stdout:(2/120): ceph-fuse-17.2.6-1296.g736ac5ba.el8.x8 1.9 MB/s | 876 kB 00:00 2023-10-06T03:20:50.013 INFO:teuthology.orchestra.run.smithi083.stdout:(3/120): ceph-immutable-object-cache-17.2.6-129 2.3 MB/s | 162 kB 00:00 2023-10-06T03:20:50.720 INFO:teuthology.orchestra.run.smithi083.stdout:(4/120): ceph-mds-17.2.6-1296.g736ac5ba.el8.x86 3.3 MB/s | 2.3 MB 00:00 2023-10-06T03:20:51.149 INFO:teuthology.orchestra.run.smithi083.stdout:(5/120): ceph-mgr-17.2.6-1296.g736ac5ba.el8.x86 3.7 MB/s | 1.6 MB 00:00 2023-10-06T03:20:51.242 INFO:teuthology.orchestra.run.smithi083.stdout:(6/120): ceph-base-17.2.6-1296.g736ac5ba.el8.x8 2.5 MB/s | 5.2 MB 00:02 2023-10-06T03:20:52.180 INFO:teuthology.orchestra.run.smithi083.stdout:(7/120): ceph-mon-17.2.6-1296.g736ac5ba.el8.x86 3.8 MB/s | 3.9 MB 00:01 2023-10-06T03:20:52.629 INFO:teuthology.orchestra.run.smithi081.stdout:(10/120): ceph-radosgw-17.2.6-1296.g736ac5ba.el 5.6 MB/s | 17 MB 00:02 2023-10-06T03:20:52.732 INFO:teuthology.orchestra.run.smithi081.stdout:(11/120): cephfs-mirror-17.2.6-1296.g736ac5ba.e 2.4 MB/s | 255 kB 00:00 2023-10-06T03:20:52.790 INFO:teuthology.orchestra.run.smithi081.stdout:(12/120): libcephfs-devel-17.2.6-1296.g736ac5ba 435 kB/s | 25 kB 00:00 2023-10-06T03:20:52.983 INFO:teuthology.orchestra.run.smithi081.stdout:(13/120): libcephfs2-17.2.6-1296.g736ac5ba.el8. 4.0 MB/s | 797 kB 00:00 2023-10-06T03:20:53.044 INFO:teuthology.orchestra.run.smithi081.stdout:(14/120): libcephsqlite-17.2.6-1296.g736ac5ba.e 2.8 MB/s | 174 kB 00:00 2023-10-06T03:20:53.103 INFO:teuthology.orchestra.run.smithi081.stdout:(15/120): librados-devel-17.2.6-1296.g736ac5ba. 2.1 MB/s | 130 kB 00:00 2023-10-06T03:20:53.230 INFO:teuthology.orchestra.run.smithi081.stdout:(16/120): libradosstriper1-17.2.6-1296.g736ac5b 3.9 MB/s | 507 kB 00:00 2023-10-06T03:20:53.767 INFO:teuthology.orchestra.run.smithi081.stdout:(17/120): ceph-test-17.2.6-1296.g736ac5ba.el8.x 13 MB/s | 52 MB 00:03 2023-10-06T03:20:53.809 INFO:teuthology.orchestra.run.smithi081.stdout:(18/120): python3-ceph-argparse-17.2.6-1296.g73 1.1 MB/s | 45 kB 00:00 2023-10-06T03:20:53.857 INFO:teuthology.orchestra.run.smithi081.stdout:(19/120): python3-ceph-common-17.2.6-1296.g736a 2.4 MB/s | 115 kB 00:00 2023-10-06T03:20:53.906 INFO:teuthology.orchestra.run.smithi081.stdout:(20/120): python3-cephfs-17.2.6-1296.g736ac5ba. 3.8 MB/s | 190 kB 00:00 2023-10-06T03:20:53.962 INFO:teuthology.orchestra.run.smithi081.stdout:(21/120): python3-rados-17.2.6-1296.g736ac5ba.e 6.5 MB/s | 371 kB 00:00 2023-10-06T03:20:54.020 INFO:teuthology.orchestra.run.smithi081.stdout:(22/120): python3-rbd-17.2.6-1296.g736ac5ba.el8 6.1 MB/s | 358 kB 00:00 2023-10-06T03:20:54.060 INFO:teuthology.orchestra.run.smithi081.stdout:(23/120): librgw2-17.2.6-1296.g736ac5ba.el8.x86 6.7 MB/s | 5.6 MB 00:00 2023-10-06T03:20:54.069 INFO:teuthology.orchestra.run.smithi081.stdout:(24/120): python3-rgw-17.2.6-1296.g736ac5ba.el8 2.1 MB/s | 107 kB 00:00 2023-10-06T03:20:54.087 INFO:teuthology.orchestra.run.smithi081.stdout:(25/120): rbd-fuse-17.2.6-1296.g736ac5ba.el8.x8 3.3 MB/s | 90 kB 00:00 2023-10-06T03:20:54.150 INFO:teuthology.orchestra.run.smithi081.stdout:(26/120): rbd-nbd-17.2.6-1296.g736ac5ba.el8.x86 2.7 MB/s | 173 kB 00:00 2023-10-06T03:20:54.208 INFO:teuthology.orchestra.run.smithi081.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1296.g 395 kB/s | 23 kB 00:00 2023-10-06T03:20:54.270 INFO:teuthology.orchestra.run.smithi081.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1296.g736ac5b 1.9 MB/s | 121 kB 00:00 2023-10-06T03:20:54.328 INFO:teuthology.orchestra.run.smithi081.stdout:(29/120): rbd-mirror-17.2.6-1296.g736ac5ba.el8. 13 MB/s | 3.5 MB 00:00 2023-10-06T03:20:54.551 INFO:teuthology.orchestra.run.smithi083.stdout:(8/120): ceph-osd-17.2.6-1296.g736ac5ba.el8.x86 5.1 MB/s | 17 MB 00:03 2023-10-06T03:20:54.611 INFO:teuthology.orchestra.run.smithi083.stdout:(9/120): ceph-selinux-17.2.6-1296.g736ac5ba.el8 409 kB/s | 24 kB 00:00 2023-10-06T03:20:54.612 INFO:teuthology.orchestra.run.smithi081.stdout:(30/120): ceph-mgr-dashboard-17.2.6-1296.g736ac 5.0 MB/s | 1.7 MB 00:00 2023-10-06T03:20:54.681 INFO:teuthology.orchestra.run.smithi081.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1296.g73 3.4 MB/s | 238 kB 00:00 2023-10-06T03:20:54.745 INFO:teuthology.orchestra.run.smithi081.stdout:(32/120): ceph-mgr-rook-17.2.6-1296.g736ac5ba.e 739 kB/s | 47 kB 00:00 2023-10-06T03:20:54.802 INFO:teuthology.orchestra.run.smithi081.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1296.g7 255 kB/s | 14 kB 00:00 2023-10-06T03:20:54.870 INFO:teuthology.orchestra.run.smithi081.stdout:(34/120): ceph-volume-17.2.6-1296.g736ac5ba.el8 3.9 MB/s | 267 kB 00:00 2023-10-06T03:20:54.905 INFO:teuthology.orchestra.run.smithi081.stdout:(35/120): ceph-mgr-diskprediction-local-17.2.6- 13 MB/s | 7.4 MB 00:00 2023-10-06T03:20:54.910 INFO:teuthology.orchestra.run.smithi081.stdout:(36/120): cephadm-17.2.6-1296.g736ac5ba.el8.noa 1.9 MB/s | 80 kB 00:00 2023-10-06T03:20:54.937 INFO:teuthology.orchestra.run.smithi081.stdout:(37/120): cephfs-top-17.2.6-1296.g736ac5ba.el8. 552 kB/s | 18 kB 00:00 2023-10-06T03:20:55.204 INFO:teuthology.orchestra.run.smithi083.stdout:(10/120): ceph-radosgw-17.2.6-1296.g736ac5ba.el 5.5 MB/s | 17 MB 00:03 2023-10-06T03:20:55.246 INFO:teuthology.orchestra.run.smithi083.stdout:(11/120): cephfs-mirror-17.2.6-1296.g736ac5ba.e 6.1 MB/s | 255 kB 00:00 2023-10-06T03:20:55.281 INFO:teuthology.orchestra.run.smithi081.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 171 kB/s | 59 kB 00:00 2023-10-06T03:20:55.282 INFO:teuthology.orchestra.run.smithi083.stdout:(12/120): libcephfs-devel-17.2.6-1296.g736ac5ba 686 kB/s | 25 kB 00:00 2023-10-06T03:20:55.375 INFO:teuthology.orchestra.run.smithi083.stdout:(13/120): libcephfs2-17.2.6-1296.g736ac5ba.el8. 8.4 MB/s | 797 kB 00:00 2023-10-06T03:20:55.413 INFO:teuthology.orchestra.run.smithi083.stdout:(14/120): libcephsqlite-17.2.6-1296.g736ac5ba.e 4.5 MB/s | 174 kB 00:00 2023-10-06T03:20:55.437 INFO:teuthology.orchestra.run.smithi081.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 482 kB/s | 75 kB 00:00 2023-10-06T03:20:55.447 INFO:teuthology.orchestra.run.smithi081.stdout:(40/120): gperftools-libs-2.7-9.el8.x86_64.rpm 570 kB/s | 306 kB 00:00 2023-10-06T03:20:55.451 INFO:teuthology.orchestra.run.smithi083.stdout:(15/120): librados-devel-17.2.6-1296.g736ac5ba. 3.4 MB/s | 130 kB 00:00 2023-10-06T03:20:55.525 INFO:teuthology.orchestra.run.smithi083.stdout:(16/120): libradosstriper1-17.2.6-1296.g736ac5b 6.7 MB/s | 507 kB 00:00 2023-10-06T03:20:55.533 INFO:teuthology.orchestra.run.smithi081.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 511 kB/s | 44 kB 00:00 2023-10-06T03:20:55.644 INFO:teuthology.orchestra.run.smithi081.stdout:(42/120): python3-beautifulsoup4-4.6.3-2.el8.1. 1.6 MB/s | 185 kB 00:00 2023-10-06T03:20:55.700 INFO:teuthology.orchestra.run.smithi081.stdout:(43/120): python3-asyncssh-2.7.0-2.el8.noarch.r 1.8 MB/s | 476 kB 00:00 2023-10-06T03:20:55.728 INFO:teuthology.orchestra.run.smithi081.stdout:(44/120): python3-cachetools-3.1.1-4.el8.noarch 396 kB/s | 33 kB 00:00 2023-10-06T03:20:55.779 INFO:teuthology.orchestra.run.smithi081.stdout:(45/120): python3-certifi-2018.10.15-7.el8.noar 208 kB/s | 16 kB 00:00 2023-10-06T03:20:55.836 INFO:teuthology.orchestra.run.smithi081.stdout:(46/120): python3-cheroot-8.5.2-1.el8.noarch.rp 1.6 MB/s | 173 kB 00:00 2023-10-06T03:20:55.896 INFO:teuthology.orchestra.run.smithi081.stdout:(47/120): python3-cherrypy-18.4.0-1.el8.noarch. 3.2 MB/s | 384 kB 00:00 2023-10-06T03:20:55.928 INFO:teuthology.orchestra.run.smithi081.stdout:(48/120): python3-google-auth-1.1.1-10.el8.noar 886 kB/s | 81 kB 00:00 2023-10-06T03:20:55.975 INFO:teuthology.orchestra.run.smithi081.stdout:(49/120): python3-jaraco-6.2-6.el8.noarch.rpm 141 kB/s | 11 kB 00:00 2023-10-06T03:20:56.009 INFO:teuthology.orchestra.run.smithi081.stdout:(50/120): python3-jaraco-functools-2.0-4.el8.no 218 kB/s | 18 kB 00:00 2023-10-06T03:20:56.096 INFO:teuthology.orchestra.run.smithi081.stdout:(51/120): python3-logutils-0.3.5-11.el8.noarch. 561 kB/s | 49 kB 00:00 2023-10-06T03:20:56.125 INFO:teuthology.orchestra.run.smithi083.stdout:(17/120): librgw2-17.2.6-1296.g736ac5ba.el8.x86 9.3 MB/s | 5.6 MB 00:00 2023-10-06T03:20:56.168 INFO:teuthology.orchestra.run.smithi083.stdout:(18/120): python3-ceph-argparse-17.2.6-1296.g73 1.0 MB/s | 45 kB 00:00 2023-10-06T03:20:56.182 INFO:teuthology.orchestra.run.smithi081.stdout:(52/120): python3-kubernetes-11.0.0-6.el8.noarc 5.6 MB/s | 1.2 MB 00:00 2023-10-06T03:20:56.183 INFO:teuthology.orchestra.run.smithi081.stdout:(53/120): python3-more-itertools-7.2.0-3.el8.no 673 kB/s | 59 kB 00:00 2023-10-06T03:20:56.210 INFO:teuthology.orchestra.run.smithi083.stdout:(19/120): python3-ceph-common-17.2.6-1296.g736a 2.8 MB/s | 115 kB 00:00 2023-10-06T03:20:56.251 INFO:teuthology.orchestra.run.smithi083.stdout:(20/120): python3-cephfs-17.2.6-1296.g736ac5ba. 4.5 MB/s | 190 kB 00:00 2023-10-06T03:20:56.262 INFO:teuthology.orchestra.run.smithi081.stdout:(54/120): python3-natsort-7.1.1-2.el8.noarch.rp 759 kB/s | 60 kB 00:00 2023-10-06T03:20:56.300 INFO:teuthology.orchestra.run.smithi083.stdout:(21/120): python3-rados-17.2.6-1296.g736ac5ba.e 7.6 MB/s | 371 kB 00:00 2023-10-06T03:20:56.312 INFO:teuthology.orchestra.run.smithi081.stdout:(55/120): python3-pecan-1.3.2-9.el8.noarch.rpm 2.1 MB/s | 283 kB 00:00 2023-10-06T03:20:56.346 INFO:teuthology.orchestra.run.smithi083.stdout:(22/120): python3-rbd-17.2.6-1296.g736ac5ba.el8 7.6 MB/s | 358 kB 00:00 2023-10-06T03:20:56.359 INFO:teuthology.orchestra.run.smithi081.stdout:(56/120): python3-portend-2.6-1.el8.noarch.rpm 162 kB/s | 16 kB 00:00 2023-10-06T03:20:56.384 INFO:teuthology.orchestra.run.smithi083.stdout:(23/120): python3-rgw-17.2.6-1296.g736ac5ba.el8 2.8 MB/s | 107 kB 00:00 2023-10-06T03:20:56.395 INFO:teuthology.orchestra.run.smithi081.stdout:(57/120): python3-repoze-lru-0.7-6.el8.noarch.r 407 kB/s | 34 kB 00:00 2023-10-06T03:20:56.422 INFO:teuthology.orchestra.run.smithi083.stdout:(24/120): rbd-fuse-17.2.6-1296.g736ac5ba.el8.x8 2.3 MB/s | 90 kB 00:00 2023-10-06T03:20:56.443 INFO:teuthology.orchestra.run.smithi081.stdout:(58/120): python3-routes-2.4.1-12.el8.noarch.rp 2.3 MB/s | 196 kB 00:00 2023-10-06T03:20:56.483 INFO:teuthology.orchestra.run.smithi081.stdout:(59/120): python3-rsa-4.9-2.el8.noarch.rpm 738 kB/s | 64 kB 00:00 2023-10-06T03:20:56.522 INFO:teuthology.orchestra.run.smithi081.stdout:(60/120): python3-simplegeneric-0.8.1-17.el8.no 239 kB/s | 19 kB 00:00 2023-10-06T03:20:56.564 INFO:teuthology.orchestra.run.smithi081.stdout:(61/120): python3-singledispatch-3.4.0.3-18.el8 295 kB/s | 24 kB 00:00 2023-10-06T03:20:56.600 INFO:teuthology.orchestra.run.smithi081.stdout:(62/120): python3-tempora-1.14.1-5.el8.noarch.r 373 kB/s | 29 kB 00:00 2023-10-06T03:20:56.646 INFO:teuthology.orchestra.run.smithi081.stdout:(63/120): python3-trustme-0.6.0-4.el8.noarch.rp 336 kB/s | 27 kB 00:00 2023-10-06T03:20:56.687 INFO:teuthology.orchestra.run.smithi081.stdout:(64/120): python3-waitress-1.4.3-1.el8.noarch.r 2.9 MB/s | 255 kB 00:00 2023-10-06T03:20:56.763 INFO:teuthology.orchestra.run.smithi081.stdout:(65/120): python3-webob-1.8.5-1.el8.1.noarch.rp 2.1 MB/s | 251 kB 00:00 2023-10-06T03:20:56.767 INFO:teuthology.orchestra.run.smithi081.stdout:(66/120): python3-websocket-client-0.56.0-5.el8 771 kB/s | 61 kB 00:00 2023-10-06T03:20:56.814 INFO:teuthology.orchestra.run.smithi083.stdout:(25/120): rbd-mirror-17.2.6-1296.g736ac5ba.el8. 8.8 MB/s | 3.5 MB 00:00 2023-10-06T03:20:56.845 INFO:teuthology.orchestra.run.smithi081.stdout:(67/120): python3-zc-lockfile-2.0-2.el8.noarch. 294 kB/s | 23 kB 00:00 2023-10-06T03:20:56.854 INFO:teuthology.orchestra.run.smithi081.stdout:(68/120): python3-webtest-2.0.33-1.el8.noarch.r 938 kB/s | 85 kB 00:00 2023-10-06T03:20:56.858 INFO:teuthology.orchestra.run.smithi083.stdout:(26/120): rbd-nbd-17.2.6-1296.g736ac5ba.el8.x86 3.9 MB/s | 173 kB 00:00 2023-10-06T03:20:56.868 INFO:teuthology.orchestra.run.smithi081.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 5.2 MB/s | 70 kB 00:00 2023-10-06T03:20:56.895 INFO:teuthology.orchestra.run.smithi083.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1296.g 634 kB/s | 23 kB 00:00 2023-10-06T03:20:56.932 INFO:teuthology.orchestra.run.smithi083.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1296.g736ac5b 3.2 MB/s | 121 kB 00:00 2023-10-06T03:20:56.998 INFO:teuthology.orchestra.run.smithi081.stdout:(70/120): thrift-0.13.0-2.el8.x86_64.rpm 11 MB/s | 1.7 MB 00:00 2023-10-06T03:20:57.026 INFO:teuthology.orchestra.run.smithi081.stdout:(71/120): python3-prettytable-0.7.2-14.el8.noar 1.6 MB/s | 44 kB 00:00 2023-10-06T03:20:57.039 INFO:teuthology.orchestra.run.smithi081.stdout:(72/120): python3-jsonpatch-1.21-2.el8.noarch.r 2.0 MB/s | 27 kB 00:00 2023-10-06T03:20:57.055 INFO:teuthology.orchestra.run.smithi081.stdout:(73/120): jq-1.5-12.el8.x86_64.rpm 10 MB/s | 161 kB 00:00 2023-10-06T03:20:57.078 INFO:teuthology.orchestra.run.smithi081.stdout:(74/120): flex-2.6.1-9.el8.x86_64.rpm 13 MB/s | 320 kB 00:00 2023-10-06T03:20:57.103 INFO:teuthology.orchestra.run.smithi081.stdout:(75/120): python3-werkzeug-0.12.2-4.el8.noarch. 18 MB/s | 457 kB 00:00 2023-10-06T03:20:57.135 INFO:teuthology.orchestra.run.smithi083.stdout:(29/120): ceph-mgr-dashboard-17.2.6-1296.g736ac 8.4 MB/s | 1.7 MB 00:00 2023-10-06T03:20:57.165 INFO:teuthology.orchestra.run.smithi081.stdout:(76/120): python3-scipy-1.0.0-20.module+el8.1.0 49 MB/s | 15 MB 00:00 2023-10-06T03:20:57.181 INFO:teuthology.orchestra.run.smithi081.stdout:(77/120): python3-markupsafe-0.23-19.el8.x86_64 2.5 MB/s | 39 kB 00:00 2023-10-06T03:20:57.209 INFO:teuthology.orchestra.run.smithi081.stdout:(78/120): bison-3.0.4-10.el8.x86_64.rpm 24 MB/s | 688 kB 00:00 2023-10-06T03:20:57.228 INFO:teuthology.orchestra.run.smithi081.stdout:(79/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 13 MB/s | 259 kB 00:00 2023-10-06T03:20:57.251 INFO:teuthology.orchestra.run.smithi081.stdout:(80/120): python3-babel-2.5.1-5.el8.noarch.rpm 32 MB/s | 4.8 MB 00:00 2023-10-06T03:20:57.255 INFO:teuthology.orchestra.run.smithi081.stdout:(81/120): python3-numpy-f2py-1.14.3-9.el8.x86_6 8.2 MB/s | 225 kB 00:00 2023-10-06T03:20:57.268 INFO:teuthology.orchestra.run.smithi081.stdout:(82/120): python3-pyasn1-0.3.7-6.el8.noarch.rpm 7.2 MB/s | 126 kB 00:00 2023-10-06T03:20:57.289 INFO:teuthology.orchestra.run.smithi081.stdout:(83/120): oniguruma-6.8.2-2.el8.x86_64.rpm 9.2 MB/s | 187 kB 00:00 2023-10-06T03:20:57.316 INFO:teuthology.orchestra.run.smithi081.stdout:(84/120): python3-jinja2-2.10.1-2.el8_0.noarch. 19 MB/s | 538 kB 00:00 2023-10-06T03:20:57.342 INFO:teuthology.orchestra.run.smithi081.stdout:(85/120): python3-numpy-1.14.3-9.el8.x86_64.rpm 43 MB/s | 3.7 MB 00:00 2023-10-06T03:20:57.348 INFO:teuthology.orchestra.run.smithi081.stdout:(86/120): socat-1.7.3.3-2.el8.x86_64.rpm 9.3 MB/s | 302 kB 00:00 2023-10-06T03:20:57.358 INFO:teuthology.orchestra.run.smithi081.stdout:(87/120): python3-mako-1.0.6-13.el8.noarch.rpm 10 MB/s | 157 kB 00:00 2023-10-06T03:20:57.362 INFO:teuthology.orchestra.run.smithi081.stdout:(88/120): python3-pyasn1-modules-0.3.7-6.el8.no 7.6 MB/s | 110 kB 00:00 2023-10-06T03:20:57.376 INFO:teuthology.orchestra.run.smithi081.stdout:(89/120): librdkafka-0.11.4-1.el8.x86_64.rpm 20 MB/s | 353 kB 00:00 2023-10-06T03:20:57.376 INFO:teuthology.orchestra.run.smithi081.stdout:(90/120): python3-jsonpointer-1.10-11.el8.noarc 1.4 MB/s | 20 kB 00:00 2023-10-06T03:20:57.391 INFO:teuthology.orchestra.run.smithi081.stdout:(91/120): python3-pytz-2017.2-9.el8.noarch.rpm 3.8 MB/s | 54 kB 00:00 2023-10-06T03:20:57.401 INFO:teuthology.orchestra.run.smithi081.stdout:(92/120): libtool-2.4.6-25.el8.x86_64.rpm 28 MB/s | 709 kB 00:00 2023-10-06T03:20:57.498 INFO:teuthology.orchestra.run.smithi081.stdout:(93/120): openblas-threads-0.3.12-1.el8.x86_64. 44 MB/s | 4.7 MB 00:00 2023-10-06T03:20:57.522 INFO:teuthology.orchestra.run.smithi081.stdout:(94/120): openblas-0.3.12-1.el8.x86_64.rpm 38 MB/s | 4.6 MB 00:00 2023-10-06T03:20:57.534 INFO:teuthology.orchestra.run.smithi081.stdout:(95/120): automake-1.16.1-7.el8.noarch.rpm 19 MB/s | 713 kB 00:00 2023-10-06T03:20:57.549 INFO:teuthology.orchestra.run.smithi081.stdout:(96/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 715 kB/s | 19 kB 00:00 2023-10-06T03:20:57.562 INFO:teuthology.orchestra.run.smithi081.stdout:(97/120): python3-jwt-1.6.1-2.el8.noarch.rpm 1.5 MB/s | 43 kB 00:00 2023-10-06T03:20:57.574 INFO:teuthology.orchestra.run.smithi081.stdout:(98/120): python3-oauthlib-2.1.0-1.el8.noarch.r 6.1 MB/s | 155 kB 00:00 2023-10-06T03:20:57.600 INFO:teuthology.orchestra.run.smithi081.stdout:(99/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 5.7 MB/s | 220 kB 00:00 2023-10-06T03:20:57.607 INFO:teuthology.orchestra.run.smithi081.stdout:(100/120): keyutils-libs-devel-1.5.10-6.el8.x86 1.4 MB/s | 48 kB 00:00 2023-10-06T03:20:57.632 INFO:teuthology.orchestra.run.smithi081.stdout:(101/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 7.1 MB/s | 229 kB 00:00 2023-10-06T03:20:57.635 INFO:teuthology.orchestra.run.smithi081.stdout:(102/120): python3-requests-oauthlib-1.0.0-1.el 1.5 MB/s | 43 kB 00:00 2023-10-06T03:20:57.664 INFO:teuthology.orchestra.run.smithi081.stdout:(103/120): libverto-devel-0.3.0-5.el8.x86_64.rp 616 kB/s | 18 kB 00:00 2023-10-06T03:20:57.700 INFO:teuthology.orchestra.run.smithi081.stdout:(104/120): openssl-devel-1.1.1g-15.el8_3.x86_64 34 MB/s | 2.3 MB 00:00 2023-10-06T03:20:57.707 INFO:teuthology.orchestra.run.smithi081.stdout:(105/120): pcre2-devel-10.32-2.el8.x86_64.rpm 14 MB/s | 605 kB 00:00 2023-10-06T03:20:57.730 INFO:teuthology.orchestra.run.smithi081.stdout:(106/120): fuse-2.9.7-12.el8.x86_64.rpm 2.7 MB/s | 83 kB 00:00 2023-10-06T03:20:57.736 INFO:teuthology.orchestra.run.smithi081.stdout:(107/120): elfutils-libelf-devel-0.182-3.el8.x8 2.0 MB/s | 59 kB 00:00 2023-10-06T03:20:57.756 INFO:teuthology.orchestra.run.smithi081.stdout:(108/120): libquadmath-8.4.1-1.el8.x86_64.rpm 6.4 MB/s | 169 kB 00:00 2023-10-06T03:20:57.761 INFO:teuthology.orchestra.run.smithi081.stdout:(109/120): libcom_err-devel-1.45.6-1.el8.x86_64 1.5 MB/s | 38 kB 00:00 2023-10-06T03:20:57.782 INFO:teuthology.orchestra.run.smithi081.stdout:(110/120): libsepol-devel-2.9-2.el8.x86_64.rpm 3.3 MB/s | 86 kB 00:00 2023-10-06T03:20:57.787 INFO:teuthology.orchestra.run.smithi081.stdout:(111/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 2.2 MB/s | 58 kB 00:00 2023-10-06T03:20:57.806 INFO:teuthology.orchestra.run.smithi081.stdout:(112/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.9 MB/s | 47 kB 00:00 2023-10-06T03:20:57.818 INFO:teuthology.orchestra.run.smithi081.stdout:(113/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.r 18 MB/s | 559 kB 00:00 2023-10-06T03:20:57.850 INFO:teuthology.orchestra.run.smithi081.stdout:(114/120): libgfortran-8.4.1-1.el8.x86_64.rpm 14 MB/s | 639 kB 00:00 2023-10-06T03:20:57.851 INFO:teuthology.orchestra.run.smithi081.stdout:(115/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rp 2.1 MB/s | 70 kB 00:00 2023-10-06T03:20:57.878 INFO:teuthology.orchestra.run.smithi081.stdout:(116/120): libuuid-devel-2.32.1-27.el8.x86_64.r 3.6 MB/s | 97 kB 00:00 2023-10-06T03:20:57.880 INFO:teuthology.orchestra.run.smithi081.stdout:(117/120): libselinux-devel-2.9-5.el8.x86_64.rp 6.7 MB/s | 200 kB 00:00 2023-10-06T03:20:57.938 INFO:teuthology.orchestra.run.smithi081.stdout:(118/120): ceph-osd-17.2.6-1296.g736ac5ba.el8.x 2.0 MB/s | 17 MB 00:08 2023-10-06T03:20:57.971 INFO:teuthology.orchestra.run.smithi083.stdout:(30/120): ceph-mgr-diskprediction-local-17.2.6- 8.8 MB/s | 7.4 MB 00:00 2023-10-06T03:20:58.027 INFO:teuthology.orchestra.run.smithi083.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1296.g73 4.2 MB/s | 238 kB 00:00 2023-10-06T03:20:58.075 INFO:teuthology.orchestra.run.smithi083.stdout:(32/120): ceph-mgr-rook-17.2.6-1296.g736ac5ba.e 982 kB/s | 47 kB 00:00 2023-10-06T03:20:58.133 INFO:teuthology.orchestra.run.smithi083.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1296.g7 254 kB/s | 14 kB 00:00 2023-10-06T03:20:58.211 INFO:teuthology.orchestra.run.smithi083.stdout:(34/120): ceph-volume-17.2.6-1296.g736ac5ba.el8 3.4 MB/s | 267 kB 00:00 2023-10-06T03:20:58.289 INFO:teuthology.orchestra.run.smithi083.stdout:(35/120): cephadm-17.2.6-1296.g736ac5ba.el8.noa 1.0 MB/s | 80 kB 00:00 2023-10-06T03:20:58.367 INFO:teuthology.orchestra.run.smithi083.stdout:(36/120): cephfs-top-17.2.6-1296.g736ac5ba.el8. 230 kB/s | 18 kB 00:00 2023-10-06T03:20:58.370 INFO:teuthology.orchestra.run.smithi081.stdout:(119/120): librbd1-17.2.6-1296.g736ac5ba.el8.x8 7.3 MB/s | 3.6 MB 00:00 2023-10-06T03:20:58.433 INFO:teuthology.orchestra.run.smithi081.stdout:(120/120): librados2-17.2.6-1296.g736ac5ba.el8. 6.2 MB/s | 3.5 MB 00:00 2023-10-06T03:20:58.437 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2023-10-06T03:20:58.437 INFO:teuthology.orchestra.run.smithi081.stdout:Total 20 MB/s | 201 MB 00:10 2023-10-06T03:20:58.506 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2023-10-06T03:20:58.630 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2023-10-06T03:20:58.630 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2023-10-06T03:20:58.712 INFO:teuthology.orchestra.run.smithi083.stdout:(37/120): gperftools-libs-2.7-9.el8.x86_64.rpm 889 kB/s | 306 kB 00:00 2023-10-06T03:20:58.770 INFO:teuthology.orchestra.run.smithi083.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 1.0 MB/s | 59 kB 00:00 2023-10-06T03:20:58.959 INFO:teuthology.orchestra.run.smithi083.stdout:(39/120): ceph-test-17.2.6-1296.g736ac5ba.el8.x 12 MB/s | 52 MB 00:04 2023-10-06T03:20:58.960 INFO:teuthology.orchestra.run.smithi083.stdout:(40/120): libunwind-1.3.1-3.el8.x86_64.rpm 394 kB/s | 75 kB 00:00 2023-10-06T03:20:59.039 INFO:teuthology.orchestra.run.smithi083.stdout:(41/120): ceph-common-17.2.6-1296.g736ac5ba.el8 2.4 MB/s | 23 MB 00:09 2023-10-06T03:20:59.040 INFO:teuthology.orchestra.run.smithi083.stdout:(42/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 550 kB/s | 44 kB 00:00 2023-10-06T03:20:59.092 INFO:teuthology.orchestra.run.smithi083.stdout:(43/120): python3-cachetools-3.1.1-4.el8.noarch 638 kB/s | 33 kB 00:00 2023-10-06T03:20:59.367 INFO:teuthology.orchestra.run.smithi083.stdout:(44/120): python3-beautifulsoup4-4.6.3-2.el8.1. 565 kB/s | 185 kB 00:00 2023-10-06T03:20:59.397 INFO:teuthology.orchestra.run.smithi083.stdout:(45/120): python3-certifi-2018.10.15-7.el8.noar 53 kB/s | 16 kB 00:00 2023-10-06T03:20:59.496 INFO:teuthology.orchestra.run.smithi083.stdout:(46/120): python3-cherrypy-18.4.0-1.el8.noarch. 3.8 MB/s | 384 kB 00:00 2023-10-06T03:20:59.553 INFO:teuthology.orchestra.run.smithi083.stdout:(47/120): python3-google-auth-1.1.1-10.el8.noar 1.4 MB/s | 81 kB 00:00 2023-10-06T03:20:59.603 INFO:teuthology.orchestra.run.smithi083.stdout:(48/120): python3-jaraco-6.2-6.el8.noarch.rpm 224 kB/s | 11 kB 00:00 2023-10-06T03:20:59.653 INFO:teuthology.orchestra.run.smithi083.stdout:(49/120): python3-jaraco-functools-2.0-4.el8.no 353 kB/s | 18 kB 00:00 2023-10-06T03:20:59.686 INFO:teuthology.orchestra.run.smithi083.stdout:(50/120): python3-asyncssh-2.7.0-2.el8.noarch.r 655 kB/s | 476 kB 00:00 2023-10-06T03:20:59.735 INFO:teuthology.orchestra.run.smithi083.stdout:(51/120): python3-cheroot-8.5.2-1.el8.noarch.rp 470 kB/s | 173 kB 00:00 2023-10-06T03:20:59.749 INFO:teuthology.orchestra.run.smithi083.stdout:(52/120): python3-logutils-0.3.5-11.el8.noarch. 775 kB/s | 49 kB 00:00 2023-10-06T03:20:59.791 INFO:teuthology.orchestra.run.smithi083.stdout:(53/120): python3-more-itertools-7.2.0-3.el8.no 1.0 MB/s | 59 kB 00:00 2023-10-06T03:20:59.801 INFO:teuthology.orchestra.run.smithi083.stdout:(54/120): python3-kubernetes-11.0.0-6.el8.noarc 7.9 MB/s | 1.2 MB 00:00 2023-10-06T03:20:59.807 INFO:teuthology.orchestra.run.smithi083.stdout:(55/120): python3-natsort-7.1.1-2.el8.noarch.rp 1.0 MB/s | 60 kB 00:00 2023-10-06T03:20:59.853 INFO:teuthology.orchestra.run.smithi083.stdout:(56/120): python3-portend-2.6-1.el8.noarch.rpm 305 kB/s | 16 kB 00:00 2023-10-06T03:20:59.861 INFO:teuthology.orchestra.run.smithi083.stdout:(57/120): python3-repoze-lru-0.7-6.el8.noarch.r 629 kB/s | 34 kB 00:00 2023-10-06T03:20:59.885 INFO:teuthology.orchestra.run.smithi083.stdout:(58/120): python3-pecan-1.3.2-9.el8.noarch.rpm 3.0 MB/s | 283 kB 00:00 2023-10-06T03:20:59.907 INFO:teuthology.orchestra.run.smithi083.stdout:(59/120): python3-routes-2.4.1-12.el8.noarch.rp 3.5 MB/s | 196 kB 00:00 2023-10-06T03:20:59.936 INFO:teuthology.orchestra.run.smithi083.stdout:(60/120): python3-simplegeneric-0.8.1-17.el8.no 370 kB/s | 19 kB 00:00 2023-10-06T03:21:00.211 INFO:teuthology.orchestra.run.smithi083.stdout:(61/120): python3-singledispatch-3.4.0.3-18.el8 79 kB/s | 24 kB 00:00 2023-10-06T03:21:00.248 INFO:teuthology.orchestra.run.smithi083.stdout:(62/120): python3-tempora-1.14.1-5.el8.noarch.r 94 kB/s | 29 kB 00:00 2023-10-06T03:21:00.255 INFO:teuthology.orchestra.run.smithi083.stdout:(63/120): python3-rsa-4.9-2.el8.noarch.rpm 163 kB/s | 64 kB 00:00 2023-10-06T03:21:00.262 INFO:teuthology.orchestra.run.smithi083.stdout:(64/120): python3-trustme-0.6.0-4.el8.noarch.rp 542 kB/s | 27 kB 00:00 2023-10-06T03:21:00.312 INFO:teuthology.orchestra.run.smithi083.stdout:(65/120): python3-websocket-client-0.56.0-5.el8 1.2 MB/s | 61 kB 00:00 2023-10-06T03:21:00.325 INFO:teuthology.orchestra.run.smithi083.stdout:(66/120): python3-waitress-1.4.3-1.el8.noarch.r 3.2 MB/s | 255 kB 00:00 2023-10-06T03:21:00.365 INFO:teuthology.orchestra.run.smithi083.stdout:(67/120): python3-webtest-2.0.33-1.el8.noarch.r 1.6 MB/s | 85 kB 00:00 2023-10-06T03:21:00.384 INFO:teuthology.orchestra.run.smithi083.stdout:(68/120): python3-webob-1.8.5-1.el8.1.noarch.rp 1.9 MB/s | 251 kB 00:00 2023-10-06T03:21:00.389 INFO:teuthology.orchestra.run.smithi083.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 15 MB/s | 70 kB 00:00 2023-10-06T03:21:00.418 INFO:teuthology.orchestra.run.smithi083.stdout:(70/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 646 kB/s | 19 kB 00:00 2023-10-06T03:21:00.427 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2023-10-06T03:21:00.432 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2023-10-06T03:21:00.432 INFO:teuthology.orchestra.run.smithi083.stdout:(71/120): python3-jwt-1.6.1-2.el8.noarch.rpm 3.0 MB/s | 43 kB 00:00 2023-10-06T03:21:00.452 INFO:teuthology.orchestra.run.smithi083.stdout:(72/120): python3-oauthlib-2.1.0-1.el8.noarch.r 7.8 MB/s | 155 kB 00:00 2023-10-06T03:21:00.467 INFO:teuthology.orchestra.run.smithi083.stdout:(73/120): thrift-0.13.0-2.el8.x86_64.rpm 17 MB/s | 1.7 MB 00:00 2023-10-06T03:21:00.477 INFO:teuthology.orchestra.run.smithi083.stdout:(74/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 8.7 MB/s | 220 kB 00:00 2023-10-06T03:21:00.502 INFO:teuthology.orchestra.run.smithi083.stdout:(75/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 9.4 MB/s | 229 kB 00:00 2023-10-06T03:21:00.518 INFO:teuthology.orchestra.run.smithi083.stdout:(76/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 947 kB/s | 48 kB 00:00 2023-10-06T03:21:00.524 INFO:teuthology.orchestra.run.smithi083.stdout:(77/120): python3-requests-oauthlib-1.0.0-1.el8 1.9 MB/s | 43 kB 00:00 2023-10-06T03:21:00.544 INFO:teuthology.orchestra.run.smithi083.stdout:(78/120): libverto-devel-0.3.0-5.el8.x86_64.rpm 911 kB/s | 18 kB 00:00 2023-10-06T03:21:00.575 INFO:teuthology.orchestra.run.smithi083.stdout:(79/120): pcre2-devel-10.32-2.el8.x86_64.rpm 19 MB/s | 605 kB 00:00 2023-10-06T03:21:00.585 INFO:teuthology.orchestra.run.smithi083.stdout:(80/120): openssl-devel-1.1.1g-15.el8_3.x86_64. 35 MB/s | 2.3 MB 00:00 2023-10-06T03:21:00.593 INFO:teuthology.orchestra.run.smithi083.stdout:(81/120): fuse-2.9.7-12.el8.x86_64.rpm 4.4 MB/s | 83 kB 00:00 2023-10-06T03:21:00.604 INFO:teuthology.orchestra.run.smithi083.stdout:(82/120): elfutils-libelf-devel-0.182-3.el8.x86 3.1 MB/s | 59 kB 00:00 2023-10-06T03:21:00.614 INFO:teuthology.orchestra.run.smithi083.stdout:(83/120): libquadmath-8.4.1-1.el8.x86_64.rpm 8.0 MB/s | 169 kB 00:00 2023-10-06T03:21:00.622 INFO:teuthology.orchestra.run.smithi083.stdout:(84/120): libcom_err-devel-1.45.6-1.el8.x86_64. 2.0 MB/s | 38 kB 00:00 2023-10-06T03:21:00.628 INFO:teuthology.orchestra.run.smithi083.stdout:(85/120): python3-zc-lockfile-2.0-2.el8.noarch. 76 kB/s | 23 kB 00:00 2023-10-06T03:21:00.633 INFO:teuthology.orchestra.run.smithi083.stdout:(86/120): libsepol-devel-2.9-2.el8.x86_64.rpm 4.7 MB/s | 86 kB 00:00 2023-10-06T03:21:00.640 INFO:teuthology.orchestra.run.smithi083.stdout:(87/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 3.3 MB/s | 58 kB 00:00 2023-10-06T03:21:00.657 INFO:teuthology.orchestra.run.smithi083.stdout:(88/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 23 MB/s | 559 kB 00:00 2023-10-06T03:21:00.667 INFO:teuthology.orchestra.run.smithi083.stdout:(89/120): libgfortran-8.4.1-1.el8.x86_64.rpm 23 MB/s | 639 kB 00:00 2023-10-06T03:21:00.669 INFO:teuthology.orchestra.run.smithi083.stdout:(90/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2023-10-06T03:21:00.672 INFO:teuthology.orchestra.run.smithi083.stdout:(91/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 4.5 MB/s | 70 kB 00:00 2023-10-06T03:21:00.689 INFO:teuthology.orchestra.run.smithi083.stdout:(92/120): libselinux-devel-2.9-5.el8.x86_64.rpm 9.3 MB/s | 200 kB 00:00 2023-10-06T03:21:00.690 INFO:teuthology.orchestra.run.smithi083.stdout:(93/120): libuuid-devel-2.32.1-27.el8.x86_64.rp 4.4 MB/s | 97 kB 00:00 2023-10-06T03:21:00.705 INFO:teuthology.orchestra.run.smithi083.stdout:(94/120): python3-prettytable-0.7.2-14.el8.noar 2.6 MB/s | 44 kB 00:00 2023-10-06T03:21:00.707 INFO:teuthology.orchestra.run.smithi083.stdout:(95/120): python3-jsonpatch-1.21-2.el8.noarch.r 1.5 MB/s | 27 kB 00:00 2023-10-06T03:21:00.727 INFO:teuthology.orchestra.run.smithi083.stdout:(96/120): jq-1.5-12.el8.x86_64.rpm 7.5 MB/s | 161 kB 00:00 2023-10-06T03:21:00.732 INFO:teuthology.orchestra.run.smithi083.stdout:(97/120): flex-2.6.1-9.el8.x86_64.rpm 13 MB/s | 320 kB 00:00 2023-10-06T03:21:00.753 INFO:teuthology.orchestra.run.smithi083.stdout:(98/120): python3-werkzeug-0.12.2-4.el8.noarch. 17 MB/s | 457 kB 00:00 2023-10-06T03:21:00.768 INFO:teuthology.orchestra.run.smithi083.stdout:(99/120): python3-markupsafe-0.23-19.el8.x86_64 2.6 MB/s | 39 kB 00:00 2023-10-06T03:21:00.802 INFO:teuthology.orchestra.run.smithi083.stdout:(100/120): bison-3.0.4-10.el8.x86_64.rpm 20 MB/s | 688 kB 00:00 2023-10-06T03:21:00.825 INFO:teuthology.orchestra.run.smithi083.stdout:(101/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 11 MB/s | 259 kB 00:00 2023-10-06T03:21:00.859 INFO:teuthology.orchestra.run.smithi083.stdout:(102/120): python3-babel-2.5.1-5.el8.noarch.rpm 38 MB/s | 4.8 MB 00:00 2023-10-06T03:21:00.863 INFO:teuthology.orchestra.run.smithi083.stdout:(103/120): python3-numpy-f2py-1.14.3-9.el8.x86_ 5.9 MB/s | 225 kB 00:00 2023-10-06T03:21:00.878 INFO:teuthology.orchestra.run.smithi083.stdout:(104/120): python3-pyasn1-0.3.7-6.el8.noarch.rp 6.7 MB/s | 126 kB 00:00 2023-10-06T03:21:00.898 INFO:teuthology.orchestra.run.smithi083.stdout:(105/120): oniguruma-6.8.2-2.el8.x86_64.rpm 9.6 MB/s | 187 kB 00:00 2023-10-06T03:21:00.925 INFO:teuthology.orchestra.run.smithi083.stdout:(106/120): python3-jinja2-2.10.1-2.el8_0.noarch 20 MB/s | 538 kB 00:00 2023-10-06T03:21:00.947 INFO:teuthology.orchestra.run.smithi083.stdout:(107/120): socat-1.7.3.3-2.el8.x86_64.rpm 14 MB/s | 302 kB 00:00 2023-10-06T03:21:00.968 INFO:teuthology.orchestra.run.smithi083.stdout:(108/120): python3-numpy-1.14.3-9.el8.x86_64.rp 36 MB/s | 3.7 MB 00:00 2023-10-06T03:21:00.972 INFO:teuthology.orchestra.run.smithi083.stdout:(109/120): python3-mako-1.0.6-13.el8.noarch.rpm 6.2 MB/s | 157 kB 00:00 2023-10-06T03:21:01.029 INFO:teuthology.orchestra.run.smithi083.stdout:(110/120): python3-scipy-1.0.0-20.module+el8.1. 41 MB/s | 15 MB 00:00 2023-10-06T03:21:01.032 INFO:teuthology.orchestra.run.smithi083.stdout:(111/120): python3-pyasn1-modules-0.3.7-6.el8.n 1.7 MB/s | 110 kB 00:00 2023-10-06T03:21:01.036 INFO:teuthology.orchestra.run.smithi083.stdout:(112/120): librdkafka-0.11.4-1.el8.x86_64.rpm 5.4 MB/s | 353 kB 00:00 2023-10-06T03:21:01.049 INFO:teuthology.orchestra.run.smithi083.stdout:(113/120): python3-jsonpointer-1.10-11.el8.noar 1.0 MB/s | 20 kB 00:00 2023-10-06T03:21:01.059 INFO:teuthology.orchestra.run.smithi083.stdout:(114/120): libtool-2.4.6-25.el8.x86_64.rpm 26 MB/s | 709 kB 00:00 2023-10-06T03:21:01.060 INFO:teuthology.orchestra.run.smithi083.stdout:(115/120): python3-pytz-2017.2-9.el8.noarch.rpm 2.2 MB/s | 54 kB 00:00 2023-10-06T03:21:01.098 INFO:teuthology.orchestra.run.smithi083.stdout:(116/120): automake-1.16.1-7.el8.noarch.rpm 19 MB/s | 713 kB 00:00 2023-10-06T03:21:01.169 INFO:teuthology.orchestra.run.smithi083.stdout:(117/120): openblas-threads-0.3.12-1.el8.x86_64 39 MB/s | 4.7 MB 00:00 2023-10-06T03:21:01.187 INFO:teuthology.orchestra.run.smithi083.stdout:(118/120): openblas-0.3.12-1.el8.x86_64.rpm 36 MB/s | 4.6 MB 00:00 2023-10-06T03:21:01.474 INFO:teuthology.orchestra.run.smithi083.stdout:(119/120): librbd1-17.2.6-1296.g736ac5ba.el8.x8 12 MB/s | 3.6 MB 00:00 2023-10-06T03:21:01.593 INFO:teuthology.orchestra.run.smithi083.stdout:(120/120): librados2-17.2.6-1296.g736ac5ba.el8. 7.0 MB/s | 3.5 MB 00:00 2023-10-06T03:21:01.596 INFO:teuthology.orchestra.run.smithi083.stdout:-------------------------------------------------------------------------------- 2023-10-06T03:21:01.596 INFO:teuthology.orchestra.run.smithi083.stdout:Total 16 MB/s | 201 MB 00:12 2023-10-06T03:21:01.665 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction check 2023-10-06T03:21:01.789 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction check succeeded. 2023-10-06T03:21:01.789 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction test 2023-10-06T03:21:03.595 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction test succeeded. 2023-10-06T03:21:03.599 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction 2023-10-06T03:21:05.205 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2023-10-06T03:21:05.375 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-06T03:21:05.614 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 2/122 2023-10-06T03:21:05.855 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 3/122 2023-10-06T03:21:06.009 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 3/122 2023-10-06T03:21:06.255 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-10-06T03:21:06.695 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-10-06T03:21:06.921 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 5/122 2023-10-06T03:21:07.378 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 5/122 2023-10-06T03:21:07.621 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T03:21:07.765 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T03:21:07.963 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 7/122 2023-10-06T03:21:08.067 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 7/122 2023-10-06T03:21:08.568 INFO:teuthology.orchestra.run.smithi083.stdout: Preparing : 1/1 2023-10-06T03:21:08.804 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-06T03:21:08.981 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-06T03:21:09.152 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-06T03:21:09.187 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 8/122 2023-10-06T03:21:09.389 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-06T03:21:09.830 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-06T03:21:09.927 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-06T03:21:10.146 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T03:21:10.293 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T03:21:10.561 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-06T03:21:10.631 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T03:21:10.784 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-06T03:21:10.963 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T03:21:11.093 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T03:21:11.102 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T03:21:11.246 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 14/122 2023-10-06T03:21:11.331 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 5/122 2023-10-06T03:21:11.340 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 14/122 2023-10-06T03:21:11.485 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 5/122 2023-10-06T03:21:11.549 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 15/122 2023-10-06T03:21:11.656 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T03:21:11.713 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 16/122 2023-10-06T03:21:11.786 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T03:21:11.895 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 16/122 2023-10-06T03:21:11.970 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 7/122 2023-10-06T03:21:12.125 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 17/122 2023-10-06T03:21:12.297 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/122 2023-10-06T03:21:12.739 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 17/122 2023-10-06T03:21:12.946 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-10-06T03:21:13.041 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-06T03:21:13.223 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T03:21:13.355 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T03:21:13.546 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-10-06T03:21:13.637 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-06T03:21:13.729 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openblas-0.3.12-1.el8.x86_64 19/122 2023-10-06T03:21:13.838 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-06T03:21:14.055 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T03:21:14.187 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T03:21:14.339 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 14/122 2023-10-06T03:21:14.440 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 14/122 2023-10-06T03:21:14.655 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 15/122 2023-10-06T03:21:14.896 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 19/122 2023-10-06T03:21:14.924 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/122 2023-10-06T03:21:15.238 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 20/122 2023-10-06T03:21:15.398 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/122 2023-10-06T03:21:15.423 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 21/122 2023-10-06T03:21:15.566 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 18/122 2023-10-06T03:21:15.630 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 22/122 2023-10-06T03:21:15.731 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-06T03:21:15.901 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-06T03:21:15.902 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/122 2023-10-06T03:21:16.114 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-06T03:21:16.218 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 24/122 2023-10-06T03:21:16.461 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-06T03:21:16.729 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-06T03:21:16.736 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8. 26/122 2023-10-06T03:21:16.867 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el 27/122 2023-10-06T03:21:16.897 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-06T03:21:17.176 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_6 28/122 2023-10-06T03:21:17.493 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-06T03:21:17.673 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : openblas-0.3.12-1.el8.x86_64 22/122 2023-10-06T03:21:18.350 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/122 2023-10-06T03:21:18.567 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 22/122 2023-10-06T03:21:18.743 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 30/122 2023-10-06T03:21:18.864 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 23/122 2023-10-06T03:21:19.138 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 31/122 2023-10-06T03:21:19.171 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/122 2023-10-06T03:21:19.407 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 32/122 2023-10-06T03:21:19.437 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-06T03:21:19.662 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8. 26/122 2023-10-06T03:21:19.728 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 33/122 2023-10-06T03:21:19.810 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el 27/122 2023-10-06T03:21:19.987 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-10-06T03:21:20.090 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_6 28/122 2023-10-06T03:21:20.366 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 29/122 2023-10-06T03:21:20.637 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 30/122 2023-10-06T03:21:20.863 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-06T03:21:22.448 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-10-06T03:21:22.840 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 35/122 2023-10-06T03:21:23.101 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-06T03:21:23.298 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-06T03:21:23.308 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-06T03:21:23.541 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 38/122 2023-10-06T03:21:23.678 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 32/122 2023-10-06T03:21:23.744 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 39/122 2023-10-06T03:21:23.964 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_6 40/122 2023-10-06T03:21:24.141 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 41/122 2023-10-06T03:21:24.342 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 42/122 2023-10-06T03:21:24.510 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 43/122 2023-10-06T03:21:24.722 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : fuse-2.9.7-12.el8.x86_64 44/122 2023-10-06T03:21:24.798 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/122 2023-10-06T03:21:24.850 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 45/122 2023-10-06T03:21:25.059 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 46/122 2023-10-06T03:21:25.197 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/122 2023-10-06T03:21:25.263 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 47/122 2023-10-06T03:21:25.468 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/122 2023-10-06T03:21:25.605 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 48/122 2023-10-06T03:21:25.705 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-06T03:21:25.876 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-06T03:21:25.902 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 49/122 2023-10-06T03:21:26.126 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 38/122 2023-10-06T03:21:26.223 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 50/122 2023-10-06T03:21:26.320 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 39/122 2023-10-06T03:21:26.601 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_6 40/122 2023-10-06T03:21:26.631 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 51/122 2023-10-06T03:21:26.837 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : automake-1.16.1-7.el8.noarch 41/122 2023-10-06T03:21:26.903 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : automake-1.16.1-7.el8.noarch 52/122 2023-10-06T03:21:27.014 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/122 2023-10-06T03:21:27.121 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 53/122 2023-10-06T03:21:27.216 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/122 2023-10-06T03:21:27.322 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 54/122 2023-10-06T03:21:27.418 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/122 2023-10-06T03:21:27.558 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 55/122 2023-10-06T03:21:27.578 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-06T03:21:27.680 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-06T03:21:27.764 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 56/122 2023-10-06T03:21:27.870 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 56/122 2023-10-06T03:21:27.873 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : jq-1.5-12.el8.x86_64 46/122 2023-10-06T03:21:28.043 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 47/122 2023-10-06T03:21:28.071 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : jq-1.5-12.el8.x86_64 57/122 2023-10-06T03:21:28.243 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/122 2023-10-06T03:21:28.273 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 58/122 2023-10-06T03:21:28.438 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-06T03:21:28.451 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 49/122 2023-10-06T03:21:28.655 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-06T03:21:28.657 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/122 2023-10-06T03:21:28.865 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/122 2023-10-06T03:21:28.944 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-06T03:21:29.078 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 52/122 2023-10-06T03:21:29.255 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-06T03:21:29.284 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/122 2023-10-06T03:21:29.459 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/122 2023-10-06T03:21:29.469 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-06T03:21:29.667 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-06T03:21:29.817 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-06T03:21:29.832 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/122 2023-10-06T03:21:30.065 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-06T03:21:30.130 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/122 2023-10-06T03:21:30.315 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-06T03:21:30.432 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/122 2023-10-06T03:21:30.531 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-06T03:21:30.740 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-06T03:21:30.740 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 58/122 2023-10-06T03:21:30.902 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-06T03:21:30.931 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-06T03:21:31.131 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-06T03:21:31.178 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-06T03:21:31.438 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-06T03:21:31.479 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-06T03:21:31.681 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-06T03:21:31.736 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-06T03:21:31.921 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-06T03:21:32.030 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-06T03:21:32.077 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-06T03:21:32.244 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-06T03:21:32.296 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-06T03:21:32.441 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-06T03:21:32.549 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-06T03:21:32.674 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-06T03:21:32.845 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-06T03:21:32.898 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-06T03:21:33.133 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-06T03:21:33.312 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-06T03:21:33.564 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-06T03:21:33.828 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-06T03:21:34.054 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-06T03:21:34.301 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-06T03:21:34.391 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-06T03:21:34.624 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-06T03:21:34.638 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-06T03:21:34.868 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-06T03:21:34.884 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-06T03:21:35.137 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-06T03:21:35.241 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-06T03:21:35.494 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-06T03:21:35.888 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-06T03:21:36.155 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-06T03:21:36.381 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-06T03:21:36.577 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-06T03:21:36.581 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-06T03:21:36.893 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-06T03:21:37.119 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-06T03:21:37.488 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-06T03:21:37.804 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-06T03:21:38.161 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-06T03:21:38.440 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-06T03:21:38.624 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-06T03:21:38.878 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-06T03:21:44.058 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T03:21:44.326 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T03:21:45.007 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T03:21:45.722 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T03:21:45.937 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 88/122 2023-10-06T03:21:45.986 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T03:21:46.114 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 88/122 2023-10-06T03:21:46.233 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 89/122 2023-10-06T03:21:46.669 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T03:21:47.238 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 88/122 2023-10-06T03:21:47.381 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 88/122 2023-10-06T03:21:47.517 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 89/122 2023-10-06T03:22:05.629 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 89/122 2023-10-06T03:22:05.629 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /sys 2023-10-06T03:22:05.629 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /proc 2023-10-06T03:22:05.629 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /dev 2023-10-06T03:22:05.629 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /run 2023-10-06T03:22:05.629 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /mnt 2023-10-06T03:22:05.629 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /var/tmp 2023-10-06T03:22:05.629 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /home 2023-10-06T03:22:05.630 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /tmp 2023-10-06T03:22:05.630 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /dev 2023-10-06T03:22:05.630 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:22:06.073 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 90/122 2023-10-06T03:22:06.747 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 89/122 2023-10-06T03:22:06.747 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /sys 2023-10-06T03:22:06.747 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /proc 2023-10-06T03:22:06.747 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /dev 2023-10-06T03:22:06.747 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /run 2023-10-06T03:22:06.747 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /mnt 2023-10-06T03:22:06.747 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /var/tmp 2023-10-06T03:22:06.748 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /home 2023-10-06T03:22:06.748 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /tmp 2023-10-06T03:22:06.748 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /dev 2023-10-06T03:22:06.748 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T03:22:07.207 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 90/122 2023-10-06T03:22:07.693 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 90/122 2023-10-06T03:22:07.867 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 91/122 2023-10-06T03:22:08.139 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 91/122 2023-10-06T03:22:08.323 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 92/122 2023-10-06T03:22:08.795 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 92/122 2023-10-06T03:22:08.827 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 90/122 2023-10-06T03:22:08.939 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 93/122 2023-10-06T03:22:08.979 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 93/122 2023-10-06T03:22:09.038 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 91/122 2023-10-06T03:22:09.310 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 91/122 2023-10-06T03:22:09.465 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 92/122 2023-10-06T03:22:09.932 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 92/122 2023-10-06T03:22:10.098 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 93/122 2023-10-06T03:22:10.137 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 93/122 2023-10-06T03:22:13.332 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 94/122 2023-10-06T03:22:13.520 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 94/122 2023-10-06T03:22:13.772 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.e 95/122 2023-10-06T03:22:13.951 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba. 96/122 2023-10-06T03:22:14.195 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 97/122 2023-10-06T03:22:14.463 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 97/122 2023-10-06T03:22:14.582 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 94/122 2023-10-06T03:22:14.658 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 98/122 2023-10-06T03:22:14.774 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 94/122 2023-10-06T03:22:15.014 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.e 95/122 2023-10-06T03:22:15.226 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba. 96/122 2023-10-06T03:22:15.464 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 97/122 2023-10-06T03:22:15.730 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 97/122 2023-10-06T03:22:15.773 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 98/122 2023-10-06T03:22:15.912 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 98/122 2023-10-06T03:22:15.979 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 99/122 2023-10-06T03:22:16.119 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 99/122 2023-10-06T03:22:16.569 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el 100/122 2023-10-06T03:22:16.771 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 101/122 2023-10-06T03:22:16.836 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 101/122 2023-10-06T03:22:17.012 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 102/122 2023-10-06T03:22:17.025 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 98/122 2023-10-06T03:22:17.039 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 102/122 2023-10-06T03:22:17.197 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 99/122 2023-10-06T03:22:17.337 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 99/122 2023-10-06T03:22:17.763 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el 100/122 2023-10-06T03:22:17.979 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 101/122 2023-10-06T03:22:18.047 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 101/122 2023-10-06T03:22:18.213 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 102/122 2023-10-06T03:22:18.239 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 102/122 2023-10-06T03:22:18.761 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 103/122 2023-10-06T03:22:19.066 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 104/122 2023-10-06T03:22:19.201 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 104/122 2023-10-06T03:22:19.396 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1296.g736ac 105/122 2023-10-06T03:22:19.469 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1296.g736ac 105/122 2023-10-06T03:22:19.621 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 106/122 2023-10-06T03:22:19.974 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 103/122 2023-10-06T03:22:20.032 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 106/122 2023-10-06T03:22:20.231 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 107/122 2023-10-06T03:22:20.972 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 104/122 2023-10-06T03:22:20.972 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 104/122 2023-10-06T03:22:20.972 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1296.g736ac 105/122 2023-10-06T03:22:20.972 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1296.g736ac 105/122 2023-10-06T03:22:20.973 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 106/122 2023-10-06T03:22:21.212 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 106/122 2023-10-06T03:22:21.405 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 107/122 2023-10-06T03:22:25.597 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 107/122 2023-10-06T03:22:25.995 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 108/122 2023-10-06T03:22:26.194 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libtool-2.4.6-25.el8.x86_64 109/122 2023-10-06T03:22:26.774 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 107/122 2023-10-06T03:22:27.258 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 109/122 2023-10-06T03:22:27.677 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 110/122 2023-10-06T03:22:27.928 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 111/122 2023-10-06T03:22:28.081 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 108/122 2023-10-06T03:22:28.090 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 112/122 2023-10-06T03:22:28.258 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_ 113/122 2023-10-06T03:22:28.392 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-06T03:22:28.510 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 109/122 2023-10-06T03:22:28.587 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 115/122 2023-10-06T03:22:28.713 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 110/122 2023-10-06T03:22:28.786 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 116/122 2023-10-06T03:22:28.963 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 111/122 2023-10-06T03:22:28.979 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 117/122 2023-10-06T03:22:29.120 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/122 2023-10-06T03:22:29.147 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/122 2023-10-06T03:22:29.196 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 118/122 2023-10-06T03:22:29.292 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_ 113/122 2023-10-06T03:22:29.443 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-06T03:22:29.444 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : bison-3.0.4-10.el8.x86_64 119/122 2023-10-06T03:22:29.525 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 119/122 2023-10-06T03:22:29.630 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 115/122 2023-10-06T03:22:29.744 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flex-2.6.1-9.el8.x86_64 120/122 2023-10-06T03:22:29.767 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 120/122 2023-10-06T03:22:29.767 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T03:22:29.837 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 116/122 2023-10-06T03:22:30.042 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T03:22:30.042 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T03:22:30.098 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 117/122 2023-10-06T03:22:30.303 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : bison-3.0.4-10.el8.x86_64 118/122 2023-10-06T03:22:30.383 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 118/122 2023-10-06T03:22:30.451 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T03:22:30.452 INFO:teuthology.orchestra.run.smithi081.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-10-06T03:22:30.452 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:22:30.562 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : flex-2.6.1-9.el8.x86_64 119/122 2023-10-06T03:22:30.586 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 119/122 2023-10-06T03:22:30.715 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/122 2023-10-06T03:22:30.715 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T03:22:30.976 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T03:22:30.976 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T03:22:31.395 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T03:22:31.395 INFO:teuthology.orchestra.run.smithi083.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-10-06T03:22:31.395 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T03:22:31.417 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 1/122 2023-10-06T03:22:31.417 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 2/122 2023-10-06T03:22:31.417 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 3/122 2023-10-06T03:22:31.417 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T03:22:31.417 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1296.g736ac 5/122 2023-10-06T03:22:31.417 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T03:22:31.417 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 7/122 2023-10-06T03:22:31.417 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 8/122 2023-10-06T03:22:31.417 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 9/122 2023-10-06T03:22:31.418 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T03:22:31.418 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 11/122 2023-10-06T03:22:31.418 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 12/122 2023-10-06T03:22:31.418 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T03:22:31.418 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_ 14/122 2023-10-06T03:22:31.418 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 15/122 2023-10-06T03:22:31.418 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 16/122 2023-10-06T03:22:31.418 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_6 17/122 2023-10-06T03:22:31.418 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 18/122 2023-10-06T03:22:31.418 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 19/122 2023-10-06T03:22:31.419 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el 20/122 2023-10-06T03:22:31.419 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8. 21/122 2023-10-06T03:22:31.419 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_6 22/122 2023-10-06T03:22:31.419 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 23/122 2023-10-06T03:22:31.419 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 24/122 2023-10-06T03:22:31.419 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 25/122 2023-10-06T03:22:31.419 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 26/122 2023-10-06T03:22:31.419 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 27/122 2023-10-06T03:22:31.419 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 28/122 2023-10-06T03:22:31.420 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba. 29/122 2023-10-06T03:22:31.420 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 30/122 2023-10-06T03:22:31.420 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 31/122 2023-10-06T03:22:31.420 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 32/122 2023-10-06T03:22:31.420 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el 33/122 2023-10-06T03:22:31.420 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 34/122 2023-10-06T03:22:31.420 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.e 35/122 2023-10-06T03:22:31.420 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 36/122 2023-10-06T03:22:31.420 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 37/122 2023-10-06T03:22:31.421 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 38/122 2023-10-06T03:22:31.421 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-06T03:22:31.421 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-06T03:22:31.421 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-06T03:22:31.421 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-06T03:22:31.421 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-06T03:22:31.421 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-06T03:22:31.421 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-06T03:22:31.422 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-06T03:22:31.422 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-06T03:22:31.422 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-06T03:22:31.422 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-06T03:22:31.422 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-06T03:22:31.422 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-06T03:22:31.422 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-06T03:22:31.422 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-06T03:22:31.422 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-06T03:22:31.423 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-06T03:22:31.423 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-06T03:22:31.423 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-06T03:22:31.423 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-06T03:22:31.423 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-06T03:22:31.423 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-06T03:22:31.423 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-06T03:22:31.423 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-06T03:22:31.423 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-06T03:22:31.423 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-06T03:22:31.424 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-06T03:22:31.424 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-06T03:22:31.424 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-06T03:22:31.424 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-06T03:22:31.424 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-06T03:22:31.424 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-06T03:22:31.424 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-06T03:22:31.424 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 72/122 2023-10-06T03:22:31.424 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 73/122 2023-10-06T03:22:31.424 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 74/122 2023-10-06T03:22:31.425 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : jq-1.5-12.el8.x86_64 75/122 2023-10-06T03:22:31.425 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flex-2.6.1-9.el8.x86_64 76/122 2023-10-06T03:22:31.425 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 77/122 2023-10-06T03:22:31.425 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 78/122 2023-10-06T03:22:31.425 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 79/122 2023-10-06T03:22:31.425 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : bison-3.0.4-10.el8.x86_64 80/122 2023-10-06T03:22:31.425 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 81/122 2023-10-06T03:22:31.425 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 82/122 2023-10-06T03:22:31.425 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 83/122 2023-10-06T03:22:31.425 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 84/122 2023-10-06T03:22:31.425 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 85/122 2023-10-06T03:22:31.426 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 86/122 2023-10-06T03:22:31.426 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 87/122 2023-10-06T03:22:31.426 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 88/122 2023-10-06T03:22:31.426 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 89/122 2023-10-06T03:22:31.426 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 90/122 2023-10-06T03:22:31.426 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 91/122 2023-10-06T03:22:31.426 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 92/122 2023-10-06T03:22:31.426 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 93/122 2023-10-06T03:22:31.426 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 94/122 2023-10-06T03:22:31.426 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 95/122 2023-10-06T03:22:31.426 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : automake-1.16.1-7.el8.noarch 96/122 2023-10-06T03:22:31.427 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 97/122 2023-10-06T03:22:31.427 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 98/122 2023-10-06T03:22:31.427 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 99/122 2023-10-06T03:22:31.427 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 100/122 2023-10-06T03:22:31.427 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 101/122 2023-10-06T03:22:31.427 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 102/122 2023-10-06T03:22:31.427 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 103/122 2023-10-06T03:22:31.427 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 104/122 2023-10-06T03:22:31.427 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 105/122 2023-10-06T03:22:31.428 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 106/122 2023-10-06T03:22:31.428 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 107/122 2023-10-06T03:22:31.428 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 108/122 2023-10-06T03:22:31.428 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 109/122 2023-10-06T03:22:31.428 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 110/122 2023-10-06T03:22:31.428 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 111/122 2023-10-06T03:22:31.428 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 112/122 2023-10-06T03:22:31.428 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 113/122 2023-10-06T03:22:31.428 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 114/122 2023-10-06T03:22:31.428 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 115/122 2023-10-06T03:22:31.428 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 116/122 2023-10-06T03:22:31.429 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 117/122 2023-10-06T03:22:31.429 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 118/122 2023-10-06T03:22:31.429 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 119/122 2023-10-06T03:22:31.429 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-06T03:22:31.429 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 121/122 2023-10-06T03:22:32.330 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 1/122 2023-10-06T03:22:32.333 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 2/122 2023-10-06T03:22:32.333 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 3/122 2023-10-06T03:22:32.333 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T03:22:32.333 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1296.g736ac 5/122 2023-10-06T03:22:32.333 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T03:22:32.334 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 7/122 2023-10-06T03:22:32.334 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 8/122 2023-10-06T03:22:32.334 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 9/122 2023-10-06T03:22:32.334 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T03:22:32.334 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 11/122 2023-10-06T03:22:32.334 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 12/122 2023-10-06T03:22:32.334 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T03:22:32.334 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_ 14/122 2023-10-06T03:22:32.334 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 15/122 2023-10-06T03:22:32.334 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 16/122 2023-10-06T03:22:32.334 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_6 17/122 2023-10-06T03:22:32.335 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 18/122 2023-10-06T03:22:32.335 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 19/122 2023-10-06T03:22:32.335 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el 20/122 2023-10-06T03:22:32.335 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8. 21/122 2023-10-06T03:22:32.335 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_6 22/122 2023-10-06T03:22:32.335 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 23/122 2023-10-06T03:22:32.335 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 24/122 2023-10-06T03:22:32.335 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 25/122 2023-10-06T03:22:32.335 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 26/122 2023-10-06T03:22:32.335 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 27/122 2023-10-06T03:22:32.335 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 28/122 2023-10-06T03:22:32.336 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba. 29/122 2023-10-06T03:22:32.336 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 30/122 2023-10-06T03:22:32.336 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 31/122 2023-10-06T03:22:32.336 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 32/122 2023-10-06T03:22:32.336 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el 33/122 2023-10-06T03:22:32.336 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 34/122 2023-10-06T03:22:32.336 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.e 35/122 2023-10-06T03:22:32.336 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 36/122 2023-10-06T03:22:32.336 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 37/122 2023-10-06T03:22:32.336 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 38/122 2023-10-06T03:22:32.336 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-06T03:22:32.336 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-06T03:22:32.337 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-06T03:22:32.337 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-06T03:22:32.337 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-06T03:22:32.337 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-06T03:22:32.337 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-06T03:22:32.337 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-06T03:22:32.337 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-06T03:22:32.337 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-06T03:22:32.337 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-06T03:22:32.337 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-06T03:22:32.337 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-06T03:22:32.338 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-06T03:22:32.338 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-06T03:22:32.338 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-06T03:22:32.338 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-06T03:22:32.338 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-06T03:22:32.338 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-06T03:22:32.338 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-06T03:22:32.338 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-06T03:22:32.338 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-06T03:22:32.338 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-06T03:22:32.338 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-06T03:22:32.339 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-06T03:22:32.339 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-06T03:22:32.339 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-06T03:22:32.339 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-06T03:22:32.339 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-06T03:22:32.339 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-06T03:22:32.339 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-06T03:22:32.339 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-06T03:22:32.339 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-06T03:22:32.339 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/122 2023-10-06T03:22:32.339 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/122 2023-10-06T03:22:32.340 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/122 2023-10-06T03:22:32.340 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/122 2023-10-06T03:22:32.340 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/122 2023-10-06T03:22:32.340 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 77/122 2023-10-06T03:22:32.340 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/122 2023-10-06T03:22:32.340 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 79/122 2023-10-06T03:22:32.340 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/122 2023-10-06T03:22:32.340 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/122 2023-10-06T03:22:32.340 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 82/122 2023-10-06T03:22:32.340 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 83/122 2023-10-06T03:22:32.341 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 84/122 2023-10-06T03:22:32.341 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 85/122 2023-10-06T03:22:32.341 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 86/122 2023-10-06T03:22:32.341 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 87/122 2023-10-06T03:22:32.341 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/122 2023-10-06T03:22:32.341 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 89/122 2023-10-06T03:22:32.341 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 90/122 2023-10-06T03:22:32.341 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/122 2023-10-06T03:22:32.341 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/122 2023-10-06T03:22:32.341 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 93/122 2023-10-06T03:22:32.341 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 94/122 2023-10-06T03:22:32.341 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 95/122 2023-10-06T03:22:32.342 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/122 2023-10-06T03:22:32.342 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : jq-1.5-12.el8.x86_64 97/122 2023-10-06T03:22:32.342 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : flex-2.6.1-9.el8.x86_64 98/122 2023-10-06T03:22:32.342 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/122 2023-10-06T03:22:32.342 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 100/122 2023-10-06T03:22:32.342 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/122 2023-10-06T03:22:32.342 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/122 2023-10-06T03:22:32.342 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 103/122 2023-10-06T03:22:32.342 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 104/122 2023-10-06T03:22:32.342 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 105/122 2023-10-06T03:22:32.342 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 106/122 2023-10-06T03:22:32.343 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/122 2023-10-06T03:22:32.343 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 108/122 2023-10-06T03:22:32.343 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 109/122 2023-10-06T03:22:32.343 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 110/122 2023-10-06T03:22:32.343 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/122 2023-10-06T03:22:32.343 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 112/122 2023-10-06T03:22:32.343 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 113/122 2023-10-06T03:22:32.343 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/122 2023-10-06T03:22:32.343 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 115/122 2023-10-06T03:22:32.343 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 116/122 2023-10-06T03:22:32.343 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 117/122 2023-10-06T03:22:32.343 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : automake-1.16.1-7.el8.noarch 118/122 2023-10-06T03:22:32.344 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 119/122 2023-10-06T03:22:32.344 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-06T03:22:32.344 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 121/122 2023-10-06T03:22:33.870 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T03:22:33.870 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:01:55 ago on Fri 06 Oct 2023 03:20:38 AM UTC. 2023-10-06T03:22:34.643 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T03:22:34.643 INFO:teuthology.orchestra.run.smithi083.stdout:Last metadata expiration check: 0:01:55 ago on Fri 06 Oct 2023 03:20:39 AM UTC. 2023-10-06T03:22:36.001 INFO:teuthology.orchestra.run.smithi081.stdout:Installed products updated. 2023-10-06T03:22:36.131 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:22:36.131 INFO:teuthology.orchestra.run.smithi081.stdout:Upgraded: 2023-10-06T03:22:36.131 INFO:teuthology.orchestra.run.smithi081.stdout: librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.131 INFO:teuthology.orchestra.run.smithi081.stdout: librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.131 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2023-10-06T03:22:36.131 INFO:teuthology.orchestra.run.smithi081.stdout: automake-1.16.1-7.el8.noarch 2023-10-06T03:22:36.132 INFO:teuthology.orchestra.run.smithi081.stdout: bison-3.0.4-10.el8.x86_64 2023-10-06T03:22:36.132 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.132 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.132 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.132 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.132 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:22:36.132 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-immutable-object-cache-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.132 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.132 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.132 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:22:36.132 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:22:36.132 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:22:36.133 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:22:36.133 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:22:36.133 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.133 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.133 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:22:36.133 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.133 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.133 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.133 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:22:36.133 INFO:teuthology.orchestra.run.smithi081.stdout: cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:22:36.133 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.133 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:22:36.133 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-06T03:22:36.134 INFO:teuthology.orchestra.run.smithi081.stdout: flex-2.6.1-9.el8.x86_64 2023-10-06T03:22:36.134 INFO:teuthology.orchestra.run.smithi081.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-06T03:22:36.134 INFO:teuthology.orchestra.run.smithi081.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-06T03:22:36.134 INFO:teuthology.orchestra.run.smithi081.stdout: jq-1.5-12.el8.x86_64 2023-10-06T03:22:36.134 INFO:teuthology.orchestra.run.smithi081.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-06T03:22:36.134 INFO:teuthology.orchestra.run.smithi081.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-06T03:22:36.134 INFO:teuthology.orchestra.run.smithi081.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-06T03:22:36.134 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.134 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.134 INFO:teuthology.orchestra.run.smithi081.stdout: libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.134 INFO:teuthology.orchestra.run.smithi081.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-06T03:22:36.134 INFO:teuthology.orchestra.run.smithi081.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-06T03:22:36.135 INFO:teuthology.orchestra.run.smithi081.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-06T03:22:36.135 INFO:teuthology.orchestra.run.smithi081.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-06T03:22:36.135 INFO:teuthology.orchestra.run.smithi081.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-06T03:22:36.135 INFO:teuthology.orchestra.run.smithi081.stdout: librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.135 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.135 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-06T03:22:36.135 INFO:teuthology.orchestra.run.smithi081.stdout: librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.135 INFO:teuthology.orchestra.run.smithi081.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-06T03:22:36.135 INFO:teuthology.orchestra.run.smithi081.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-06T03:22:36.135 INFO:teuthology.orchestra.run.smithi081.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-06T03:22:36.135 INFO:teuthology.orchestra.run.smithi081.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-06T03:22:36.135 INFO:teuthology.orchestra.run.smithi081.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-06T03:22:36.136 INFO:teuthology.orchestra.run.smithi081.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-06T03:22:36.136 INFO:teuthology.orchestra.run.smithi081.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-06T03:22:36.136 INFO:teuthology.orchestra.run.smithi081.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-06T03:22:36.136 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-06T03:22:36.136 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-06T03:22:36.136 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-06T03:22:36.136 INFO:teuthology.orchestra.run.smithi081.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-06T03:22:36.136 INFO:teuthology.orchestra.run.smithi081.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-06T03:22:36.136 INFO:teuthology.orchestra.run.smithi081.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-06T03:22:36.136 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-06T03:22:36.136 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-06T03:22:36.136 INFO:teuthology.orchestra.run.smithi081.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-06T03:22:36.137 INFO:teuthology.orchestra.run.smithi081.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-06T03:22:36.137 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-06T03:22:36.137 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.137 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.137 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.137 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-06T03:22:36.137 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-06T03:22:36.137 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-06T03:22:36.137 INFO:teuthology.orchestra.run.smithi081.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-06T03:22:36.137 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-06T03:22:36.137 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-06T03:22:36.137 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-06T03:22:36.138 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-06T03:22:36.138 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-06T03:22:36.138 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-06T03:22:36.138 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-06T03:22:36.138 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-06T03:22:36.138 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-06T03:22:36.138 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-06T03:22:36.138 INFO:teuthology.orchestra.run.smithi081.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-06T03:22:36.138 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-06T03:22:36.138 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-06T03:22:36.138 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-06T03:22:36.138 INFO:teuthology.orchestra.run.smithi081.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-06T03:22:36.139 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-06T03:22:36.139 INFO:teuthology.orchestra.run.smithi081.stdout: python3-portend-2.6-1.el8.noarch 2023-10-06T03:22:36.139 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-06T03:22:36.139 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-06T03:22:36.139 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-06T03:22:36.139 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-06T03:22:36.139 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.139 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.139 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-06T03:22:36.139 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-06T03:22:36.139 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.139 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-06T03:22:36.140 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-06T03:22:36.140 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-06T03:22:36.140 INFO:teuthology.orchestra.run.smithi081.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-06T03:22:36.140 INFO:teuthology.orchestra.run.smithi081.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-06T03:22:36.140 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-06T03:22:36.140 INFO:teuthology.orchestra.run.smithi081.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-06T03:22:36.140 INFO:teuthology.orchestra.run.smithi081.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-06T03:22:36.140 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-06T03:22:36.140 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-06T03:22:36.140 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-06T03:22:36.140 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-06T03:22:36.140 INFO:teuthology.orchestra.run.smithi081.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-06T03:22:36.140 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.141 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.141 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.141 INFO:teuthology.orchestra.run.smithi081.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-06T03:22:36.141 INFO:teuthology.orchestra.run.smithi081.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-06T03:22:36.141 INFO:teuthology.orchestra.run.smithi081.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-06T03:22:36.141 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-06T03:22:36.141 INFO:teuthology.orchestra.run.smithi081.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-06T03:22:36.141 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:22:36.142 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2023-10-06T03:22:36.451 DEBUG:teuthology.parallel:result is None 2023-10-06T03:22:36.716 INFO:teuthology.orchestra.run.smithi083.stdout:Installed products updated. 2023-10-06T03:22:36.848 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T03:22:36.848 INFO:teuthology.orchestra.run.smithi083.stdout:Upgraded: 2023-10-06T03:22:36.848 INFO:teuthology.orchestra.run.smithi083.stdout: librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.848 INFO:teuthology.orchestra.run.smithi083.stdout: librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.848 INFO:teuthology.orchestra.run.smithi083.stdout:Installed: 2023-10-06T03:22:36.848 INFO:teuthology.orchestra.run.smithi083.stdout: automake-1.16.1-7.el8.noarch 2023-10-06T03:22:36.848 INFO:teuthology.orchestra.run.smithi083.stdout: bison-3.0.4-10.el8.x86_64 2023-10-06T03:22:36.848 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.848 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.849 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.849 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.849 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:22:36.849 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-immutable-object-cache-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.849 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.849 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.849 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:22:36.849 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:22:36.849 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:22:36.849 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:22:36.849 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:22:36.850 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.850 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.850 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:22:36.850 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.850 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.850 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.850 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:22:36.850 INFO:teuthology.orchestra.run.smithi083.stdout: cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:22:36.850 INFO:teuthology.orchestra.run.smithi083.stdout: cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.850 INFO:teuthology.orchestra.run.smithi083.stdout: cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:22:36.850 INFO:teuthology.orchestra.run.smithi083.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-06T03:22:36.851 INFO:teuthology.orchestra.run.smithi083.stdout: flex-2.6.1-9.el8.x86_64 2023-10-06T03:22:36.851 INFO:teuthology.orchestra.run.smithi083.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-06T03:22:36.851 INFO:teuthology.orchestra.run.smithi083.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-06T03:22:36.851 INFO:teuthology.orchestra.run.smithi083.stdout: jq-1.5-12.el8.x86_64 2023-10-06T03:22:36.851 INFO:teuthology.orchestra.run.smithi083.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-06T03:22:36.851 INFO:teuthology.orchestra.run.smithi083.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-06T03:22:36.851 INFO:teuthology.orchestra.run.smithi083.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-06T03:22:36.851 INFO:teuthology.orchestra.run.smithi083.stdout: libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.851 INFO:teuthology.orchestra.run.smithi083.stdout: libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.852 INFO:teuthology.orchestra.run.smithi083.stdout: libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.852 INFO:teuthology.orchestra.run.smithi083.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-06T03:22:36.852 INFO:teuthology.orchestra.run.smithi083.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-06T03:22:36.852 INFO:teuthology.orchestra.run.smithi083.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-06T03:22:36.852 INFO:teuthology.orchestra.run.smithi083.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-06T03:22:36.852 INFO:teuthology.orchestra.run.smithi083.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-06T03:22:36.852 INFO:teuthology.orchestra.run.smithi083.stdout: librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.853 INFO:teuthology.orchestra.run.smithi083.stdout: libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.853 INFO:teuthology.orchestra.run.smithi083.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-06T03:22:36.853 INFO:teuthology.orchestra.run.smithi083.stdout: librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.854 INFO:teuthology.orchestra.run.smithi083.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-06T03:22:36.854 INFO:teuthology.orchestra.run.smithi083.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-06T03:22:36.854 INFO:teuthology.orchestra.run.smithi083.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-06T03:22:36.854 INFO:teuthology.orchestra.run.smithi083.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-06T03:22:36.855 INFO:teuthology.orchestra.run.smithi083.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-06T03:22:36.855 INFO:teuthology.orchestra.run.smithi083.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-06T03:22:36.855 INFO:teuthology.orchestra.run.smithi083.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-06T03:22:36.855 INFO:teuthology.orchestra.run.smithi083.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-06T03:22:36.855 INFO:teuthology.orchestra.run.smithi083.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-06T03:22:36.855 INFO:teuthology.orchestra.run.smithi083.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-06T03:22:36.855 INFO:teuthology.orchestra.run.smithi083.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-06T03:22:36.855 INFO:teuthology.orchestra.run.smithi083.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-06T03:22:36.855 INFO:teuthology.orchestra.run.smithi083.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-06T03:22:36.855 INFO:teuthology.orchestra.run.smithi083.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-06T03:22:36.855 INFO:teuthology.orchestra.run.smithi083.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-06T03:22:36.855 INFO:teuthology.orchestra.run.smithi083.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-06T03:22:36.856 INFO:teuthology.orchestra.run.smithi083.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-06T03:22:36.856 INFO:teuthology.orchestra.run.smithi083.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-06T03:22:36.856 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-06T03:22:36.856 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.856 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.856 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.856 INFO:teuthology.orchestra.run.smithi083.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-06T03:22:36.856 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-06T03:22:36.856 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-06T03:22:36.856 INFO:teuthology.orchestra.run.smithi083.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-06T03:22:36.856 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-06T03:22:36.856 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-06T03:22:36.857 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-06T03:22:36.857 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-06T03:22:36.857 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-06T03:22:36.857 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-06T03:22:36.857 INFO:teuthology.orchestra.run.smithi083.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-06T03:22:36.857 INFO:teuthology.orchestra.run.smithi083.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-06T03:22:36.857 INFO:teuthology.orchestra.run.smithi083.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-06T03:22:36.857 INFO:teuthology.orchestra.run.smithi083.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-06T03:22:36.857 INFO:teuthology.orchestra.run.smithi083.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-06T03:22:36.857 INFO:teuthology.orchestra.run.smithi083.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-06T03:22:36.857 INFO:teuthology.orchestra.run.smithi083.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-06T03:22:36.858 INFO:teuthology.orchestra.run.smithi083.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-06T03:22:36.858 INFO:teuthology.orchestra.run.smithi083.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-06T03:22:36.858 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-06T03:22:36.858 INFO:teuthology.orchestra.run.smithi083.stdout: python3-portend-2.6-1.el8.noarch 2023-10-06T03:22:36.858 INFO:teuthology.orchestra.run.smithi083.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-06T03:22:36.858 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-06T03:22:36.858 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-06T03:22:36.858 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-06T03:22:36.858 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.858 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.858 INFO:teuthology.orchestra.run.smithi083.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-06T03:22:36.858 INFO:teuthology.orchestra.run.smithi083.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-06T03:22:36.859 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.859 INFO:teuthology.orchestra.run.smithi083.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-06T03:22:36.859 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-06T03:22:36.859 INFO:teuthology.orchestra.run.smithi083.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-06T03:22:36.859 INFO:teuthology.orchestra.run.smithi083.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-06T03:22:36.859 INFO:teuthology.orchestra.run.smithi083.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-06T03:22:36.859 INFO:teuthology.orchestra.run.smithi083.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-06T03:22:36.859 INFO:teuthology.orchestra.run.smithi083.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-06T03:22:36.859 INFO:teuthology.orchestra.run.smithi083.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-06T03:22:36.859 INFO:teuthology.orchestra.run.smithi083.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-06T03:22:36.859 INFO:teuthology.orchestra.run.smithi083.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-06T03:22:36.859 INFO:teuthology.orchestra.run.smithi083.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-06T03:22:36.860 INFO:teuthology.orchestra.run.smithi083.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-06T03:22:36.860 INFO:teuthology.orchestra.run.smithi083.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-06T03:22:36.860 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.860 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.860 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:22:36.860 INFO:teuthology.orchestra.run.smithi083.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-06T03:22:36.860 INFO:teuthology.orchestra.run.smithi083.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-06T03:22:36.860 INFO:teuthology.orchestra.run.smithi083.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-06T03:22:36.860 INFO:teuthology.orchestra.run.smithi083.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-06T03:22:36.861 INFO:teuthology.orchestra.run.smithi083.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-06T03:22:36.861 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T03:22:36.861 INFO:teuthology.orchestra.run.smithi083.stdout:Complete! 2023-10-06T03:22:37.173 DEBUG:teuthology.parallel:result is None 2023-10-06T03:22:37.174 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T03:22:37.317 DEBUG:teuthology.orchestra.run.smithi081:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-06T03:22:37.369 INFO:teuthology.orchestra.run.smithi081.stdout:17.2.6-1296.g736ac5ba.el8 2023-10-06T03:22:37.370 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1296.g736ac5ba.el8 2023-10-06T03:22:37.370 INFO:teuthology.task.install:The correct ceph version 17.2.6-1296.g736ac5ba is installed. 2023-10-06T03:22:37.370 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T03:22:37.645 DEBUG:teuthology.orchestra.run.smithi083:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-06T03:22:37.696 INFO:teuthology.orchestra.run.smithi083.stdout:17.2.6-1296.g736ac5ba.el8 2023-10-06T03:22:37.696 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1296.g736ac5ba.el8 2023-10-06T03:22:37.696 INFO:teuthology.task.install:The correct ceph version 17.2.6-1296.g736ac5ba is installed. 2023-10-06T03:22:37.696 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-06T03:22:37.697 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-06T03:22:37.697 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T03:22:37.777 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T03:22:37.778 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T03:22:37.857 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-06T03:22:37.858 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-06T03:22:37.858 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T03:22:37.919 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T03:22:38.019 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T03:22:38.019 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T03:22:38.082 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T03:22:38.183 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-06T03:22:38.184 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-06T03:22:38.184 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T03:22:38.244 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T03:22:38.343 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T03:22:38.343 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T03:22:38.406 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T03:22:38.509 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-06T03:22:38.509 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-06T03:22:38.509 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T03:22:38.570 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T03:22:38.670 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T03:22:38.670 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T03:22:38.736 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T03:22:38.836 INFO:teuthology.run_tasks:Running task ceph... 2023-10-06T03:22:38.899 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-06T03:22:38.900 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 777 /var/log/ceph 2023-10-06T03:22:38.904 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 777 /var/log/ceph 2023-10-06T03:22:38.964 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-06T03:22:38.964 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T03:22:38.968 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T03:22:39.029 INFO:tasks.ceph:Creating extra log directories... 2023-10-06T03:22:39.029 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T03:22:39.033 DEBUG:teuthology.orchestra.run.smithi083:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T03:22:39.101 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-06T03:22:39.102 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-06T03:22:39.102 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-06T03:22:39.102 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-06T03:22:39.102 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T03:22:39.138 DEBUG:teuthology.orchestra.run.smithi081:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T03:22:39.921 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-06T03:22:39.986 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T03:22:39.986 DEBUG:teuthology.orchestra.run.smithi083:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T03:22:40.021 DEBUG:teuthology.orchestra.run.smithi083:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T03:22:40.735 DEBUG:teuthology.orchestra.run.smithi083:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-06T03:22:40.808 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-06T03:22:40.809 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-06T03:22:40.809 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412190', 'branch': 'wip-yuri-testing-2023-10-05-0730-quincy', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/recovery-fs}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7412190', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.4', 'overrides': {'admin_socket': {'branch': 'wip-yuri-testing-2023-10-05-0730-quincy'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri-testing-2023-10-05-0730-quincy', 'sha1': 'f1e315a9732d36c05ec316678e2397dc58561c7f'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 7519, 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri-testing-2023-10-05-0730-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'f1e315a9732d36c05ec316678e2397dc58561c7f', 'targets': {'smithi081.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAng7mx3KK1mbrZaEcAuFf4OFz3tDcmGoUSySkZNN4nrOuQCh6AdwilToSGjD2wT5DO2iskM/PGDZ6iRRZoS2cg=', 'smithi083.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNRMH/N5QcDWa4IoLhxpFtPD4tBR5xwZfDHY9UNeUhQ9Aa3PdfqvWber4izkcZSlWpbVFZNH8PUk2XaPboLbaSs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_recovery_fs']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-05_23:52:50', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-06T03:22:40.809 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T03:22:40.814 DEBUG:teuthology.orchestra.run.smithi083:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T03:22:40.851 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T03:22:40.895 DEBUG:teuthology.orchestra.run.smithi083:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T03:22:40.957 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-06T03:22:40.957 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T03:22:40.996 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T03:22:40.997 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_1 2023-10-06T03:22:41.074 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T03:22:41.074 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T03:22:41.074 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 452 Links: 1 2023-10-06T03:22:41.074 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T03:22:41.074 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T03:22:41.074 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2023-10-06 03:22:30.753501476 +0000 2023-10-06T03:22:41.075 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2023-10-06 03:19:45.466650170 +0000 2023-10-06T03:22:41.075 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2023-10-06 03:19:45.466650170 +0000 2023-10-06T03:22:41.075 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2023-10-06T03:22:41.075 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T03:22:41.171 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2023-10-06T03:22:41.171 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2023-10-06T03:22:41.171 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000364797 s, 1.4 MB/s 2023-10-06T03:22:41.174 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T03:22:41.212 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_2 2023-10-06T03:22:41.288 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T03:22:41.288 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T03:22:41.288 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 458 Links: 1 2023-10-06T03:22:41.289 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T03:22:41.289 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T03:22:41.289 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2023-10-06 03:22:30.754501457 +0000 2023-10-06T03:22:41.289 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2023-10-06 03:19:46.228636095 +0000 2023-10-06T03:22:41.289 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2023-10-06 03:19:46.228636095 +0000 2023-10-06T03:22:41.289 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2023-10-06T03:22:41.289 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T03:22:41.386 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2023-10-06T03:22:41.386 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2023-10-06T03:22:41.386 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000301102 s, 1.7 MB/s 2023-10-06T03:22:41.388 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T03:22:41.426 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_3 2023-10-06T03:22:41.502 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T03:22:41.502 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T03:22:41.502 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 464 Links: 1 2023-10-06T03:22:41.502 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T03:22:41.502 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T03:22:41.502 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2023-10-06 03:22:30.754501457 +0000 2023-10-06T03:22:41.502 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2023-10-06 03:19:46.986622095 +0000 2023-10-06T03:22:41.502 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2023-10-06 03:19:46.986622095 +0000 2023-10-06T03:22:41.502 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2023-10-06T03:22:41.503 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T03:22:41.598 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2023-10-06T03:22:41.599 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2023-10-06T03:22:41.599 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000311385 s, 1.6 MB/s 2023-10-06T03:22:41.601 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T03:22:41.639 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_4 2023-10-06T03:22:41.715 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T03:22:41.715 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T03:22:41.715 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 470 Links: 1 2023-10-06T03:22:41.715 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T03:22:41.715 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T03:22:41.715 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2023-10-06 03:22:30.754501457 +0000 2023-10-06T03:22:41.715 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2023-10-06 03:19:47.780607429 +0000 2023-10-06T03:22:41.715 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2023-10-06 03:19:47.780607429 +0000 2023-10-06T03:22:41.716 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2023-10-06T03:22:41.716 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T03:22:41.812 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2023-10-06T03:22:41.812 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2023-10-06T03:22:41.812 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000333041 s, 1.5 MB/s 2023-10-06T03:22:41.814 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T03:22:41.852 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T03:22:41.852 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T03:22:41.852 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T03:22:41.889 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T03:22:41.889 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_1 2023-10-06T03:22:41.965 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T03:22:41.965 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T03:22:41.965 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 5h/5d Inode: 452 Links: 1 2023-10-06T03:22:41.966 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T03:22:41.966 INFO:teuthology.orchestra.run.smithi083.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T03:22:41.966 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2023-10-06 03:22:31.731023729 +0000 2023-10-06T03:22:41.966 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2023-10-06 03:19:37.742504649 +0000 2023-10-06T03:22:41.966 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2023-10-06 03:19:37.742504649 +0000 2023-10-06T03:22:41.966 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: - 2023-10-06T03:22:41.966 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T03:22:42.063 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2023-10-06T03:22:42.063 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2023-10-06T03:22:42.063 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000366513 s, 1.4 MB/s 2023-10-06T03:22:42.066 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T03:22:42.103 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_2 2023-10-06T03:22:42.180 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T03:22:42.180 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T03:22:42.181 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 5h/5d Inode: 458 Links: 1 2023-10-06T03:22:42.181 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T03:22:42.181 INFO:teuthology.orchestra.run.smithi083.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T03:22:42.181 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2023-10-06 03:22:31.731023729 +0000 2023-10-06T03:22:42.181 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2023-10-06 03:19:38.533485851 +0000 2023-10-06T03:22:42.181 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2023-10-06 03:19:38.533485851 +0000 2023-10-06T03:22:42.181 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: - 2023-10-06T03:22:42.181 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T03:22:42.278 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2023-10-06T03:22:42.278 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2023-10-06T03:22:42.278 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000315533 s, 1.6 MB/s 2023-10-06T03:22:42.280 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T03:22:42.319 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_3 2023-10-06T03:22:42.395 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T03:22:42.396 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T03:22:42.396 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 5h/5d Inode: 464 Links: 1 2023-10-06T03:22:42.396 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T03:22:42.396 INFO:teuthology.orchestra.run.smithi083.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T03:22:42.396 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2023-10-06 03:22:31.732023705 +0000 2023-10-06T03:22:42.396 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2023-10-06 03:19:39.292467814 +0000 2023-10-06T03:22:42.396 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2023-10-06 03:19:39.292467814 +0000 2023-10-06T03:22:42.396 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: - 2023-10-06T03:22:42.396 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T03:22:42.493 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2023-10-06T03:22:42.493 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2023-10-06T03:22:42.493 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000312063 s, 1.6 MB/s 2023-10-06T03:22:42.495 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T03:22:42.533 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_4 2023-10-06T03:22:42.609 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T03:22:42.609 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T03:22:42.609 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 5h/5d Inode: 470 Links: 1 2023-10-06T03:22:42.609 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T03:22:42.609 INFO:teuthology.orchestra.run.smithi083.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T03:22:42.609 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2023-10-06 03:22:31.732023705 +0000 2023-10-06T03:22:42.610 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2023-10-06 03:19:40.069449350 +0000 2023-10-06T03:22:42.610 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2023-10-06 03:19:40.069449350 +0000 2023-10-06T03:22:42.610 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: - 2023-10-06T03:22:42.610 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T03:22:42.706 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2023-10-06T03:22:42.706 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2023-10-06T03:22:42.706 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000287892 s, 1.8 MB/s 2023-10-06T03:22:42.708 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T03:22:42.746 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T03:22:42.747 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi081.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi083.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-06T03:22:42.747 INFO:tasks.ceph:Generating config... 2023-10-06T03:22:42.748 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-06T03:22:42.748 INFO:tasks.ceph:[client] debug client = 20 2023-10-06T03:22:42.748 INFO:tasks.ceph:[client] debug ms = 1 2023-10-06T03:22:42.748 INFO:tasks.ceph:[client] pid file = 2023-10-06T03:22:42.748 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-06T03:22:42.748 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-06T03:22:42.748 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-10-06T03:22:42.749 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-06T03:22:42.749 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-06T03:22:42.749 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-06T03:22:42.749 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-06T03:22:42.749 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-06T03:22:42.749 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-06T03:22:42.749 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-06T03:22:42.749 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-06T03:22:42.749 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-06T03:22:42.749 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-06T03:22:42.749 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-06T03:22:42.750 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-06T03:22:42.750 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-06T03:22:42.750 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-06T03:22:42.750 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-06T03:22:42.750 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-06T03:22:42.750 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-06T03:22:42.750 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-10-06T03:22:42.750 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-10-06T03:22:42.750 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-06T03:22:42.750 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-06T03:22:42.750 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-10-06T03:22:42.751 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-06T03:22:42.751 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-06T03:22:42.751 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-06T03:22:42.751 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-06T03:22:42.751 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-06T03:22:42.751 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-06T03:22:42.751 INFO:tasks.ceph:Setting up mon.a... 2023-10-06T03:22:42.751 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-06T03:22:42.851 INFO:teuthology.orchestra.run.smithi081.stdout:creating /etc/ceph/ceph.keyring 2023-10-06T03:22:42.856 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-06T03:22:42.942 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T03:22:43.002 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.81'), ('mon.b', '172.21.15.83'), ('mon.c', '[v2:172.21.15.83:3301,v1:172.21.15.83:6790]')] 2023-10-06T03:22:43.002 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.81,172.21.15.83,[v2:172.21.15.83:3301,v1:172.21.15.83:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-06T03:22:43.003 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-06T03:22:43.003 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-06T03:22:43.039 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.81 --add b 172.21.15.83 --addv c '[v2:172.21.15.83:3301,v1:172.21.15.83:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:22:43.151 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:22:43.151 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: generated fsid 1807b5d7-9be8-43ad-aaf8-99a4273430b3 2023-10-06T03:22:43.151 INFO:teuthology.orchestra.run.smithi081.stdout:setting min_mon_release = octopus 2023-10-06T03:22:43.151 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 0 2023-10-06T03:22:43.151 INFO:teuthology.orchestra.run.smithi081.stdout:fsid 1807b5d7-9be8-43ad-aaf8-99a4273430b3 2023-10-06T03:22:43.151 INFO:teuthology.orchestra.run.smithi081.stdout:last_changed 2023-10-06T03:22:43.150576+0000 2023-10-06T03:22:43.151 INFO:teuthology.orchestra.run.smithi081.stdout:created 2023-10-06T03:22:43.150576+0000 2023-10-06T03:22:43.151 INFO:teuthology.orchestra.run.smithi081.stdout:min_mon_release 15 (octopus) 2023-10-06T03:22:43.151 INFO:teuthology.orchestra.run.smithi081.stdout:election_strategy: 1 2023-10-06T03:22:43.151 INFO:teuthology.orchestra.run.smithi081.stdout:0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.a 2023-10-06T03:22:43.152 INFO:teuthology.orchestra.run.smithi081.stdout:1: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.b 2023-10-06T03:22:43.152 INFO:teuthology.orchestra.run.smithi081.stdout:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2023-10-06T03:22:43.152 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-06T03:22:43.153 DEBUG:teuthology.orchestra.run.smithi081:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-06T03:22:43.188 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 1807b5d7-9be8-43ad-aaf8-99a4273430b3... 2023-10-06T03:22:43.189 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T03:22:43.233 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T03:22:43.338 INFO:teuthology.orchestra.run.smithi081.stdout:[global] 2023-10-06T03:22:43.339 INFO:teuthology.orchestra.run.smithi081.stdout: chdir = "" 2023-10-06T03:22:43.339 INFO:teuthology.orchestra.run.smithi081.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T03:22:43.339 INFO:teuthology.orchestra.run.smithi081.stdout: auth supported = cephx 2023-10-06T03:22:43.339 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:22:43.339 INFO:teuthology.orchestra.run.smithi081.stdout: filestore xattr use omap = true 2023-10-06T03:22:43.339 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:22:43.339 INFO:teuthology.orchestra.run.smithi081.stdout: mon clock drift allowed = 1.000 2023-10-06T03:22:43.339 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:22:43.340 INFO:teuthology.orchestra.run.smithi081.stdout: osd crush chooseleaf type = 0 2023-10-06T03:22:43.340 INFO:teuthology.orchestra.run.smithi081.stdout: auth debug = true 2023-10-06T03:22:43.340 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:22:43.340 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on old message = true 2023-10-06T03:22:43.340 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on bug = true 2023-10-06T03:22:43.340 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:22:43.341 INFO:teuthology.orchestra.run.smithi081.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T03:22:43.341 INFO:teuthology.orchestra.run.smithi081.stdout: mon pg warn max object skew = 0 2023-10-06T03:22:43.341 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:22:43.341 INFO:teuthology.orchestra.run.smithi081.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T03:22:43.342 INFO:teuthology.orchestra.run.smithi081.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T03:22:43.342 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:22:43.342 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default size = 2 2023-10-06T03:22:43.343 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:22:43.343 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow primary affinity = true 2023-10-06T03:22:43.343 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow pg remap = true 2023-10-06T03:22:43.343 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on legacy crush tunables = false 2023-10-06T03:22:43.343 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on crush straw calc version zero = false 2023-10-06T03:22:43.343 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on no sortbitwise = false 2023-10-06T03:22:43.343 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on osd down out interval zero = false 2023-10-06T03:22:43.344 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on too few osds = false 2023-10-06T03:22:43.344 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T03:22:43.344 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T03:22:43.344 INFO:teuthology.orchestra.run.smithi081.stdout: mon_allow_pool_size_one = true 2023-10-06T03:22:43.344 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:22:43.344 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T03:22:43.345 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:22:43.345 INFO:teuthology.orchestra.run.smithi081.stdout: osd default data pool replay window = 5 2023-10-06T03:22:43.345 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:22:43.346 INFO:teuthology.orchestra.run.smithi081.stdout: mon allow pool delete = true 2023-10-06T03:22:43.346 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:22:43.346 INFO:teuthology.orchestra.run.smithi081.stdout: mon cluster log file level = debug 2023-10-06T03:22:43.346 INFO:teuthology.orchestra.run.smithi081.stdout: debug asserts on shutdown = true 2023-10-06T03:22:43.346 INFO:teuthology.orchestra.run.smithi081.stdout: mon health detail to clog = false 2023-10-06T03:22:43.347 INFO:teuthology.orchestra.run.smithi081.stdout: mon host = "172.21.15.81,172.21.15.83,[v2:172.21.15.83:3301,v1:172.21.15.83:6790]" 2023-10-06T03:22:43.347 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on skipped message = False 2023-10-06T03:22:43.347 INFO:teuthology.orchestra.run.smithi081.stdout: fsid = 1807b5d7-9be8-43ad-aaf8-99a4273430b3 2023-10-06T03:22:43.347 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:22:43.347 INFO:teuthology.orchestra.run.smithi081.stdout:[osd] 2023-10-06T03:22:43.347 INFO:teuthology.orchestra.run.smithi081.stdout: osd journal size = 100 2023-10-06T03:22:43.348 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:22:43.348 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub load threshold = 5.0 2023-10-06T03:22:43.348 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub max interval = 600 2023-10-06T03:22:43.348 INFO:teuthology.orchestra.run.smithi081.stdout: osd mclock profile = high_recovery_ops 2023-10-06T03:22:43.348 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:22:43.348 INFO:teuthology.orchestra.run.smithi081.stdout: osd recover clone overlap = true 2023-10-06T03:22:43.349 INFO:teuthology.orchestra.run.smithi081.stdout: osd recovery max chunk = 1048576 2023-10-06T03:22:43.349 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:22:43.349 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug shutdown = true 2023-10-06T03:22:43.349 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug op order = true 2023-10-06T03:22:43.349 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug verify stray on activate = true 2023-10-06T03:22:43.349 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:22:43.349 INFO:teuthology.orchestra.run.smithi081.stdout: osd open classes on start = true 2023-10-06T03:22:43.349 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug pg log writeout = true 2023-10-06T03:22:43.349 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:22:43.349 INFO:teuthology.orchestra.run.smithi081.stdout: osd deep scrub update digest min age = 30 2023-10-06T03:22:43.350 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:22:43.350 INFO:teuthology.orchestra.run.smithi081.stdout: osd map max advance = 10 2023-10-06T03:22:43.350 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:22:43.350 INFO:teuthology.orchestra.run.smithi081.stdout: journal zero on create = true 2023-10-06T03:22:43.350 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:22:43.350 INFO:teuthology.orchestra.run.smithi081.stdout: filestore ondisk finisher threads = 3 2023-10-06T03:22:43.350 INFO:teuthology.orchestra.run.smithi081.stdout: filestore apply finisher threads = 3 2023-10-06T03:22:43.350 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:22:43.350 INFO:teuthology.orchestra.run.smithi081.stdout: bdev debug aio = true 2023-10-06T03:22:43.350 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug misdirected ops = true 2023-10-06T03:22:43.350 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore block size = 96636764160 2023-10-06T03:22:43.351 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore fsck on mount = True 2023-10-06T03:22:43.351 INFO:teuthology.orchestra.run.smithi081.stdout: debug bluefs = 20 2023-10-06T03:22:43.351 INFO:teuthology.orchestra.run.smithi081.stdout: debug bluestore = 20 2023-10-06T03:22:43.351 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2023-10-06T03:22:43.351 INFO:teuthology.orchestra.run.smithi081.stdout: debug osd = 20 2023-10-06T03:22:43.351 INFO:teuthology.orchestra.run.smithi081.stdout: debug rocksdb = 10 2023-10-06T03:22:43.351 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T03:22:43.351 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd full ratio = 0.9 2023-10-06T03:22:43.351 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd nearfull ratio = 0.8 2023-10-06T03:22:43.351 INFO:teuthology.orchestra.run.smithi081.stdout: osd failsafe full ratio = 0.95 2023-10-06T03:22:43.351 INFO:teuthology.orchestra.run.smithi081.stdout: osd objectstore = bluestore 2023-10-06T03:22:43.351 INFO:teuthology.orchestra.run.smithi081.stdout: osd op complaint time = 180 2023-10-06T03:22:43.352 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:22:43.352 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr] 2023-10-06T03:22:43.352 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2023-10-06T03:22:43.352 INFO:teuthology.orchestra.run.smithi081.stdout: debug mgr = 20 2023-10-06T03:22:43.352 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2023-10-06T03:22:43.352 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2023-10-06T03:22:43.352 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2023-10-06T03:22:43.352 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2023-10-06T03:22:43.352 INFO:teuthology.orchestra.run.smithi081.stdout: mgr/telemetry/nag = false 2023-10-06T03:22:43.352 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:22:43.352 INFO:teuthology.orchestra.run.smithi081.stdout:[mon] 2023-10-06T03:22:43.353 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2023-10-06T03:22:43.353 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2023-10-06T03:22:43.353 INFO:teuthology.orchestra.run.smithi081.stdout: debug paxos = 20 2023-10-06T03:22:43.353 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2023-10-06T03:22:43.353 INFO:teuthology.orchestra.run.smithi081.stdout: mon data avail warn = 5 2023-10-06T03:22:43.353 INFO:teuthology.orchestra.run.smithi081.stdout: mon mgr mkfs grace = 240 2023-10-06T03:22:43.353 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2023-10-06T03:22:43.353 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd reporter subtree level = osd 2023-10-06T03:22:43.353 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd prime pg temp = true 2023-10-06T03:22:43.353 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2023-10-06T03:22:43.354 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:22:43.354 INFO:teuthology.orchestra.run.smithi081.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T03:22:43.354 INFO:teuthology.orchestra.run.smithi081.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T03:22:43.354 INFO:teuthology.orchestra.run.smithi081.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T03:22:43.354 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:22:43.354 INFO:teuthology.orchestra.run.smithi081.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T03:22:43.354 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T03:22:43.354 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T03:22:43.354 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:22:43.355 INFO:teuthology.orchestra.run.smithi081.stdout: # 1m isn't quite enough 2023-10-06T03:22:43.355 INFO:teuthology.orchestra.run.smithi081.stdout: mon_down_mkfs_grace = 2m 2023-10-06T03:22:43.355 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:22:43.355 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_filestore_osds = false 2023-10-06T03:22:43.355 INFO:teuthology.orchestra.run.smithi081.stdout: mon op complaint time = 120 2023-10-06T03:22:43.355 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:22:43.355 INFO:teuthology.orchestra.run.smithi081.stdout:[client] 2023-10-06T03:22:43.355 INFO:teuthology.orchestra.run.smithi081.stdout: rgw cache enabled = true 2023-10-06T03:22:43.355 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable ops log = true 2023-10-06T03:22:43.355 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable usage log = true 2023-10-06T03:22:43.355 INFO:teuthology.orchestra.run.smithi081.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T03:22:43.356 INFO:teuthology.orchestra.run.smithi081.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T03:22:43.356 INFO:teuthology.orchestra.run.smithi081.stdout: client mount timeout = 600 2023-10-06T03:22:43.356 INFO:teuthology.orchestra.run.smithi081.stdout: debug client = 20 2023-10-06T03:22:43.356 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2023-10-06T03:22:43.356 INFO:teuthology.orchestra.run.smithi081.stdout: pid file = "" 2023-10-06T03:22:43.356 INFO:teuthology.orchestra.run.smithi081.stdout: rados mon op timeout = 900 2023-10-06T03:22:43.356 INFO:teuthology.orchestra.run.smithi081.stdout: rados osd op timeout = 900 2023-10-06T03:22:43.356 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.a] 2023-10-06T03:22:43.356 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.b] 2023-10-06T03:22:43.357 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.c] 2023-10-06T03:22:43.357 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.a] 2023-10-06T03:22:43.357 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.c] 2023-10-06T03:22:43.357 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.b] 2023-10-06T03:22:43.357 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.d] 2023-10-06T03:22:43.357 INFO:teuthology.orchestra.run.smithi081.stdout:[mds] 2023-10-06T03:22:43.357 INFO:teuthology.orchestra.run.smithi081.stdout: debug mds = 20 2023-10-06T03:22:43.357 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2023-10-06T03:22:43.357 INFO:teuthology.orchestra.run.smithi081.stdout: mds debug frag = True 2023-10-06T03:22:43.357 INFO:teuthology.orchestra.run.smithi081.stdout: mds debug scatterstat = True 2023-10-06T03:22:43.358 INFO:teuthology.orchestra.run.smithi081.stdout: mds op complaint time = 180 2023-10-06T03:22:43.358 INFO:teuthology.orchestra.run.smithi081.stdout: mds verify scatter = True 2023-10-06T03:22:43.358 INFO:teuthology.orchestra.run.smithi081.stdout: osd op complaint time = 180 2023-10-06T03:22:43.358 INFO:teuthology.orchestra.run.smithi081.stdout: rados mon op timeout = 900 2023-10-06T03:22:43.358 INFO:teuthology.orchestra.run.smithi081.stdout: rados osd op timeout = 900 2023-10-06T03:22:43.359 INFO:teuthology.orchestra.run.smithi083.stdout:[global] 2023-10-06T03:22:43.359 INFO:teuthology.orchestra.run.smithi083.stdout: chdir = "" 2023-10-06T03:22:43.359 INFO:teuthology.orchestra.run.smithi083.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T03:22:43.359 INFO:teuthology.orchestra.run.smithi083.stdout: auth supported = cephx 2023-10-06T03:22:43.359 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T03:22:43.359 INFO:teuthology.orchestra.run.smithi083.stdout: filestore xattr use omap = true 2023-10-06T03:22:43.359 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T03:22:43.360 INFO:teuthology.orchestra.run.smithi083.stdout: mon clock drift allowed = 1.000 2023-10-06T03:22:43.360 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T03:22:43.360 INFO:teuthology.orchestra.run.smithi083.stdout: osd crush chooseleaf type = 0 2023-10-06T03:22:43.360 INFO:teuthology.orchestra.run.smithi083.stdout: auth debug = true 2023-10-06T03:22:43.360 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T03:22:43.360 INFO:teuthology.orchestra.run.smithi083.stdout: ms die on old message = true 2023-10-06T03:22:43.360 INFO:teuthology.orchestra.run.smithi083.stdout: ms die on bug = true 2023-10-06T03:22:43.360 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T03:22:43.361 INFO:teuthology.orchestra.run.smithi083.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T03:22:43.361 INFO:teuthology.orchestra.run.smithi083.stdout: mon pg warn max object skew = 0 2023-10-06T03:22:43.361 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T03:22:43.361 INFO:teuthology.orchestra.run.smithi083.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T03:22:43.362 INFO:teuthology.orchestra.run.smithi083.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T03:22:43.362 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T03:22:43.362 INFO:teuthology.orchestra.run.smithi083.stdout: osd pool default size = 2 2023-10-06T03:22:43.362 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T03:22:43.362 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd allow primary affinity = true 2023-10-06T03:22:43.362 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd allow pg remap = true 2023-10-06T03:22:43.362 INFO:teuthology.orchestra.run.smithi083.stdout: mon warn on legacy crush tunables = false 2023-10-06T03:22:43.362 INFO:teuthology.orchestra.run.smithi083.stdout: mon warn on crush straw calc version zero = false 2023-10-06T03:22:43.362 INFO:teuthology.orchestra.run.smithi083.stdout: mon warn on no sortbitwise = false 2023-10-06T03:22:43.362 INFO:teuthology.orchestra.run.smithi083.stdout: mon warn on osd down out interval zero = false 2023-10-06T03:22:43.362 INFO:teuthology.orchestra.run.smithi083.stdout: mon warn on too few osds = false 2023-10-06T03:22:43.363 INFO:teuthology.orchestra.run.smithi083.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T03:22:43.363 INFO:teuthology.orchestra.run.smithi083.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T03:22:43.363 INFO:teuthology.orchestra.run.smithi083.stdout: mon_allow_pool_size_one = true 2023-10-06T03:22:43.363 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T03:22:43.363 INFO:teuthology.orchestra.run.smithi083.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T03:22:43.363 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T03:22:43.363 INFO:teuthology.orchestra.run.smithi083.stdout: osd default data pool replay window = 5 2023-10-06T03:22:43.363 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T03:22:43.363 INFO:teuthology.orchestra.run.smithi083.stdout: mon allow pool delete = true 2023-10-06T03:22:43.363 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T03:22:43.363 INFO:teuthology.orchestra.run.smithi083.stdout: mon cluster log file level = debug 2023-10-06T03:22:43.364 INFO:teuthology.orchestra.run.smithi083.stdout: debug asserts on shutdown = true 2023-10-06T03:22:43.364 INFO:teuthology.orchestra.run.smithi083.stdout: mon health detail to clog = false 2023-10-06T03:22:43.364 INFO:teuthology.orchestra.run.smithi083.stdout: mon host = "172.21.15.81,172.21.15.83,[v2:172.21.15.83:3301,v1:172.21.15.83:6790]" 2023-10-06T03:22:43.364 INFO:teuthology.orchestra.run.smithi083.stdout: ms die on skipped message = False 2023-10-06T03:22:43.364 INFO:teuthology.orchestra.run.smithi083.stdout: fsid = 1807b5d7-9be8-43ad-aaf8-99a4273430b3 2023-10-06T03:22:43.364 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T03:22:43.364 INFO:teuthology.orchestra.run.smithi083.stdout:[osd] 2023-10-06T03:22:43.364 INFO:teuthology.orchestra.run.smithi083.stdout: osd journal size = 100 2023-10-06T03:22:43.364 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T03:22:43.364 INFO:teuthology.orchestra.run.smithi083.stdout: osd scrub load threshold = 5.0 2023-10-06T03:22:43.364 INFO:teuthology.orchestra.run.smithi083.stdout: osd scrub max interval = 600 2023-10-06T03:22:43.365 INFO:teuthology.orchestra.run.smithi083.stdout: osd mclock profile = high_recovery_ops 2023-10-06T03:22:43.365 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T03:22:43.365 INFO:teuthology.orchestra.run.smithi083.stdout: osd recover clone overlap = true 2023-10-06T03:22:43.365 INFO:teuthology.orchestra.run.smithi083.stdout: osd recovery max chunk = 1048576 2023-10-06T03:22:43.365 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T03:22:43.365 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug shutdown = true 2023-10-06T03:22:43.365 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug op order = true 2023-10-06T03:22:43.365 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug verify stray on activate = true 2023-10-06T03:22:43.365 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T03:22:43.365 INFO:teuthology.orchestra.run.smithi083.stdout: osd open classes on start = true 2023-10-06T03:22:43.365 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug pg log writeout = true 2023-10-06T03:22:43.365 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T03:22:43.366 INFO:teuthology.orchestra.run.smithi083.stdout: osd deep scrub update digest min age = 30 2023-10-06T03:22:43.366 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T03:22:43.366 INFO:teuthology.orchestra.run.smithi083.stdout: osd map max advance = 10 2023-10-06T03:22:43.366 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T03:22:43.366 INFO:teuthology.orchestra.run.smithi083.stdout: journal zero on create = true 2023-10-06T03:22:43.366 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T03:22:43.366 INFO:teuthology.orchestra.run.smithi083.stdout: filestore ondisk finisher threads = 3 2023-10-06T03:22:43.366 INFO:teuthology.orchestra.run.smithi083.stdout: filestore apply finisher threads = 3 2023-10-06T03:22:43.366 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T03:22:43.366 INFO:teuthology.orchestra.run.smithi083.stdout: bdev debug aio = true 2023-10-06T03:22:43.366 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug misdirected ops = true 2023-10-06T03:22:43.367 INFO:teuthology.orchestra.run.smithi083.stdout: bluestore block size = 96636764160 2023-10-06T03:22:43.367 INFO:teuthology.orchestra.run.smithi083.stdout: bluestore fsck on mount = True 2023-10-06T03:22:43.367 INFO:teuthology.orchestra.run.smithi083.stdout: debug bluefs = 20 2023-10-06T03:22:43.367 INFO:teuthology.orchestra.run.smithi083.stdout: debug bluestore = 20 2023-10-06T03:22:43.367 INFO:teuthology.orchestra.run.smithi083.stdout: debug ms = 1 2023-10-06T03:22:43.367 INFO:teuthology.orchestra.run.smithi083.stdout: debug osd = 20 2023-10-06T03:22:43.367 INFO:teuthology.orchestra.run.smithi083.stdout: debug rocksdb = 10 2023-10-06T03:22:43.367 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T03:22:43.367 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd full ratio = 0.9 2023-10-06T03:22:43.367 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd nearfull ratio = 0.8 2023-10-06T03:22:43.367 INFO:teuthology.orchestra.run.smithi083.stdout: osd failsafe full ratio = 0.95 2023-10-06T03:22:43.368 INFO:teuthology.orchestra.run.smithi083.stdout: osd objectstore = bluestore 2023-10-06T03:22:43.368 INFO:teuthology.orchestra.run.smithi083.stdout: osd op complaint time = 180 2023-10-06T03:22:43.368 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T03:22:43.368 INFO:teuthology.orchestra.run.smithi083.stdout:[mgr] 2023-10-06T03:22:43.368 INFO:teuthology.orchestra.run.smithi083.stdout: debug ms = 1 2023-10-06T03:22:43.368 INFO:teuthology.orchestra.run.smithi083.stdout: debug mgr = 20 2023-10-06T03:22:43.368 INFO:teuthology.orchestra.run.smithi083.stdout: debug mon = 20 2023-10-06T03:22:43.368 INFO:teuthology.orchestra.run.smithi083.stdout: debug auth = 20 2023-10-06T03:22:43.368 INFO:teuthology.orchestra.run.smithi083.stdout: mon reweight min pgs per osd = 4 2023-10-06T03:22:43.368 INFO:teuthology.orchestra.run.smithi083.stdout: mon reweight min bytes per osd = 10 2023-10-06T03:22:43.368 INFO:teuthology.orchestra.run.smithi083.stdout: mgr/telemetry/nag = false 2023-10-06T03:22:43.369 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T03:22:43.369 INFO:teuthology.orchestra.run.smithi083.stdout:[mon] 2023-10-06T03:22:43.369 INFO:teuthology.orchestra.run.smithi083.stdout: debug ms = 1 2023-10-06T03:22:43.369 INFO:teuthology.orchestra.run.smithi083.stdout: debug mon = 20 2023-10-06T03:22:43.369 INFO:teuthology.orchestra.run.smithi083.stdout: debug paxos = 20 2023-10-06T03:22:43.369 INFO:teuthology.orchestra.run.smithi083.stdout: debug auth = 20 2023-10-06T03:22:43.369 INFO:teuthology.orchestra.run.smithi083.stdout: mon data avail warn = 5 2023-10-06T03:22:43.369 INFO:teuthology.orchestra.run.smithi083.stdout: mon mgr mkfs grace = 240 2023-10-06T03:22:43.369 INFO:teuthology.orchestra.run.smithi083.stdout: mon reweight min pgs per osd = 4 2023-10-06T03:22:43.369 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd reporter subtree level = osd 2023-10-06T03:22:43.369 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd prime pg temp = true 2023-10-06T03:22:43.370 INFO:teuthology.orchestra.run.smithi083.stdout: mon reweight min bytes per osd = 10 2023-10-06T03:22:43.370 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T03:22:43.370 INFO:teuthology.orchestra.run.smithi083.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T03:22:43.370 INFO:teuthology.orchestra.run.smithi083.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T03:22:43.370 INFO:teuthology.orchestra.run.smithi083.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T03:22:43.370 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T03:22:43.370 INFO:teuthology.orchestra.run.smithi083.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T03:22:43.370 INFO:teuthology.orchestra.run.smithi083.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T03:22:43.370 INFO:teuthology.orchestra.run.smithi083.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T03:22:43.370 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T03:22:43.370 INFO:teuthology.orchestra.run.smithi083.stdout: # 1m isn't quite enough 2023-10-06T03:22:43.371 INFO:teuthology.orchestra.run.smithi083.stdout: mon_down_mkfs_grace = 2m 2023-10-06T03:22:43.371 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T03:22:43.371 INFO:teuthology.orchestra.run.smithi083.stdout: mon_warn_on_filestore_osds = false 2023-10-06T03:22:43.371 INFO:teuthology.orchestra.run.smithi083.stdout: mon op complaint time = 120 2023-10-06T03:22:43.371 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T03:22:43.371 INFO:teuthology.orchestra.run.smithi083.stdout:[client] 2023-10-06T03:22:43.371 INFO:teuthology.orchestra.run.smithi083.stdout: rgw cache enabled = true 2023-10-06T03:22:43.371 INFO:teuthology.orchestra.run.smithi083.stdout: rgw enable ops log = true 2023-10-06T03:22:43.371 INFO:teuthology.orchestra.run.smithi083.stdout: rgw enable usage log = true 2023-10-06T03:22:43.371 INFO:teuthology.orchestra.run.smithi083.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T03:22:43.371 INFO:teuthology.orchestra.run.smithi083.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T03:22:43.372 INFO:teuthology.orchestra.run.smithi083.stdout: client mount timeout = 600 2023-10-06T03:22:43.372 INFO:teuthology.orchestra.run.smithi083.stdout: debug client = 20 2023-10-06T03:22:43.372 INFO:teuthology.orchestra.run.smithi083.stdout: debug ms = 1 2023-10-06T03:22:43.372 INFO:teuthology.orchestra.run.smithi083.stdout: pid file = "" 2023-10-06T03:22:43.372 INFO:teuthology.orchestra.run.smithi083.stdout: rados mon op timeout = 900 2023-10-06T03:22:43.372 INFO:teuthology.orchestra.run.smithi083.stdout: rados osd op timeout = 900 2023-10-06T03:22:43.372 INFO:teuthology.orchestra.run.smithi083.stdout:[mon.a] 2023-10-06T03:22:43.372 INFO:teuthology.orchestra.run.smithi083.stdout:[mon.b] 2023-10-06T03:22:43.372 INFO:teuthology.orchestra.run.smithi083.stdout:[mon.c] 2023-10-06T03:22:43.372 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.a] 2023-10-06T03:22:43.372 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.c] 2023-10-06T03:22:43.372 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.b] 2023-10-06T03:22:43.373 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.d] 2023-10-06T03:22:43.373 INFO:teuthology.orchestra.run.smithi083.stdout:[mds] 2023-10-06T03:22:43.373 INFO:teuthology.orchestra.run.smithi083.stdout: debug mds = 20 2023-10-06T03:22:43.373 INFO:teuthology.orchestra.run.smithi083.stdout: debug ms = 1 2023-10-06T03:22:43.373 INFO:teuthology.orchestra.run.smithi083.stdout: mds debug frag = True 2023-10-06T03:22:43.373 INFO:teuthology.orchestra.run.smithi083.stdout: mds debug scatterstat = True 2023-10-06T03:22:43.373 INFO:teuthology.orchestra.run.smithi083.stdout: mds op complaint time = 180 2023-10-06T03:22:43.373 INFO:teuthology.orchestra.run.smithi083.stdout: mds verify scatter = True 2023-10-06T03:22:43.373 INFO:teuthology.orchestra.run.smithi083.stdout: osd op complaint time = 180 2023-10-06T03:22:43.373 INFO:teuthology.orchestra.run.smithi083.stdout: rados mon op timeout = 900 2023-10-06T03:22:43.373 INFO:teuthology.orchestra.run.smithi083.stdout: rados osd op timeout = 900 2023-10-06T03:22:43.377 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-06T03:22:43.378 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-06T03:22:43.474 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-06T03:22:43.474 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-06T03:22:43.474 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-06T03:22:43.510 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-06T03:22:43.510 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-06T03:22:43.585 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi081.front.sepia.ceph.com 2023-10-06T03:22:43.585 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-06T03:22:43.585 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T03:22:43.586 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T03:22:43.711 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-06T03:22:43.712 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:22:43.787 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T03:22:43.787 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T03:22:43.787 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T03:22:43.787 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T03:22:43.876 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T03:22:43.876 DEBUG:teuthology.orchestra.run.smithi083:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:22:43.951 INFO:tasks.ceph:Setting up mon nodes... 2023-10-06T03:22:43.951 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-06T03:22:43.951 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-06T03:22:44.061 INFO:teuthology.orchestra.run.smithi081.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-06T03:22:44.066 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-06T03:22:44.180 INFO:teuthology.orchestra.run.smithi083.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-06T03:22:44.186 INFO:tasks.ceph:Setting up mds nodes... 2023-10-06T03:22:44.187 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-06T03:22:44.295 INFO:teuthology.orchestra.run.smithi081.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-06T03:22:44.300 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-06T03:22:44.360 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-06T03:22:44.468 INFO:teuthology.orchestra.run.smithi081.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-06T03:22:44.473 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-06T03:22:44.533 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-06T03:22:44.642 INFO:teuthology.orchestra.run.smithi083.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-06T03:22:44.646 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-06T03:22:44.707 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-06T03:22:44.816 INFO:teuthology.orchestra.run.smithi083.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-06T03:22:44.821 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-06T03:22:44.880 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-06T03:22:44.881 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-06T03:22:44.963 INFO:teuthology.orchestra.run.smithi081.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-06T03:22:44.994 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-06T03:22:45.077 INFO:teuthology.orchestra.run.smithi081.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-06T03:22:45.107 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-06T03:22:45.190 INFO:teuthology.orchestra.run.smithi083.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-06T03:22:45.220 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-06T03:22:45.301 INFO:teuthology.orchestra.run.smithi083.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-06T03:22:45.332 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-06T03:22:45.332 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi081.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi083.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-06T03:22:45.333 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-06T03:22:45.394 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T03:22:45.394 INFO:tasks.ceph:role: osd.0 2023-10-06T03:22:45.394 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi081.front.sepia.ceph.com 2023-10-06T03:22:45.395 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-06T03:22:45.461 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T03:22:45.461 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T03:22:45.461 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T03:22:45.461 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 2023-10-06T03:22:45.461 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T03:22:45.461 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2023-10-06T03:22:45.461 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T03:22:45.462 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T03:22:45.462 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T03:22:45.462 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T03:22:45.892 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2023-10-06T03:22:45.896 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2023-10-06T03:22:45.896 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-06T03:22:46.090 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-06T03:22:46.157 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-06T03:22:46.217 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T03:22:46.217 INFO:tasks.ceph:role: osd.1 2023-10-06T03:22:46.217 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi081.front.sepia.ceph.com 2023-10-06T03:22:46.217 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-06T03:22:46.284 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T03:22:46.284 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T03:22:46.284 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T03:22:46.284 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 2023-10-06T03:22:46.284 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T03:22:46.285 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2023-10-06T03:22:46.285 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T03:22:46.285 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T03:22:46.285 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T03:22:46.285 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T03:22:46.695 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2023-10-06T03:22:46.699 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2023-10-06T03:22:46.699 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-06T03:22:46.836 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-06T03:22:46.902 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-06T03:22:46.962 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T03:22:46.963 INFO:tasks.ceph:role: osd.2 2023-10-06T03:22:46.963 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi081.front.sepia.ceph.com 2023-10-06T03:22:46.963 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-06T03:22:47.030 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T03:22:47.031 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T03:22:47.031 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T03:22:47.031 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 2023-10-06T03:22:47.031 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T03:22:47.031 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2023-10-06T03:22:47.031 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T03:22:47.031 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T03:22:47.031 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T03:22:47.031 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T03:22:47.476 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2023-10-06T03:22:47.480 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2023-10-06T03:22:47.481 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-06T03:22:47.643 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-06T03:22:47.710 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-06T03:22:47.769 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T03:22:47.770 INFO:tasks.ceph:role: osd.3 2023-10-06T03:22:47.770 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi081.front.sepia.ceph.com 2023-10-06T03:22:47.770 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-06T03:22:47.837 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T03:22:47.837 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T03:22:47.837 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T03:22:47.837 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 2023-10-06T03:22:47.837 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T03:22:47.837 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2023-10-06T03:22:47.838 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T03:22:47.838 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T03:22:47.838 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T03:22:47.838 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T03:22:48.275 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2023-10-06T03:22:48.278 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2023-10-06T03:22:48.278 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-06T03:22:48.467 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-06T03:22:48.537 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:22:48.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:22:48.651+0000 7f5296a8d540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-06T03:22:48.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:22:48.651+0000 7f5296a8d540 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-06T03:22:48.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:22:48.651+0000 7f5296a8d540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T03:22:48.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:22:48.651+0000 7f5296a8d540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T03:22:48.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:22:48.651+0000 7f5296a8d540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T03:22:48.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:22:48.653+0000 7f5296a8d540 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-06T03:22:49.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:22:49.193+0000 7f5296a8d540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:22:49.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:22:49.954+0000 7f5296a8d540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:22:50.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:22:50.721+0000 7f5296a8d540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:22:51.534 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-06T03:22:51.606 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:22:51.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:22:51.707+0000 7f59ea376540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-06T03:22:51.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:22:51.707+0000 7f59ea376540 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-06T03:22:51.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:22:51.707+0000 7f59ea376540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T03:22:51.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:22:51.707+0000 7f59ea376540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T03:22:51.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:22:51.708+0000 7f59ea376540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T03:22:51.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:22:51.709+0000 7f59ea376540 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-06T03:22:52.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:22:52.246+0000 7f59ea376540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:22:53.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:22:53.005+0000 7f59ea376540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:22:53.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:22:53.770+0000 7f59ea376540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:22:54.589 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-06T03:22:54.652 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:22:54.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:22:54.740+0000 7f7f428df540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-06T03:22:54.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:22:54.741+0000 7f7f428df540 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-06T03:22:54.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:22:54.741+0000 7f7f428df540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T03:22:54.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:22:54.741+0000 7f7f428df540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T03:22:54.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:22:54.741+0000 7f7f428df540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T03:22:54.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:22:54.743+0000 7f7f428df540 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-06T03:22:55.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:22:55.281+0000 7f7f428df540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:22:56.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:22:56.045+0000 7f7f428df540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:22:56.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:22:56.807+0000 7f7f428df540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:22:57.625 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-06T03:22:57.698 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:22:57.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:22:57.854+0000 7f410d9fc540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-06T03:22:57.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:22:57.854+0000 7f410d9fc540 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-06T03:22:57.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:22:57.854+0000 7f410d9fc540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T03:22:57.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:22:57.854+0000 7f410d9fc540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T03:22:57.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:22:57.854+0000 7f410d9fc540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T03:22:57.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:22:57.856+0000 7f410d9fc540 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-06T03:22:58.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:22:58.389+0000 7f410d9fc540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:22:59.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:22:59.152+0000 7f410d9fc540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:22:59.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:22:59.915+0000 7f410d9fc540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:23:00.726 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-06T03:23:00.790 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-06T03:23:00.858 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T03:23:00.858 INFO:tasks.ceph:role: osd.4 2023-10-06T03:23:00.858 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T03:23:00.858 DEBUG:teuthology.orchestra.run.smithi083:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-06T03:23:00.927 INFO:teuthology.orchestra.run.smithi083.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T03:23:00.928 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T03:23:00.928 INFO:teuthology.orchestra.run.smithi083.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T03:23:00.928 INFO:teuthology.orchestra.run.smithi083.stdout: = reflink=1 2023-10-06T03:23:00.928 INFO:teuthology.orchestra.run.smithi083.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T03:23:00.928 INFO:teuthology.orchestra.run.smithi083.stdout: = sunit=0 swidth=0 blks 2023-10-06T03:23:00.928 INFO:teuthology.orchestra.run.smithi083.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T03:23:00.928 INFO:teuthology.orchestra.run.smithi083.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T03:23:00.928 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T03:23:00.928 INFO:teuthology.orchestra.run.smithi083.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T03:23:01.355 INFO:teuthology.orchestra.run.smithi083.stdout:Discarding blocks...Done. 2023-10-06T03:23:01.359 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi083.front.sepia.ceph.com -o noatime 2023-10-06T03:23:01.359 DEBUG:teuthology.orchestra.run.smithi083:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-06T03:23:01.550 DEBUG:teuthology.orchestra.run.smithi083:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-06T03:23:01.621 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-06T03:23:01.682 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T03:23:01.682 INFO:tasks.ceph:role: osd.5 2023-10-06T03:23:01.682 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T03:23:01.682 DEBUG:teuthology.orchestra.run.smithi083:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-06T03:23:01.755 INFO:teuthology.orchestra.run.smithi083.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T03:23:01.755 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T03:23:01.755 INFO:teuthology.orchestra.run.smithi083.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T03:23:01.755 INFO:teuthology.orchestra.run.smithi083.stdout: = reflink=1 2023-10-06T03:23:01.756 INFO:teuthology.orchestra.run.smithi083.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T03:23:01.756 INFO:teuthology.orchestra.run.smithi083.stdout: = sunit=0 swidth=0 blks 2023-10-06T03:23:01.756 INFO:teuthology.orchestra.run.smithi083.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T03:23:01.756 INFO:teuthology.orchestra.run.smithi083.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T03:23:01.756 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T03:23:01.756 INFO:teuthology.orchestra.run.smithi083.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T03:23:02.163 INFO:teuthology.orchestra.run.smithi083.stdout:Discarding blocks...Done. 2023-10-06T03:23:02.167 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi083.front.sepia.ceph.com -o noatime 2023-10-06T03:23:02.168 DEBUG:teuthology.orchestra.run.smithi083:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-06T03:23:02.305 DEBUG:teuthology.orchestra.run.smithi083:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-06T03:23:02.372 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-06T03:23:02.432 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T03:23:02.432 INFO:tasks.ceph:role: osd.6 2023-10-06T03:23:02.433 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T03:23:02.433 DEBUG:teuthology.orchestra.run.smithi083:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-06T03:23:02.502 INFO:teuthology.orchestra.run.smithi083.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T03:23:02.502 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T03:23:02.502 INFO:teuthology.orchestra.run.smithi083.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T03:23:02.502 INFO:teuthology.orchestra.run.smithi083.stdout: = reflink=1 2023-10-06T03:23:02.502 INFO:teuthology.orchestra.run.smithi083.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T03:23:02.503 INFO:teuthology.orchestra.run.smithi083.stdout: = sunit=0 swidth=0 blks 2023-10-06T03:23:02.503 INFO:teuthology.orchestra.run.smithi083.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T03:23:02.503 INFO:teuthology.orchestra.run.smithi083.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T03:23:02.503 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T03:23:02.503 INFO:teuthology.orchestra.run.smithi083.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T03:23:02.952 INFO:teuthology.orchestra.run.smithi083.stdout:Discarding blocks...Done. 2023-10-06T03:23:02.955 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi083.front.sepia.ceph.com -o noatime 2023-10-06T03:23:02.955 DEBUG:teuthology.orchestra.run.smithi083:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-06T03:23:03.129 DEBUG:teuthology.orchestra.run.smithi083:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-06T03:23:03.198 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-06T03:23:03.258 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T03:23:03.258 INFO:tasks.ceph:role: osd.7 2023-10-06T03:23:03.258 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T03:23:03.258 DEBUG:teuthology.orchestra.run.smithi083:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-06T03:23:03.325 INFO:teuthology.orchestra.run.smithi083.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T03:23:03.325 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T03:23:03.326 INFO:teuthology.orchestra.run.smithi083.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T03:23:03.326 INFO:teuthology.orchestra.run.smithi083.stdout: = reflink=1 2023-10-06T03:23:03.326 INFO:teuthology.orchestra.run.smithi083.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T03:23:03.326 INFO:teuthology.orchestra.run.smithi083.stdout: = sunit=0 swidth=0 blks 2023-10-06T03:23:03.326 INFO:teuthology.orchestra.run.smithi083.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T03:23:03.326 INFO:teuthology.orchestra.run.smithi083.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T03:23:03.326 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T03:23:03.326 INFO:teuthology.orchestra.run.smithi083.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T03:23:03.754 INFO:teuthology.orchestra.run.smithi083.stdout:Discarding blocks...Done. 2023-10-06T03:23:03.759 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi083.front.sepia.ceph.com -o noatime 2023-10-06T03:23:03.759 DEBUG:teuthology.orchestra.run.smithi083:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-06T03:23:03.915 DEBUG:teuthology.orchestra.run.smithi083:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-06T03:23:03.984 DEBUG:teuthology.orchestra.run.smithi083:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:23:04.097 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:04.096+0000 7f6b05dff540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-06T03:23:04.098 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:04.096+0000 7f6b05dff540 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-06T03:23:04.098 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:04.096+0000 7f6b05dff540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T03:23:04.098 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:04.096+0000 7f6b05dff540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T03:23:04.098 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:04.096+0000 7f6b05dff540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T03:23:04.099 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:04.098+0000 7f6b05dff540 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-06T03:23:04.638 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:04.636+0000 7f6b05dff540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:23:05.400 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:05.399+0000 7f6b05dff540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:23:06.168 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:06.167+0000 7f6b05dff540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:23:06.980 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-06T03:23:07.045 DEBUG:teuthology.orchestra.run.smithi083:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:23:07.137 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:07.136+0000 7fa86a9ba540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-06T03:23:07.138 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:07.136+0000 7fa86a9ba540 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-06T03:23:07.138 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:07.136+0000 7fa86a9ba540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T03:23:07.138 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:07.136+0000 7fa86a9ba540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T03:23:07.138 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:07.136+0000 7fa86a9ba540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T03:23:07.138 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:07.138+0000 7fa86a9ba540 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-06T03:23:07.675 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:07.674+0000 7fa86a9ba540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:23:08.440 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:08.439+0000 7fa86a9ba540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:23:09.205 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:09.204+0000 7fa86a9ba540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:23:10.020 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-06T03:23:10.085 DEBUG:teuthology.orchestra.run.smithi083:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:23:10.178 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:10.177+0000 7f991f2f8540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-06T03:23:10.178 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:10.177+0000 7f991f2f8540 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-06T03:23:10.179 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:10.177+0000 7f991f2f8540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T03:23:10.179 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:10.177+0000 7f991f2f8540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T03:23:10.179 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:10.177+0000 7f991f2f8540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T03:23:10.180 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:10.179+0000 7f991f2f8540 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-06T03:23:10.716 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:10.715+0000 7f991f2f8540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:23:10.811 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:23:10.817 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:23:11.481 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:11.480+0000 7f991f2f8540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:23:12.244 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:12.243+0000 7f991f2f8540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:23:13.056 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-06T03:23:13.118 DEBUG:teuthology.orchestra.run.smithi083:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:23:13.209 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:13.208+0000 7f47b0684540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-06T03:23:13.209 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:13.208+0000 7f47b0684540 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-06T03:23:13.209 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:13.208+0000 7f47b0684540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T03:23:13.209 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:13.208+0000 7f47b0684540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T03:23:13.209 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:13.208+0000 7f47b0684540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T03:23:13.210 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:13.210+0000 7f47b0684540 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-06T03:23:13.745 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:13.744+0000 7f47b0684540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:23:14.507 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:14.506+0000 7f47b0684540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:23:15.278 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:15.275+0000 7f47b0684540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:23:16.088 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-06T03:23:16.152 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-06T03:23:16.153 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-06T03:23:16.153 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-06T03:23:16.220 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-06T03:23:16.220 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-06T03:23:16.322 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-06T03:23:16.322 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-06T03:23:16.422 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-06T03:23:16.422 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-06T03:23:16.521 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-06T03:23:16.522 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-06T03:23:16.621 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-06T03:23:16.621 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-06T03:23:16.721 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-06T03:23:16.721 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-06T03:23:16.821 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T03:23:16.821 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-06T03:23:16.887 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T03:23:16.887 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-06T03:23:16.989 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T03:23:16.989 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-06T03:23:17.090 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T03:23:17.090 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-06T03:23:17.189 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T03:23:17.190 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-06T03:23:17.289 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T03:23:17.289 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-06T03:23:17.392 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T03:23:17.393 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-06T03:23:17.494 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-06T03:23:17.494 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-06T03:23:17.534 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-06T03:23:17.535 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-06T03:23:17.616 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T03:23:17.617 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-06T03:23:17.654 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T03:23:17.654 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-06T03:23:17.730 INFO:tasks.ceph:Adding keys to all mons... 2023-10-06T03:23:17.731 DEBUG:teuthology.orchestra.run.smithi081:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-06T03:23:17.736 DEBUG:teuthology.orchestra.run.smithi083:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-06T03:23:17.794 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr.y] 2023-10-06T03:23:17.795 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCEfR9lD2WjAxAAHDliqz+MLlnqVbsYxJfTxA== 2023-10-06T03:23:17.795 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.a] 2023-10-06T03:23:17.795 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCEfR9lAjGXERAA+7LUsMjk9KJ93+18lZm5aQ== 2023-10-06T03:23:17.795 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.c] 2023-10-06T03:23:17.795 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCEfR9lH37sGxAAxY4R6GIDNumJk8VYoVwhRA== 2023-10-06T03:23:17.795 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.0] 2023-10-06T03:23:17.795 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCIfR9lTcHdJhAA0eVdUm48/it3BmkczVlljg== 2023-10-06T03:23:17.795 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.1] 2023-10-06T03:23:17.795 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCLfR9lplo0KhAAvqadP20cm4k5wvYY1RmBPg== 2023-10-06T03:23:17.795 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.2] 2023-10-06T03:23:17.796 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCOfR9luUszLBAAGtT+YFfViyBmhVGYllP7Uw== 2023-10-06T03:23:17.796 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.3] 2023-10-06T03:23:17.796 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCRfR9ltDb2MhAA5exrej1tY10faawm0yO7/A== 2023-10-06T03:23:17.796 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr.x] 2023-10-06T03:23:17.796 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCEfR9lZDLGChAAV8lHi/WF1WnkkYkDlWmpRg== 2023-10-06T03:23:17.796 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.b] 2023-10-06T03:23:17.796 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCEfR9lkHpCJhAAuB+BT/teSqCc1NJ0mEk4hA== 2023-10-06T03:23:17.796 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.d] 2023-10-06T03:23:17.796 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCEfR9l5iWsMBAAfyBSEUMZPujA6UgBdFN+fA== 2023-10-06T03:23:17.796 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.4] 2023-10-06T03:23:17.796 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCYfR9lvHTKBRAAiB70jUlv77eYZsdXW15BGQ== 2023-10-06T03:23:17.797 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.5] 2023-10-06T03:23:17.797 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCbfR9lGfAtCBAAOA+EIqxcsj8ifR2cGPMb9A== 2023-10-06T03:23:17.797 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.6] 2023-10-06T03:23:17.797 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCefR9lTwueChAAToelbRZrG6PZKXUHe2lcOw== 2023-10-06T03:23:17.797 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.7] 2023-10-06T03:23:17.797 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQChfR9lssJzDBAAmdZqEcq8pZIAtRQ3Shb6dA== 2023-10-06T03:23:17.797 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2023-10-06T03:23:17.797 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCEfR9lvC9rORAAEapIVaQt8uYuYc54lxyMSA== 2023-10-06T03:23:17.797 INFO:teuthology.orchestra.run.smithi081.stdout:[client.2] 2023-10-06T03:23:17.797 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCFfR9lWC+aBBAAKAxIFUayi1py63P4L5kaEQ== 2023-10-06T03:23:17.797 INFO:teuthology.orchestra.run.smithi081.stdout:[client.1] 2023-10-06T03:23:17.797 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCFfR9lrz1UCxAAWpz2cFK0CeM591c1ZxPWdw== 2023-10-06T03:23:17.798 INFO:teuthology.orchestra.run.smithi081.stdout:[client.3] 2023-10-06T03:23:17.798 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCFfR9lPFb8ERAA4zlybKipwO35yitDisQIGA== 2023-10-06T03:23:17.829 INFO:teuthology.orchestra.run.smithi083.stdout:[mgr.y] 2023-10-06T03:23:17.829 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCEfR9lD2WjAxAAHDliqz+MLlnqVbsYxJfTxA== 2023-10-06T03:23:17.829 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.a] 2023-10-06T03:23:17.830 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCEfR9lAjGXERAA+7LUsMjk9KJ93+18lZm5aQ== 2023-10-06T03:23:17.830 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.c] 2023-10-06T03:23:17.830 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCEfR9lH37sGxAAxY4R6GIDNumJk8VYoVwhRA== 2023-10-06T03:23:17.830 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.0] 2023-10-06T03:23:17.830 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCIfR9lTcHdJhAA0eVdUm48/it3BmkczVlljg== 2023-10-06T03:23:17.830 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.1] 2023-10-06T03:23:17.830 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCLfR9lplo0KhAAvqadP20cm4k5wvYY1RmBPg== 2023-10-06T03:23:17.830 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.2] 2023-10-06T03:23:17.830 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCOfR9luUszLBAAGtT+YFfViyBmhVGYllP7Uw== 2023-10-06T03:23:17.831 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.3] 2023-10-06T03:23:17.831 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCRfR9ltDb2MhAA5exrej1tY10faawm0yO7/A== 2023-10-06T03:23:17.831 INFO:teuthology.orchestra.run.smithi083.stdout:[mgr.x] 2023-10-06T03:23:17.831 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCEfR9lZDLGChAAV8lHi/WF1WnkkYkDlWmpRg== 2023-10-06T03:23:17.831 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.b] 2023-10-06T03:23:17.831 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCEfR9lkHpCJhAAuB+BT/teSqCc1NJ0mEk4hA== 2023-10-06T03:23:17.831 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.d] 2023-10-06T03:23:17.831 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCEfR9l5iWsMBAAfyBSEUMZPujA6UgBdFN+fA== 2023-10-06T03:23:17.831 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.4] 2023-10-06T03:23:17.831 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCYfR9lvHTKBRAAiB70jUlv77eYZsdXW15BGQ== 2023-10-06T03:23:17.832 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.5] 2023-10-06T03:23:17.832 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCbfR9lGfAtCBAAOA+EIqxcsj8ifR2cGPMb9A== 2023-10-06T03:23:17.832 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.6] 2023-10-06T03:23:17.832 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCefR9lTwueChAAToelbRZrG6PZKXUHe2lcOw== 2023-10-06T03:23:17.832 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.7] 2023-10-06T03:23:17.832 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQChfR9lssJzDBAAmdZqEcq8pZIAtRQ3Shb6dA== 2023-10-06T03:23:17.832 INFO:teuthology.orchestra.run.smithi083.stdout:[client.0] 2023-10-06T03:23:17.832 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCEfR9lvC9rORAAEapIVaQt8uYuYc54lxyMSA== 2023-10-06T03:23:17.832 INFO:teuthology.orchestra.run.smithi083.stdout:[client.2] 2023-10-06T03:23:17.832 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCFfR9lWC+aBBAAKAxIFUayi1py63P4L5kaEQ== 2023-10-06T03:23:17.833 INFO:teuthology.orchestra.run.smithi083.stdout:[client.1] 2023-10-06T03:23:17.833 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCFfR9lrz1UCxAAWpz2cFK0CeM591c1ZxPWdw== 2023-10-06T03:23:17.833 INFO:teuthology.orchestra.run.smithi083.stdout:[client.3] 2023-10-06T03:23:17.833 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQCFfR9lPFb8ERAA4zlybKipwO35yitDisQIGA== 2023-10-06T03:23:17.834 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T03:23:17.843 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T03:23:17.971 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T03:23:17.975 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T03:23:18.071 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T03:23:18.076 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T03:23:18.172 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:23:18.177 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:23:18.270 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:23:18.274 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:23:18.368 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:23:18.372 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:23:18.467 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:23:18.472 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:23:18.566 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T03:23:18.571 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T03:23:18.665 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T03:23:18.669 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T03:23:18.766 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T03:23:18.770 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T03:23:18.867 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:23:18.872 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:23:18.965 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:23:18.969 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:23:19.063 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:23:19.068 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:23:19.162 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:23:19.166 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:23:19.260 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T03:23:19.265 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T03:23:19.362 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T03:23:19.366 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T03:23:19.463 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T03:23:19.467 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T03:23:19.564 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T03:23:19.569 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T03:23:19.665 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-06T03:23:19.666 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-06T03:23:19.726 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T03:23:19.834 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-06T03:23:19.895 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-06T03:23:19.956 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T03:23:20.062 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-06T03:23:20.122 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-06T03:23:20.182 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T03:23:20.289 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-06T03:23:20.350 DEBUG:teuthology.orchestra.run.smithi081:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:23:20.354 DEBUG:teuthology.orchestra.run.smithi083:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:23:20.389 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-06T03:23:20.390 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-06T03:23:20.390 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-06T03:23:20.430 INFO:tasks.ceph.mon.a:Started 2023-10-06T03:23:20.430 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-06T03:23:20.430 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-06T03:23:20.435 INFO:tasks.ceph.mon.b:Started 2023-10-06T03:23:20.435 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-06T03:23:20.435 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-06T03:23:20.439 INFO:tasks.ceph.mon.c:Started 2023-10-06T03:23:20.439 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-06T03:23:20.439 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-06T03:23:20.439 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-06T03:23:20.443 INFO:tasks.ceph.mgr.y:Started 2023-10-06T03:23:20.443 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-06T03:23:20.443 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-06T03:23:20.447 INFO:tasks.ceph.mgr.x:Started 2023-10-06T03:23:20.447 INFO:tasks.ceph:Setting crush tunables to default 2023-10-06T03:23:20.448 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd crush tunables default 2023-10-06T03:23:20.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.626+0000 7fe3c959d700 1 Processor -- start 2023-10-06T03:23:20.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.626+0000 7fe3c959d700 1 -- start start 2023-10-06T03:23:20.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.627+0000 7fe3c959d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe3c40b1f50 0x7fe3c415c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:20.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.627+0000 7fe3c959d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe3c4157cb0 0x7fe3c40d0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:20.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.627+0000 7fe3c959d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3c415b4f0 con 0x7fe3c415cad0 2023-10-06T03:23:20.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.627+0000 7fe3c959d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3c415b7d0 con 0x7fe3c4157cb0 2023-10-06T03:23:20.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.627+0000 7fe3c959d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3c415bab0 con 0x7fe3c40b1f50 2023-10-06T03:23:20.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.627+0000 7fe3c3fff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe3c40b1f50 0x7fe3c415c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:20.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.628+0000 7fe3c37fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe3c415cad0 0x7fe3c41575a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:56082/0 (socket says 172.21.15.81:56082) 2023-10-06T03:23:20.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.628+0000 7fe3c37fe700 1 -- 172.21.15.81:0/1678940036 learned_addr learned my addr 172.21.15.81:0/1678940036 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:23:20.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.628+0000 7fe3c3fff700 1 -- 172.21.15.81:0/1678940036 >> v2:172.21.15.83:3300/0 conn(0x7fe3c40b1f50 msgr2=0x7fe3c415c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T03:23:20.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.628+0000 7fe3c3fff700 1 -- 172.21.15.81:0/1678940036 >> v2:172.21.15.83:3300/0 conn(0x7fe3c40b1f50 msgr2=0x7fe3c415c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T03:23:20.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.628+0000 7fe3c3fff700 1 --2- 172.21.15.81:0/1678940036 >> v2:172.21.15.83:3300/0 conn(0x7fe3c40b1f50 0x7fe3c415c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T03:23:20.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.628+0000 7fe3c3fff700 1 --2- 172.21.15.81:0/1678940036 >> v2:172.21.15.83:3300/0 conn(0x7fe3c40b1f50 0x7fe3c415c590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T03:23:20.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.628+0000 7fe3c8d9c700 1 --2- 172.21.15.81:0/1678940036 >> v2:172.21.15.81:3300/0 conn(0x7fe3c4157cb0 0x7fe3c40d0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:20.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.628+0000 7fe3c8d9c700 1 -- 172.21.15.81:0/1678940036 >> v2:172.21.15.81:3300/0 conn(0x7fe3c4157cb0 msgr2=0x7fe3c40d0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-06T03:23:20.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.628+0000 7fe3c8d9c700 1 -- 172.21.15.81:0/1678940036 >> v2:172.21.15.81:3300/0 conn(0x7fe3c4157cb0 msgr2=0x7fe3c40d0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T03:23:20.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.628+0000 7fe3c8d9c700 1 --2- 172.21.15.81:0/1678940036 >> v2:172.21.15.81:3300/0 conn(0x7fe3c4157cb0 0x7fe3c40d0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T03:23:20.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.628+0000 7fe3c8d9c700 1 --2- 172.21.15.81:0/1678940036 >> v2:172.21.15.81:3300/0 conn(0x7fe3c4157cb0 0x7fe3c40d0790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T03:23:20.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.826+0000 7fe3c2ffd700 1 -- 172.21.15.81:0/1678940036 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2286364344 0 0) 0x7fe3c415b4f0 con 0x7fe3c415cad0 2023-10-06T03:23:20.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.826+0000 7fe3c2ffd700 1 -- 172.21.15.81:0/1678940036 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3ac003570 con 0x7fe3c415cad0 2023-10-06T03:23:20.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.826+0000 7fe3c2ffd700 1 -- 172.21.15.81:0/1678940036 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3407000209 0 0) 0x7fe3ac003570 con 0x7fe3c415cad0 2023-10-06T03:23:20.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.826+0000 7fe3c2ffd700 1 -- 172.21.15.81:0/1678940036 >> v2:172.21.15.83:3300/0 conn(0x7fe3c40b1f50 msgr2=0x7fe3c415c590 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T03:23:20.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.826+0000 7fe3c2ffd700 1 --2- 172.21.15.81:0/1678940036 >> v2:172.21.15.83:3300/0 conn(0x7fe3c40b1f50 0x7fe3c415c590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:20.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.826+0000 7fe3c2ffd700 1 -- 172.21.15.81:0/1678940036 >> v2:172.21.15.81:3300/0 conn(0x7fe3c4157cb0 msgr2=0x7fe3c40d0790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T03:23:20.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.826+0000 7fe3c2ffd700 1 --2- 172.21.15.81:0/1678940036 >> v2:172.21.15.81:3300/0 conn(0x7fe3c4157cb0 0x7fe3c40d0790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:20.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.826+0000 7fe3c2ffd700 1 -- 172.21.15.81:0/1678940036 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c415bd90 con 0x7fe3c415cad0 2023-10-06T03:23:20.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.826+0000 7fe3c2ffd700 1 -- 172.21.15.81:0/1678940036 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2513016936 0 0) 0x7fe3b8001470 con 0x7fe3c415cad0 2023-10-06T03:23:20.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.826+0000 7fe3c2ffd700 1 -- 172.21.15.81:0/1678940036 >> v1:172.21.15.81:6789/0 conn(0x7fe3c415cad0 legacy=0x7fe3c41575a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:20.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.826+0000 7fe3c2ffd700 1 --2- 172.21.15.81:0/1678940036 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3ac003b30 0x7fe3ac003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:20.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.826+0000 7fe3c2ffd700 1 --2- 172.21.15.81:0/1678940036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3ac004810 0x7fe3ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:20.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.826+0000 7fe3c2ffd700 1 --2- 172.21.15.81:0/1678940036 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3ac0052e0 0x7fe3ac00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:20.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.826+0000 7fe3c2ffd700 1 -- 172.21.15.81:0/1678940036 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c415b7d0 con 0x7fe3ac004810 2023-10-06T03:23:20.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.826+0000 7fe3c2ffd700 1 -- 172.21.15.81:0/1678940036 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c415bab0 con 0x7fe3ac0052e0 2023-10-06T03:23:20.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.827+0000 7fe3c2ffd700 1 -- 172.21.15.81:0/1678940036 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3ac0149f0 con 0x7fe3ac003b30 2023-10-06T03:23:20.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.827+0000 7fe3c8d9c700 1 --2- 172.21.15.81:0/1678940036 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3ac0052e0 0x7fe3ac00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:20.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.827+0000 7fe3c3fff700 1 --2- 172.21.15.81:0/1678940036 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3ac003b30 0x7fe3ac003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:20.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.827+0000 7fe3c37fe700 1 --2- 172.21.15.81:0/1678940036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3ac004810 0x7fe3ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:20.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.827+0000 7fe3c3fff700 1 -- 172.21.15.81:0/1678940036 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3ac0052e0 msgr2=0x7fe3ac00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:20.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.827+0000 7fe3c3fff700 1 --2- 172.21.15.81:0/1678940036 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3ac0052e0 0x7fe3ac00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:20.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.827+0000 7fe3c3fff700 1 -- 172.21.15.81:0/1678940036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3ac004810 msgr2=0x7fe3ac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:20.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.827+0000 7fe3c3fff700 1 --2- 172.21.15.81:0/1678940036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3ac004810 0x7fe3ac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:20.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.827+0000 7fe3c3fff700 1 -- 172.21.15.81:0/1678940036 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3ac003570 con 0x7fe3ac003b30 2023-10-06T03:23:20.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.827+0000 7fe3c8d9c700 1 --2- 172.21.15.81:0/1678940036 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3ac0052e0 0x7fe3ac00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:23:20.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.827+0000 7fe3c8d9c700 1 -- 172.21.15.81:0/1678940036 reap_dead start 2023-10-06T03:23:20.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.828+0000 7fe3c3fff700 1 --2- 172.21.15.81:0/1678940036 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3ac003b30 0x7fe3ac003f40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe3b400bb40 tx=0x7fe3b4008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b61ed2a66ab9b1d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:20.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.828+0000 7fe3c2ffd700 1 -- 172.21.15.81:0/1678940036 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b4018070 con 0x7fe3ac003b30 2023-10-06T03:23:20.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.828+0000 7fe3c2ffd700 1 -- 172.21.15.81:0/1678940036 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3b400d5d0 con 0x7fe3ac003b30 2023-10-06T03:23:20.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.828+0000 7fe3c2ffd700 1 -- 172.21.15.81:0/1678940036 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b400d990 con 0x7fe3ac003b30 2023-10-06T03:23:20.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.829+0000 7fe3c959d700 1 -- 172.21.15.81:0/1678940036 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3ac003b30 msgr2=0x7fe3ac003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:20.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.829+0000 7fe3c959d700 1 --2- 172.21.15.81:0/1678940036 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3ac003b30 0x7fe3ac003f40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe3b400bb40 tx=0x7fe3b4008040 comp rx=0 tx=0).stop 2023-10-06T03:23:20.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.829+0000 7fe3c959d700 1 -- 172.21.15.81:0/1678940036 shutdown_connections 2023-10-06T03:23:20.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.829+0000 7fe3c959d700 1 --2- 172.21.15.81:0/1678940036 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3ac003b30 0x7fe3ac003f40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:20.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.829+0000 7fe3c959d700 1 -- 172.21.15.81:0/1678940036 >> 172.21.15.81:0/1678940036 conn(0x7fe3c406ed10 msgr2=0x7fe3c406f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:20.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.829+0000 7fe3c959d700 1 -- 172.21.15.81:0/1678940036 shutdown_connections 2023-10-06T03:23:20.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.829+0000 7fe3c959d700 1 -- 172.21.15.81:0/1678940036 wait complete. 2023-10-06T03:23:20.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.831+0000 7fe3c959d700 1 Processor -- start 2023-10-06T03:23:20.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.831+0000 7fe3c959d700 1 -- start start 2023-10-06T03:23:20.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.832+0000 7fe3c959d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3ac003b30 0x7fe3c4153230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:20.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.832+0000 7fe3c959d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3c4153770 0x7fe3c414cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:20.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.832+0000 7fe3c959d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3c414d130 0x7fe3c40b4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:20.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.832+0000 7fe3c959d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c4158080 con 0x7fe3c414d130 2023-10-06T03:23:20.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.832+0000 7fe3c959d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c4158920 con 0x7fe3ac003b30 2023-10-06T03:23:20.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.832+0000 7fe3c959d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c4153bf0 con 0x7fe3c4153770 2023-10-06T03:23:20.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.832+0000 7fe3c3fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3ac003b30 0x7fe3c4153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:20.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.832+0000 7fe3c3fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3ac003b30 0x7fe3c4153230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:33682/0 (socket says 172.21.15.81:33682) 2023-10-06T03:23:20.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.832+0000 7fe3c3fff700 1 -- 172.21.15.81:0/1103464834 learned_addr learned my addr 172.21.15.81:0/1103464834 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:20.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.832+0000 7fe3c37fe700 1 --2- 172.21.15.81:0/1103464834 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3c4153770 0x7fe3c414cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:20.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.832+0000 7fe3c8d9c700 1 --2- 172.21.15.81:0/1103464834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3c414d130 0x7fe3c40b4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:20.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.833+0000 7fe3c8d9c700 1 -- 172.21.15.81:0/1103464834 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3c4153770 msgr2=0x7fe3c414cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:20.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.833+0000 7fe3c8d9c700 1 --2- 172.21.15.81:0/1103464834 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3c4153770 0x7fe3c414cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:20.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.833+0000 7fe3c8d9c700 1 -- 172.21.15.81:0/1103464834 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3ac003b30 msgr2=0x7fe3c4153230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:20.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.833+0000 7fe3c8d9c700 1 --2- 172.21.15.81:0/1103464834 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3ac003b30 0x7fe3c4153230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:20.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.833+0000 7fe3c8d9c700 1 -- 172.21.15.81:0/1103464834 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c41582d0 con 0x7fe3c414d130 2023-10-06T03:23:20.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.833+0000 7fe3c8d9c700 1 --2- 172.21.15.81:0/1103464834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3c414d130 0x7fe3c40b4320 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe3c40af910 tx=0x7fe3bc009720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:20.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.833+0000 7fe3abfff700 1 -- 172.21.15.81:0/1103464834 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc013580 con 0x7fe3c414d130 2023-10-06T03:23:20.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.833+0000 7fe3abfff700 1 -- 172.21.15.81:0/1103464834 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3bc013700 con 0x7fe3c414d130 2023-10-06T03:23:20.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.833+0000 7fe3c959d700 1 -- 172.21.15.81:0/1103464834 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3c41585b0 con 0x7fe3c414d130 2023-10-06T03:23:20.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.833+0000 7fe3abfff700 1 -- 172.21.15.81:0/1103464834 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc013ac0 con 0x7fe3c414d130 2023-10-06T03:23:20.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.833+0000 7fe3c959d700 1 -- 172.21.15.81:0/1103464834 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3c4158db0 con 0x7fe3c414d130 2023-10-06T03:23:20.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.834+0000 7fe3abfff700 1 -- 172.21.15.81:0/1103464834 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fe3bc00ad50 con 0x7fe3c414d130 2023-10-06T03:23:20.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.834+0000 7fe3abfff700 1 -- 172.21.15.81:0/1103464834 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fe3bc01dba0 con 0x7fe3c414d130 2023-10-06T03:23:20.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.834+0000 7fe3c959d700 1 -- 172.21.15.81:0/1103464834 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3c4158ab0 con 0x7fe3c414d130 2023-10-06T03:23:20.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.839+0000 7fe3abfff700 1 -- 172.21.15.81:0/1103464834 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fe3bc01dd60 con 0x7fe3c414d130 2023-10-06T03:23:20.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.917+0000 7fe3c959d700 1 -- 172.21.15.81:0/1103464834 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fe3c404c3c0 con 0x7fe3c414d130 2023-10-06T03:23:20.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.925+0000 7fe3abfff700 1 -- 172.21.15.81:0/1103464834 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fe3bc027430 con 0x7fe3c414d130 2023-10-06T03:23:20.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.926+0000 7fe3c959d700 1 -- 172.21.15.81:0/1103464834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3c414d130 msgr2=0x7fe3c40b4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:20.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.926+0000 7fe3c959d700 1 --2- 172.21.15.81:0/1103464834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3c414d130 0x7fe3c40b4320 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe3c40af910 tx=0x7fe3bc009720 comp rx=0 tx=0).stop 2023-10-06T03:23:20.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.926+0000 7fe3c959d700 1 -- 172.21.15.81:0/1103464834 shutdown_connections 2023-10-06T03:23:20.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.926+0000 7fe3c959d700 1 --2- 172.21.15.81:0/1103464834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3c414d130 0x7fe3c40b4320 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:20.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.926+0000 7fe3c959d700 1 --2- 172.21.15.81:0/1103464834 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3ac003b30 0x7fe3c4153230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:20.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.926+0000 7fe3c959d700 1 --2- 172.21.15.81:0/1103464834 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3c4153770 0x7fe3c414cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:20.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.926+0000 7fe3c959d700 1 -- 172.21.15.81:0/1103464834 >> 172.21.15.81:0/1103464834 conn(0x7fe3c406ed10 msgr2=0x7fe3c415cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:20.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.926+0000 7fe3c959d700 1 -- 172.21.15.81:0/1103464834 shutdown_connections 2023-10-06T03:23:20.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:20.926+0000 7fe3c959d700 1 -- 172.21.15.81:0/1103464834 wait complete. 2023-10-06T03:23:20.929 INFO:teuthology.orchestra.run.smithi081.stderr:adjusted tunables profile to default 2023-10-06T03:23:20.945 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-06T03:23:20.945 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-06T03:23:20.946 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-06T03:23:21.008 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-06T03:23:21.008 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-06T03:23:21.114 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-06T03:23:21.114 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-06T03:23:21.214 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-06T03:23:21.215 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-06T03:23:21.324 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T03:23:21.324 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-06T03:23:21.385 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T03:23:21.385 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-06T03:23:21.486 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T03:23:21.486 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-06T03:23:21.586 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T03:23:21.586 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-06T03:23:21.688 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd new 14fb667d-a677-4978-a477-80027f889d36 0 2023-10-06T03:23:21.906 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.904+0000 7fb9d759e700 1 Processor -- start 2023-10-06T03:23:21.906 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.904+0000 7fb9d759e700 1 -- start start 2023-10-06T03:23:21.908 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.905+0000 7fb9d759e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb9d80b2320 0x7fb9d81575a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:21.908 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.905+0000 7fb9d759e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9d8157ee0 con 0x7fb9d80b1f50 2023-10-06T03:23:21.908 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.905+0000 7fb9d759e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9d815b4f0 con 0x7fb9d8157ae0 2023-10-06T03:23:21.908 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.905+0000 7fb9d759e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9d815b7d0 con 0x7fb9d80b2320 2023-10-06T03:23:21.909 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.905+0000 7fb9d5d9b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb9d80b2320 0x7fb9d81575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:21.909 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.905+0000 7fb9d5d9b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb9d80b2320 0x7fb9d81575a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38382/0 (socket says 172.21.15.83:38382) 2023-10-06T03:23:21.909 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.905+0000 7fb9d5d9b700 1 -- 172.21.15.83:0/2319667979 learned_addr learned my addr 172.21.15.83:0/2319667979 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-10-06T03:23:21.909 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.905+0000 7fb9d6d9d700 1 --1- 172.21.15.83:0/2319667979 >> v1:172.21.15.83:6789/0 conn(0x7fb9d8157ae0 0x7fb9d80d0790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:43688/0 (socket says 172.21.15.83:43688) 2023-10-06T03:23:21.909 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.906+0000 7fb9d5d9b700 1 -- 172.21.15.83:0/2319667979 >> v1:172.21.15.83:6789/0 conn(0x7fb9d8157ae0 legacy=0x7fb9d80d0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:21.909 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.906+0000 7fb9d5d9b700 1 -- 172.21.15.83:0/2319667979 >> v1:172.21.15.81:6789/0 conn(0x7fb9d80b1f50 legacy=0x7fb9d815c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:21.909 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.906+0000 7fb9d5d9b700 1 -- 172.21.15.83:0/2319667979 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d815bab0 con 0x7fb9d80b2320 2023-10-06T03:23:21.909 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.906+0000 7fb9d559a700 1 -- 172.21.15.83:0/2319667979 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 827983933 0 0) 0x7fb9d8157ee0 con 0x7fb9d80b1f50 2023-10-06T03:23:21.909 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.906+0000 7fb9d5d9b700 1 --2- 172.21.15.83:0/2319667979 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb9d80b2320 0x7fb9d81575a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc0099b0 tx=0x7fb9cc009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4fc4a40eaef80a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:21.911 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.906+0000 7fb9d559a700 1 -- 172.21.15.83:0/2319667979 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc00b860 con 0x7fb9d80b2320 2023-10-06T03:23:21.911 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.906+0000 7fb9d559a700 1 -- 172.21.15.83:0/2319667979 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9cc00b9c0 con 0x7fb9d80b2320 2023-10-06T03:23:21.911 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.906+0000 7fb9d559a700 1 -- 172.21.15.83:0/2319667979 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc00bd60 con 0x7fb9d80b2320 2023-10-06T03:23:21.911 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.907+0000 7fb9d759e700 1 -- 172.21.15.83:0/2319667979 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb9d80b2320 msgr2=0x7fb9d81575a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:21.911 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.907+0000 7fb9d759e700 1 --2- 172.21.15.83:0/2319667979 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb9d80b2320 0x7fb9d81575a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc0099b0 tx=0x7fb9cc009250 comp rx=0 tx=0).stop 2023-10-06T03:23:21.911 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.907+0000 7fb9d759e700 1 -- 172.21.15.83:0/2319667979 shutdown_connections 2023-10-06T03:23:21.911 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.907+0000 7fb9d759e700 1 --2- 172.21.15.83:0/2319667979 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb9d80b2320 0x7fb9d81575a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:21.911 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.907+0000 7fb9d759e700 1 -- 172.21.15.83:0/2319667979 >> 172.21.15.83:0/2319667979 conn(0x7fb9d806ed10 msgr2=0x7fb9d806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:21.911 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.907+0000 7fb9d759e700 1 -- 172.21.15.83:0/2319667979 shutdown_connections 2023-10-06T03:23:21.911 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.907+0000 7fb9d759e700 1 -- 172.21.15.83:0/2319667979 wait complete. 2023-10-06T03:23:21.911 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.908+0000 7fb9d759e700 1 Processor -- start 2023-10-06T03:23:21.912 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.909+0000 7fb9d759e700 1 -- start start 2023-10-06T03:23:21.914 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.909+0000 7fb9d759e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9d80b1f50 0x7fb9d8156740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:21.914 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.909+0000 7fb9d759e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb9d80b2320 0x7fb9d8152ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:21.914 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.910+0000 7fb9d759e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb9d8157ae0 0x7fb9d81533e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:21.914 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.910+0000 7fb9d759e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d8151970 con 0x7fb9d80b1f50 2023-10-06T03:23:21.914 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.910+0000 7fb9d759e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d8151c10 con 0x7fb9d80b2320 2023-10-06T03:23:21.914 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.910+0000 7fb9d759e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d8151ef0 con 0x7fb9d8157ae0 2023-10-06T03:23:21.915 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.910+0000 7fb9d5d9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb9d80b2320 0x7fb9d8152ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:21.915 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.910+0000 7fb9d5d9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb9d80b2320 0x7fb9d8152ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38384/0 (socket says 172.21.15.83:38384) 2023-10-06T03:23:21.915 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.910+0000 7fb9d5d9b700 1 -- 172.21.15.83:0/2938958763 learned_addr learned my addr 172.21.15.83:0/2938958763 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-10-06T03:23:21.915 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.910+0000 7fb9d659c700 1 --2- 172.21.15.83:0/2938958763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9d80b1f50 0x7fb9d8156740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:21.915 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.910+0000 7fb9d6d9d700 1 --2- 172.21.15.83:0/2938958763 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb9d8157ae0 0x7fb9d81533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:21.915 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.910+0000 7fb9d5d9b700 1 -- 172.21.15.83:0/2938958763 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb9d8157ae0 msgr2=0x7fb9d81533e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:21.915 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.910+0000 7fb9d5d9b700 1 --2- 172.21.15.83:0/2938958763 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb9d8157ae0 0x7fb9d81533e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:21.915 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.910+0000 7fb9d5d9b700 1 -- 172.21.15.83:0/2938958763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9d80b1f50 msgr2=0x7fb9d8156740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:21.915 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.910+0000 7fb9d5d9b700 1 --2- 172.21.15.83:0/2938958763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9d80b1f50 0x7fb9d8156740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:21.915 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.910+0000 7fb9d5d9b700 1 -- 172.21.15.83:0/2938958763 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9cc0094f0 con 0x7fb9d80b2320 2023-10-06T03:23:21.915 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.910+0000 7fb9d659c700 1 --2- 172.21.15.83:0/2938958763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9d80b1f50 0x7fb9d8156740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:23:21.915 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.910+0000 7fb9d5d9b700 1 --2- 172.21.15.83:0/2938958763 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb9d80b2320 0x7fb9d8152ea0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc006f50 tx=0x7fb9cc017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:21.916 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.911+0000 7fb9c67fc700 1 -- 172.21.15.83:0/2938958763 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc01f070 con 0x7fb9d80b2320 2023-10-06T03:23:21.916 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.911+0000 7fb9c67fc700 1 -- 172.21.15.83:0/2938958763 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9cc011bb0 con 0x7fb9d80b2320 2023-10-06T03:23:21.916 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.911+0000 7fb9d759e700 1 -- 172.21.15.83:0/2938958763 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9d81521d0 con 0x7fb9d80b2320 2023-10-06T03:23:21.916 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.911+0000 7fb9c67fc700 1 -- 172.21.15.83:0/2938958763 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc025420 con 0x7fb9d80b2320 2023-10-06T03:23:21.916 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.911+0000 7fb9d759e700 1 -- 172.21.15.83:0/2938958763 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9d8156c80 con 0x7fb9d80b2320 2023-10-06T03:23:21.916 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.911+0000 7fb9c67fc700 1 -- 172.21.15.83:0/2938958763 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fb9cc023070 con 0x7fb9d80b2320 2023-10-06T03:23:21.916 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.912+0000 7fb9c67fc700 1 -- 172.21.15.83:0/2938958763 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7fb9cc01a420 con 0x7fb9d80b2320 2023-10-06T03:23:21.916 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.912+0000 7fb9d759e700 1 -- 172.21.15.83:0/2938958763 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9d81523e0 con 0x7fb9d80b2320 2023-10-06T03:23:21.918 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:21.916+0000 7fb9c67fc700 1 -- 172.21.15.83:0/2938958763 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fb9cc02a070 con 0x7fb9d80b2320 2023-10-06T03:23:22.004 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.002+0000 7fb9d759e700 1 -- 172.21.15.83:0/2938958763 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd new", "uuid": "14fb667d-a677-4978-a477-80027f889d36", "id": 0} v 0) v1 -- 0x7fb9d804c3c0 con 0x7fb9d80b2320 2023-10-06T03:23:22.009 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.006+0000 7fb9c67fc700 1 -- 172.21.15.83:0/2938958763 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "14fb667d-a677-4978-a477-80027f889d36", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb9cc015020 con 0x7fb9d80b2320 2023-10-06T03:23:22.009 INFO:teuthology.orchestra.run.smithi083.stdout:0 2023-10-06T03:23:22.010 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.008+0000 7fb9d759e700 1 -- 172.21.15.83:0/2938958763 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb9d80b2320 msgr2=0x7fb9d8152ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:22.010 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.008+0000 7fb9d759e700 1 --2- 172.21.15.83:0/2938958763 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb9d80b2320 0x7fb9d8152ea0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc006f50 tx=0x7fb9cc017000 comp rx=0 tx=0).stop 2023-10-06T03:23:22.011 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.008+0000 7fb9d759e700 1 -- 172.21.15.83:0/2938958763 shutdown_connections 2023-10-06T03:23:22.011 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.008+0000 7fb9d759e700 1 --2- 172.21.15.83:0/2938958763 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb9d8157ae0 0x7fb9d81533e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:22.011 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.008+0000 7fb9d759e700 1 --2- 172.21.15.83:0/2938958763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9d80b1f50 0x7fb9d8156740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:22.011 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.008+0000 7fb9d759e700 1 --2- 172.21.15.83:0/2938958763 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb9d80b2320 0x7fb9d8152ea0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:22.011 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.008+0000 7fb9d759e700 1 -- 172.21.15.83:0/2938958763 >> 172.21.15.83:0/2938958763 conn(0x7fb9d806ed10 msgr2=0x7fb9d8148050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:22.012 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.008+0000 7fb9d759e700 1 -- 172.21.15.83:0/2938958763 shutdown_connections 2023-10-06T03:23:22.012 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.008+0000 7fb9d759e700 1 -- 172.21.15.83:0/2938958763 wait complete. 2023-10-06T03:23:22.026 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd new 974d8a86-1829-4176-89ce-18e6038857f7 1 2023-10-06T03:23:22.203 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.201+0000 7f2b54f9d700 1 Processor -- start 2023-10-06T03:23:22.203 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.201+0000 7f2b54f9d700 1 -- start start 2023-10-06T03:23:22.204 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.202+0000 7f2b54f9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2b5015ac00 0x7f2b5015a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:22.204 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.202+0000 7f2b54f9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2b50157670 0x7f2b500b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:22.204 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.202+0000 7f2b54f9d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b5015bef0 con 0x7f2b501535a0 2023-10-06T03:23:22.205 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.202+0000 7f2b54f9d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b5015aaa0 con 0x7f2b5015ac00 2023-10-06T03:23:22.205 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.202+0000 7f2b54f9d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5015b080 con 0x7f2b50157670 2023-10-06T03:23:22.205 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.202+0000 7f2b4ffff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2b50157670 0x7f2b500b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:22.205 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.202+0000 7f2b4f7fe700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f2b501535a0 0x7f2b50153970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:43700/0 (socket says 172.21.15.83:43700) 2023-10-06T03:23:22.205 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.202+0000 7f2b4f7fe700 1 -- 172.21.15.83:0/2759720515 learned_addr learned my addr 172.21.15.83:0/2759720515 (peer_addr_for_me v1:172.21.15.83:0/0) 2023-10-06T03:23:22.205 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.203+0000 7f2b4effd700 1 --2- 172.21.15.83:0/2759720515 >> v2:172.21.15.81:3300/0 conn(0x7f2b5015ac00 0x7f2b5015a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:22.207 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.203+0000 7f2b4ffff700 1 -- 172.21.15.83:0/2759720515 >> v2:172.21.15.81:3300/0 conn(0x7f2b5015ac00 msgr2=0x7f2b5015a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:22.207 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.203+0000 7f2b4ffff700 1 --2- 172.21.15.83:0/2759720515 >> v2:172.21.15.81:3300/0 conn(0x7f2b5015ac00 0x7f2b5015a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:22.207 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.203+0000 7f2b4ffff700 1 -- 172.21.15.83:0/2759720515 >> v1:172.21.15.83:6789/0 conn(0x7f2b501535a0 legacy=0x7f2b50153970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:22.207 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.203+0000 7f2b4e7fc700 1 -- 172.21.15.83:0/2759720515 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2747225985 0 0) 0x7f2b5015bef0 con 0x7f2b501535a0 2023-10-06T03:23:22.207 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.203+0000 7f2b4ffff700 1 -- 172.21.15.83:0/2759720515 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b500d1160 con 0x7f2b50157670 2023-10-06T03:23:22.207 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.203+0000 7f2b4ffff700 1 --2- 172.21.15.83:0/2759720515 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2b50157670 0x7f2b500b1cf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2b48009e60 tx=0x7f2b48009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=feb52212d0cf69e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:22.208 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.203+0000 7f2b4e7fc700 1 -- 172.21.15.83:0/2759720515 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4800e070 con 0x7f2b50157670 2023-10-06T03:23:22.208 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.203+0000 7f2b4e7fc700 1 -- 172.21.15.83:0/2759720515 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b4800bb60 con 0x7f2b50157670 2023-10-06T03:23:22.208 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.203+0000 7f2b4e7fc700 1 -- 172.21.15.83:0/2759720515 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b48012430 con 0x7f2b50157670 2023-10-06T03:23:22.208 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.204+0000 7f2b54f9d700 1 -- 172.21.15.83:0/2759720515 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2b50157670 msgr2=0x7f2b500b1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:22.208 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.204+0000 7f2b54f9d700 1 --2- 172.21.15.83:0/2759720515 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2b50157670 0x7f2b500b1cf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2b48009e60 tx=0x7f2b48009780 comp rx=0 tx=0).stop 2023-10-06T03:23:22.208 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.204+0000 7f2b54f9d700 1 -- 172.21.15.83:0/2759720515 shutdown_connections 2023-10-06T03:23:22.208 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.204+0000 7f2b54f9d700 1 --2- 172.21.15.83:0/2759720515 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2b50157670 0x7f2b500b1cf0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:22.208 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.204+0000 7f2b54f9d700 1 --2- 172.21.15.83:0/2759720515 >> v2:172.21.15.81:3300/0 conn(0x7f2b5015ac00 0x7f2b5015a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:22.208 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.204+0000 7f2b54f9d700 1 -- 172.21.15.83:0/2759720515 >> 172.21.15.83:0/2759720515 conn(0x7f2b50068230 msgr2=0x7f2b50068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:22.209 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.204+0000 7f2b54f9d700 1 -- 172.21.15.83:0/2759720515 shutdown_connections 2023-10-06T03:23:22.209 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.204+0000 7f2b54f9d700 1 -- 172.21.15.83:0/2759720515 wait complete. 2023-10-06T03:23:22.211 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.206+0000 7f2b54f9d700 1 Processor -- start 2023-10-06T03:23:22.212 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.206+0000 7f2b54f9d700 1 -- start start 2023-10-06T03:23:22.212 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.207+0000 7f2b54f9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b501535a0 0x7f2b501526d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:22.212 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.207+0000 7f2b54f9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b50157670 0x7f2b5016cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:22.212 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.207+0000 7f2b54f9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2b5015ac00 0x7f2b500b0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:22.212 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.207+0000 7f2b54f9d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b500afcf0 con 0x7f2b501535a0 2023-10-06T03:23:22.212 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.207+0000 7f2b54f9d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5016d7a0 con 0x7f2b50157670 2023-10-06T03:23:22.212 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.207+0000 7f2b54f9d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5016da80 con 0x7f2b5015ac00 2023-10-06T03:23:22.212 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.207+0000 7f2b4effd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b50157670 0x7f2b5016cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:22.212 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.207+0000 7f2b4ffff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2b5015ac00 0x7f2b500b0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:22.213 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.207+0000 7f2b4effd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b50157670 0x7f2b5016cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38394/0 (socket says 172.21.15.83:38394) 2023-10-06T03:23:22.213 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.207+0000 7f2b4effd700 1 -- 172.21.15.83:0/1321949650 learned_addr learned my addr 172.21.15.83:0/1321949650 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-10-06T03:23:22.213 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.207+0000 7f2b4f7fe700 1 --2- 172.21.15.83:0/1321949650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b501535a0 0x7f2b501526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:22.213 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.207+0000 7f2b4effd700 1 -- 172.21.15.83:0/1321949650 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2b5015ac00 msgr2=0x7f2b500b0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:22.213 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.207+0000 7f2b4effd700 1 --2- 172.21.15.83:0/1321949650 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2b5015ac00 0x7f2b500b0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:22.213 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.207+0000 7f2b4effd700 1 -- 172.21.15.83:0/1321949650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b501535a0 msgr2=0x7f2b501526d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:22.213 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.207+0000 7f2b4effd700 1 --2- 172.21.15.83:0/1321949650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b501535a0 0x7f2b501526d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:22.213 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.207+0000 7f2b4effd700 1 -- 172.21.15.83:0/1321949650 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b48009a20 con 0x7f2b50157670 2023-10-06T03:23:22.213 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.208+0000 7f2b4effd700 1 --2- 172.21.15.83:0/1321949650 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b50157670 0x7f2b5016cf70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2b4400e930 tx=0x7f2b440091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:22.214 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.208+0000 7f2b377fe700 1 -- 172.21.15.83:0/1321949650 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b44013680 con 0x7f2b50157670 2023-10-06T03:23:22.214 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.208+0000 7f2b377fe700 1 -- 172.21.15.83:0/1321949650 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b440137e0 con 0x7f2b50157670 2023-10-06T03:23:22.214 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.208+0000 7f2b54f9d700 1 -- 172.21.15.83:0/1321949650 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b500aff60 con 0x7f2b50157670 2023-10-06T03:23:22.214 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.208+0000 7f2b377fe700 1 -- 172.21.15.83:0/1321949650 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b44013b80 con 0x7f2b50157670 2023-10-06T03:23:22.214 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.208+0000 7f2b54f9d700 1 -- 172.21.15.83:0/1321949650 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b5016dd60 con 0x7f2b50157670 2023-10-06T03:23:22.215 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.208+0000 7f2b377fe700 1 -- 172.21.15.83:0/1321949650 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f2b44005c80 con 0x7f2b50157670 2023-10-06T03:23:22.215 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.208+0000 7f2b377fe700 1 -- 172.21.15.83:0/1321949650 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f2b4401c450 con 0x7f2b50157670 2023-10-06T03:23:22.215 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.209+0000 7f2b54f9d700 1 -- 172.21.15.83:0/1321949650 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b500cd480 con 0x7f2b50157670 2023-10-06T03:23:22.216 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.212+0000 7f2b377fe700 1 -- 172.21.15.83:0/1321949650 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f2b44021060 con 0x7f2b50157670 2023-10-06T03:23:22.245 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-06T03:23:22.243+0000 7f8366d58180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T03:23:22.278 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T03:23:22.276+0000 7f7a5e870180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T03:23:22.299 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.297+0000 7f2b54f9d700 1 -- 172.21.15.83:0/1321949650 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd new", "uuid": "974d8a86-1829-4176-89ce-18e6038857f7", "id": 1} v 0) v1 -- 0x7f2b500b4740 con 0x7f2b50157670 2023-10-06T03:23:22.304 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.302+0000 7f2b377fe700 1 -- 172.21.15.83:0/1321949650 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "974d8a86-1829-4176-89ce-18e6038857f7", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2b44017070 con 0x7f2b50157670 2023-10-06T03:23:22.304 INFO:teuthology.orchestra.run.smithi083.stdout:1 2023-10-06T03:23:22.305 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.303+0000 7f2b54f9d700 1 -- 172.21.15.83:0/1321949650 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b50157670 msgr2=0x7f2b5016cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:22.305 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.303+0000 7f2b54f9d700 1 --2- 172.21.15.83:0/1321949650 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b50157670 0x7f2b5016cf70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2b4400e930 tx=0x7f2b440091a0 comp rx=0 tx=0).stop 2023-10-06T03:23:22.306 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.303+0000 7f2b54f9d700 1 -- 172.21.15.83:0/1321949650 shutdown_connections 2023-10-06T03:23:22.306 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.303+0000 7f2b54f9d700 1 --2- 172.21.15.83:0/1321949650 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2b5015ac00 0x7f2b500b0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:22.306 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.303+0000 7f2b54f9d700 1 --2- 172.21.15.83:0/1321949650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b501535a0 0x7f2b501526d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:22.306 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.303+0000 7f2b54f9d700 1 --2- 172.21.15.83:0/1321949650 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b50157670 0x7f2b5016cf70 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:22.306 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.303+0000 7f2b54f9d700 1 -- 172.21.15.83:0/1321949650 >> 172.21.15.83:0/1321949650 conn(0x7f2b50068230 msgr2=0x7f2b500ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:22.307 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.303+0000 7f2b54f9d700 1 -- 172.21.15.83:0/1321949650 shutdown_connections 2023-10-06T03:23:22.307 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.303+0000 7f2b54f9d700 1 -- 172.21.15.83:0/1321949650 wait complete. 2023-10-06T03:23:22.322 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd new ffbfe056-46bc-46e0-bf49-4d8f8650e20f 2 2023-10-06T03:23:22.407 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-06T03:23:22.405+0000 7f8366d58180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T03:23:22.452 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T03:23:22.450+0000 7f7a5e870180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T03:23:22.499 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.497+0000 7f74dbfff700 1 Processor -- start 2023-10-06T03:23:22.500 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.497+0000 7f74dbfff700 1 -- start start 2023-10-06T03:23:22.501 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-06T03:23:22.497+0000 7f8366d58180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T03:23:22.504 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.498+0000 7f74dbfff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f74dc1535a0 0x7f74dc15ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:22.504 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.498+0000 7f74dbfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f74dc15a560 0x7f74dc153970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:22.505 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.498+0000 7f74dbfff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74dc15bef0 con 0x7f74dc157670 2023-10-06T03:23:22.505 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.498+0000 7f74dbfff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74dc0d1160 con 0x7f74dc15a560 2023-10-06T03:23:22.505 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.498+0000 7f74dbfff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74dc15a9e0 con 0x7f74dc1535a0 2023-10-06T03:23:22.505 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.498+0000 7f74daffd700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f74dc1535a0 0x7f74dc15ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:22.505 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.499+0000 7f74daffd700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f74dc1535a0 0x7f74dc15ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38402/0 (socket says 172.21.15.83:38402) 2023-10-06T03:23:22.506 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.499+0000 7f74daffd700 1 -- 172.21.15.83:0/2710723937 learned_addr learned my addr 172.21.15.83:0/2710723937 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-10-06T03:23:22.506 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.499+0000 7f74db7fe700 1 --1- 172.21.15.83:0/2710723937 >> v1:172.21.15.83:6789/0 conn(0x7f74dc157670 0x7f74dc0b1cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:43714/0 (socket says 172.21.15.83:43714) 2023-10-06T03:23:22.506 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.499+0000 7f74da7fc700 1 --2- 172.21.15.83:0/2710723937 >> v2:172.21.15.81:3300/0 conn(0x7f74dc15a560 0x7f74dc153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:22.507 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.499+0000 7f74da7fc700 1 -- 172.21.15.83:0/2710723937 >> v2:172.21.15.83:3300/0 conn(0x7f74dc1535a0 msgr2=0x7f74dc15ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:22.507 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.499+0000 7f74da7fc700 1 --2- 172.21.15.83:0/2710723937 >> v2:172.21.15.83:3300/0 conn(0x7f74dc1535a0 0x7f74dc15ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:22.507 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.499+0000 7f74d9ffb700 1 -- 172.21.15.83:0/2710723937 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2894264607 0 0) 0x7f74dc15bef0 con 0x7f74dc157670 2023-10-06T03:23:22.507 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.499+0000 7f74da7fc700 1 -- 172.21.15.83:0/2710723937 >> v1:172.21.15.83:6789/0 conn(0x7f74dc157670 legacy=0x7f74dc0b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:22.507 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.499+0000 7f74da7fc700 1 -- 172.21.15.83:0/2710723937 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74dc153eb0 con 0x7f74dc15a560 2023-10-06T03:23:22.507 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.499+0000 7f74da7fc700 1 --2- 172.21.15.83:0/2710723937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74dc15a560 0x7f74dc153970 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f74dc0d1430 tx=0x7f74d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0b414451a70e392 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:22.507 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.500+0000 7f74d9ffb700 1 -- 172.21.15.83:0/2710723937 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d0011630 con 0x7f74dc15a560 2023-10-06T03:23:22.508 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.500+0000 7f74d9ffb700 1 -- 172.21.15.83:0/2710723937 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74d0011790 con 0x7f74dc15a560 2023-10-06T03:23:22.508 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.500+0000 7f74d9ffb700 1 -- 172.21.15.83:0/2710723937 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d0011b30 con 0x7f74dc15a560 2023-10-06T03:23:22.508 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.500+0000 7f74dbfff700 1 -- 172.21.15.83:0/2710723937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74dc15a560 msgr2=0x7f74dc153970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:22.508 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.500+0000 7f74dbfff700 1 --2- 172.21.15.83:0/2710723937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74dc15a560 0x7f74dc153970 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f74dc0d1430 tx=0x7f74d00091a0 comp rx=0 tx=0).stop 2023-10-06T03:23:22.508 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.500+0000 7f74dbfff700 1 -- 172.21.15.83:0/2710723937 shutdown_connections 2023-10-06T03:23:22.508 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.500+0000 7f74dbfff700 1 --2- 172.21.15.83:0/2710723937 >> v2:172.21.15.83:3300/0 conn(0x7f74dc1535a0 0x7f74dc15ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:22.508 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.500+0000 7f74dbfff700 1 --2- 172.21.15.83:0/2710723937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74dc15a560 0x7f74dc153970 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:22.508 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.500+0000 7f74dbfff700 1 -- 172.21.15.83:0/2710723937 >> 172.21.15.83:0/2710723937 conn(0x7f74dc068230 msgr2=0x7f74dc068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:22.508 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.500+0000 7f74dbfff700 1 -- 172.21.15.83:0/2710723937 shutdown_connections 2023-10-06T03:23:22.508 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.500+0000 7f74dbfff700 1 -- 172.21.15.83:0/2710723937 wait complete. 2023-10-06T03:23:22.508 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.502+0000 7f74dbfff700 1 Processor -- start 2023-10-06T03:23:22.509 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.502+0000 7f74dbfff700 1 -- start start 2023-10-06T03:23:22.511 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.503+0000 7f74dbfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f74dc1535a0 0x7f74dc16a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:22.511 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.503+0000 7f74dbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74dc157670 0x7f74dc1563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:22.511 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.503+0000 7f74dbfff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f74dc15a560 0x7f74dc15e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:22.511 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.503+0000 7f74dbfff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74dc16abf0 con 0x7f74dc157670 2023-10-06T03:23:22.511 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.503+0000 7f74dbfff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74dc155070 con 0x7f74dc1535a0 2023-10-06T03:23:22.511 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.503+0000 7f74dbfff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74dc155350 con 0x7f74dc15a560 2023-10-06T03:23:22.511 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.503+0000 7f74daffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f74dc1535a0 0x7f74dc16a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:22.511 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.503+0000 7f74db7fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f74dc15a560 0x7f74dc15e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:22.512 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.503+0000 7f74daffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f74dc1535a0 0x7f74dc16a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38404/0 (socket says 172.21.15.83:38404) 2023-10-06T03:23:22.512 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.503+0000 7f74daffd700 1 -- 172.21.15.83:0/2764806414 learned_addr learned my addr 172.21.15.83:0/2764806414 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-10-06T03:23:22.512 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.503+0000 7f74da7fc700 1 --2- 172.21.15.83:0/2764806414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74dc157670 0x7f74dc1563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:22.512 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.503+0000 7f74daffd700 1 -- 172.21.15.83:0/2764806414 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f74dc15a560 msgr2=0x7f74dc15e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:22.512 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.503+0000 7f74daffd700 1 --2- 172.21.15.83:0/2764806414 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f74dc15a560 0x7f74dc15e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:22.512 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.503+0000 7f74daffd700 1 -- 172.21.15.83:0/2764806414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74dc157670 msgr2=0x7f74dc1563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:22.512 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.503+0000 7f74daffd700 1 --2- 172.21.15.83:0/2764806414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74dc157670 0x7f74dc1563f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:22.512 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.503+0000 7f74daffd700 1 -- 172.21.15.83:0/2764806414 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d0009420 con 0x7f74dc1535a0 2023-10-06T03:23:22.512 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.504+0000 7f74daffd700 1 --2- 172.21.15.83:0/2764806414 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f74dc1535a0 0x7f74dc16a6b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f74cc00ea50 tx=0x7f74cc009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:22.512 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.504+0000 7f74c2ffd700 1 -- 172.21.15.83:0/2764806414 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74cc00c640 con 0x7f74dc1535a0 2023-10-06T03:23:22.512 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.504+0000 7f74c2ffd700 1 -- 172.21.15.83:0/2764806414 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74cc00c7a0 con 0x7f74dc1535a0 2023-10-06T03:23:22.513 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.504+0000 7f74c2ffd700 1 -- 172.21.15.83:0/2764806414 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74cc00cb20 con 0x7f74dc1535a0 2023-10-06T03:23:22.513 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.504+0000 7f74dbfff700 1 -- 172.21.15.83:0/2764806414 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74dc155630 con 0x7f74dc1535a0 2023-10-06T03:23:22.513 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.504+0000 7f74dbfff700 1 -- 172.21.15.83:0/2764806414 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74dc155bf0 con 0x7f74dc1535a0 2023-10-06T03:23:22.513 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.504+0000 7f74c2ffd700 1 -- 172.21.15.83:0/2764806414 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f74cc005c80 con 0x7f74dc1535a0 2023-10-06T03:23:22.513 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.504+0000 7f74c2ffd700 1 -- 172.21.15.83:0/2764806414 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f74cc006020 con 0x7f74dc1535a0 2023-10-06T03:23:22.513 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.505+0000 7f74dbfff700 1 -- 172.21.15.83:0/2764806414 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74dc04c3c0 con 0x7f74dc1535a0 2023-10-06T03:23:22.513 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.507+0000 7f74c2ffd700 1 -- 172.21.15.83:0/2764806414 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f74cc021060 con 0x7f74dc1535a0 2023-10-06T03:23:22.551 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T03:23:22.549+0000 7f7a5e870180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T03:23:22.595 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.592+0000 7f74dbfff700 1 -- 172.21.15.83:0/2764806414 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ffbfe056-46bc-46e0-bf49-4d8f8650e20f", "id": 2} v 0) v1 -- 0x7f74dc15b2e0 con 0x7f74dc1535a0 2023-10-06T03:23:22.599 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.596+0000 7f74c2ffd700 1 -- 172.21.15.83:0/2764806414 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ffbfe056-46bc-46e0-bf49-4d8f8650e20f", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f74cc029020 con 0x7f74dc1535a0 2023-10-06T03:23:22.599 INFO:teuthology.orchestra.run.smithi083.stdout:2 2023-10-06T03:23:22.600 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.598+0000 7f74dbfff700 1 -- 172.21.15.83:0/2764806414 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f74dc1535a0 msgr2=0x7f74dc16a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:22.601 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.598+0000 7f74dbfff700 1 --2- 172.21.15.83:0/2764806414 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f74dc1535a0 0x7f74dc16a6b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f74cc00ea50 tx=0x7f74cc009250 comp rx=0 tx=0).stop 2023-10-06T03:23:22.601 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.598+0000 7f74dbfff700 1 -- 172.21.15.83:0/2764806414 shutdown_connections 2023-10-06T03:23:22.601 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.598+0000 7f74dbfff700 1 --2- 172.21.15.83:0/2764806414 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f74dc15a560 0x7f74dc15e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:22.601 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.598+0000 7f74dbfff700 1 --2- 172.21.15.83:0/2764806414 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f74dc1535a0 0x7f74dc16a6b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:22.601 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.598+0000 7f74dbfff700 1 --2- 172.21.15.83:0/2764806414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74dc157670 0x7f74dc1563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:22.601 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.598+0000 7f74dbfff700 1 -- 172.21.15.83:0/2764806414 >> 172.21.15.83:0/2764806414 conn(0x7f74dc068230 msgr2=0x7f74dc159300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:22.602 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.598+0000 7f74dbfff700 1 -- 172.21.15.83:0/2764806414 shutdown_connections 2023-10-06T03:23:22.602 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.598+0000 7f74dbfff700 1 -- 172.21.15.83:0/2764806414 wait complete. 2023-10-06T03:23:22.617 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd new ef9a8314-3d37-4ea1-858a-e704d5695002 3 2023-10-06T03:23:22.722 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-06T03:23:22.719+0000 7f8366d58180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T03:23:22.783 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T03:23:22.781+0000 7f7a5e870180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T03:23:22.796 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.793+0000 7fafecd9d700 1 Processor -- start 2023-10-06T03:23:22.796 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.793+0000 7fafecd9d700 1 -- start start 2023-10-06T03:23:22.798 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.795+0000 7fafecd9d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fafe81535a0 0x7fafe815ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:22.798 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.795+0000 7fafecd9d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafe815bef0 con 0x7fafe815a560 2023-10-06T03:23:22.798 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.795+0000 7fafecd9d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafe80d1160 con 0x7fafe8157670 2023-10-06T03:23:22.798 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.795+0000 7fafecd9d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafe815a9e0 con 0x7fafe81535a0 2023-10-06T03:23:22.798 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.795+0000 7fafe77fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fafe81535a0 0x7fafe815ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:22.799 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.795+0000 7fafe7fff700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fafe8157670 0x7fafe80b1cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:43718/0 (socket says 172.21.15.83:43718) 2023-10-06T03:23:22.799 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.795+0000 7fafe7fff700 1 -- 172.21.15.83:0/803393218 learned_addr learned my addr 172.21.15.83:0/803393218 (peer_addr_for_me v1:172.21.15.83:0/0) 2023-10-06T03:23:22.799 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.795+0000 7fafe77fe700 1 -- 172.21.15.83:0/803393218 >> v1:172.21.15.83:6789/0 conn(0x7fafe8157670 legacy=0x7fafe80b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:22.799 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.795+0000 7fafe67fc700 1 -- 172.21.15.83:0/803393218 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2629733301 0 0) 0x7fafe80d1160 con 0x7fafe8157670 2023-10-06T03:23:22.799 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.795+0000 7fafe77fe700 1 -- 172.21.15.83:0/803393218 >> v1:172.21.15.81:6789/0 conn(0x7fafe815a560 legacy=0x7fafe8153970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:22.799 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.795+0000 7fafe77fe700 1 -- 172.21.15.83:0/803393218 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe815b2e0 con 0x7fafe81535a0 2023-10-06T03:23:22.799 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.796+0000 7fafe77fe700 1 --2- 172.21.15.83:0/803393218 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fafe81535a0 0x7fafe815ac00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fafd80098e0 tx=0x7fafd80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49e97871d62037b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:22.799 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.796+0000 7fafe67fc700 1 -- 172.21.15.83:0/803393218 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd8009e80 con 0x7fafe81535a0 2023-10-06T03:23:22.800 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.796+0000 7fafe67fc700 1 -- 172.21.15.83:0/803393218 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd800b860 con 0x7fafe81535a0 2023-10-06T03:23:22.800 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.796+0000 7fafe67fc700 1 -- 172.21.15.83:0/803393218 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd800bbe0 con 0x7fafe81535a0 2023-10-06T03:23:22.801 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.796+0000 7fafecd9d700 1 -- 172.21.15.83:0/803393218 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fafe81535a0 msgr2=0x7fafe815ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:22.801 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.796+0000 7fafecd9d700 1 --2- 172.21.15.83:0/803393218 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fafe81535a0 0x7fafe815ac00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fafd80098e0 tx=0x7fafd80091a0 comp rx=0 tx=0).stop 2023-10-06T03:23:22.801 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.797+0000 7fafecd9d700 1 -- 172.21.15.83:0/803393218 shutdown_connections 2023-10-06T03:23:22.801 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.797+0000 7fafecd9d700 1 --2- 172.21.15.83:0/803393218 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fafe81535a0 0x7fafe815ac00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:22.801 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.797+0000 7fafecd9d700 1 -- 172.21.15.83:0/803393218 >> 172.21.15.83:0/803393218 conn(0x7fafe8068230 msgr2=0x7fafe8068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:22.801 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.797+0000 7fafecd9d700 1 -- 172.21.15.83:0/803393218 shutdown_connections 2023-10-06T03:23:22.802 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.797+0000 7fafecd9d700 1 -- 172.21.15.83:0/803393218 wait complete. 2023-10-06T03:23:22.802 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.798+0000 7fafecd9d700 1 Processor -- start 2023-10-06T03:23:22.802 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.798+0000 7fafecd9d700 1 -- start start 2023-10-06T03:23:22.804 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.799+0000 7fafecd9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fafe81535a0 0x7fafe815f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:22.804 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.799+0000 7fafecd9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafe8157670 0x7fafe815ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:22.805 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.799+0000 7fafecd9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fafe815a560 0x7fafe8157d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:22.805 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.799+0000 7fafecd9d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe815df30 con 0x7fafe8157670 2023-10-06T03:23:22.805 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.799+0000 7fafecd9d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe815d3f0 con 0x7fafe815a560 2023-10-06T03:23:22.805 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.799+0000 7fafecd9d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe815d690 con 0x7fafe81535a0 2023-10-06T03:23:22.805 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.800+0000 7fafe77fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fafe81535a0 0x7fafe815f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:22.805 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.800+0000 7fafe77fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fafe81535a0 0x7fafe815f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.83:46166/0 (socket says 172.21.15.83:46166) 2023-10-06T03:23:22.805 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.800+0000 7fafe77fe700 1 -- 172.21.15.83:0/3252637773 learned_addr learned my addr 172.21.15.83:0/3252637773 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-10-06T03:23:22.805 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.800+0000 7fafe7fff700 1 --2- 172.21.15.83:0/3252637773 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fafe815a560 0x7fafe8157d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:22.806 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.800+0000 7fafe6ffd700 1 --2- 172.21.15.83:0/3252637773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafe8157670 0x7fafe815ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:22.806 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.800+0000 7fafe77fe700 1 -- 172.21.15.83:0/3252637773 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fafe815a560 msgr2=0x7fafe8157d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:22.806 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.800+0000 7fafe77fe700 1 --2- 172.21.15.83:0/3252637773 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fafe815a560 0x7fafe8157d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:22.806 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.800+0000 7fafe77fe700 1 -- 172.21.15.83:0/3252637773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafe8157670 msgr2=0x7fafe815ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:22.806 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.800+0000 7fafe77fe700 1 --2- 172.21.15.83:0/3252637773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafe8157670 0x7fafe815ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:22.806 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.800+0000 7fafe77fe700 1 -- 172.21.15.83:0/3252637773 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd8009420 con 0x7fafe81535a0 2023-10-06T03:23:22.806 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.800+0000 7fafe7fff700 1 --2- 172.21.15.83:0/3252637773 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fafe815a560 0x7fafe8157d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:23:22.806 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.800+0000 7fafe77fe700 1 --2- 172.21.15.83:0/3252637773 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fafe81535a0 0x7fafe815f570 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fafe8088fa0 tx=0x7fafd8017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:22.806 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.801+0000 7fafcf7fe700 1 -- 172.21.15.83:0/3252637773 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd801f070 con 0x7fafe81535a0 2023-10-06T03:23:22.806 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.801+0000 7fafcf7fe700 1 -- 172.21.15.83:0/3252637773 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd8000c90 con 0x7fafe81535a0 2023-10-06T03:23:22.807 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.801+0000 7fafecd9d700 1 -- 172.21.15.83:0/3252637773 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafe815d970 con 0x7fafe81535a0 2023-10-06T03:23:22.807 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.801+0000 7fafcf7fe700 1 -- 172.21.15.83:0/3252637773 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd8025420 con 0x7fafe81535a0 2023-10-06T03:23:22.807 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.801+0000 7fafecd9d700 1 -- 172.21.15.83:0/3252637773 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafe8169b60 con 0x7fafe81535a0 2023-10-06T03:23:22.807 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.801+0000 7fafcf7fe700 1 -- 172.21.15.83:0/3252637773 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fafd8023070 con 0x7fafe81535a0 2023-10-06T03:23:22.807 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.801+0000 7fafcf7fe700 1 -- 172.21.15.83:0/3252637773 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7fafd8011420 con 0x7fafe81535a0 2023-10-06T03:23:22.807 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.802+0000 7fafecd9d700 1 -- 172.21.15.83:0/3252637773 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafe804c3c0 con 0x7fafe81535a0 2023-10-06T03:23:22.808 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.804+0000 7fafcf7fe700 1 -- 172.21.15.83:0/3252637773 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fafd802a070 con 0x7fafe81535a0 2023-10-06T03:23:22.893 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.891+0000 7fafecd9d700 1 -- 172.21.15.83:0/3252637773 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ef9a8314-3d37-4ea1-858a-e704d5695002", "id": 3} v 0) v1 -- 0x7fafe815b5c0 con 0x7fafe81535a0 2023-10-06T03:23:22.902 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.900+0000 7fafcf7fe700 1 -- 172.21.15.83:0/3252637773 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ef9a8314-3d37-4ea1-858a-e704d5695002", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fafd8015020 con 0x7fafe81535a0 2023-10-06T03:23:22.903 INFO:teuthology.orchestra.run.smithi083.stdout:3 2023-10-06T03:23:22.904 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.902+0000 7fafecd9d700 1 -- 172.21.15.83:0/3252637773 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fafe81535a0 msgr2=0x7fafe815f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:22.905 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.902+0000 7fafecd9d700 1 --2- 172.21.15.83:0/3252637773 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fafe81535a0 0x7fafe815f570 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fafe8088fa0 tx=0x7fafd8017000 comp rx=0 tx=0).stop 2023-10-06T03:23:22.905 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.902+0000 7fafecd9d700 1 -- 172.21.15.83:0/3252637773 shutdown_connections 2023-10-06T03:23:22.905 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.902+0000 7fafecd9d700 1 --2- 172.21.15.83:0/3252637773 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fafe815a560 0x7fafe8157d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:22.905 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.902+0000 7fafecd9d700 1 --2- 172.21.15.83:0/3252637773 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fafe81535a0 0x7fafe815f570 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:22.905 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.902+0000 7fafecd9d700 1 --2- 172.21.15.83:0/3252637773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafe8157670 0x7fafe815ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:22.906 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.902+0000 7fafecd9d700 1 -- 172.21.15.83:0/3252637773 >> 172.21.15.83:0/3252637773 conn(0x7fafe8068230 msgr2=0x7fafe80b3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:22.906 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.902+0000 7fafecd9d700 1 -- 172.21.15.83:0/3252637773 shutdown_connections 2023-10-06T03:23:22.906 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:22.902+0000 7fafecd9d700 1 -- 172.21.15.83:0/3252637773 wait complete. 2023-10-06T03:23:22.919 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd new d83506a0-2c96-4bcb-a9fa-05e43dc329df 4 2023-10-06T03:23:22.933 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-06T03:23:22.931+0000 7f8366d58180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T03:23:23.006 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T03:23:23.005+0000 7f7a5e870180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T03:23:23.026 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-06T03:23:23.024+0000 7f8366d58180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T03:23:23.096 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.095+0000 7f56ca99d700 1 Processor -- start 2023-10-06T03:23:23.097 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.095+0000 7f56ca99d700 1 -- start start 2023-10-06T03:23:23.100 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.096+0000 7f56ca99d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56c40b1f50 0x7f56c415c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:23.100 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.096+0000 7f56ca99d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f56c4157cb0 0x7f56c40d0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:23.101 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.096+0000 7f56ca99d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56c415b4f0 con 0x7f56c415cad0 2023-10-06T03:23:23.101 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.096+0000 7f56ca99d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56c415b7d0 con 0x7f56c4157cb0 2023-10-06T03:23:23.101 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.096+0000 7f56ca99d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56c415bab0 con 0x7f56c40b1f50 2023-10-06T03:23:23.101 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.097+0000 7f56ca19c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f56c4157cb0 0x7f56c40d0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:23.101 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.097+0000 7f56c999b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56c40b1f50 0x7f56c415c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:23.101 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.097+0000 7f56c999b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56c40b1f50 0x7f56c415c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.83:46170/0 (socket says 172.21.15.83:46170) 2023-10-06T03:23:23.101 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.097+0000 7f56ca19c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f56c4157cb0 0x7f56c40d0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38436/0 (socket says 172.21.15.83:38436) 2023-10-06T03:23:23.102 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.097+0000 7f56c999b700 1 -- 172.21.15.83:0/2736103820 learned_addr learned my addr 172.21.15.83:0/2736103820 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-10-06T03:23:23.102 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.097+0000 7f56c919a700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f56c415cad0 0x7f56c41575a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:43722/0 (socket says 172.21.15.83:43722) 2023-10-06T03:23:23.102 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.097+0000 7f56c999b700 1 -- 172.21.15.83:0/2736103820 >> v2:172.21.15.83:3300/0 conn(0x7f56c4157cb0 msgr2=0x7f56c40d0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:23.102 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.097+0000 7f56c999b700 1 --2- 172.21.15.83:0/2736103820 >> v2:172.21.15.83:3300/0 conn(0x7f56c4157cb0 0x7f56c40d0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:23.102 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.097+0000 7f56c999b700 1 -- 172.21.15.83:0/2736103820 >> v1:172.21.15.83:6789/0 conn(0x7f56c415cad0 legacy=0x7f56c41575a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:23.102 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.097+0000 7f56c999b700 1 -- 172.21.15.83:0/2736103820 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c415bd90 con 0x7f56c40b1f50 2023-10-06T03:23:23.102 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.097+0000 7f56c8999700 1 -- 172.21.15.83:0/2736103820 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 155947799 0 0) 0x7f56c415b4f0 con 0x7f56c415cad0 2023-10-06T03:23:23.103 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.097+0000 7f56ca19c700 1 --2- 172.21.15.83:0/2736103820 >> v2:172.21.15.83:3300/0 conn(0x7f56c4157cb0 0x7f56c40d0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:23:23.103 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.098+0000 7f56c999b700 1 --2- 172.21.15.83:0/2736103820 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56c40b1f50 0x7f56c415c590 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f56c00099b0 tx=0x7f56c0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65787f377defdcdf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:23.103 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.098+0000 7f56c8999700 1 -- 172.21.15.83:0/2736103820 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c0009ea0 con 0x7f56c40b1f50 2023-10-06T03:23:23.103 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.098+0000 7f56c8999700 1 -- 172.21.15.83:0/2736103820 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c000b860 con 0x7f56c40b1f50 2023-10-06T03:23:23.103 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.098+0000 7f56c8999700 1 -- 172.21.15.83:0/2736103820 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c000bc00 con 0x7f56c40b1f50 2023-10-06T03:23:23.103 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.098+0000 7f56ca99d700 1 -- 172.21.15.83:0/2736103820 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56c40b1f50 msgr2=0x7f56c415c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:23.103 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.098+0000 7f56ca99d700 1 --2- 172.21.15.83:0/2736103820 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56c40b1f50 0x7f56c415c590 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f56c00099b0 tx=0x7f56c0009250 comp rx=0 tx=0).stop 2023-10-06T03:23:23.103 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.098+0000 7f56ca99d700 1 -- 172.21.15.83:0/2736103820 shutdown_connections 2023-10-06T03:23:23.103 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.098+0000 7f56ca99d700 1 --2- 172.21.15.83:0/2736103820 >> v2:172.21.15.83:3300/0 conn(0x7f56c4157cb0 0x7f56c40d0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:23.103 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.098+0000 7f56ca99d700 1 --2- 172.21.15.83:0/2736103820 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56c40b1f50 0x7f56c415c590 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:23.103 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.098+0000 7f56ca99d700 1 -- 172.21.15.83:0/2736103820 >> 172.21.15.83:0/2736103820 conn(0x7f56c406ed10 msgr2=0x7f56c406f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:23.104 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.099+0000 7f56ca99d700 1 -- 172.21.15.83:0/2736103820 shutdown_connections 2023-10-06T03:23:23.104 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.099+0000 7f56ca99d700 1 -- 172.21.15.83:0/2736103820 wait complete. 2023-10-06T03:23:23.106 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.100+0000 7f56ca99d700 1 Processor -- start 2023-10-06T03:23:23.106 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.100+0000 7f56ca99d700 1 -- start start 2023-10-06T03:23:23.106 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.101+0000 7f56ca99d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56c40b1f50 0x7f56c4144ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:23.106 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.101+0000 7f56ca99d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56c4157cb0 0x7f56c41580a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:23.107 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.101+0000 7f56ca99d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56c415cad0 0x7f56c414c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:23.107 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.101+0000 7f56ca99d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c41453e0 con 0x7f56c415cad0 2023-10-06T03:23:23.107 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.101+0000 7f56ca99d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c4158ad0 con 0x7f56c40b1f50 2023-10-06T03:23:23.107 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.101+0000 7f56ca99d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56c4158db0 con 0x7f56c4157cb0 2023-10-06T03:23:23.107 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.101+0000 7f56c999b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56c40b1f50 0x7f56c4144ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:23.107 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.101+0000 7f56c919a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56c4157cb0 0x7f56c41580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:23.107 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.101+0000 7f56c999b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56c40b1f50 0x7f56c4144ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38448/0 (socket says 172.21.15.83:38448) 2023-10-06T03:23:23.107 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.101+0000 7f56c999b700 1 -- 172.21.15.83:0/292232519 learned_addr learned my addr 172.21.15.83:0/292232519 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-10-06T03:23:23.107 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.101+0000 7f56ca19c700 1 --2- 172.21.15.83:0/292232519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56c415cad0 0x7f56c414c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:23.108 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.102+0000 7f56c999b700 1 -- 172.21.15.83:0/292232519 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56c4157cb0 msgr2=0x7f56c41580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:23.108 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.102+0000 7f56c999b700 1 --2- 172.21.15.83:0/292232519 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56c4157cb0 0x7f56c41580a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:23.108 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.102+0000 7f56c999b700 1 -- 172.21.15.83:0/292232519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56c415cad0 msgr2=0x7f56c414c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:23.108 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.102+0000 7f56c999b700 1 --2- 172.21.15.83:0/292232519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56c415cad0 0x7f56c414c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:23.108 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.102+0000 7f56c999b700 1 -- 172.21.15.83:0/292232519 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56bc009a20 con 0x7f56c40b1f50 2023-10-06T03:23:23.108 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.102+0000 7f56ca19c700 1 --2- 172.21.15.83:0/292232519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56c415cad0 0x7f56c414c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:23:23.108 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.102+0000 7f56c999b700 1 --2- 172.21.15.83:0/292232519 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56c40b1f50 0x7f56c4144ea0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f56c415bbf0 tx=0x7f56c0017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:23.108 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.102+0000 7f56b9ffb700 1 -- 172.21.15.83:0/292232519 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c000bbe0 con 0x7f56c40b1f50 2023-10-06T03:23:23.108 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.102+0000 7f56b9ffb700 1 -- 172.21.15.83:0/292232519 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c0011420 con 0x7f56c40b1f50 2023-10-06T03:23:23.108 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.102+0000 7f56b9ffb700 1 -- 172.21.15.83:0/292232519 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c00117e0 con 0x7f56c40b1f50 2023-10-06T03:23:23.108 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.102+0000 7f56ca99d700 1 -- 172.21.15.83:0/292232519 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56c00094f0 con 0x7f56c40b1f50 2023-10-06T03:23:23.109 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.102+0000 7f56ca99d700 1 -- 172.21.15.83:0/292232519 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56c4159370 con 0x7f56c40b1f50 2023-10-06T03:23:23.109 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.102+0000 7f56b9ffb700 1 -- 172.21.15.83:0/292232519 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f56c002e3f0 con 0x7f56c40b1f50 2023-10-06T03:23:23.109 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.103+0000 7f56b9ffb700 1 -- 172.21.15.83:0/292232519 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f56c00253f0 con 0x7f56c40b1f50 2023-10-06T03:23:23.109 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.104+0000 7f56ca99d700 1 -- 172.21.15.83:0/292232519 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56c41596a0 con 0x7f56c40b1f50 2023-10-06T03:23:23.109 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.106+0000 7f56b9ffb700 1 -- 172.21.15.83:0/292232519 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f56c0033060 con 0x7f56c40b1f50 2023-10-06T03:23:23.110 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T03:23:23.106+0000 7f7a5e870180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T03:23:23.184 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-06T03:23:23.183+0000 7f8366d58180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T03:23:23.200 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.199+0000 7f56ca99d700 1 -- 172.21.15.83:0/292232519 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d83506a0-2c96-4bcb-a9fa-05e43dc329df", "id": 4} v 0) v1 -- 0x7f56c404c3c0 con 0x7f56c40b1f50 2023-10-06T03:23:23.209 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.208+0000 7f56b9ffb700 1 -- 172.21.15.83:0/292232519 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d83506a0-2c96-4bcb-a9fa-05e43dc329df", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f56c0015020 con 0x7f56c40b1f50 2023-10-06T03:23:23.209 INFO:teuthology.orchestra.run.smithi083.stdout:4 2023-10-06T03:23:23.210 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.209+0000 7f56ca99d700 1 -- 172.21.15.83:0/292232519 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56c40b1f50 msgr2=0x7f56c4144ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:23.210 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.209+0000 7f56ca99d700 1 --2- 172.21.15.83:0/292232519 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56c40b1f50 0x7f56c4144ea0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f56c415bbf0 tx=0x7f56c0017000 comp rx=0 tx=0).stop 2023-10-06T03:23:23.210 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.209+0000 7f56ca99d700 1 -- 172.21.15.83:0/292232519 shutdown_connections 2023-10-06T03:23:23.210 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.209+0000 7f56ca99d700 1 --2- 172.21.15.83:0/292232519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56c415cad0 0x7f56c414c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:23.210 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.209+0000 7f56ca99d700 1 --2- 172.21.15.83:0/292232519 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56c40b1f50 0x7f56c4144ea0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:23.210 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.209+0000 7f56ca99d700 1 --2- 172.21.15.83:0/292232519 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56c4157cb0 0x7f56c41580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:23.210 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.209+0000 7f56ca99d700 1 -- 172.21.15.83:0/292232519 >> 172.21.15.83:0/292232519 conn(0x7f56c406ed10 msgr2=0x7f56c40d0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:23.211 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.209+0000 7f56ca99d700 1 -- 172.21.15.83:0/292232519 shutdown_connections 2023-10-06T03:23:23.211 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.209+0000 7f56ca99d700 1 -- 172.21.15.83:0/292232519 wait complete. 2023-10-06T03:23:23.227 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd new 10687c63-a3d5-472f-acc0-4f61847b6e0d 5 2023-10-06T03:23:23.289 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T03:23:23.288+0000 7f7a5e870180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T03:23:23.300 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-06T03:23:23.299+0000 7f8366d58180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T03:23:23.410 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.409+0000 7fee8519d700 1 Processor -- start 2023-10-06T03:23:23.411 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.409+0000 7fee8519d700 1 -- start start 2023-10-06T03:23:23.413 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.411+0000 7fee8519d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fee800b1f50 0x7fee8015c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:23.413 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.411+0000 7fee8519d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fee80157cb0 0x7fee800d0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:23.413 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.411+0000 7fee8519d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee8015b4f0 con 0x7fee8015cad0 2023-10-06T03:23:23.413 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.411+0000 7fee8519d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee8015b7d0 con 0x7fee800b1f50 2023-10-06T03:23:23.413 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.411+0000 7fee8519d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee8015bab0 con 0x7fee80157cb0 2023-10-06T03:23:23.413 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.411+0000 7fee8499c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fee80157cb0 0x7fee800d0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:23.413 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.411+0000 7fee7ffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fee800b1f50 0x7fee8015c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:23.413 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.411+0000 7fee7ffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fee800b1f50 0x7fee8015c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.83:45970/0 (socket says 172.21.15.83:45970) 2023-10-06T03:23:23.413 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.411+0000 7fee7ffff700 1 -- 172.21.15.83:0/1935605561 learned_addr learned my addr 172.21.15.83:0/1935605561 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-10-06T03:23:23.414 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.411+0000 7fee7f7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fee8015cad0 0x7fee801575a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.83:33460/0 (socket says 172.21.15.83:33460) 2023-10-06T03:23:23.414 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.411+0000 7fee7effd700 1 -- 172.21.15.83:0/1935605561 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2587232173 0 0) 0x7fee8015b4f0 con 0x7fee8015cad0 2023-10-06T03:23:23.414 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.411+0000 7fee7effd700 1 -- 172.21.15.83:0/1935605561 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee68003570 con 0x7fee8015cad0 2023-10-06T03:23:23.414 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.411+0000 7fee8499c700 1 -- 172.21.15.83:0/1935605561 >> v2:172.21.15.81:3300/0 conn(0x7fee800b1f50 msgr2=0x7fee8015c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:23.414 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.412+0000 7fee8499c700 1 --2- 172.21.15.83:0/1935605561 >> v2:172.21.15.81:3300/0 conn(0x7fee800b1f50 0x7fee8015c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:23.414 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.412+0000 7fee8499c700 1 -- 172.21.15.83:0/1935605561 >> v1:172.21.15.81:6789/0 conn(0x7fee8015cad0 legacy=0x7fee801575a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:23.414 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.412+0000 7fee8499c700 1 -- 172.21.15.83:0/1935605561 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee8015bd90 con 0x7fee80157cb0 2023-10-06T03:23:23.414 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.412+0000 7fee8499c700 1 --2- 172.21.15.83:0/1935605561 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fee80157cb0 0x7fee800d0790 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fee800af580 tx=0x7fee78009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c961a7f5af308c85 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:23.414 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T03:23:23.412+0000 7f7a5e870180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T03:23:23.416 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.412+0000 7fee7effd700 1 -- 172.21.15.83:0/1935605561 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7800e070 con 0x7fee80157cb0 2023-10-06T03:23:23.416 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.412+0000 7fee7effd700 1 -- 172.21.15.83:0/1935605561 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee7800bab0 con 0x7fee80157cb0 2023-10-06T03:23:23.416 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.412+0000 7fee7effd700 1 -- 172.21.15.83:0/1935605561 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7800be70 con 0x7fee80157cb0 2023-10-06T03:23:23.416 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.413+0000 7fee8519d700 1 -- 172.21.15.83:0/1935605561 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fee80157cb0 msgr2=0x7fee800d0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:23.416 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.413+0000 7fee8519d700 1 --2- 172.21.15.83:0/1935605561 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fee80157cb0 0x7fee800d0790 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fee800af580 tx=0x7fee78009780 comp rx=0 tx=0).stop 2023-10-06T03:23:23.416 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.413+0000 7fee8519d700 1 -- 172.21.15.83:0/1935605561 shutdown_connections 2023-10-06T03:23:23.416 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.413+0000 7fee8519d700 1 --2- 172.21.15.83:0/1935605561 >> v2:172.21.15.81:3300/0 conn(0x7fee800b1f50 0x7fee8015c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:23.416 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.413+0000 7fee8519d700 1 --2- 172.21.15.83:0/1935605561 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fee80157cb0 0x7fee800d0790 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:23.416 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.413+0000 7fee8519d700 1 -- 172.21.15.83:0/1935605561 >> 172.21.15.83:0/1935605561 conn(0x7fee8006ed10 msgr2=0x7fee8006f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:23.416 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.413+0000 7fee8519d700 1 -- 172.21.15.83:0/1935605561 shutdown_connections 2023-10-06T03:23:23.416 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.413+0000 7fee8519d700 1 -- 172.21.15.83:0/1935605561 wait complete. 2023-10-06T03:23:23.417 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.414+0000 7fee8519d700 1 Processor -- start 2023-10-06T03:23:23.417 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.414+0000 7fee8519d700 1 -- start start 2023-10-06T03:23:23.419 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.415+0000 7fee8519d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee800b1f50 0x7fee80147e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:23.419 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.415+0000 7fee8519d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fee80157cb0 0x7fee8015ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:23.419 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.415+0000 7fee8519d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fee8015cad0 0x7fee80158a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:23.419 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.415+0000 7fee8519d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee8014b960 con 0x7fee800b1f50 2023-10-06T03:23:23.419 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.415+0000 7fee8519d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee80169f30 con 0x7fee8015cad0 2023-10-06T03:23:23.419 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.415+0000 7fee8519d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee80169320 con 0x7fee80157cb0 2023-10-06T03:23:23.419 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.416+0000 7fee7ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee800b1f50 0x7fee80147e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:23.419 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.416+0000 7fee7f7fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fee80157cb0 0x7fee8015ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:23.419 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.416+0000 7fee8499c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fee8015cad0 0x7fee80158a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:23.419 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.416+0000 7fee7ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee800b1f50 0x7fee80147e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.83:45984/0 (socket says 172.21.15.83:45984) 2023-10-06T03:23:23.420 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.416+0000 7fee7ffff700 1 -- 172.21.15.83:0/2256344750 learned_addr learned my addr 172.21.15.83:0/2256344750 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-10-06T03:23:23.420 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.416+0000 7fee8499c700 1 --2- 172.21.15.83:0/2256344750 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fee8015cad0 0x7fee80158a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38470/0 (socket says 172.21.15.83:38470) 2023-10-06T03:23:23.420 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.416+0000 7fee7ffff700 1 -- 172.21.15.83:0/2256344750 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fee80157cb0 msgr2=0x7fee8015ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:23.420 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.416+0000 7fee7ffff700 1 --2- 172.21.15.83:0/2256344750 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fee80157cb0 0x7fee8015ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:23.420 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.416+0000 7fee7ffff700 1 -- 172.21.15.83:0/2256344750 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fee8015cad0 msgr2=0x7fee80158a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:23.420 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.416+0000 7fee7ffff700 1 --2- 172.21.15.83:0/2256344750 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fee8015cad0 0x7fee80158a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:23.420 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.416+0000 7fee7ffff700 1 -- 172.21.15.83:0/2256344750 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee78009a20 con 0x7fee800b1f50 2023-10-06T03:23:23.420 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.416+0000 7fee7f7fe700 1 --2- 172.21.15.83:0/2256344750 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fee80157cb0 0x7fee8015ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:23:23.420 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.416+0000 7fee7ffff700 1 --2- 172.21.15.83:0/2256344750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee800b1f50 0x7fee80147e40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fee7000ea80 tx=0x7fee70009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:23.420 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.417+0000 7fee67fff700 1 -- 172.21.15.83:0/2256344750 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7000ee60 con 0x7fee800b1f50 2023-10-06T03:23:23.420 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.417+0000 7fee67fff700 1 -- 172.21.15.83:0/2256344750 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee7000c850 con 0x7fee800b1f50 2023-10-06T03:23:23.421 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.417+0000 7fee67fff700 1 -- 172.21.15.83:0/2256344750 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7000cbd0 con 0x7fee800b1f50 2023-10-06T03:23:23.421 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.417+0000 7fee8519d700 1 -- 172.21.15.83:0/2256344750 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee80169600 con 0x7fee800b1f50 2023-10-06T03:23:23.421 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.417+0000 7fee8519d700 1 -- 172.21.15.83:0/2256344750 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee80169bc0 con 0x7fee800b1f50 2023-10-06T03:23:23.421 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.417+0000 7fee67fff700 1 -- 172.21.15.83:0/2256344750 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fee70005c80 con 0x7fee800b1f50 2023-10-06T03:23:23.421 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.417+0000 7fee67fff700 1 -- 172.21.15.83:0/2256344750 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7fee700065c0 con 0x7fee800b1f50 2023-10-06T03:23:23.421 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.418+0000 7fee8519d700 1 -- 172.21.15.83:0/2256344750 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee8004c3c0 con 0x7fee800b1f50 2023-10-06T03:23:23.421 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.420+0000 7fee67fff700 1 -- 172.21.15.83:0/2256344750 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fee70021060 con 0x7fee800b1f50 2023-10-06T03:23:23.506 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.505+0000 7fee8519d700 1 -- 172.21.15.83:0/2256344750 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd new", "uuid": "10687c63-a3d5-472f-acc0-4f61847b6e0d", "id": 5} v 0) v1 -- 0x7fee8015c070 con 0x7fee800b1f50 2023-10-06T03:23:23.510 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.509+0000 7fee67fff700 1 -- 172.21.15.83:0/2256344750 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "10687c63-a3d5-472f-acc0-4f61847b6e0d", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fee70017070 con 0x7fee800b1f50 2023-10-06T03:23:23.510 INFO:teuthology.orchestra.run.smithi083.stdout:5 2023-10-06T03:23:23.512 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.510+0000 7fee8519d700 1 -- 172.21.15.83:0/2256344750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee800b1f50 msgr2=0x7fee80147e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:23.512 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.510+0000 7fee8519d700 1 --2- 172.21.15.83:0/2256344750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee800b1f50 0x7fee80147e40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fee7000ea80 tx=0x7fee70009250 comp rx=0 tx=0).stop 2023-10-06T03:23:23.512 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.510+0000 7fee8519d700 1 -- 172.21.15.83:0/2256344750 shutdown_connections 2023-10-06T03:23:23.512 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.510+0000 7fee8519d700 1 --2- 172.21.15.83:0/2256344750 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fee8015cad0 0x7fee80158a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:23.512 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.510+0000 7fee8519d700 1 --2- 172.21.15.83:0/2256344750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee800b1f50 0x7fee80147e40 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:23.512 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.510+0000 7fee8519d700 1 --2- 172.21.15.83:0/2256344750 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fee80157cb0 0x7fee8015ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:23.512 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.510+0000 7fee8519d700 1 -- 172.21.15.83:0/2256344750 >> 172.21.15.83:0/2256344750 conn(0x7fee8006ed10 msgr2=0x7fee800b3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:23.512 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.510+0000 7fee8519d700 1 -- 172.21.15.83:0/2256344750 shutdown_connections 2023-10-06T03:23:23.512 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.511+0000 7fee8519d700 1 -- 172.21.15.83:0/2256344750 wait complete. 2023-10-06T03:23:23.528 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd new 2e9daf76-5607-4a29-9a58-6e270700d223 6 2023-10-06T03:23:23.705 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.703+0000 7f5e6919d700 1 Processor -- start 2023-10-06T03:23:23.705 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.704+0000 7f5e6919d700 1 -- start start 2023-10-06T03:23:23.707 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.706+0000 7f5e6919d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5e641535a0 0x7f5e6415ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:23.707 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.706+0000 7f5e6919d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e6415bef0 con 0x7f5e64157670 2023-10-06T03:23:23.707 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.706+0000 7f5e6919d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e640d1160 con 0x7f5e6415a560 2023-10-06T03:23:23.708 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.706+0000 7f5e6919d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6415a9d0 con 0x7f5e641535a0 2023-10-06T03:23:23.708 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.706+0000 7f5e637fe700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f5e6415a560 0x7f5e64153970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:43724/0 (socket says 172.21.15.83:43724) 2023-10-06T03:23:23.708 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.706+0000 7f5e63fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5e641535a0 0x7f5e6415ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:23.708 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.706+0000 7f5e637fe700 1 -- 172.21.15.83:0/3971015637 learned_addr learned my addr 172.21.15.83:0/3971015637 (peer_addr_for_me v1:172.21.15.83:0/0) 2023-10-06T03:23:23.710 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.707+0000 7f5e62ffd700 1 -- 172.21.15.83:0/3971015637 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2561487901 0 0) 0x7f5e640d1160 con 0x7f5e6415a560 2023-10-06T03:23:23.710 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.707+0000 7f5e62ffd700 1 -- 172.21.15.83:0/3971015637 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e4c003570 con 0x7f5e6415a560 2023-10-06T03:23:23.710 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.707+0000 7f5e62ffd700 1 -- 172.21.15.83:0/3971015637 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1781043336 0 0) 0x7f5e6415bef0 con 0x7f5e64157670 2023-10-06T03:23:23.710 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.707+0000 7f5e63fff700 1 -- 172.21.15.83:0/3971015637 >> v1:172.21.15.83:6789/0 conn(0x7f5e6415a560 legacy=0x7f5e64153970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:23.710 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.707+0000 7f5e63fff700 1 -- 172.21.15.83:0/3971015637 >> v1:172.21.15.81:6789/0 conn(0x7f5e64157670 legacy=0x7f5e640b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:23.710 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.707+0000 7f5e63fff700 1 -- 172.21.15.83:0/3971015637 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e6415b2e0 con 0x7f5e641535a0 2023-10-06T03:23:23.710 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.707+0000 7f5e63fff700 1 --2- 172.21.15.83:0/3971015637 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5e641535a0 0x7f5e6415ac00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5e54009910 tx=0x7f5e540091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff75ec50300758f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:23.710 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.707+0000 7f5e62ffd700 1 -- 172.21.15.83:0/3971015637 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5400b680 con 0x7f5e641535a0 2023-10-06T03:23:23.710 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.707+0000 7f5e62ffd700 1 -- 172.21.15.83:0/3971015637 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e5400b7e0 con 0x7f5e641535a0 2023-10-06T03:23:23.710 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.707+0000 7f5e62ffd700 1 -- 172.21.15.83:0/3971015637 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5400bba0 con 0x7f5e641535a0 2023-10-06T03:23:23.711 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.708+0000 7f5e6919d700 1 -- 172.21.15.83:0/3971015637 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5e641535a0 msgr2=0x7f5e6415ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:23.711 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.708+0000 7f5e6919d700 1 --2- 172.21.15.83:0/3971015637 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5e641535a0 0x7f5e6415ac00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5e54009910 tx=0x7f5e540091a0 comp rx=0 tx=0).stop 2023-10-06T03:23:23.711 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.708+0000 7f5e6919d700 1 -- 172.21.15.83:0/3971015637 shutdown_connections 2023-10-06T03:23:23.711 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.708+0000 7f5e6919d700 1 --2- 172.21.15.83:0/3971015637 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5e641535a0 0x7f5e6415ac00 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:23.711 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.708+0000 7f5e6919d700 1 -- 172.21.15.83:0/3971015637 >> 172.21.15.83:0/3971015637 conn(0x7f5e64068230 msgr2=0x7f5e64068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:23.711 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.708+0000 7f5e6919d700 1 -- 172.21.15.83:0/3971015637 shutdown_connections 2023-10-06T03:23:23.711 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.708+0000 7f5e6919d700 1 -- 172.21.15.83:0/3971015637 wait complete. 2023-10-06T03:23:23.713 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.710+0000 7f5e6919d700 1 Processor -- start 2023-10-06T03:23:23.713 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.710+0000 7f5e6919d700 1 -- start start 2023-10-06T03:23:23.714 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.711+0000 7f5e6919d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e641535a0 0x7f5e6416b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:23.714 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.711+0000 7f5e6919d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5e64157670 0x7f5e640a98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:23.714 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.711+0000 7f5e6919d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e6415a560 0x7f5e6416aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:23.714 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.711+0000 7f5e6919d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e640a7420 con 0x7f5e6415a560 2023-10-06T03:23:23.714 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.711+0000 7f5e6919d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6416af70 con 0x7f5e641535a0 2023-10-06T03:23:23.714 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.711+0000 7f5e6919d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e640a6e10 con 0x7f5e64157670 2023-10-06T03:23:23.714 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.711+0000 7f5e63fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e641535a0 0x7f5e6416b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:23.714 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.711+0000 7f5e637fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5e64157670 0x7f5e640a98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:23.714 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.711+0000 7f5e63fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e641535a0 0x7f5e6416b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38472/0 (socket says 172.21.15.83:38472) 2023-10-06T03:23:23.714 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.711+0000 7f5e63fff700 1 -- 172.21.15.83:0/100316866 learned_addr learned my addr 172.21.15.83:0/100316866 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-10-06T03:23:23.714 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.711+0000 7f5e6899c700 1 --2- 172.21.15.83:0/100316866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e6415a560 0x7f5e6416aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:23.715 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.711+0000 7f5e63fff700 1 -- 172.21.15.83:0/100316866 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5e64157670 msgr2=0x7f5e640a98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:23.715 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.711+0000 7f5e63fff700 1 --2- 172.21.15.83:0/100316866 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5e64157670 0x7f5e640a98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:23.715 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.711+0000 7f5e63fff700 1 -- 172.21.15.83:0/100316866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e6415a560 msgr2=0x7f5e6416aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:23.715 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.711+0000 7f5e63fff700 1 --2- 172.21.15.83:0/100316866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e6415a560 0x7f5e6416aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:23.715 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.711+0000 7f5e63fff700 1 -- 172.21.15.83:0/100316866 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e54009420 con 0x7f5e641535a0 2023-10-06T03:23:23.715 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.711+0000 7f5e6899c700 1 --2- 172.21.15.83:0/100316866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e6415a560 0x7f5e6416aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:23:23.715 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.712+0000 7f5e63fff700 1 --2- 172.21.15.83:0/100316866 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e641535a0 0x7f5e6416b160 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5e64088fa0 tx=0x7f5e54017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:23.715 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.712+0000 7f5e4bfff700 1 -- 172.21.15.83:0/100316866 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5400bb60 con 0x7f5e641535a0 2023-10-06T03:23:23.715 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.712+0000 7f5e4bfff700 1 -- 172.21.15.83:0/100316866 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e54027450 con 0x7f5e641535a0 2023-10-06T03:23:23.715 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.712+0000 7f5e4bfff700 1 -- 172.21.15.83:0/100316866 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e540277f0 con 0x7f5e641535a0 2023-10-06T03:23:23.715 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.712+0000 7f5e6919d700 1 -- 172.21.15.83:0/100316866 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e640aa2c0 con 0x7f5e641535a0 2023-10-06T03:23:23.715 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.712+0000 7f5e6919d700 1 -- 172.21.15.83:0/100316866 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e640a70b0 con 0x7f5e641535a0 2023-10-06T03:23:23.716 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.712+0000 7f5e4bfff700 1 -- 172.21.15.83:0/100316866 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f5e54027b60 con 0x7f5e641535a0 2023-10-06T03:23:23.716 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.712+0000 7f5e4bfff700 1 -- 172.21.15.83:0/100316866 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7f5e5401ac60 con 0x7f5e641535a0 2023-10-06T03:23:23.716 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.713+0000 7f5e6919d700 1 -- 172.21.15.83:0/100316866 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e640a6c70 con 0x7f5e641535a0 2023-10-06T03:23:23.716 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.715+0000 7f5e4bfff700 1 -- 172.21.15.83:0/100316866 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f5e640a6c70 con 0x7f5e641535a0 2023-10-06T03:23:23.801 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.799+0000 7f5e6919d700 1 -- 172.21.15.83:0/100316866 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2e9daf76-5607-4a29-9a58-6e270700d223", "id": 6} v 0) v1 -- 0x7f5e64068ea0 con 0x7f5e641535a0 2023-10-06T03:23:23.809 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.808+0000 7f5e4bfff700 1 -- 172.21.15.83:0/100316866 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2e9daf76-5607-4a29-9a58-6e270700d223", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5e540350b0 con 0x7f5e641535a0 2023-10-06T03:23:23.810 INFO:teuthology.orchestra.run.smithi083.stdout:6 2023-10-06T03:23:23.811 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.809+0000 7f5e6919d700 1 -- 172.21.15.83:0/100316866 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e641535a0 msgr2=0x7f5e6416b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:23.811 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.809+0000 7f5e6919d700 1 --2- 172.21.15.83:0/100316866 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e641535a0 0x7f5e6416b160 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5e64088fa0 tx=0x7f5e54017000 comp rx=0 tx=0).stop 2023-10-06T03:23:23.811 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.809+0000 7f5e6919d700 1 -- 172.21.15.83:0/100316866 shutdown_connections 2023-10-06T03:23:23.811 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.809+0000 7f5e6919d700 1 --2- 172.21.15.83:0/100316866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e6415a560 0x7f5e6416aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:23.811 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.809+0000 7f5e6919d700 1 --2- 172.21.15.83:0/100316866 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e641535a0 0x7f5e6416b160 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:23.811 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.809+0000 7f5e6919d700 1 --2- 172.21.15.83:0/100316866 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5e64157670 0x7f5e640a98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:23.811 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.809+0000 7f5e6919d700 1 -- 172.21.15.83:0/100316866 >> 172.21.15.83:0/100316866 conn(0x7f5e64068230 msgr2=0x7f5e64152e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:23.811 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.809+0000 7f5e6919d700 1 -- 172.21.15.83:0/100316866 shutdown_connections 2023-10-06T03:23:23.811 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:23.809+0000 7f5e6919d700 1 -- 172.21.15.83:0/100316866 wait complete. 2023-10-06T03:23:23.827 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd new 5019e1ff-233a-4a5a-91ca-8afccb7ab6e8 7 2023-10-06T03:23:23.916 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-06T03:23:23.915+0000 7f8366d58180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T03:23:24.009 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-06T03:23:24.008+0000 7f8366d58180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T03:23:24.010 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.008+0000 7f470ad9d700 1 Processor -- start 2023-10-06T03:23:24.010 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.008+0000 7f470ad9d700 1 -- start start 2023-10-06T03:23:24.011 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.010+0000 7f470ad9d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f470415a560 0x7f47040b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:24.011 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.010+0000 7f470ad9d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f470415bef0 con 0x7f47041535a0 2023-10-06T03:23:24.011 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.010+0000 7f470ad9d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f470415b080 con 0x7f470415ac00 2023-10-06T03:23:24.011 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.010+0000 7f470ad9d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4704157d80 con 0x7f470415a560 2023-10-06T03:23:24.011 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.010+0000 7f470a59c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f470415a560 0x7f47040b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:24.011 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.010+0000 7f470959a700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f470415ac00 0x7f4704157670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:43740/0 (socket says 172.21.15.83:43740) 2023-10-06T03:23:24.012 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.010+0000 7f470a59c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f470415a560 0x7f47040b1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38476/0 (socket says 172.21.15.83:38476) 2023-10-06T03:23:24.012 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.010+0000 7f470959a700 1 -- 172.21.15.83:0/1694971316 learned_addr learned my addr 172.21.15.83:0/1694971316 (peer_addr_for_me v1:172.21.15.83:0/0) 2023-10-06T03:23:24.013 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.010+0000 7f4708d99700 1 -- 172.21.15.83:0/1694971316 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3231544739 0 0) 0x7f470415b080 con 0x7f470415ac00 2023-10-06T03:23:24.013 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.010+0000 7f470a59c700 1 -- 172.21.15.83:0/1694971316 >> v1:172.21.15.83:6789/0 conn(0x7f470415ac00 legacy=0x7f4704157670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:24.013 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.010+0000 7f470a59c700 1 -- 172.21.15.83:0/1694971316 >> v1:172.21.15.81:6789/0 conn(0x7f47041535a0 legacy=0x7f4704153970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:24.013 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.010+0000 7f470a59c700 1 -- 172.21.15.83:0/1694971316 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47040d1160 con 0x7f470415a560 2023-10-06T03:23:24.014 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.011+0000 7f470a59c700 1 --2- 172.21.15.83:0/1694971316 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f470415a560 0x7f47040b1cf0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f46fc009e60 tx=0x7f46fc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7302000144968326 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:24.014 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.011+0000 7f4708d99700 1 -- 172.21.15.83:0/1694971316 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46fc00e070 con 0x7f470415a560 2023-10-06T03:23:24.014 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.011+0000 7f4708d99700 1 -- 172.21.15.83:0/1694971316 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46fc00bc30 con 0x7f470415a560 2023-10-06T03:23:24.014 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.011+0000 7f4708d99700 1 -- 172.21.15.83:0/1694971316 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46fc012430 con 0x7f470415a560 2023-10-06T03:23:24.014 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.012+0000 7f470ad9d700 1 -- 172.21.15.83:0/1694971316 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f470415a560 msgr2=0x7f47040b1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:24.014 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.012+0000 7f470ad9d700 1 --2- 172.21.15.83:0/1694971316 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f470415a560 0x7f47040b1cf0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f46fc009e60 tx=0x7f46fc009780 comp rx=0 tx=0).stop 2023-10-06T03:23:24.014 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.012+0000 7f470ad9d700 1 -- 172.21.15.83:0/1694971316 shutdown_connections 2023-10-06T03:23:24.014 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.012+0000 7f470ad9d700 1 --2- 172.21.15.83:0/1694971316 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f470415a560 0x7f47040b1cf0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:24.014 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.012+0000 7f470ad9d700 1 -- 172.21.15.83:0/1694971316 >> 172.21.15.83:0/1694971316 conn(0x7f4704068230 msgr2=0x7f4704068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:24.014 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.012+0000 7f470ad9d700 1 -- 172.21.15.83:0/1694971316 shutdown_connections 2023-10-06T03:23:24.014 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.012+0000 7f470ad9d700 1 -- 172.21.15.83:0/1694971316 wait complete. 2023-10-06T03:23:24.015 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.014+0000 7f470ad9d700 1 Processor -- start 2023-10-06T03:23:24.015 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.014+0000 7f470ad9d700 1 -- start start 2023-10-06T03:23:24.018 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.016+0000 7f470ad9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47041535a0 0x7f4704169de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:24.019 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.016+0000 7f470ad9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f470415a560 0x7f4704150150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:24.019 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.016+0000 7f470ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f470415ac00 0x7f47040b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:24.019 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.016+0000 7f470ad9d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47040b25e0 con 0x7f470415ac00 2023-10-06T03:23:24.019 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.016+0000 7f470ad9d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4704156f90 con 0x7f470415a560 2023-10-06T03:23:24.019 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.016+0000 7f470ad9d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4704150690 con 0x7f47041535a0 2023-10-06T03:23:24.019 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.016+0000 7f4709d9b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47041535a0 0x7f4704169de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:24.019 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.016+0000 7f470959a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f470415a560 0x7f4704150150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:24.019 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.016+0000 7f4709d9b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47041535a0 0x7f4704169de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.83:46214/0 (socket says 172.21.15.83:46214) 2023-10-06T03:23:24.019 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.016+0000 7f470959a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f470415a560 0x7f4704150150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38478/0 (socket says 172.21.15.83:38478) 2023-10-06T03:23:24.019 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.016+0000 7f4709d9b700 1 -- 172.21.15.83:0/1774484720 learned_addr learned my addr 172.21.15.83:0/1774484720 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-10-06T03:23:24.019 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.016+0000 7f470a59c700 1 --2- 172.21.15.83:0/1774484720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f470415ac00 0x7f47040b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:24.019 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.016+0000 7f470959a700 1 -- 172.21.15.83:0/1774484720 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47041535a0 msgr2=0x7f4704169de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:24.020 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.016+0000 7f470959a700 1 --2- 172.21.15.83:0/1774484720 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47041535a0 0x7f4704169de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:24.020 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.016+0000 7f470959a700 1 -- 172.21.15.83:0/1774484720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f470415ac00 msgr2=0x7f47040b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:24.020 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.016+0000 7f470959a700 1 --2- 172.21.15.83:0/1774484720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f470415ac00 0x7f47040b15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:24.020 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.016+0000 7f470959a700 1 -- 172.21.15.83:0/1774484720 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46fc009a20 con 0x7f470415a560 2023-10-06T03:23:24.020 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.017+0000 7f470959a700 1 --2- 172.21.15.83:0/1774484720 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f470415a560 0x7f4704150150 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f46f400c520 tx=0x7f46f4007f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:24.020 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.017+0000 7f46f9ffb700 1 -- 172.21.15.83:0/1774484720 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f400ce90 con 0x7f470415a560 2023-10-06T03:23:24.020 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.017+0000 7f46f9ffb700 1 -- 172.21.15.83:0/1774484720 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f4005b30 con 0x7f470415a560 2023-10-06T03:23:24.020 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.017+0000 7f470ad9d700 1 -- 172.21.15.83:0/1774484720 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47040b1b10 con 0x7f470415a560 2023-10-06T03:23:24.020 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.017+0000 7f46f9ffb700 1 -- 172.21.15.83:0/1774484720 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f40070d0 con 0x7f470415a560 2023-10-06T03:23:24.020 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.017+0000 7f470ad9d700 1 -- 172.21.15.83:0/1774484720 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47040b2020 con 0x7f470415a560 2023-10-06T03:23:24.020 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.017+0000 7f46f9ffb700 1 -- 172.21.15.83:0/1774484720 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f46f401c440 con 0x7f470415a560 2023-10-06T03:23:24.021 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.017+0000 7f46f9ffb700 1 -- 172.21.15.83:0/1774484720 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7f46f4007700 con 0x7f470415a560 2023-10-06T03:23:24.021 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.018+0000 7f470ad9d700 1 -- 172.21.15.83:0/1774484720 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f470404c3c0 con 0x7f470415a560 2023-10-06T03:23:24.021 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.020+0000 7f46f9ffb700 1 -- 172.21.15.83:0/1774484720 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f46f4017070 con 0x7f470415a560 2023-10-06T03:23:24.042 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T03:23:24.041+0000 7f7a5e870180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T03:23:24.104 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-06T03:23:24.103+0000 7f8366d58180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T03:23:24.108 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.107+0000 7f470ad9d700 1 -- 172.21.15.83:0/1774484720 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5019e1ff-233a-4a5a-91ca-8afccb7ab6e8", "id": 7} v 0) v1 -- 0x7f470415a9c0 con 0x7f470415a560 2023-10-06T03:23:24.117 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.115+0000 7f46f9ffb700 1 -- 172.21.15.83:0/1774484720 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5019e1ff-233a-4a5a-91ca-8afccb7ab6e8", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f46f401c6f0 con 0x7f470415a560 2023-10-06T03:23:24.118 INFO:teuthology.orchestra.run.smithi083.stdout:7 2023-10-06T03:23:24.118 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.116+0000 7f470ad9d700 1 -- 172.21.15.83:0/1774484720 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f470415a560 msgr2=0x7f4704150150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:24.119 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.116+0000 7f470ad9d700 1 --2- 172.21.15.83:0/1774484720 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f470415a560 0x7f4704150150 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f46f400c520 tx=0x7f46f4007f50 comp rx=0 tx=0).stop 2023-10-06T03:23:24.119 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.116+0000 7f470ad9d700 1 -- 172.21.15.83:0/1774484720 shutdown_connections 2023-10-06T03:23:24.119 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.116+0000 7f470ad9d700 1 --2- 172.21.15.83:0/1774484720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f470415ac00 0x7f47040b15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:24.119 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.116+0000 7f470ad9d700 1 --2- 172.21.15.83:0/1774484720 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47041535a0 0x7f4704169de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:24.119 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.116+0000 7f470ad9d700 1 --2- 172.21.15.83:0/1774484720 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f470415a560 0x7f4704150150 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:24.119 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.116+0000 7f470ad9d700 1 -- 172.21.15.83:0/1774484720 >> 172.21.15.83:0/1774484720 conn(0x7f4704068230 msgr2=0x7f47040b4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:24.119 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.116+0000 7f470ad9d700 1 -- 172.21.15.83:0/1774484720 shutdown_connections 2023-10-06T03:23:24.120 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T03:23:24.116+0000 7f470ad9d700 1 -- 172.21.15.83:0/1774484720 wait complete. 2023-10-06T03:23:24.135 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-06T03:23:24.135 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-06T03:23:24.140 INFO:tasks.ceph.osd.0:Started 2023-10-06T03:23:24.140 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-06T03:23:24.140 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-06T03:23:24.142 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T03:23:24.142+0000 7f7a5e870180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T03:23:24.144 INFO:tasks.ceph.osd.1:Started 2023-10-06T03:23:24.144 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-06T03:23:24.144 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-06T03:23:24.148 INFO:tasks.ceph.osd.2:Started 2023-10-06T03:23:24.149 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-06T03:23:24.149 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-06T03:23:24.153 INFO:tasks.ceph.osd.3:Started 2023-10-06T03:23:24.154 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-06T03:23:24.154 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-06T03:23:24.158 INFO:tasks.ceph.osd.4:Started 2023-10-06T03:23:24.158 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-06T03:23:24.158 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-06T03:23:24.162 INFO:tasks.ceph.osd.5:Started 2023-10-06T03:23:24.162 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-06T03:23:24.162 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-06T03:23:24.166 INFO:tasks.ceph.osd.6:Started 2023-10-06T03:23:24.166 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-06T03:23:24.166 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-06T03:23:24.171 INFO:tasks.ceph.osd.7:Started 2023-10-06T03:23:24.171 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:23:24.274 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T03:23:24.273+0000 7f7a5e870180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T03:23:24.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.411+0000 7fad44d9d700 1 Processor -- start 2023-10-06T03:23:24.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.411+0000 7fad44d9d700 1 -- start start 2023-10-06T03:23:24.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.412+0000 7fad44d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fad400cc670 0x7fad400ccd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:24.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.412+0000 7fad44d9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad4015a450 0x7fad4015a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:24.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.412+0000 7fad44d9d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad400b4760 con 0x7fad400b1d10 2023-10-06T03:23:24.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.412+0000 7fad44d9d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad400b60f0 con 0x7fad400cc670 2023-10-06T03:23:24.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.412+0000 7fad44d9d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad400cd320 con 0x7fad4015a450 2023-10-06T03:23:24.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.413+0000 7fad3f7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fad400cc670 0x7fad400ccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:24.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.413+0000 7fad3f7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fad400cc670 0x7fad400ccd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44282/0 (socket says 172.21.15.81:44282) 2023-10-06T03:23:24.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.413+0000 7fad3f7fe700 1 -- 172.21.15.81:0/1714608623 learned_addr learned my addr 172.21.15.81:0/1714608623 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:24.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.413+0000 7fad3ffff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fad400b1d10 0x7fad400b2120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:56140/0 (socket says 172.21.15.81:56140) 2023-10-06T03:23:24.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.413+0000 7fad3effd700 1 --2- 172.21.15.81:0/1714608623 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad4015a450 0x7fad4015a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:24.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.413+0000 7fad3f7fe700 1 -- 172.21.15.81:0/1714608623 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad4015a450 msgr2=0x7fad4015a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:24.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.413+0000 7fad3f7fe700 1 --2- 172.21.15.81:0/1714608623 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad4015a450 0x7fad4015a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:24.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.413+0000 7fad3f7fe700 1 -- 172.21.15.81:0/1714608623 >> v1:172.21.15.81:6789/0 conn(0x7fad400b1d10 legacy=0x7fad400b2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:24.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.413+0000 7fad3f7fe700 1 -- 172.21.15.81:0/1714608623 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad400b3e30 con 0x7fad400cc670 2023-10-06T03:23:24.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.413+0000 7fad3e7fc700 1 -- 172.21.15.81:0/1714608623 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1327788214 0 0) 0x7fad400b4760 con 0x7fad400b1d10 2023-10-06T03:23:24.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.414+0000 7fad3f7fe700 1 --2- 172.21.15.81:0/1714608623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad400cc670 0x7fad400ccd40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fad300099b0 tx=0x7fad30009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6e660eb42334f60 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:24.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.414+0000 7fad3e7fc700 1 -- 172.21.15.81:0/1714608623 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad30009ea0 con 0x7fad400cc670 2023-10-06T03:23:24.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.414+0000 7fad3e7fc700 1 -- 172.21.15.81:0/1714608623 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3000b860 con 0x7fad400cc670 2023-10-06T03:23:24.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.414+0000 7fad3e7fc700 1 -- 172.21.15.81:0/1714608623 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3000bc00 con 0x7fad400cc670 2023-10-06T03:23:24.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.414+0000 7fad44d9d700 1 -- 172.21.15.81:0/1714608623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad400cc670 msgr2=0x7fad400ccd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:24.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.414+0000 7fad44d9d700 1 --2- 172.21.15.81:0/1714608623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad400cc670 0x7fad400ccd40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fad300099b0 tx=0x7fad30009250 comp rx=0 tx=0).stop 2023-10-06T03:23:24.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.414+0000 7fad44d9d700 1 -- 172.21.15.81:0/1714608623 shutdown_connections 2023-10-06T03:23:24.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.414+0000 7fad44d9d700 1 --2- 172.21.15.81:0/1714608623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad400cc670 0x7fad400ccd40 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:24.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.414+0000 7fad44d9d700 1 --2- 172.21.15.81:0/1714608623 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad4015a450 0x7fad4015a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:24.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.414+0000 7fad44d9d700 1 -- 172.21.15.81:0/1714608623 >> 172.21.15.81:0/1714608623 conn(0x7fad4006ed10 msgr2=0x7fad4006f110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:24.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.414+0000 7fad44d9d700 1 -- 172.21.15.81:0/1714608623 shutdown_connections 2023-10-06T03:23:24.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.414+0000 7fad44d9d700 1 -- 172.21.15.81:0/1714608623 wait complete. 2023-10-06T03:23:24.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.416+0000 7fad44d9d700 1 Processor -- start 2023-10-06T03:23:24.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.416+0000 7fad44d9d700 1 -- start start 2023-10-06T03:23:24.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.417+0000 7fad44d9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad400b1d10 0x7fad4013dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:24.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.417+0000 7fad44d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad400cc670 0x7fad4015a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:24.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.417+0000 7fad44d9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad4015a450 0x7fad4015ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:24.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.417+0000 7fad44d9d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad4015b340 con 0x7fad400cc670 2023-10-06T03:23:24.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.417+0000 7fad44d9d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad40154f50 con 0x7fad400b1d10 2023-10-06T03:23:24.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.417+0000 7fad44d9d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad40155230 con 0x7fad4015a450 2023-10-06T03:23:24.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.417+0000 7fad3effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad400cc670 0x7fad4015a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:24.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.417+0000 7fad3effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad400cc670 0x7fad4015a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44286/0 (socket says 172.21.15.81:44286) 2023-10-06T03:23:24.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.417+0000 7fad3effd700 1 -- 172.21.15.81:0/3717423057 learned_addr learned my addr 172.21.15.81:0/3717423057 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:24.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.417+0000 7fad3ffff700 1 --2- 172.21.15.81:0/3717423057 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad4015a450 0x7fad4015ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:24.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.417+0000 7fad3f7fe700 1 --2- 172.21.15.81:0/3717423057 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad400b1d10 0x7fad4013dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:24.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.418+0000 7fad3effd700 1 -- 172.21.15.81:0/3717423057 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad4015a450 msgr2=0x7fad4015ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:24.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.418+0000 7fad3effd700 1 --2- 172.21.15.81:0/3717423057 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad4015a450 0x7fad4015ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:24.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.418+0000 7fad3effd700 1 -- 172.21.15.81:0/3717423057 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad400b1d10 msgr2=0x7fad4013dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:24.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.418+0000 7fad3effd700 1 --2- 172.21.15.81:0/3717423057 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad400b1d10 0x7fad4013dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:24.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.418+0000 7fad3effd700 1 -- 172.21.15.81:0/3717423057 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad300094f0 con 0x7fad400cc670 2023-10-06T03:23:24.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.418+0000 7fad3effd700 1 --2- 172.21.15.81:0/3717423057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad400cc670 0x7fad4015a8c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fad3400e930 tx=0x7fad340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:24.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.418+0000 7fad277fe700 1 -- 172.21.15.81:0/3717423057 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad34013680 con 0x7fad400cc670 2023-10-06T03:23:24.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.418+0000 7fad277fe700 1 -- 172.21.15.81:0/3717423057 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad340137e0 con 0x7fad400cc670 2023-10-06T03:23:24.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.418+0000 7fad44d9d700 1 -- 172.21.15.81:0/3717423057 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad40155510 con 0x7fad400cc670 2023-10-06T03:23:24.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.418+0000 7fad277fe700 1 -- 172.21.15.81:0/3717423057 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad34013b80 con 0x7fad400cc670 2023-10-06T03:23:24.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.418+0000 7fad44d9d700 1 -- 172.21.15.81:0/3717423057 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad4013e1f0 con 0x7fad400cc670 2023-10-06T03:23:24.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.419+0000 7fad277fe700 1 -- 172.21.15.81:0/3717423057 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fad3401c6d0 con 0x7fad400cc670 2023-10-06T03:23:24.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.419+0000 7fad277fe700 1 -- 172.21.15.81:0/3717423057 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7fad3400cb60 con 0x7fad400cc670 2023-10-06T03:23:24.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.419+0000 7fad44d9d700 1 -- 172.21.15.81:0/3717423057 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad4004c3c0 con 0x7fad400cc670 2023-10-06T03:23:24.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.424+0000 7fad277fe700 1 -- 172.21.15.81:0/3717423057 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fad3403b6d0 con 0x7fad400cc670 2023-10-06T03:23:24.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.495+0000 7fad44d9d700 1 -- 172.21.15.81:0/3717423057 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad4004bb80 con 0x7fad400cc670 2023-10-06T03:23:24.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.496+0000 7fad277fe700 1 -- 172.21.15.81:0/3717423057 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7fad3402a020 con 0x7fad400cc670 2023-10-06T03:23:24.497 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:23:24.497 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":10,"fsid":"1807b5d7-9be8-43ad-aaf8-99a4273430b3","created":"2023-10-06T03:23:20.805306+0000","modified":"2023-10-06T03:23:24.109024+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T03:23:24.109024+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"14fb667d-a677-4978-a477-80027f889d36","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"974d8a86-1829-4176-89ce-18e6038857f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ffbfe056-46bc-46e0-bf49-4d8f8650e20f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ef9a8314-3d37-4ea1-858a-e704d5695002","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d83506a0-2c96-4bcb-a9fa-05e43dc329df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"10687c63-a3d5-472f-acc0-4f61847b6e0d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2e9daf76-5607-4a29-9a58-6e270700d223","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5019e1ff-233a-4a5a-91ca-8afccb7ab6e8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:23:24.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.497+0000 7fad44d9d700 1 -- 172.21.15.81:0/3717423057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad400cc670 msgr2=0x7fad4015a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:24.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.497+0000 7fad44d9d700 1 --2- 172.21.15.81:0/3717423057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad400cc670 0x7fad4015a8c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fad3400e930 tx=0x7fad340091a0 comp rx=0 tx=0).stop 2023-10-06T03:23:24.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.497+0000 7fad44d9d700 1 -- 172.21.15.81:0/3717423057 shutdown_connections 2023-10-06T03:23:24.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.497+0000 7fad44d9d700 1 --2- 172.21.15.81:0/3717423057 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad4015a450 0x7fad4015ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:24.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.497+0000 7fad44d9d700 1 --2- 172.21.15.81:0/3717423057 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad400b1d10 0x7fad4013dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:24.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.497+0000 7fad44d9d700 1 --2- 172.21.15.81:0/3717423057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad400cc670 0x7fad4015a8c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:24.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.497+0000 7fad44d9d700 1 -- 172.21.15.81:0/3717423057 >> 172.21.15.81:0/3717423057 conn(0x7fad4006ed10 msgr2=0x7fad400b4bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:24.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.497+0000 7fad44d9d700 1 -- 172.21.15.81:0/3717423057 shutdown_connections 2023-10-06T03:23:24.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:24.497+0000 7fad44d9d700 1 -- 172.21.15.81:0/3717423057 wait complete. 2023-10-06T03:23:24.515 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-06T03:23:24.515 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-06T03:23:24.826 INFO:tasks.ceph.osd.1.smithi081.stderr:2023-10-06T03:23:24.825+0000 7f7c26647540 -1 Falling back to public interface 2023-10-06T03:23:24.828 INFO:tasks.ceph.osd.4.smithi083.stderr:2023-10-06T03:23:24.827+0000 7ff6f29f5540 -1 Falling back to public interface 2023-10-06T03:23:24.844 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-10-06T03:23:24.843+0000 7f90fb707540 -1 Falling back to public interface 2023-10-06T03:23:24.844 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-10-06T03:23:24.842+0000 7f1ba296e540 -1 Falling back to public interface 2023-10-06T03:23:24.849 INFO:tasks.ceph.osd.2.smithi081.stderr:2023-10-06T03:23:24.848+0000 7ff870eae540 -1 Falling back to public interface 2023-10-06T03:23:24.854 INFO:tasks.ceph.osd.0.smithi081.stderr:2023-10-06T03:23:24.853+0000 7fbadef9c540 -1 Falling back to public interface 2023-10-06T03:23:24.854 INFO:tasks.ceph.osd.3.smithi081.stderr:2023-10-06T03:23:24.854+0000 7f8c6d1c6540 -1 Falling back to public interface 2023-10-06T03:23:24.868 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-10-06T03:23:24.866+0000 7ff61799e540 -1 Falling back to public interface 2023-10-06T03:23:24.911 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-06T03:23:24.910+0000 7f8366d58180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-06T03:23:25.003 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T03:23:25.002+0000 7f7a5e870180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-06T03:23:25.081 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-06T03:23:25.080+0000 7f8366d58180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T03:23:25.174 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T03:23:25.173+0000 7f7a5e870180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T03:23:25.201 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-06T03:23:25.200+0000 7f8366d58180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T03:23:25.272 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T03:23:25.271+0000 7f7a5e870180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T03:23:25.321 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T03:23:25.485 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.484+0000 7f586359e700 1 Processor -- start 2023-10-06T03:23:25.485 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.484+0000 7f586359e700 1 -- start start 2023-10-06T03:23:25.487 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.485+0000 7f586359e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5864159250 0x7f58640cb280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:25.487 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.485+0000 7f586359e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f58640cf230 0x7f5864163090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:25.487 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.485+0000 7f586359e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58640c5090 con 0x7f58640cb7c0 2023-10-06T03:23:25.487 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.485+0000 7f586359e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58640cbc40 con 0x7f5864159250 2023-10-06T03:23:25.487 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.485+0000 7f586359e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58640cbf20 con 0x7f58640cf230 2023-10-06T03:23:25.487 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.485+0000 7f586259c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5864159250 0x7f58640cb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:25.487 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.485+0000 7f586259c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5864159250 0x7f58640cb280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44296/0 (socket says 172.21.15.81:44296) 2023-10-06T03:23:25.488 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.485+0000 7f586259c700 1 -- 172.21.15.81:0/1451372886 learned_addr learned my addr 172.21.15.81:0/1451372886 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:25.488 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.485+0000 7f5862d9d700 1 --2- 172.21.15.81:0/1451372886 >> v2:172.21.15.83:3300/0 conn(0x7f58640cf230 0x7f5864163090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:25.488 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.486+0000 7f586259c700 1 -- 172.21.15.81:0/1451372886 >> v2:172.21.15.83:3300/0 conn(0x7f58640cf230 msgr2=0x7f5864163090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:25.488 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.486+0000 7f586259c700 1 --2- 172.21.15.81:0/1451372886 >> v2:172.21.15.83:3300/0 conn(0x7f58640cf230 0x7f5864163090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:25.488 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.486+0000 7f586259c700 1 -- 172.21.15.81:0/1451372886 >> v1:172.21.15.83:6789/0 conn(0x7f58640cb7c0 legacy=0x7f58640ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:25.488 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.486+0000 7f586259c700 1 -- 172.21.15.81:0/1451372886 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58640cc200 con 0x7f5864159250 2023-10-06T03:23:25.488 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.486+0000 7f586259c700 1 --2- 172.21.15.81:0/1451372886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5864159250 0x7f58640cb280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f58640d0120 tx=0x7f5854009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f483fe76b9624059 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:25.488 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.486+0000 7f586159a700 1 -- 172.21.15.81:0/1451372886 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5854005c10 con 0x7f5864159250 2023-10-06T03:23:25.488 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.486+0000 7f586159a700 1 -- 172.21.15.81:0/1451372886 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5854005d70 con 0x7f5864159250 2023-10-06T03:23:25.488 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.486+0000 7f586159a700 1 -- 172.21.15.81:0/1451372886 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5854006260 con 0x7f5864159250 2023-10-06T03:23:25.489 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.487+0000 7f586359e700 1 -- 172.21.15.81:0/1451372886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5864159250 msgr2=0x7f58640cb280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:25.489 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.487+0000 7f586359e700 1 --2- 172.21.15.81:0/1451372886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5864159250 0x7f58640cb280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f58640d0120 tx=0x7f5854009220 comp rx=0 tx=0).stop 2023-10-06T03:23:25.489 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.487+0000 7f586359e700 1 -- 172.21.15.81:0/1451372886 shutdown_connections 2023-10-06T03:23:25.490 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.487+0000 7f586359e700 1 --2- 172.21.15.81:0/1451372886 >> v2:172.21.15.83:3300/0 conn(0x7f58640cf230 0x7f5864163090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:25.490 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.487+0000 7f586359e700 1 --2- 172.21.15.81:0/1451372886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5864159250 0x7f58640cb280 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:25.490 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.487+0000 7f586359e700 1 -- 172.21.15.81:0/1451372886 >> 172.21.15.81:0/1451372886 conn(0x7f5864099640 msgr2=0x7f586406f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:25.490 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.487+0000 7f586359e700 1 -- 172.21.15.81:0/1451372886 shutdown_connections 2023-10-06T03:23:25.490 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.487+0000 7f586359e700 1 -- 172.21.15.81:0/1451372886 wait complete. 2023-10-06T03:23:25.490 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.488+0000 7f586359e700 1 Processor -- start 2023-10-06T03:23:25.490 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.489+0000 7f586359e700 1 -- start start 2023-10-06T03:23:25.492 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.489+0000 7f586359e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58640cf230 0x7f5864147c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:25.492 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.489+0000 7f586359e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5864159250 0x7f58641560f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:25.492 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.489+0000 7f586359e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5864150f70 0x7f5864151410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:25.493 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.490+0000 7f586359e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5864151950 con 0x7f58640cf230 2023-10-06T03:23:25.493 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.490+0000 7f586359e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5864150550 con 0x7f5864150f70 2023-10-06T03:23:25.493 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.490+0000 7f586359e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58640c7440 con 0x7f5864159250 2023-10-06T03:23:25.493 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.490+0000 7f586259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58640cf230 0x7f5864147c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:25.493 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.490+0000 7f586259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58640cf230 0x7f5864147c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44298/0 (socket says 172.21.15.81:44298) 2023-10-06T03:23:25.493 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.490+0000 7f586259c700 1 -- 172.21.15.81:0/1850976237 learned_addr learned my addr 172.21.15.81:0/1850976237 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:25.493 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.490+0000 7f5862d9d700 1 --2- 172.21.15.81:0/1850976237 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5864150f70 0x7f5864151410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:25.493 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.490+0000 7f5861d9b700 1 --2- 172.21.15.81:0/1850976237 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5864159250 0x7f58641560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:25.493 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.490+0000 7f586259c700 1 -- 172.21.15.81:0/1850976237 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5864159250 msgr2=0x7f58641560f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:25.493 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.490+0000 7f586259c700 1 --2- 172.21.15.81:0/1850976237 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5864159250 0x7f58641560f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:25.493 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.490+0000 7f586259c700 1 -- 172.21.15.81:0/1850976237 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5864150f70 msgr2=0x7f5864151410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:25.494 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.490+0000 7f586259c700 1 --2- 172.21.15.81:0/1850976237 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5864150f70 0x7f5864151410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:25.494 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.490+0000 7f586259c700 1 -- 172.21.15.81:0/1850976237 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5854009480 con 0x7f58640cf230 2023-10-06T03:23:25.494 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.490+0000 7f586259c700 1 --2- 172.21.15.81:0/1850976237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58640cf230 0x7f5864147c50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5864067ac0 tx=0x7f5854016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:25.494 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.491+0000 7f58527fc700 1 -- 172.21.15.81:0/1850976237 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585400bb00 con 0x7f58640cf230 2023-10-06T03:23:25.494 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.491+0000 7f58527fc700 1 -- 172.21.15.81:0/1850976237 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f585400bc60 con 0x7f58640cf230 2023-10-06T03:23:25.494 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.491+0000 7f586359e700 1 -- 172.21.15.81:0/1850976237 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58640c7720 con 0x7f58640cf230 2023-10-06T03:23:25.494 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.491+0000 7f58527fc700 1 -- 172.21.15.81:0/1850976237 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585401b430 con 0x7f58640cf230 2023-10-06T03:23:25.494 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.491+0000 7f586359e700 1 -- 172.21.15.81:0/1850976237 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58640c7ce0 con 0x7f58640cf230 2023-10-06T03:23:25.494 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.491+0000 7f58527fc700 1 -- 172.21.15.81:0/1850976237 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f585401ba60 con 0x7f58640cf230 2023-10-06T03:23:25.494 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.491+0000 7f58527fc700 1 -- 172.21.15.81:0/1850976237 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f585401bd10 con 0x7f58640cf230 2023-10-06T03:23:25.494 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.492+0000 7f586359e700 1 -- 172.21.15.81:0/1850976237 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58640c7f00 con 0x7f58640cf230 2023-10-06T03:23:25.495 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.494+0000 7f58527fc700 1 -- 172.21.15.81:0/1850976237 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f585402a060 con 0x7f58640cf230 2023-10-06T03:23:25.504 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-06T03:23:25.504+0000 7f8366d58180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-06T03:23:25.565 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.564+0000 7f586359e700 1 -- 172.21.15.81:0/1850976237 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f586404c3c0 con 0x7f58640cf230 2023-10-06T03:23:25.566 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.565+0000 7f58527fc700 1 -- 172.21.15.81:0/1850976237 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f58540115b0 con 0x7f58640cf230 2023-10-06T03:23:25.566 INFO:teuthology.misc.health.smithi081.stdout: 2023-10-06T03:23:25.566 INFO:teuthology.misc.health.smithi081.stdout:{"epoch":10,"fsid":"1807b5d7-9be8-43ad-aaf8-99a4273430b3","created":"2023-10-06T03:23:20.805306+0000","modified":"2023-10-06T03:23:24.109024+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T03:23:24.109024+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"14fb667d-a677-4978-a477-80027f889d36","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"974d8a86-1829-4176-89ce-18e6038857f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ffbfe056-46bc-46e0-bf49-4d8f8650e20f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ef9a8314-3d37-4ea1-858a-e704d5695002","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d83506a0-2c96-4bcb-a9fa-05e43dc329df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"10687c63-a3d5-472f-acc0-4f61847b6e0d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2e9daf76-5607-4a29-9a58-6e270700d223","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5019e1ff-233a-4a5a-91ca-8afccb7ab6e8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:23:25.567 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.566+0000 7f586359e700 1 -- 172.21.15.81:0/1850976237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58640cf230 msgr2=0x7f5864147c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:25.567 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.566+0000 7f586359e700 1 --2- 172.21.15.81:0/1850976237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58640cf230 0x7f5864147c50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5864067ac0 tx=0x7f5854016000 comp rx=0 tx=0).stop 2023-10-06T03:23:25.567 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.566+0000 7f586359e700 1 -- 172.21.15.81:0/1850976237 shutdown_connections 2023-10-06T03:23:25.567 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.566+0000 7f586359e700 1 --2- 172.21.15.81:0/1850976237 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5864150f70 0x7f5864151410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:25.567 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.566+0000 7f586359e700 1 --2- 172.21.15.81:0/1850976237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58640cf230 0x7f5864147c50 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:25.567 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.566+0000 7f586359e700 1 --2- 172.21.15.81:0/1850976237 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5864159250 0x7f58641560f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:25.567 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.566+0000 7f586359e700 1 -- 172.21.15.81:0/1850976237 >> 172.21.15.81:0/1850976237 conn(0x7f5864099640 msgr2=0x7f5864068260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:25.567 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.566+0000 7f586359e700 1 -- 172.21.15.81:0/1850976237 shutdown_connections 2023-10-06T03:23:25.568 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:25.566+0000 7f586359e700 1 -- 172.21.15.81:0/1850976237 wait complete. 2023-10-06T03:23:25.572 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T03:23:25.571+0000 7f7a5e870180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-06T03:23:25.581 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-06T03:23:25.603 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-06T03:23:25.602+0000 7f8366d58180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T03:23:25.670 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T03:23:25.668+0000 7f7a5e870180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T03:23:26.595 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-06T03:23:26.594+0000 7f8366d58180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-06T03:23:26.667 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T03:23:26.666+0000 7f7a5e870180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-06T03:23:26.686 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-06T03:23:26.685+0000 7f8366d58180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T03:23:26.760 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T03:23:26.759+0000 7f7a5e870180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T03:23:26.780 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-06T03:23:26.779+0000 7f8366d58180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T03:23:26.855 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T03:23:26.853+0000 7f7a5e870180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T03:23:26.940 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-06T03:23:26.939+0000 7f8366d58180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T03:23:27.015 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T03:23:27.014+0000 7f7a5e870180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T03:23:27.046 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-06T03:23:27.045+0000 7f8366d58180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T03:23:27.122 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T03:23:27.121+0000 7f7a5e870180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T03:23:27.236 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-06T03:23:27.235+0000 7f8366d58180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T03:23:27.311 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T03:23:27.310+0000 7f7a5e870180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T03:23:27.343 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-06T03:23:27.343+0000 7f8366d58180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T03:23:27.422 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T03:23:27.421+0000 7f7a5e870180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T03:23:27.442 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-06T03:23:27.441+0000 7f8366d58180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T03:23:27.516 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T03:23:27.515+0000 7f7a5e870180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T03:23:27.538 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-06T03:23:27.537+0000 7f8366d58180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T03:23:27.618 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T03:23:27.617+0000 7f7a5e870180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T03:23:28.333 INFO:tasks.ceph.osd.1.smithi081.stderr:2023-10-06T03:23:28.332+0000 7f7c26647540 -1 osd.1 0 log_to_monitors true 2023-10-06T03:23:28.370 INFO:tasks.ceph.osd.4.smithi083.stderr:2023-10-06T03:23:28.369+0000 7ff6f29f5540 -1 osd.4 0 log_to_monitors true 2023-10-06T03:23:28.415 INFO:tasks.ceph.osd.3.smithi081.stderr:2023-10-06T03:23:28.414+0000 7f8c6d1c6540 -1 osd.3 0 log_to_monitors true 2023-10-06T03:23:28.420 INFO:tasks.ceph.osd.2.smithi081.stderr:2023-10-06T03:23:28.419+0000 7ff870eae540 -1 osd.2 0 log_to_monitors true 2023-10-06T03:23:28.422 INFO:tasks.ceph.osd.0.smithi081.stderr:2023-10-06T03:23:28.421+0000 7fbadef9c540 -1 osd.0 0 log_to_monitors true 2023-10-06T03:23:28.451 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-10-06T03:23:28.449+0000 7f1ba296e540 -1 osd.7 0 log_to_monitors true 2023-10-06T03:23:28.451 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-10-06T03:23:28.450+0000 7f90fb707540 -1 osd.6 0 log_to_monitors true 2023-10-06T03:23:28.470 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-10-06T03:23:28.469+0000 7ff61799e540 -1 osd.5 0 log_to_monitors true 2023-10-06T03:23:28.559 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-06T03:23:28.558+0000 7f831edfa700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-06T03:23:28.559 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-06T03:23:28.558+0000 7f831edfa700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-06T03:23:31.734 INFO:tasks.ceph.osd.3.smithi081.stderr:2023-10-06T03:23:31.731+0000 7f8c60bf6700 -1 osd.3 0 waiting for initial osdmap 2023-10-06T03:23:31.743 INFO:tasks.ceph.osd.3.smithi081.stderr:2023-10-06T03:23:31.742+0000 7f8c59be8700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T03:23:31.832 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-10-06T03:23:31.830+0000 7f90f09f9700 -1 osd.6 0 waiting for initial osdmap 2023-10-06T03:23:31.844 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-10-06T03:23:31.843+0000 7f90e81e8700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T03:23:31.860 INFO:tasks.ceph.osd.4.smithi083.stderr:2023-10-06T03:23:31.859+0000 7ff6e7bf9700 -1 osd.4 0 waiting for initial osdmap 2023-10-06T03:23:31.870 INFO:tasks.ceph.osd.4.smithi083.stderr:2023-10-06T03:23:31.868+0000 7ff6df3e8700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T03:23:31.969 INFO:tasks.ceph.osd.2.smithi081.stderr:2023-10-06T03:23:31.968+0000 7ff8649f6700 -1 osd.2 0 waiting for initial osdmap 2023-10-06T03:23:31.975 INFO:tasks.ceph.osd.2.smithi081.stderr:2023-10-06T03:23:31.974+0000 7ff85d9e8700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T03:23:32.033 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-10-06T03:23:32.031+0000 7ff60b3f6700 -1 osd.5 0 waiting for initial osdmap 2023-10-06T03:23:32.039 INFO:tasks.ceph.osd.0.smithi081.stderr:2023-10-06T03:23:32.038+0000 7fbad29f6700 -1 osd.0 0 waiting for initial osdmap 2023-10-06T03:23:32.039 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-10-06T03:23:32.038+0000 7ff6043e8700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T03:23:32.040 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-10-06T03:23:32.039+0000 7f1b963f6700 -1 osd.7 0 waiting for initial osdmap 2023-10-06T03:23:32.042 INFO:tasks.ceph.osd.1.smithi081.stderr:2023-10-06T03:23:32.041+0000 7f7c1a1f6700 -1 osd.1 0 waiting for initial osdmap 2023-10-06T03:23:32.045 INFO:tasks.ceph.osd.0.smithi081.stderr:2023-10-06T03:23:32.044+0000 7fbacb9e8700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T03:23:32.046 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-10-06T03:23:32.045+0000 7f1b8f3e8700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T03:23:32.048 INFO:tasks.ceph.osd.1.smithi081.stderr:2023-10-06T03:23:32.047+0000 7f7c131e8700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T03:23:32.387 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T03:23:32.543 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.542+0000 7f3ee29ff700 1 Processor -- start 2023-10-06T03:23:32.543 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.542+0000 7f3ee29ff700 1 -- start start 2023-10-06T03:23:32.545 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.543+0000 7f3ee29ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3edc13fa40 0x7f3edc0ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:32.545 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.543+0000 7f3ee29ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f3edc15a630 0x7f3edc0c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:32.545 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.543+0000 7f3ee29ff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3edc0cb0f0 con 0x7f3edc0cac00 2023-10-06T03:23:32.545 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.543+0000 7f3ee29ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3edc0c67b0 con 0x7f3edc13fa40 2023-10-06T03:23:32.545 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.543+0000 7f3ee29ff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3edc0cb3d0 con 0x7f3edc15a630 2023-10-06T03:23:32.545 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.544+0000 7f3edbfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3edc13fa40 0x7f3edc0ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:32.546 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.544+0000 7f3edbfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3edc13fa40 0x7f3edc0ca6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44142/0 (socket says 172.21.15.81:44142) 2023-10-06T03:23:32.546 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.544+0000 7f3edbfff700 1 -- 172.21.15.81:0/1148495521 learned_addr learned my addr 172.21.15.81:0/1148495521 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:32.546 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.544+0000 7f3ee0f9c700 1 --2- 172.21.15.81:0/1148495521 >> v2:172.21.15.83:3300/0 conn(0x7f3edc15a630 0x7f3edc0c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:32.546 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.544+0000 7f3edbfff700 1 -- 172.21.15.81:0/1148495521 >> v2:172.21.15.83:3300/0 conn(0x7f3edc15a630 msgr2=0x7f3edc0c6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:32.546 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.544+0000 7f3edbfff700 1 --2- 172.21.15.81:0/1148495521 >> v2:172.21.15.83:3300/0 conn(0x7f3edc15a630 0x7f3edc0c6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:32.546 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.544+0000 7f3edbfff700 1 -- 172.21.15.81:0/1148495521 >> v1:172.21.15.81:6789/0 conn(0x7f3edc0cac00 legacy=0x7f3edc159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:32.546 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.544+0000 7f3edbfff700 1 -- 172.21.15.81:0/1148495521 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3edc0cb6b0 con 0x7f3edc13fa40 2023-10-06T03:23:32.546 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.544+0000 7f3edbfff700 1 --2- 172.21.15.81:0/1148495521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3edc13fa40 0x7f3edc0ca6c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3edc0c68f0 tx=0x7f3ecc00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f5570c1a767fb00 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:32.547 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.545+0000 7f3edb7fe700 1 -- 172.21.15.81:0/1148495521 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc00da70 con 0x7f3edc13fa40 2023-10-06T03:23:32.547 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.545+0000 7f3edb7fe700 1 -- 172.21.15.81:0/1148495521 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ecc00dbd0 con 0x7f3edc13fa40 2023-10-06T03:23:32.548 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.545+0000 7f3edb7fe700 1 -- 172.21.15.81:0/1148495521 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc010470 con 0x7f3edc13fa40 2023-10-06T03:23:32.548 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.545+0000 7f3ee29ff700 1 -- 172.21.15.81:0/1148495521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3edc13fa40 msgr2=0x7f3edc0ca6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:32.548 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.545+0000 7f3ee29ff700 1 --2- 172.21.15.81:0/1148495521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3edc13fa40 0x7f3edc0ca6c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3edc0c68f0 tx=0x7f3ecc00b4f0 comp rx=0 tx=0).stop 2023-10-06T03:23:32.548 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.545+0000 7f3ee29ff700 1 -- 172.21.15.81:0/1148495521 shutdown_connections 2023-10-06T03:23:32.548 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.545+0000 7f3ee29ff700 1 --2- 172.21.15.81:0/1148495521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3edc13fa40 0x7f3edc0ca6c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:32.548 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.545+0000 7f3ee29ff700 1 --2- 172.21.15.81:0/1148495521 >> v2:172.21.15.83:3300/0 conn(0x7f3edc15a630 0x7f3edc0c6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:32.548 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.545+0000 7f3ee29ff700 1 -- 172.21.15.81:0/1148495521 >> 172.21.15.81:0/1148495521 conn(0x7f3edc0cc0e0 msgr2=0x7f3edc0cc4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:32.548 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.545+0000 7f3ee29ff700 1 -- 172.21.15.81:0/1148495521 shutdown_connections 2023-10-06T03:23:32.548 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.545+0000 7f3ee29ff700 1 -- 172.21.15.81:0/1148495521 wait complete. 2023-10-06T03:23:32.548 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.547+0000 7f3ee29ff700 1 Processor -- start 2023-10-06T03:23:32.548 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.547+0000 7f3ee29ff700 1 -- start start 2023-10-06T03:23:32.550 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.548+0000 7f3ee29ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3edc0cac00 0x7f3edc0c7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:32.550 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.548+0000 7f3ee29ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3edc13fa40 0x7f3edc0af960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:32.550 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.548+0000 7f3ee29ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3edc15a630 0x7f3edc0aee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:32.551 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.548+0000 7f3ee29ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3edc1696a0 con 0x7f3edc0cac00 2023-10-06T03:23:32.551 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.548+0000 7f3ee29ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3edc0c75c0 con 0x7f3edc15a630 2023-10-06T03:23:32.551 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.548+0000 7f3ee29ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3edc16d130 con 0x7f3edc13fa40 2023-10-06T03:23:32.551 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.548+0000 7f3edbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3edc0cac00 0x7f3edc0c7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:32.551 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.548+0000 7f3edbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3edc0cac00 0x7f3edc0c7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44146/0 (socket says 172.21.15.81:44146) 2023-10-06T03:23:32.551 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.548+0000 7f3edbfff700 1 -- 172.21.15.81:0/3545765272 learned_addr learned my addr 172.21.15.81:0/3545765272 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:32.551 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.548+0000 7f3ee0f9c700 1 --2- 172.21.15.81:0/3545765272 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3edc15a630 0x7f3edc0aee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:32.551 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.548+0000 7f3edbfff700 1 -- 172.21.15.81:0/3545765272 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3edc13fa40 msgr2=0x7f3edc0af960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:32.551 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.548+0000 7f3edbfff700 1 --2- 172.21.15.81:0/3545765272 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3edc13fa40 0x7f3edc0af960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:32.551 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.548+0000 7f3edbfff700 1 -- 172.21.15.81:0/3545765272 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3edc15a630 msgr2=0x7f3edc0aee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:32.551 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.548+0000 7f3edbfff700 1 --2- 172.21.15.81:0/3545765272 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3edc15a630 0x7f3edc0aee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:32.552 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.548+0000 7f3edbfff700 1 -- 172.21.15.81:0/3545765272 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ecc00b790 con 0x7f3edc0cac00 2023-10-06T03:23:32.552 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.548+0000 7f3ee0f9c700 1 --2- 172.21.15.81:0/3545765272 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3edc15a630 0x7f3edc0aee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:23:32.552 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.549+0000 7f3edbfff700 1 --2- 172.21.15.81:0/3545765272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3edc0cac00 0x7f3edc0c7080 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3edc159e80 tx=0x7f3ecc01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:32.552 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.549+0000 7f3ed8ff9700 1 -- 172.21.15.81:0/3545765272 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc006bc0 con 0x7f3edc0cac00 2023-10-06T03:23:32.552 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.549+0000 7f3ed8ff9700 1 -- 172.21.15.81:0/3545765272 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ecc018630 con 0x7f3edc0cac00 2023-10-06T03:23:32.552 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.549+0000 7f3ed8ff9700 1 -- 172.21.15.81:0/3545765272 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc0189f0 con 0x7f3edc0cac00 2023-10-06T03:23:32.552 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.549+0000 7f3ee29ff700 1 -- 172.21.15.81:0/3545765272 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3edc16d410 con 0x7f3edc0cac00 2023-10-06T03:23:32.552 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.549+0000 7f3ee29ff700 1 -- 172.21.15.81:0/3545765272 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3edc16d9d0 con 0x7f3edc0cac00 2023-10-06T03:23:32.553 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.550+0000 7f3ee29ff700 1 -- 172.21.15.81:0/3545765272 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3edc063230 con 0x7f3edc0cac00 2023-10-06T03:23:32.553 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.551+0000 7f3ed8ff9700 1 -- 172.21.15.81:0/3545765272 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f3ecc022410 con 0x7f3edc0cac00 2023-10-06T03:23:32.553 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.552+0000 7f3ed8ff9700 1 --2- 172.21.15.81:0/3545765272 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f3ebc066ea0 0x7f3ebc069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:32.553 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.552+0000 7f3ed8ff9700 1 -- 172.21.15.81:0/3545765272 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2227+0+0 (secure 0 0 0) 0x7f3ecc014070 con 0x7f3edc0cac00 2023-10-06T03:23:32.553 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.552+0000 7f3ed37fe700 1 --2- 172.21.15.81:0/3545765272 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f3ebc066ea0 0x7f3ebc069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:32.554 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.552+0000 7f3ed37fe700 1 --2- 172.21.15.81:0/3545765272 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f3ebc066ea0 0x7f3ebc069350 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3edc0b1080 tx=0x7f3ec4007e20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:32.558 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.556+0000 7f3ed8ff9700 1 -- 172.21.15.81:0/3545765272 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3ecc0530e0 con 0x7f3edc0cac00 2023-10-06T03:23:32.761 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.760+0000 7f3ee29ff700 1 -- 172.21.15.81:0/3545765272 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3edc0cb990 con 0x7f3edc0cac00 2023-10-06T03:23:32.761 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.761+0000 7f3ed8ff9700 1 -- 172.21.15.81:0/3545765272 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10348 (secure 0 0 0) 0x7f3ecc056700 con 0x7f3edc0cac00 2023-10-06T03:23:32.762 INFO:teuthology.misc.health.smithi081.stdout: 2023-10-06T03:23:32.762 INFO:teuthology.misc.health.smithi081.stdout:{"epoch":13,"fsid":"1807b5d7-9be8-43ad-aaf8-99a4273430b3","created":"2023-10-06T03:23:20.805306+0000","modified":"2023-10-06T03:23:32.735796+0000","last_up_change":"2023-10-06T03:23:32.735796+0000","last_in_change":"2023-10-06T03:23:24.109024+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"14fb667d-a677-4978-a477-80027f889d36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":85563},{"type":"v1","addr":"172.21.15.81:6818","nonce":85563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":85563},{"type":"v1","addr":"172.21.15.81:6822","nonce":85563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":85563},{"type":"v1","addr":"172.21.15.81:6830","nonce":85563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":85563},{"type":"v1","addr":"172.21.15.81:6826","nonce":85563}]},"public_addr":"172.21.15.81:6818/85563","cluster_addr":"172.21.15.81:6822/85563","heartbeat_back_addr":"172.21.15.81:6830/85563","heartbeat_front_addr":"172.21.15.81:6826/85563","state":["exists","up"]},{"osd":1,"uuid":"974d8a86-1829-4176-89ce-18e6038857f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":85561},{"type":"v1","addr":"172.21.15.81:6801","nonce":85561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":85561},{"type":"v1","addr":"172.21.15.81:6803","nonce":85561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":85561},{"type":"v1","addr":"172.21.15.81:6807","nonce":85561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":85561},{"type":"v1","addr":"172.21.15.81:6805","nonce":85561}]},"public_addr":"172.21.15.81:6801/85561","cluster_addr":"172.21.15.81:6803/85561","heartbeat_back_addr":"172.21.15.81:6807/85561","heartbeat_front_addr":"172.21.15.81:6805/85561","state":["exists","up"]},{"osd":2,"uuid":"ffbfe056-46bc-46e0-bf49-4d8f8650e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":85564},{"type":"v1","addr":"172.21.15.81:6809","nonce":85564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":85564},{"type":"v1","addr":"172.21.15.81:6811","nonce":85564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":85564},{"type":"v1","addr":"172.21.15.81:6815","nonce":85564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":85564},{"type":"v1","addr":"172.21.15.81:6813","nonce":85564}]},"public_addr":"172.21.15.81:6809/85564","cluster_addr":"172.21.15.81:6811/85564","heartbeat_back_addr":"172.21.15.81:6815/85564","heartbeat_front_addr":"172.21.15.81:6813/85564","state":["exists","up"]},{"osd":3,"uuid":"ef9a8314-3d37-4ea1-858a-e704d5695002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":85562},{"type":"v1","addr":"172.21.15.81:6819","nonce":85562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":85562},{"type":"v1","addr":"172.21.15.81:6823","nonce":85562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":85562},{"type":"v1","addr":"172.21.15.81:6831","nonce":85562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":85562},{"type":"v1","addr":"172.21.15.81:6827","nonce":85562}]},"public_addr":"172.21.15.81:6819/85562","cluster_addr":"172.21.15.81:6823/85562","heartbeat_back_addr":"172.21.15.81:6831/85562","heartbeat_front_addr":"172.21.15.81:6827/85562","state":["exists","up"]},{"osd":4,"uuid":"d83506a0-2c96-4bcb-a9fa-05e43dc329df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":85785},{"type":"v1","addr":"172.21.15.83:6801","nonce":85785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":85785},{"type":"v1","addr":"172.21.15.83:6803","nonce":85785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":85785},{"type":"v1","addr":"172.21.15.83:6807","nonce":85785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":85785},{"type":"v1","addr":"172.21.15.83:6805","nonce":85785}]},"public_addr":"172.21.15.83:6801/85785","cluster_addr":"172.21.15.83:6803/85785","heartbeat_back_addr":"172.21.15.83:6807/85785","heartbeat_front_addr":"172.21.15.83:6805/85785","state":["exists","up"]},{"osd":5,"uuid":"10687c63-a3d5-472f-acc0-4f61847b6e0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":85818},{"type":"v1","addr":"172.21.15.83:6825","nonce":85818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":85818},{"type":"v1","addr":"172.21.15.83:6827","nonce":85818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":85818},{"type":"v1","addr":"172.21.15.83:6831","nonce":85818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":85818},{"type":"v1","addr":"172.21.15.83:6829","nonce":85818}]},"public_addr":"172.21.15.83:6825/85818","cluster_addr":"172.21.15.83:6827/85818","heartbeat_back_addr":"172.21.15.83:6831/85818","heartbeat_front_addr":"172.21.15.83:6829/85818","state":["exists","up"]},{"osd":6,"uuid":"2e9daf76-5607-4a29-9a58-6e270700d223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":85787},{"type":"v1","addr":"172.21.15.83:6811","nonce":85787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":85787},{"type":"v1","addr":"172.21.15.83:6815","nonce":85787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":85787},{"type":"v1","addr":"172.21.15.83:6823","nonce":85787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6817","nonce":85787},{"type":"v1","addr":"172.21.15.83:6819","nonce":85787}]},"public_addr":"172.21.15.83:6811/85787","cluster_addr":"172.21.15.83:6815/85787","heartbeat_back_addr":"172.21.15.83:6823/85787","heartbeat_front_addr":"172.21.15.83:6819/85787","state":["exists","up"]},{"osd":7,"uuid":"5019e1ff-233a-4a5a-91ca-8afccb7ab6e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":85786},{"type":"v1","addr":"172.21.15.83:6810","nonce":85786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":85786},{"type":"v1","addr":"172.21.15.83:6814","nonce":85786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":85786},{"type":"v1","addr":"172.21.15.83:6822","nonce":85786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":85786},{"type":"v1","addr":"172.21.15.83:6818","nonce":85786}]},"public_addr":"172.21.15.83:6810/85786","cluster_addr":"172.21.15.83:6814/85786","heartbeat_back_addr":"172.21.15.83:6822/85786","heartbeat_front_addr":"172.21.15.83:6818/85786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:23:32.764 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.763+0000 7f3ee29ff700 1 -- 172.21.15.81:0/3545765272 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f3ebc066ea0 msgr2=0x7f3ebc069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:32.764 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.763+0000 7f3ee29ff700 1 --2- 172.21.15.81:0/3545765272 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f3ebc066ea0 0x7f3ebc069350 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3edc0b1080 tx=0x7f3ec4007e20 comp rx=0 tx=0).stop 2023-10-06T03:23:32.765 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.763+0000 7f3ee29ff700 1 -- 172.21.15.81:0/3545765272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3edc0cac00 msgr2=0x7f3edc0c7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:32.765 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.763+0000 7f3ee29ff700 1 --2- 172.21.15.81:0/3545765272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3edc0cac00 0x7f3edc0c7080 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3edc159e80 tx=0x7f3ecc01a000 comp rx=0 tx=0).stop 2023-10-06T03:23:32.765 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.763+0000 7f3ee29ff700 1 -- 172.21.15.81:0/3545765272 shutdown_connections 2023-10-06T03:23:32.765 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.763+0000 7f3ee29ff700 1 --2- 172.21.15.81:0/3545765272 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3edc15a630 0x7f3edc0aee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:32.765 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.763+0000 7f3ee29ff700 1 --2- 172.21.15.81:0/3545765272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3edc0cac00 0x7f3edc0c7080 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:32.765 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.763+0000 7f3ee29ff700 1 --2- 172.21.15.81:0/3545765272 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f3ebc066ea0 0x7f3ebc069350 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:32.765 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.763+0000 7f3ee29ff700 1 --2- 172.21.15.81:0/3545765272 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3edc13fa40 0x7f3edc0af960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:32.765 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.763+0000 7f3ee29ff700 1 -- 172.21.15.81:0/3545765272 >> 172.21.15.81:0/3545765272 conn(0x7f3edc0cc0e0 msgr2=0x7f3edc0c9bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:32.765 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.764+0000 7f3ee29ff700 1 -- 172.21.15.81:0/3545765272 shutdown_connections 2023-10-06T03:23:32.765 INFO:teuthology.misc.health.smithi081.stderr:2023-10-06T03:23:32.764+0000 7f3ee29ff700 1 -- 172.21.15.81:0/3545765272 wait complete. 2023-10-06T03:23:32.779 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-06T03:23:32.779 INFO:tasks.ceph:Creating RBD pool 2023-10-06T03:23:32.780 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd pool create rbd 8 2023-10-06T03:23:32.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.953+0000 7fbcddfff700 1 Processor -- start 2023-10-06T03:23:32.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.953+0000 7fbcddfff700 1 -- start start 2023-10-06T03:23:32.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.955+0000 7fbcddfff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbcd80ca640 0x7fbcd815a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:32.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.955+0000 7fbcddfff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fbcd815ad10 0x7fbcd80c6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:32.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.955+0000 7fbcddfff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcd80cb580 con 0x7fbcd813fd70 2023-10-06T03:23:32.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.955+0000 7fbcddfff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcd80c6800 con 0x7fbcd815ad10 2023-10-06T03:23:32.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.955+0000 7fbcddfff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd80caa90 con 0x7fbcd80ca640 2023-10-06T03:23:32.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.955+0000 7fbcd77fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbcd813fd70 0x7fbcd815a0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:55164/0 (socket says 172.21.15.81:55164) 2023-10-06T03:23:32.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.955+0000 7fbcd77fe700 1 -- 172.21.15.81:0/1467502858 learned_addr learned my addr 172.21.15.81:0/1467502858 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:23:32.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.955+0000 7fbcd6ffd700 1 --2- 172.21.15.81:0/1467502858 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbcd80ca640 0x7fbcd815a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:32.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.955+0000 7fbcd7fff700 1 --2- 172.21.15.81:0/1467502858 >> v2:172.21.15.83:3300/0 conn(0x7fbcd815ad10 0x7fbcd80c6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:32.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.955+0000 7fbcd67fc700 1 -- 172.21.15.81:0/1467502858 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 698664623 0 0) 0x7fbcd80cb580 con 0x7fbcd813fd70 2023-10-06T03:23:32.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.955+0000 7fbcd67fc700 1 -- 172.21.15.81:0/1467502858 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcc0003570 con 0x7fbcd813fd70 2023-10-06T03:23:32.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.955+0000 7fbcd67fc700 1 -- 172.21.15.81:0/1467502858 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2636732515 0 0) 0x7fbcc0003570 con 0x7fbcd813fd70 2023-10-06T03:23:32.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.955+0000 7fbcd67fc700 1 -- 172.21.15.81:0/1467502858 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbcd80ca640 msgr2=0x7fbcd815a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:32.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.955+0000 7fbcd67fc700 1 --2- 172.21.15.81:0/1467502858 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbcd80ca640 0x7fbcd815a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:32.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.955+0000 7fbcd67fc700 1 -- 172.21.15.81:0/1467502858 >> v2:172.21.15.83:3300/0 conn(0x7fbcd815ad10 msgr2=0x7fbcd80c6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:32.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.955+0000 7fbcd67fc700 1 --2- 172.21.15.81:0/1467502858 >> v2:172.21.15.83:3300/0 conn(0x7fbcd815ad10 0x7fbcd80c6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:32.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.956+0000 7fbcd67fc700 1 -- 172.21.15.81:0/1467502858 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd8069880 con 0x7fbcd813fd70 2023-10-06T03:23:32.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.956+0000 7fbcd67fc700 1 -- 172.21.15.81:0/1467502858 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2513016936 0 0) 0x7fbcc80015f0 con 0x7fbcd813fd70 2023-10-06T03:23:32.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.956+0000 7fbcd67fc700 1 -- 172.21.15.81:0/1467502858 >> v1:172.21.15.81:6789/0 conn(0x7fbcd813fd70 legacy=0x7fbcd815a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:32.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.956+0000 7fbcd67fc700 1 --2- 172.21.15.81:0/1467502858 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbcd80ca640 0x7fbcc0003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:32.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.956+0000 7fbcd67fc700 1 --2- 172.21.15.81:0/1467502858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcc0003fe0 0x7fbcc0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:32.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.956+0000 7fbcd67fc700 1 --2- 172.21.15.81:0/1467502858 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcc0004d50 0x7fbcc00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:32.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.956+0000 7fbcd67fc700 1 -- 172.21.15.81:0/1467502858 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd80c6800 con 0x7fbcc0003fe0 2023-10-06T03:23:32.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.956+0000 7fbcd67fc700 1 -- 172.21.15.81:0/1467502858 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd80caa90 con 0x7fbcc0004d50 2023-10-06T03:23:32.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.956+0000 7fbcd67fc700 1 -- 172.21.15.81:0/1467502858 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc000dca0 con 0x7fbcd80ca640 2023-10-06T03:23:32.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.956+0000 7fbcd6ffd700 1 --2- 172.21.15.81:0/1467502858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcc0003fe0 0x7fbcc0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:32.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.956+0000 7fbcd77fe700 1 --2- 172.21.15.81:0/1467502858 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbcd80ca640 0x7fbcc0003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:32.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.956+0000 7fbcd7fff700 1 --2- 172.21.15.81:0/1467502858 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcc0004d50 0x7fbcc00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:32.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.956+0000 7fbcd6ffd700 1 -- 172.21.15.81:0/1467502858 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbcd80ca640 msgr2=0x7fbcc0003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:32.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.956+0000 7fbcd6ffd700 1 --2- 172.21.15.81:0/1467502858 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbcd80ca640 0x7fbcc0003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:32.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.956+0000 7fbcd6ffd700 1 -- 172.21.15.81:0/1467502858 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcc0004d50 msgr2=0x7fbcc00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:32.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.956+0000 7fbcd6ffd700 1 --2- 172.21.15.81:0/1467502858 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcc0004d50 0x7fbcc00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:32.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.956+0000 7fbcd6ffd700 1 -- 172.21.15.81:0/1467502858 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc0003570 con 0x7fbcc0003fe0 2023-10-06T03:23:32.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.956+0000 7fbcd6ffd700 1 --2- 172.21.15.81:0/1467502858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcc0003fe0 0x7fbcc0004810 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbccc009c00 tx=0x7fbccc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f8d8b3c0d2b9d9a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:32.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.957+0000 7fbcd67fc700 1 -- 172.21.15.81:0/1467502858 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbccc00e6b0 con 0x7fbcc0003fe0 2023-10-06T03:23:32.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.957+0000 7fbcd67fc700 1 -- 172.21.15.81:0/1467502858 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbccc00e810 con 0x7fbcc0003fe0 2023-10-06T03:23:32.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.957+0000 7fbcd67fc700 1 -- 172.21.15.81:0/1467502858 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbccc00ebd0 con 0x7fbcc0003fe0 2023-10-06T03:23:32.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.957+0000 7fbcddfff700 1 -- 172.21.15.81:0/1467502858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcc0003fe0 msgr2=0x7fbcc0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:32.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.957+0000 7fbcddfff700 1 --2- 172.21.15.81:0/1467502858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcc0003fe0 0x7fbcc0004810 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbccc009c00 tx=0x7fbccc0091a0 comp rx=0 tx=0).stop 2023-10-06T03:23:32.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.957+0000 7fbcd7fff700 1 -- 172.21.15.81:0/1467502858 reap_dead start 2023-10-06T03:23:32.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.957+0000 7fbcddfff700 1 -- 172.21.15.81:0/1467502858 shutdown_connections 2023-10-06T03:23:32.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.957+0000 7fbcddfff700 1 -- 172.21.15.81:0/1467502858 >> 172.21.15.81:0/1467502858 conn(0x7fbcd80cc090 msgr2=0x7fbcd80cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:32.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.957+0000 7fbcddfff700 1 -- 172.21.15.81:0/1467502858 shutdown_connections 2023-10-06T03:23:32.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.957+0000 7fbcddfff700 1 -- 172.21.15.81:0/1467502858 wait complete. 2023-10-06T03:23:32.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.959+0000 7fbcddfff700 1 Processor -- start 2023-10-06T03:23:32.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.959+0000 7fbcddfff700 1 -- start start 2023-10-06T03:23:32.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.960+0000 7fbcddfff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbcc0003fe0 0x7fbcd813a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:32.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.960+0000 7fbcddfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcd80b0fc0 0x7fbcd80c4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:32.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.960+0000 7fbcddfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcd80c54e0 0x7fbcd815d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:32.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.960+0000 7fbcddfff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd80c5940 con 0x7fbcd80b0fc0 2023-10-06T03:23:32.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.960+0000 7fbcddfff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd80b1cf0 con 0x7fbcd80c54e0 2023-10-06T03:23:32.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.960+0000 7fbcddfff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd815d440 con 0x7fbcc0003fe0 2023-10-06T03:23:32.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.960+0000 7fbcd77fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbcc0003fe0 0x7fbcd813a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:32.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.960+0000 7fbcd6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcd80b0fc0 0x7fbcd80c4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:32.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.960+0000 7fbcd77fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbcc0003fe0 0x7fbcd813a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:51976/0 (socket says 172.21.15.81:51976) 2023-10-06T03:23:32.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.960+0000 7fbcd77fe700 1 -- 172.21.15.81:0/708694195 learned_addr learned my addr 172.21.15.81:0/708694195 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:32.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.960+0000 7fbcd7fff700 1 --2- 172.21.15.81:0/708694195 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcd80c54e0 0x7fbcd815d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:32.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.960+0000 7fbcd6ffd700 1 -- 172.21.15.81:0/708694195 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbcc0003fe0 msgr2=0x7fbcd813a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:32.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.960+0000 7fbcd6ffd700 1 --2- 172.21.15.81:0/708694195 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbcc0003fe0 0x7fbcd813a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:32.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.960+0000 7fbcd6ffd700 1 -- 172.21.15.81:0/708694195 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcd80c54e0 msgr2=0x7fbcd815d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:32.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.960+0000 7fbcd6ffd700 1 --2- 172.21.15.81:0/708694195 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcd80c54e0 0x7fbcd815d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:32.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.960+0000 7fbcd6ffd700 1 -- 172.21.15.81:0/708694195 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd80c5da0 con 0x7fbcd80b0fc0 2023-10-06T03:23:32.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.961+0000 7fbcd6ffd700 1 --2- 172.21.15.81:0/708694195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcd80b0fc0 0x7fbcd80c4fa0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbccc019000 tx=0x7fbccc01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:32.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.961+0000 7fbcbf7fe700 1 -- 172.21.15.81:0/708694195 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbccc022070 con 0x7fbcd80b0fc0 2023-10-06T03:23:32.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.961+0000 7fbcbf7fe700 1 -- 172.21.15.81:0/708694195 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbccc00e980 con 0x7fbcd80b0fc0 2023-10-06T03:23:32.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.961+0000 7fbcbf7fe700 1 -- 172.21.15.81:0/708694195 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbccc00e6b0 con 0x7fbcd80b0fc0 2023-10-06T03:23:32.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.961+0000 7fbcddfff700 1 -- 172.21.15.81:0/708694195 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcd80b1450 con 0x7fbcd80b0fc0 2023-10-06T03:23:32.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.961+0000 7fbcddfff700 1 -- 172.21.15.81:0/708694195 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcd80b1a10 con 0x7fbcd80b0fc0 2023-10-06T03:23:32.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.962+0000 7fbcddfff700 1 -- 172.21.15.81:0/708694195 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcd80c58e0 con 0x7fbcd80b0fc0 2023-10-06T03:23:32.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.963+0000 7fbcbf7fe700 1 -- 172.21.15.81:0/708694195 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7fbccc027680 con 0x7fbcd80b0fc0 2023-10-06T03:23:32.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.964+0000 7fbcbf7fe700 1 --2- 172.21.15.81:0/708694195 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fbcc4066ea0 0x7fbcc4069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:32.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.964+0000 7fbcbf7fe700 1 -- 172.21.15.81:0/708694195 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4467+0+0 (secure 0 0 0) 0x7fbccc085590 con 0x7fbcd80b0fc0 2023-10-06T03:23:32.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.964+0000 7fbcd77fe700 1 --2- 172.21.15.81:0/708694195 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fbcc4066ea0 0x7fbcc4069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:32.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.964+0000 7fbcd77fe700 1 --2- 172.21.15.81:0/708694195 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fbcc4066ea0 0x7fbcc4069350 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8001260 tx=0x7fbcc8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:32.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:32.968+0000 7fbcbf7fe700 1 -- 172.21.15.81:0/708694195 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbcd80c58e0 con 0x7fbcd80b0fc0 2023-10-06T03:23:33.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:33.161+0000 7fbcddfff700 1 -- 172.21.15.81:0/708694195 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fbcd80c58e0 con 0x7fbcd80b0fc0 2023-10-06T03:23:33.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:33.855+0000 7fbcbf7fe700 1 -- 172.21.15.81:0/708694195 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v14) v1 ==== 109+0+0 (secure 0 0 0) 0x7fbccc0170a0 con 0x7fbcd80b0fc0 2023-10-06T03:23:33.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:33.858+0000 7fbcddfff700 1 -- 172.21.15.81:0/708694195 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fbcc4066ea0 msgr2=0x7fbcc4069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:33.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:33.858+0000 7fbcddfff700 1 --2- 172.21.15.81:0/708694195 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fbcc4066ea0 0x7fbcc4069350 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8001260 tx=0x7fbcc8009040 comp rx=0 tx=0).stop 2023-10-06T03:23:33.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:33.858+0000 7fbcddfff700 1 -- 172.21.15.81:0/708694195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcd80b0fc0 msgr2=0x7fbcd80c4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:33.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:33.858+0000 7fbcddfff700 1 --2- 172.21.15.81:0/708694195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcd80b0fc0 0x7fbcd80c4fa0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbccc019000 tx=0x7fbccc01a000 comp rx=0 tx=0).stop 2023-10-06T03:23:33.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:33.858+0000 7fbcddfff700 1 -- 172.21.15.81:0/708694195 shutdown_connections 2023-10-06T03:23:33.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:33.858+0000 7fbcddfff700 1 --2- 172.21.15.81:0/708694195 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcd80c54e0 0x7fbcd815d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:33.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:33.858+0000 7fbcddfff700 1 --2- 172.21.15.81:0/708694195 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fbcc4066ea0 0x7fbcc4069350 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:33.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:33.858+0000 7fbcddfff700 1 --2- 172.21.15.81:0/708694195 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbcc0003fe0 0x7fbcd813a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:33.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:33.858+0000 7fbcddfff700 1 --2- 172.21.15.81:0/708694195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcd80b0fc0 0x7fbcd80c4fa0 secure :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbccc019000 tx=0x7fbccc01a000 comp rx=0 tx=0).stop 2023-10-06T03:23:33.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:33.858+0000 7fbcddfff700 1 -- 172.21.15.81:0/708694195 >> 172.21.15.81:0/708694195 conn(0x7fbcd80cc090 msgr2=0x7fbcd80c11d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:33.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:33.859+0000 7fbcddfff700 1 -- 172.21.15.81:0/708694195 shutdown_connections 2023-10-06T03:23:33.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:33.859+0000 7fbcddfff700 1 -- 172.21.15.81:0/708694195 wait complete. 2023-10-06T03:23:33.862 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'rbd' created 2023-10-06T03:23:33.877 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-10-06T03:23:34.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.051+0000 7f11a219d700 1 Processor -- start 2023-10-06T03:23:34.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.052+0000 7f11a219d700 1 -- start start 2023-10-06T03:23:34.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.053+0000 7f11a219d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f119c0b1f20 0x7f119c1599b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:34.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.053+0000 7f11a219d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f119c1571a0 0x7f119c15d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:34.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.053+0000 7f11a219d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f119c15a930 con 0x7f119c0b22f0 2023-10-06T03:23:34.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.053+0000 7f11a219d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f119c15a090 con 0x7f119c1571a0 2023-10-06T03:23:34.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.053+0000 7f11a219d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f119c15a370 con 0x7f119c0b1f20 2023-10-06T03:23:34.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.053+0000 7f11a199c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f119c1571a0 0x7f119c15d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:34.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.053+0000 7f11a119b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f119c0b1f20 0x7f119c1599b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:34.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.053+0000 7f11a199c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f119c1571a0 0x7f119c15d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:44228/0 (socket says 172.21.15.81:44228) 2023-10-06T03:23:34.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.053+0000 7f11a119b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f119c0b1f20 0x7f119c1599b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:51978/0 (socket says 172.21.15.81:51978) 2023-10-06T03:23:34.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.053+0000 7f11a199c700 1 -- 172.21.15.81:0/3933820955 learned_addr learned my addr 172.21.15.81:0/3933820955 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:34.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.054+0000 7f11a199c700 1 -- 172.21.15.81:0/3933820955 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f119c0b1f20 msgr2=0x7f119c1599b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:34.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.054+0000 7f11a199c700 1 --2- 172.21.15.81:0/3933820955 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f119c0b1f20 0x7f119c1599b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:34.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.054+0000 7f11a199c700 1 -- 172.21.15.81:0/3933820955 >> v1:172.21.15.83:6789/0 conn(0x7f119c0b22f0 legacy=0x7f119c156a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:34.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.054+0000 7f11a199c700 1 -- 172.21.15.81:0/3933820955 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f119c15a650 con 0x7f119c1571a0 2023-10-06T03:23:34.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.054+0000 7f11a119b700 1 --2- 172.21.15.81:0/3933820955 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f119c0b1f20 0x7f119c1599b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:23:34.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.054+0000 7f11a199c700 1 --2- 172.21.15.81:0/3933820955 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f119c1571a0 0x7f119c15d990 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1194009f20 tx=0x7f1194009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b81065f498ec602b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:34.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.054+0000 7f1193fff700 1 -- 172.21.15.81:0/3933820955 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119400e070 con 0x7f119c1571a0 2023-10-06T03:23:34.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.054+0000 7f1193fff700 1 -- 172.21.15.81:0/3933820955 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f119400b9d0 con 0x7f119c1571a0 2023-10-06T03:23:34.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.054+0000 7f1193fff700 1 -- 172.21.15.81:0/3933820955 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11940092e0 con 0x7f119c1571a0 2023-10-06T03:23:34.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.055+0000 7f11a219d700 1 -- 172.21.15.81:0/3933820955 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f119c1571a0 msgr2=0x7f119c15d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:34.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.055+0000 7f11a219d700 1 --2- 172.21.15.81:0/3933820955 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f119c1571a0 0x7f119c15d990 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1194009f20 tx=0x7f1194009840 comp rx=0 tx=0).stop 2023-10-06T03:23:34.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.055+0000 7f11a219d700 1 -- 172.21.15.81:0/3933820955 shutdown_connections 2023-10-06T03:23:34.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.055+0000 7f11a219d700 1 --2- 172.21.15.81:0/3933820955 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f119c1571a0 0x7f119c15d990 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:34.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.055+0000 7f11a219d700 1 --2- 172.21.15.81:0/3933820955 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f119c0b1f20 0x7f119c1599b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:34.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.055+0000 7f11a219d700 1 -- 172.21.15.81:0/3933820955 >> 172.21.15.81:0/3933820955 conn(0x7f119c0698d0 msgr2=0x7f119c069ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:34.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.055+0000 7f11a219d700 1 -- 172.21.15.81:0/3933820955 shutdown_connections 2023-10-06T03:23:34.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.055+0000 7f11a219d700 1 -- 172.21.15.81:0/3933820955 wait complete. 2023-10-06T03:23:34.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.056+0000 7f11a219d700 1 Processor -- start 2023-10-06T03:23:34.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.056+0000 7f11a219d700 1 -- start start 2023-10-06T03:23:34.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.057+0000 7f11a219d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f119c0b1f20 0x7f119c155140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:34.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.057+0000 7f11a219d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f119c0b22f0 0x7f119c157f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:34.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.057+0000 7f11a219d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f119c1571a0 0x7f119c14c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:34.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.057+0000 7f11a219d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119c1563f0 con 0x7f119c0b1f20 2023-10-06T03:23:34.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.057+0000 7f11a219d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119c1557e0 con 0x7f119c1571a0 2023-10-06T03:23:34.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.057+0000 7f11a219d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f119c155ac0 con 0x7f119c0b22f0 2023-10-06T03:23:34.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.058+0000 7f11a119b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f119c0b1f20 0x7f119c155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:34.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.058+0000 7f11a119b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f119c0b1f20 0x7f119c155140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44162/0 (socket says 172.21.15.81:44162) 2023-10-06T03:23:34.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.058+0000 7f11a119b700 1 -- 172.21.15.81:0/2347380966 learned_addr learned my addr 172.21.15.81:0/2347380966 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:34.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.058+0000 7f11a199c700 1 --2- 172.21.15.81:0/2347380966 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f119c1571a0 0x7f119c14c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:34.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.058+0000 7f11a099a700 1 --2- 172.21.15.81:0/2347380966 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f119c0b22f0 0x7f119c157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:34.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.058+0000 7f11a119b700 1 -- 172.21.15.81:0/2347380966 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f119c0b22f0 msgr2=0x7f119c157f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:34.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.058+0000 7f11a119b700 1 --2- 172.21.15.81:0/2347380966 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f119c0b22f0 0x7f119c157f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:34.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.058+0000 7f11a119b700 1 -- 172.21.15.81:0/2347380966 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f119c1571a0 msgr2=0x7f119c14c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:34.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.058+0000 7f11a119b700 1 --2- 172.21.15.81:0/2347380966 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f119c1571a0 0x7f119c14c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:34.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.058+0000 7f11a119b700 1 -- 172.21.15.81:0/2347380966 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1198009420 con 0x7f119c0b1f20 2023-10-06T03:23:34.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.058+0000 7f11a199c700 1 --2- 172.21.15.81:0/2347380966 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f119c1571a0 0x7f119c14c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:23:34.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.058+0000 7f11a119b700 1 --2- 172.21.15.81:0/2347380966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f119c0b1f20 0x7f119c155140 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f119800ec80 tx=0x7f11980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:34.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.059+0000 7f11917fa700 1 -- 172.21.15.81:0/2347380966 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119800c9d0 con 0x7f119c0b1f20 2023-10-06T03:23:34.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.059+0000 7f11917fa700 1 -- 172.21.15.81:0/2347380966 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f119800cb30 con 0x7f119c0b1f20 2023-10-06T03:23:34.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.059+0000 7f11a219d700 1 -- 172.21.15.81:0/2347380966 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1194009ae0 con 0x7f119c0b1f20 2023-10-06T03:23:34.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.059+0000 7f11917fa700 1 -- 172.21.15.81:0/2347380966 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119800ceb0 con 0x7f119c0b1f20 2023-10-06T03:23:34.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.059+0000 7f11a219d700 1 -- 172.21.15.81:0/2347380966 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f119c156080 con 0x7f119c0b1f20 2023-10-06T03:23:34.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.060+0000 7f11a219d700 1 -- 172.21.15.81:0/2347380966 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f119c04c3c0 con 0x7f119c0b1f20 2023-10-06T03:23:34.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.061+0000 7f11917fa700 1 -- 172.21.15.81:0/2347380966 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f1198013680 con 0x7f119c0b1f20 2023-10-06T03:23:34.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.062+0000 7f11917fa700 1 --2- 172.21.15.81:0/2347380966 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f1180066ea0 0x7f1180069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:34.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.062+0000 7f11917fa700 1 -- 172.21.15.81:0/2347380966 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 5184+0+0 (secure 0 0 0) 0x7f1198084700 con 0x7f119c0b1f20 2023-10-06T03:23:34.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.062+0000 7f11a099a700 1 --2- 172.21.15.81:0/2347380966 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f1180066ea0 0x7f1180069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:34.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.062+0000 7f11a099a700 1 --2- 172.21.15.81:0/2347380966 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f1180066ea0 0x7f1180069350 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f119c152b40 tx=0x7f118c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:34.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.066+0000 7f11917fa700 1 -- 172.21.15.81:0/2347380966 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1198051c60 con 0x7f119c0b1f20 2023-10-06T03:23:34.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.258+0000 7f11a219d700 1 -- 172.21.15.81:0/2347380966 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f119c0b34d0 con 0x7f119c0b1f20 2023-10-06T03:23:34.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.858+0000 7f11917fa700 1 -- 172.21.15.81:0/2347380966 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v15) v1 ==== 173+0+0 (secure 0 0 0) 0x7f1198055280 con 0x7f119c0b1f20 2023-10-06T03:23:34.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.861+0000 7f11a219d700 1 -- 172.21.15.81:0/2347380966 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f1180066ea0 msgr2=0x7f1180069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:34.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.861+0000 7f11a219d700 1 --2- 172.21.15.81:0/2347380966 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f1180066ea0 0x7f1180069350 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f119c152b40 tx=0x7f118c009040 comp rx=0 tx=0).stop 2023-10-06T03:23:34.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.861+0000 7f11a219d700 1 -- 172.21.15.81:0/2347380966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f119c0b1f20 msgr2=0x7f119c155140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:34.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.861+0000 7f11a219d700 1 --2- 172.21.15.81:0/2347380966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f119c0b1f20 0x7f119c155140 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f119800ec80 tx=0x7f11980091a0 comp rx=0 tx=0).stop 2023-10-06T03:23:34.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.862+0000 7f11a219d700 1 -- 172.21.15.81:0/2347380966 shutdown_connections 2023-10-06T03:23:34.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.862+0000 7f11a219d700 1 --2- 172.21.15.81:0/2347380966 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f119c1571a0 0x7f119c14c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:34.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.862+0000 7f11a219d700 1 --2- 172.21.15.81:0/2347380966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f119c0b1f20 0x7f119c155140 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:34.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.862+0000 7f11a219d700 1 --2- 172.21.15.81:0/2347380966 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f1180066ea0 0x7f1180069350 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:34.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.862+0000 7f11a219d700 1 --2- 172.21.15.81:0/2347380966 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f119c0b22f0 0x7f119c157f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:34.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.862+0000 7f11a219d700 1 -- 172.21.15.81:0/2347380966 >> 172.21.15.81:0/2347380966 conn(0x7f119c0698d0 msgr2=0x7f119c0b4db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:34.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.862+0000 7f11a219d700 1 -- 172.21.15.81:0/2347380966 shutdown_connections 2023-10-06T03:23:34.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:34.862+0000 7f11a219d700 1 -- 172.21.15.81:0/2347380966 wait complete. 2023-10-06T03:23:34.865 INFO:teuthology.orchestra.run.smithi081.stderr:enabled application 'rbd' on pool 'rbd' 2023-10-06T03:23:34.885 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-06T03:23:34.886 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T03:23:34.886 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T03:23:34.890 INFO:tasks.ceph.mds.a:Started 2023-10-06T03:23:34.890 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T03:23:34.891 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T03:23:34.895 INFO:tasks.ceph.mds.c:Started 2023-10-06T03:23:34.895 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T03:23:34.895 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T03:23:34.899 INFO:tasks.ceph.mds.b:Started 2023-10-06T03:23:34.900 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T03:23:34.900 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T03:23:34.907 INFO:tasks.ceph.mds.d:Started 2023-10-06T03:23:34.907 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-06T03:23:34.907 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:23:35.040 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2023-10-06T03:23:35.044 INFO:tasks.ceph.mds.b.smithi083.stdout:starting mds.b at 2023-10-06T03:23:35.045 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2023-10-06T03:23:35.054 INFO:tasks.ceph.mds.d.smithi083.stdout:starting mds.d at 2023-10-06T03:23:35.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.115+0000 7f529b59d700 1 Processor -- start 2023-10-06T03:23:35.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.115+0000 7f529b59d700 1 -- start start 2023-10-06T03:23:35.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.116+0000 7f529b59d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f529415a4b0 0x7f52940b1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:35.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.116+0000 7f529b59d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f529415b380 0x7f52940b2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:35.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.116+0000 7f529b59d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5294150970 con 0x7f529415ca90 2023-10-06T03:23:35.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.116+0000 7f529b59d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f529415b800 con 0x7f529415a4b0 2023-10-06T03:23:35.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.116+0000 7f529b59d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f529415c600 con 0x7f529415b380 2023-10-06T03:23:35.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.117+0000 7f529a59b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f529415a4b0 0x7f52940b1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:35.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.117+0000 7f529a59b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f529415a4b0 0x7f52940b1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44244/0 (socket says 172.21.15.81:44244) 2023-10-06T03:23:35.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.117+0000 7f529a59b700 1 -- 172.21.15.81:0/3598995867 learned_addr learned my addr 172.21.15.81:0/3598995867 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:35.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.117+0000 7f529ad9c700 1 --2- 172.21.15.81:0/3598995867 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f529415b380 0x7f52940b2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:35.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.117+0000 7f529a59b700 1 -- 172.21.15.81:0/3598995867 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f529415b380 msgr2=0x7f52940b2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:35.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.117+0000 7f529a59b700 1 --2- 172.21.15.81:0/3598995867 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f529415b380 0x7f52940b2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:35.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.117+0000 7f529a59b700 1 -- 172.21.15.81:0/3598995867 >> v1:172.21.15.81:6789/0 conn(0x7f529415ca90 legacy=0x7f529415ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:35.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.117+0000 7f529a59b700 1 -- 172.21.15.81:0/3598995867 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f529415b9f0 con 0x7f529415a4b0 2023-10-06T03:23:35.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.117+0000 7f5299599700 1 -- 172.21.15.81:0/3598995867 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 529177364 0 0) 0x7f5294150970 con 0x7f529415ca90 2023-10-06T03:23:35.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.117+0000 7f529a59b700 1 --2- 172.21.15.81:0/3598995867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f529415a4b0 0x7f52940b1d20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f52900099b0 tx=0x7f5290009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f60c662477de0292 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:35.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.118+0000 7f5299599700 1 -- 172.21.15.81:0/3598995867 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5290009ea0 con 0x7f529415a4b0 2023-10-06T03:23:35.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.118+0000 7f5299599700 1 -- 172.21.15.81:0/3598995867 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f529000b860 con 0x7f529415a4b0 2023-10-06T03:23:35.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.118+0000 7f5299599700 1 -- 172.21.15.81:0/3598995867 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529000bc00 con 0x7f529415a4b0 2023-10-06T03:23:35.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.118+0000 7f529b59d700 1 -- 172.21.15.81:0/3598995867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f529415a4b0 msgr2=0x7f52940b1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:35.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.118+0000 7f529b59d700 1 --2- 172.21.15.81:0/3598995867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f529415a4b0 0x7f52940b1d20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f52900099b0 tx=0x7f5290009250 comp rx=0 tx=0).stop 2023-10-06T03:23:35.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.118+0000 7f529b59d700 1 -- 172.21.15.81:0/3598995867 shutdown_connections 2023-10-06T03:23:35.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.118+0000 7f529b59d700 1 --2- 172.21.15.81:0/3598995867 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f529415b380 0x7f52940b2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:35.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.118+0000 7f529b59d700 1 --2- 172.21.15.81:0/3598995867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f529415a4b0 0x7f52940b1d20 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:35.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.118+0000 7f529b59d700 1 -- 172.21.15.81:0/3598995867 >> 172.21.15.81:0/3598995867 conn(0x7f529406ed10 msgr2=0x7f529406f110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:35.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.118+0000 7f529b59d700 1 -- 172.21.15.81:0/3598995867 shutdown_connections 2023-10-06T03:23:35.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.118+0000 7f529b59d700 1 -- 172.21.15.81:0/3598995867 wait complete. 2023-10-06T03:23:35.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.120+0000 7f529b59d700 1 Processor -- start 2023-10-06T03:23:35.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.120+0000 7f529b59d700 1 -- start start 2023-10-06T03:23:35.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.121+0000 7f529b59d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f529415a4b0 0x7f529413c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:35.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.121+0000 7f529b59d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f529415b380 0x7f5294154030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:35.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.121+0000 7f529b59d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f529415ca90 0x7f5294154570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:35.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.121+0000 7f529b59d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529416de60 con 0x7f529415ca90 2023-10-06T03:23:35.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.121+0000 7f529b59d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529416d250 con 0x7f529415b380 2023-10-06T03:23:35.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.121+0000 7f529b59d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f529416d530 con 0x7f529415a4b0 2023-10-06T03:23:35.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.121+0000 7f529ad9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f529415ca90 0x7f5294154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:35.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.121+0000 7f529ad9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f529415ca90 0x7f5294154570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44258/0 (socket says 172.21.15.81:44258) 2023-10-06T03:23:35.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.121+0000 7f529ad9c700 1 -- 172.21.15.81:0/2998557172 learned_addr learned my addr 172.21.15.81:0/2998557172 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:35.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.121+0000 7f5299d9a700 1 --2- 172.21.15.81:0/2998557172 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f529415b380 0x7f5294154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:35.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.121+0000 7f529a59b700 1 --2- 172.21.15.81:0/2998557172 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f529415a4b0 0x7f529413c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:35.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.121+0000 7f529ad9c700 1 -- 172.21.15.81:0/2998557172 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f529415a4b0 msgr2=0x7f529413c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:35.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.121+0000 7f529ad9c700 1 --2- 172.21.15.81:0/2998557172 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f529415a4b0 0x7f529413c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:35.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.121+0000 7f529ad9c700 1 -- 172.21.15.81:0/2998557172 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f529415b380 msgr2=0x7f5294154030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:35.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.121+0000 7f529ad9c700 1 --2- 172.21.15.81:0/2998557172 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f529415b380 0x7f5294154030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:35.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.121+0000 7f529ad9c700 1 -- 172.21.15.81:0/2998557172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52900094f0 con 0x7f529415ca90 2023-10-06T03:23:35.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.122+0000 7f529ad9c700 1 --2- 172.21.15.81:0/2998557172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f529415ca90 0x7f5294154570 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f528c009e90 tx=0x7f528c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:35.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.122+0000 7f528a7fc700 1 -- 172.21.15.81:0/2998557172 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528c00cb70 con 0x7f529415ca90 2023-10-06T03:23:35.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.122+0000 7f528a7fc700 1 -- 172.21.15.81:0/2998557172 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f528c00f040 con 0x7f529415ca90 2023-10-06T03:23:35.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.122+0000 7f528a7fc700 1 -- 172.21.15.81:0/2998557172 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528c014480 con 0x7f529415ca90 2023-10-06T03:23:35.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.122+0000 7f529b59d700 1 -- 172.21.15.81:0/2998557172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f529416d810 con 0x7f529415ca90 2023-10-06T03:23:35.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.122+0000 7f529b59d700 1 -- 172.21.15.81:0/2998557172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f529416a9b0 con 0x7f529415ca90 2023-10-06T03:23:35.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.123+0000 7f529b59d700 1 -- 172.21.15.81:0/2998557172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f529415bcd0 con 0x7f529415ca90 2023-10-06T03:23:35.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.124+0000 7f528a7fc700 1 -- 172.21.15.81:0/2998557172 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f528c014830 con 0x7f529415ca90 2023-10-06T03:23:35.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.125+0000 7f528a7fc700 1 --2- 172.21.15.81:0/2998557172 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f5278066ea0 0x7f5278069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:35.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.125+0000 7f528a7fc700 1 -- 172.21.15.81:0/2998557172 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f528c084cf0 con 0x7f529415ca90 2023-10-06T03:23:35.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.126+0000 7f529a59b700 1 --2- 172.21.15.81:0/2998557172 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f5278066ea0 0x7f5278069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:35.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.126+0000 7f529a59b700 1 --2- 172.21.15.81:0/2998557172 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f5278066ea0 0x7f5278069350 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f52900099b0 tx=0x7f5290017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:35.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.130+0000 7f528a7fc700 1 -- 172.21.15.81:0/2998557172 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f528c052190 con 0x7f529415ca90 2023-10-06T03:23:35.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.343+0000 7f529b59d700 1 -- 172.21.15.81:0/2998557172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f529404bb80 con 0x7f529415ca90 2023-10-06T03:23:35.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.343+0000 7f528a7fc700 1 -- 172.21.15.81:0/2998557172 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+13626 (secure 0 0 0) 0x7f528c0557b0 con 0x7f529415ca90 2023-10-06T03:23:35.344 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:23:35.345 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":15,"fsid":"1807b5d7-9be8-43ad-aaf8-99a4273430b3","created":"2023-10-06T03:23:20.805306+0000","modified":"2023-10-06T03:23:34.854206+0000","last_up_change":"2023-10-06T03:23:32.735796+0000","last_in_change":"2023-10-06T03:23:24.109024+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:33.198850+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:33.606744+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"14fb667d-a677-4978-a477-80027f889d36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":85563},{"type":"v1","addr":"172.21.15.81:6818","nonce":85563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":85563},{"type":"v1","addr":"172.21.15.81:6822","nonce":85563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":85563},{"type":"v1","addr":"172.21.15.81:6830","nonce":85563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":85563},{"type":"v1","addr":"172.21.15.81:6826","nonce":85563}]},"public_addr":"172.21.15.81:6818/85563","cluster_addr":"172.21.15.81:6822/85563","heartbeat_back_addr":"172.21.15.81:6830/85563","heartbeat_front_addr":"172.21.15.81:6826/85563","state":["exists","up"]},{"osd":1,"uuid":"974d8a86-1829-4176-89ce-18e6038857f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":85561},{"type":"v1","addr":"172.21.15.81:6801","nonce":85561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":85561},{"type":"v1","addr":"172.21.15.81:6803","nonce":85561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":85561},{"type":"v1","addr":"172.21.15.81:6807","nonce":85561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":85561},{"type":"v1","addr":"172.21.15.81:6805","nonce":85561}]},"public_addr":"172.21.15.81:6801/85561","cluster_addr":"172.21.15.81:6803/85561","heartbeat_back_addr":"172.21.15.81:6807/85561","heartbeat_front_addr":"172.21.15.81:6805/85561","state":["exists","up"]},{"osd":2,"uuid":"ffbfe056-46bc-46e0-bf49-4d8f8650e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":85564},{"type":"v1","addr":"172.21.15.81:6809","nonce":85564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":85564},{"type":"v1","addr":"172.21.15.81:6811","nonce":85564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":85564},{"type":"v1","addr":"172.21.15.81:6815","nonce":85564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":85564},{"type":"v1","addr":"172.21.15.81:6813","nonce":85564}]},"public_addr":"172.21.15.81:6809/85564","cluster_addr":"172.21.15.81:6811/85564","heartbeat_back_addr":"172.21.15.81:6815/85564","heartbeat_front_addr":"172.21.15.81:6813/85564","state":["exists","up"]},{"osd":3,"uuid":"ef9a8314-3d37-4ea1-858a-e704d5695002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":85562},{"type":"v1","addr":"172.21.15.81:6819","nonce":85562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":85562},{"type":"v1","addr":"172.21.15.81:6823","nonce":85562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":85562},{"type":"v1","addr":"172.21.15.81:6831","nonce":85562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":85562},{"type":"v1","addr":"172.21.15.81:6827","nonce":85562}]},"public_addr":"172.21.15.81:6819/85562","cluster_addr":"172.21.15.81:6823/85562","heartbeat_back_addr":"172.21.15.81:6831/85562","heartbeat_front_addr":"172.21.15.81:6827/85562","state":["exists","up"]},{"osd":4,"uuid":"d83506a0-2c96-4bcb-a9fa-05e43dc329df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":85785},{"type":"v1","addr":"172.21.15.83:6801","nonce":85785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":85785},{"type":"v1","addr":"172.21.15.83:6803","nonce":85785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":85785},{"type":"v1","addr":"172.21.15.83:6807","nonce":85785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":85785},{"type":"v1","addr":"172.21.15.83:6805","nonce":85785}]},"public_addr":"172.21.15.83:6801/85785","cluster_addr":"172.21.15.83:6803/85785","heartbeat_back_addr":"172.21.15.83:6807/85785","heartbeat_front_addr":"172.21.15.83:6805/85785","state":["exists","up"]},{"osd":5,"uuid":"10687c63-a3d5-472f-acc0-4f61847b6e0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":85818},{"type":"v1","addr":"172.21.15.83:6825","nonce":85818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":85818},{"type":"v1","addr":"172.21.15.83:6827","nonce":85818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":85818},{"type":"v1","addr":"172.21.15.83:6831","nonce":85818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":85818},{"type":"v1","addr":"172.21.15.83:6829","nonce":85818}]},"public_addr":"172.21.15.83:6825/85818","cluster_addr":"172.21.15.83:6827/85818","heartbeat_back_addr":"172.21.15.83:6831/85818","heartbeat_front_addr":"172.21.15.83:6829/85818","state":["exists","up"]},{"osd":6,"uuid":"2e9daf76-5607-4a29-9a58-6e270700d223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":85787},{"type":"v1","addr":"172.21.15.83:6811","nonce":85787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":85787},{"type":"v1","addr":"172.21.15.83:6815","nonce":85787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":85787},{"type":"v1","addr":"172.21.15.83:6823","nonce":85787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6817","nonce":85787},{"type":"v1","addr":"172.21.15.83:6819","nonce":85787}]},"public_addr":"172.21.15.83:6811/85787","cluster_addr":"172.21.15.83:6815/85787","heartbeat_back_addr":"172.21.15.83:6823/85787","heartbeat_front_addr":"172.21.15.83:6819/85787","state":["exists","up"]},{"osd":7,"uuid":"5019e1ff-233a-4a5a-91ca-8afccb7ab6e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":85786},{"type":"v1","addr":"172.21.15.83:6810","nonce":85786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":85786},{"type":"v1","addr":"172.21.15.83:6814","nonce":85786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":85786},{"type":"v1","addr":"172.21.15.83:6822","nonce":85786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":85786},{"type":"v1","addr":"172.21.15.83:6818","nonce":85786}]},"public_addr":"172.21.15.83:6810/85786","cluster_addr":"172.21.15.83:6814/85786","heartbeat_back_addr":"172.21.15.83:6822/85786","heartbeat_front_addr":"172.21.15.83:6818/85786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.393431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.360031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.407428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.391613+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.403211+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.438142+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.496181+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.472323+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:23:35.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.346+0000 7f529b59d700 1 -- 172.21.15.81:0/2998557172 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f5278066ea0 msgr2=0x7f5278069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:35.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.346+0000 7f529b59d700 1 --2- 172.21.15.81:0/2998557172 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f5278066ea0 0x7f5278069350 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f52900099b0 tx=0x7f5290017000 comp rx=0 tx=0).stop 2023-10-06T03:23:35.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.346+0000 7f529b59d700 1 -- 172.21.15.81:0/2998557172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f529415ca90 msgr2=0x7f5294154570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:35.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.346+0000 7f529b59d700 1 --2- 172.21.15.81:0/2998557172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f529415ca90 0x7f5294154570 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f528c009e90 tx=0x7f528c00b040 comp rx=0 tx=0).stop 2023-10-06T03:23:35.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.346+0000 7f529b59d700 1 -- 172.21.15.81:0/2998557172 shutdown_connections 2023-10-06T03:23:35.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.346+0000 7f529b59d700 1 --2- 172.21.15.81:0/2998557172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f529415ca90 0x7f5294154570 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:35.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.346+0000 7f529b59d700 1 --2- 172.21.15.81:0/2998557172 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f5278066ea0 0x7f5278069350 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:35.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.346+0000 7f529b59d700 1 --2- 172.21.15.81:0/2998557172 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f529415a4b0 0x7f529413c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:35.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.346+0000 7f529b59d700 1 --2- 172.21.15.81:0/2998557172 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f529415b380 0x7f5294154030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:35.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.346+0000 7f529b59d700 1 -- 172.21.15.81:0/2998557172 >> 172.21.15.81:0/2998557172 conn(0x7f529406ed10 msgr2=0x7f529415a880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:35.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.346+0000 7f529b59d700 1 -- 172.21.15.81:0/2998557172 shutdown_connections 2023-10-06T03:23:35.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.347+0000 7f529b59d700 1 -- 172.21.15.81:0/2998557172 wait complete. 2023-10-06T03:23:35.366 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:23:33.198850+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:23:33.606744+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T03:23:35.366 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:23:35.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.556+0000 7f43ef19d700 1 Processor -- start 2023-10-06T03:23:35.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.556+0000 7f43ef19d700 1 -- start start 2023-10-06T03:23:35.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.558+0000 7f43ef19d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f43e8157cb0 0x7f43e815a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:35.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.558+0000 7f43ef19d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43e815b4f0 con 0x7f43e80b1f50 2023-10-06T03:23:35.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.558+0000 7f43ef19d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43e815b7d0 con 0x7f43e80b2320 2023-10-06T03:23:35.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.558+0000 7f43ef19d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e815bab0 con 0x7f43e8157cb0 2023-10-06T03:23:35.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.558+0000 7f43ee19b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f43e80b1f50 0x7f43e815c590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:55188/0 (socket says 172.21.15.81:55188) 2023-10-06T03:23:35.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.558+0000 7f43ee19b700 1 -- 172.21.15.81:0/329964879 learned_addr learned my addr 172.21.15.81:0/329964879 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:23:35.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.558+0000 7f43ee99c700 1 --2- 172.21.15.81:0/329964879 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f43e8157cb0 0x7f43e815a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:35.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.558+0000 7f43ed199700 1 -- 172.21.15.81:0/329964879 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1140290136 0 0) 0x7f43e815b4f0 con 0x7f43e80b1f50 2023-10-06T03:23:35.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.558+0000 7f43ed199700 1 -- 172.21.15.81:0/329964879 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43d4003570 con 0x7f43e80b1f50 2023-10-06T03:23:35.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.558+0000 7f43ed199700 1 -- 172.21.15.81:0/329964879 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2540520030 0 0) 0x7f43e815b7d0 con 0x7f43e80b2320 2023-10-06T03:23:35.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.558+0000 7f43ed199700 1 -- 172.21.15.81:0/329964879 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43e815b4f0 con 0x7f43e80b2320 2023-10-06T03:23:35.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.558+0000 7f43ee99c700 1 -- 172.21.15.81:0/329964879 >> v1:172.21.15.83:6789/0 conn(0x7f43e80b2320 legacy=0x7f43e81575a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:35.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.558+0000 7f43ee99c700 1 -- 172.21.15.81:0/329964879 >> v1:172.21.15.81:6789/0 conn(0x7f43e80b1f50 legacy=0x7f43e815c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:35.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.558+0000 7f43ee99c700 1 -- 172.21.15.81:0/329964879 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e815bd90 con 0x7f43e8157cb0 2023-10-06T03:23:35.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.559+0000 7f43ee99c700 1 --2- 172.21.15.81:0/329964879 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f43e8157cb0 0x7f43e815a9c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f43e0009e90 tx=0x7f43e0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=271d64a158fe24f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:35.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.559+0000 7f43ed199700 1 -- 172.21.15.81:0/329964879 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e000e070 con 0x7f43e8157cb0 2023-10-06T03:23:35.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.559+0000 7f43ed199700 1 -- 172.21.15.81:0/329964879 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43e000bb80 con 0x7f43e8157cb0 2023-10-06T03:23:35.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.559+0000 7f43ed199700 1 -- 172.21.15.81:0/329964879 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e0012430 con 0x7f43e8157cb0 2023-10-06T03:23:35.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.559+0000 7f43ef19d700 1 -- 172.21.15.81:0/329964879 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f43e8157cb0 msgr2=0x7f43e815a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:35.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.559+0000 7f43ef19d700 1 --2- 172.21.15.81:0/329964879 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f43e8157cb0 0x7f43e815a9c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f43e0009e90 tx=0x7f43e0009780 comp rx=0 tx=0).stop 2023-10-06T03:23:35.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.560+0000 7f43ef19d700 1 -- 172.21.15.81:0/329964879 shutdown_connections 2023-10-06T03:23:35.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.560+0000 7f43ef19d700 1 --2- 172.21.15.81:0/329964879 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f43e8157cb0 0x7f43e815a9c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:35.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.560+0000 7f43ef19d700 1 -- 172.21.15.81:0/329964879 >> 172.21.15.81:0/329964879 conn(0x7f43e806ed10 msgr2=0x7f43e806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:35.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.560+0000 7f43ef19d700 1 -- 172.21.15.81:0/329964879 shutdown_connections 2023-10-06T03:23:35.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.560+0000 7f43ef19d700 1 -- 172.21.15.81:0/329964879 wait complete. 2023-10-06T03:23:35.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.561+0000 7f43ef19d700 1 Processor -- start 2023-10-06T03:23:35.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.561+0000 7f43ef19d700 1 -- start start 2023-10-06T03:23:35.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.562+0000 7f43ef19d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43e80b1f50 0x7f43e81523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:35.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.562+0000 7f43ef19d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43e80b2320 0x7f43e816ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:35.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.562+0000 7f43ef19d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f43e8157cb0 0x7f43e816cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:35.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.562+0000 7f43ef19d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e8158b80 con 0x7f43e80b2320 2023-10-06T03:23:35.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.562+0000 7f43ef19d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e8154260 con 0x7f43e80b1f50 2023-10-06T03:23:35.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.562+0000 7f43ef19d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e8152ee0 con 0x7f43e8157cb0 2023-10-06T03:23:35.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.562+0000 7f43ed99a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43e80b2320 0x7f43e816ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:35.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.562+0000 7f43ed99a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43e80b2320 0x7f43e816ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44268/0 (socket says 172.21.15.81:44268) 2023-10-06T03:23:35.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.562+0000 7f43ed99a700 1 -- 172.21.15.81:0/378404276 learned_addr learned my addr 172.21.15.81:0/378404276 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:35.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.563+0000 7f43ee19b700 1 --2- 172.21.15.81:0/378404276 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43e80b1f50 0x7f43e81523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:35.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.563+0000 7f43ee99c700 1 --2- 172.21.15.81:0/378404276 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f43e8157cb0 0x7f43e816cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:35.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.563+0000 7f43ed99a700 1 -- 172.21.15.81:0/378404276 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f43e8157cb0 msgr2=0x7f43e816cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:35.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.563+0000 7f43ed99a700 1 --2- 172.21.15.81:0/378404276 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f43e8157cb0 0x7f43e816cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:35.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.563+0000 7f43ed99a700 1 -- 172.21.15.81:0/378404276 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43e80b1f50 msgr2=0x7f43e81523d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:35.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.563+0000 7f43ed99a700 1 --2- 172.21.15.81:0/378404276 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43e80b1f50 0x7f43e81523d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:35.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.563+0000 7f43ed99a700 1 -- 172.21.15.81:0/378404276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e0009a20 con 0x7f43e80b2320 2023-10-06T03:23:35.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.563+0000 7f43ed99a700 1 --2- 172.21.15.81:0/378404276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43e80b2320 0x7f43e816ca30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f43d800c7c0 tx=0x7f43d8007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:35.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.563+0000 7f43de7fc700 1 -- 172.21.15.81:0/378404276 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d8016070 con 0x7f43e80b2320 2023-10-06T03:23:35.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.563+0000 7f43de7fc700 1 -- 172.21.15.81:0/378404276 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43d8011680 con 0x7f43e80b2320 2023-10-06T03:23:35.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.563+0000 7f43de7fc700 1 -- 172.21.15.81:0/378404276 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d8011a20 con 0x7f43e80b2320 2023-10-06T03:23:35.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.563+0000 7f43ef19d700 1 -- 172.21.15.81:0/378404276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43e81531c0 con 0x7f43e80b2320 2023-10-06T03:23:35.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.563+0000 7f43ef19d700 1 -- 172.21.15.81:0/378404276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43e813d610 con 0x7f43e80b2320 2023-10-06T03:23:35.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.564+0000 7f43ef19d700 1 -- 172.21.15.81:0/378404276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43e81589d0 con 0x7f43e80b2320 2023-10-06T03:23:35.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.565+0000 7f43de7fc700 1 -- 172.21.15.81:0/378404276 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f43d8012440 con 0x7f43e80b2320 2023-10-06T03:23:35.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.566+0000 7f43de7fc700 1 --2- 172.21.15.81:0/378404276 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f43cc066ea0 0x7f43cc069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:35.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.566+0000 7f43de7fc700 1 -- 172.21.15.81:0/378404276 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f43d8084110 con 0x7f43e80b2320 2023-10-06T03:23:35.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.566+0000 7f43ee19b700 1 --2- 172.21.15.81:0/378404276 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f43cc066ea0 0x7f43cc069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:35.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.567+0000 7f43ee19b700 1 --2- 172.21.15.81:0/378404276 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f43cc066ea0 0x7f43cc069350 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f43e40058d0 tx=0x7f43e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:35.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.574+0000 7f43de7fc700 1 -- 172.21.15.81:0/378404276 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f43d80515b0 con 0x7f43e80b2320 2023-10-06T03:23:35.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.774+0000 7f43ef19d700 1 -- 172.21.15.81:0/378404276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f43e8158670 con 0x7f43e80b2320 2023-10-06T03:23:35.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.775+0000 7f43de7fc700 1 -- 172.21.15.81:0/378404276 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v15) v1 ==== 92+0+10 (secure 0 0 0) 0x7f43e8158670 con 0x7f43e80b2320 2023-10-06T03:23:35.776 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-10-06T03:23:35.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.777+0000 7f43ef19d700 1 -- 172.21.15.81:0/378404276 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f43cc066ea0 msgr2=0x7f43cc069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:35.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.777+0000 7f43ef19d700 1 --2- 172.21.15.81:0/378404276 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f43cc066ea0 0x7f43cc069350 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f43e40058d0 tx=0x7f43e4009040 comp rx=0 tx=0).stop 2023-10-06T03:23:35.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.777+0000 7f43ef19d700 1 -- 172.21.15.81:0/378404276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43e80b2320 msgr2=0x7f43e816ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:35.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.777+0000 7f43ef19d700 1 --2- 172.21.15.81:0/378404276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43e80b2320 0x7f43e816ca30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f43d800c7c0 tx=0x7f43d8007dd0 comp rx=0 tx=0).stop 2023-10-06T03:23:35.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.777+0000 7f43ef19d700 1 -- 172.21.15.81:0/378404276 shutdown_connections 2023-10-06T03:23:35.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.777+0000 7f43ef19d700 1 --2- 172.21.15.81:0/378404276 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f43cc066ea0 0x7f43cc069350 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:35.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.777+0000 7f43ef19d700 1 --2- 172.21.15.81:0/378404276 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f43e8157cb0 0x7f43e816cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:35.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.777+0000 7f43ef19d700 1 --2- 172.21.15.81:0/378404276 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43e80b1f50 0x7f43e81523d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:35.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.777+0000 7f43ef19d700 1 --2- 172.21.15.81:0/378404276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43e80b2320 0x7f43e816ca30 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:35.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.777+0000 7f43ef19d700 1 -- 172.21.15.81:0/378404276 >> 172.21.15.81:0/378404276 conn(0x7f43e806ed10 msgr2=0x7f43e814f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:35.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.777+0000 7f43ef19d700 1 -- 172.21.15.81:0/378404276 shutdown_connections 2023-10-06T03:23:35.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.778+0000 7f43ef19d700 1 -- 172.21.15.81:0/378404276 wait complete. 2023-10-06T03:23:35.795 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:23:35.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.983+0000 7fc45e1ff700 1 Processor -- start 2023-10-06T03:23:35.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.983+0000 7fc45e1ff700 1 -- start start 2023-10-06T03:23:35.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.984+0000 7fc45e1ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc4580c9fb0 0x7fc45806eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:35.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.984+0000 7fc45e1ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc45806f430 0x7fc458155510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:35.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.984+0000 7fc45e1ff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4580cadd0 con 0x7fc4580c9be0 2023-10-06T03:23:35.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.984+0000 7fc45e1ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4580ccf50 con 0x7fc4580c9fb0 2023-10-06T03:23:35.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.984+0000 7fc45e1ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc45806db40 con 0x7fc45806f430 2023-10-06T03:23:35.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.985+0000 7fc456ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc4580c9fb0 0x7fc45806eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:35.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.985+0000 7fc456ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc4580c9fb0 0x7fc45806eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44270/0 (socket says 172.21.15.81:44270) 2023-10-06T03:23:35.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.985+0000 7fc456ffd700 1 -- 172.21.15.81:0/4019725637 learned_addr learned my addr 172.21.15.81:0/4019725637 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:35.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.985+0000 7fc4577fe700 1 --1- 172.21.15.81:0/4019725637 >> v1:172.21.15.83:6789/0 conn(0x7fc4580c9be0 0x7fc4580ca6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:54150/0 (socket says 172.21.15.81:54150) 2023-10-06T03:23:35.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.985+0000 7fc457fff700 1 --2- 172.21.15.81:0/4019725637 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc45806f430 0x7fc458155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:35.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.985+0000 7fc456ffd700 1 -- 172.21.15.81:0/4019725637 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc45806f430 msgr2=0x7fc458155510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:35.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.985+0000 7fc456ffd700 1 --2- 172.21.15.81:0/4019725637 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc45806f430 0x7fc458155510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:35.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.985+0000 7fc456ffd700 1 -- 172.21.15.81:0/4019725637 >> v1:172.21.15.83:6789/0 conn(0x7fc4580c9be0 legacy=0x7fc4580ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:35.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.985+0000 7fc456ffd700 1 -- 172.21.15.81:0/4019725637 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc45806de20 con 0x7fc4580c9fb0 2023-10-06T03:23:35.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.985+0000 7fc4567fc700 1 -- 172.21.15.81:0/4019725637 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 73296606 0 0) 0x7fc4580cadd0 con 0x7fc4580c9be0 2023-10-06T03:23:35.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.985+0000 7fc456ffd700 1 --2- 172.21.15.81:0/4019725637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4580c9fb0 0x7fc45806eef0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc44c0099b0 tx=0x7fc44c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cfb977c7f3fd50d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:35.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.986+0000 7fc4567fc700 1 -- 172.21.15.81:0/4019725637 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44c009ea0 con 0x7fc4580c9fb0 2023-10-06T03:23:35.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.986+0000 7fc4567fc700 1 -- 172.21.15.81:0/4019725637 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc44c00b860 con 0x7fc4580c9fb0 2023-10-06T03:23:35.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.986+0000 7fc4567fc700 1 -- 172.21.15.81:0/4019725637 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44c00bc00 con 0x7fc4580c9fb0 2023-10-06T03:23:35.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.986+0000 7fc45e1ff700 1 -- 172.21.15.81:0/4019725637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4580c9fb0 msgr2=0x7fc45806eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:35.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.986+0000 7fc45e1ff700 1 --2- 172.21.15.81:0/4019725637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4580c9fb0 0x7fc45806eef0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc44c0099b0 tx=0x7fc44c009250 comp rx=0 tx=0).stop 2023-10-06T03:23:35.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.986+0000 7fc45e1ff700 1 -- 172.21.15.81:0/4019725637 shutdown_connections 2023-10-06T03:23:35.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.986+0000 7fc45e1ff700 1 --2- 172.21.15.81:0/4019725637 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc45806f430 0x7fc458155510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:35.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.986+0000 7fc45e1ff700 1 --2- 172.21.15.81:0/4019725637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4580c9fb0 0x7fc45806eef0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:35.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.986+0000 7fc45e1ff700 1 -- 172.21.15.81:0/4019725637 >> 172.21.15.81:0/4019725637 conn(0x7fc4580cc010 msgr2=0x7fc4580cc410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:35.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.986+0000 7fc45e1ff700 1 -- 172.21.15.81:0/4019725637 shutdown_connections 2023-10-06T03:23:35.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.986+0000 7fc45e1ff700 1 -- 172.21.15.81:0/4019725637 wait complete. 2023-10-06T03:23:35.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.988+0000 7fc45e1ff700 1 Processor -- start 2023-10-06T03:23:35.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.988+0000 7fc45e1ff700 1 -- start start 2023-10-06T03:23:35.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.989+0000 7fc45e1ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc45806f430 0x7fc458149280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:35.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.989+0000 7fc45e1ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4580c9be0 0x7fc458145410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:35.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.989+0000 7fc45e1ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4580c9fb0 0x7fc45814e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:35.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.989+0000 7fc45e1ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc458146110 con 0x7fc4580c9be0 2023-10-06T03:23:35.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.989+0000 7fc45e1ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc458148df0 con 0x7fc4580c9fb0 2023-10-06T03:23:35.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.989+0000 7fc45e1ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc458147f40 con 0x7fc45806f430 2023-10-06T03:23:35.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.989+0000 7fc456ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4580c9be0 0x7fc458145410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:35.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.989+0000 7fc456ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4580c9be0 0x7fc458145410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44288/0 (socket says 172.21.15.81:44288) 2023-10-06T03:23:35.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.989+0000 7fc456ffd700 1 -- 172.21.15.81:0/1700340892 learned_addr learned my addr 172.21.15.81:0/1700340892 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:35.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.989+0000 7fc4577fe700 1 --2- 172.21.15.81:0/1700340892 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc45806f430 0x7fc458149280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:35.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.989+0000 7fc457fff700 1 --2- 172.21.15.81:0/1700340892 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4580c9fb0 0x7fc45814e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:35.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.989+0000 7fc456ffd700 1 -- 172.21.15.81:0/1700340892 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc45806f430 msgr2=0x7fc458149280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:35.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.989+0000 7fc456ffd700 1 --2- 172.21.15.81:0/1700340892 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc45806f430 0x7fc458149280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:35.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.989+0000 7fc456ffd700 1 -- 172.21.15.81:0/1700340892 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4580c9fb0 msgr2=0x7fc45814e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:35.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.989+0000 7fc456ffd700 1 --2- 172.21.15.81:0/1700340892 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4580c9fb0 0x7fc45814e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:35.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.989+0000 7fc456ffd700 1 -- 172.21.15.81:0/1700340892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc44c0094f0 con 0x7fc4580c9be0 2023-10-06T03:23:35.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.990+0000 7fc456ffd700 1 --2- 172.21.15.81:0/1700340892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4580c9be0 0x7fc458145410 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc45806ceb0 tx=0x7fc44c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:35.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.990+0000 7fc43f7fe700 1 -- 172.21.15.81:0/1700340892 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44c000d10 con 0x7fc4580c9be0 2023-10-06T03:23:35.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.990+0000 7fc43f7fe700 1 -- 172.21.15.81:0/1700340892 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc44c00bbe0 con 0x7fc4580c9be0 2023-10-06T03:23:35.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.990+0000 7fc43f7fe700 1 -- 172.21.15.81:0/1700340892 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44c01a6c0 con 0x7fc4580c9be0 2023-10-06T03:23:35.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.990+0000 7fc45e1ff700 1 -- 172.21.15.81:0/1700340892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4581481e0 con 0x7fc4580c9be0 2023-10-06T03:23:35.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.990+0000 7fc45e1ff700 1 -- 172.21.15.81:0/1700340892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4581487a0 con 0x7fc4580c9be0 2023-10-06T03:23:35.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.991+0000 7fc45e1ff700 1 -- 172.21.15.81:0/1700340892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc45804c3c0 con 0x7fc4580c9be0 2023-10-06T03:23:35.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.992+0000 7fc43f7fe700 1 -- 172.21.15.81:0/1700340892 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7fc44c01aab0 con 0x7fc4580c9be0 2023-10-06T03:23:35.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.992+0000 7fc43f7fe700 1 --2- 172.21.15.81:0/1700340892 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc444066ea0 0x7fc444069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:35.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.993+0000 7fc43f7fe700 1 -- 172.21.15.81:0/1700340892 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fc44c085bf0 con 0x7fc4580c9be0 2023-10-06T03:23:35.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.993+0000 7fc4577fe700 1 --2- 172.21.15.81:0/1700340892 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc444066ea0 0x7fc444069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:35.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.993+0000 7fc4577fe700 1 --2- 172.21.15.81:0/1700340892 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc444066ea0 0x7fc444069350 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc448007fd0 tx=0x7fc448007d50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:35.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:35.997+0000 7fc43f7fe700 1 -- 172.21.15.81:0/1700340892 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc44c053090 con 0x7fc4580c9be0 2023-10-06T03:23:36.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.189+0000 7fc45e1ff700 1 -- 172.21.15.81:0/1700340892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc458148f30 con 0x7fc4580c9be0 2023-10-06T03:23:36.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.190+0000 7fc43f7fe700 1 -- 172.21.15.81:0/1700340892 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc44c0566b0 con 0x7fc4580c9be0 2023-10-06T03:23:36.191 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-06T03:23:36.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.192+0000 7fc45e1ff700 1 -- 172.21.15.81:0/1700340892 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc444066ea0 msgr2=0x7fc444069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:36.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.192+0000 7fc45e1ff700 1 --2- 172.21.15.81:0/1700340892 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc444066ea0 0x7fc444069350 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc448007fd0 tx=0x7fc448007d50 comp rx=0 tx=0).stop 2023-10-06T03:23:36.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.192+0000 7fc45e1ff700 1 -- 172.21.15.81:0/1700340892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4580c9be0 msgr2=0x7fc458145410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:36.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.192+0000 7fc45e1ff700 1 --2- 172.21.15.81:0/1700340892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4580c9be0 0x7fc458145410 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc45806ceb0 tx=0x7fc44c017000 comp rx=0 tx=0).stop 2023-10-06T03:23:36.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.192+0000 7fc45e1ff700 1 -- 172.21.15.81:0/1700340892 shutdown_connections 2023-10-06T03:23:36.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.192+0000 7fc45e1ff700 1 --2- 172.21.15.81:0/1700340892 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4580c9fb0 0x7fc45814e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:36.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.192+0000 7fc45e1ff700 1 --2- 172.21.15.81:0/1700340892 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc444066ea0 0x7fc444069350 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:36.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.192+0000 7fc45e1ff700 1 --2- 172.21.15.81:0/1700340892 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc45806f430 0x7fc458149280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:36.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.192+0000 7fc45e1ff700 1 --2- 172.21.15.81:0/1700340892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4580c9be0 0x7fc458145410 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:36.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.192+0000 7fc45e1ff700 1 -- 172.21.15.81:0/1700340892 >> 172.21.15.81:0/1700340892 conn(0x7fc4580cc010 msgr2=0x7fc458068f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:36.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.192+0000 7fc45e1ff700 1 -- 172.21.15.81:0/1700340892 shutdown_connections 2023-10-06T03:23:36.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.192+0000 7fc45e1ff700 1 -- 172.21.15.81:0/1700340892 wait complete. 2023-10-06T03:23:36.213 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:23:36.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.396+0000 7f5ffb59e700 1 Processor -- start 2023-10-06T03:23:36.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.396+0000 7f5ffb59e700 1 -- start start 2023-10-06T03:23:36.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.397+0000 7f5ffb59e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f5ffc0cc670 0x7f5ffc0ccd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:36.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.397+0000 7f5ffb59e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ffc0b2420 0x7f5ffc15a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:36.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.397+0000 7f5ffb59e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ffc0b4760 con 0x7f5ffc15a450 2023-10-06T03:23:36.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.397+0000 7f5ffb59e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ffc0b60f0 con 0x7f5ffc0cc670 2023-10-06T03:23:36.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.397+0000 7f5ffb59e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ffc0cd320 con 0x7f5ffc0b2420 2023-10-06T03:23:36.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.397+0000 7f5ffa59c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f5ffc0cc670 0x7f5ffc0ccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:36.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.397+0000 7f5ffad9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ffc0b2420 0x7f5ffc15a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:36.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.398+0000 7f5ffa59c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f5ffc0cc670 0x7f5ffc0ccd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:44340/0 (socket says 172.21.15.81:44340) 2023-10-06T03:23:36.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.398+0000 7f5ffa59c700 1 -- 172.21.15.81:0/3207919071 learned_addr learned my addr 172.21.15.81:0/3207919071 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:36.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.398+0000 7f5ffad9d700 1 -- 172.21.15.81:0/3207919071 >> v2:172.21.15.83:3300/0 conn(0x7f5ffc0cc670 msgr2=0x7f5ffc0ccd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:36.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.398+0000 7f5ffad9d700 1 --2- 172.21.15.81:0/3207919071 >> v2:172.21.15.83:3300/0 conn(0x7f5ffc0cc670 0x7f5ffc0ccd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:36.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.398+0000 7f5ffad9d700 1 -- 172.21.15.81:0/3207919071 >> v1:172.21.15.81:6789/0 conn(0x7f5ffc15a450 legacy=0x7f5ffc0b1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:36.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.398+0000 7f5ffad9d700 1 -- 172.21.15.81:0/3207919071 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ffc0b3e30 con 0x7f5ffc0b2420 2023-10-06T03:23:36.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.398+0000 7f5ffa59c700 1 --2- 172.21.15.81:0/3207919071 >> v2:172.21.15.83:3300/0 conn(0x7f5ffc0cc670 0x7f5ffc0ccd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:23:36.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.398+0000 7f5ffad9d700 1 --2- 172.21.15.81:0/3207919071 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ffc0b2420 0x7f5ffc15a8f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5ff4009e60 tx=0x7f5ff4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c83e5c47cb4b9ac server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:36.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.399+0000 7f5ff959a700 1 -- 172.21.15.81:0/3207919071 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff400e070 con 0x7f5ffc0b2420 2023-10-06T03:23:36.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.399+0000 7f5ff959a700 1 -- 172.21.15.81:0/3207919071 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff400bb60 con 0x7f5ffc0b2420 2023-10-06T03:23:36.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.399+0000 7f5ff959a700 1 -- 172.21.15.81:0/3207919071 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff4012430 con 0x7f5ffc0b2420 2023-10-06T03:23:36.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.399+0000 7f5ffb59e700 1 -- 172.21.15.81:0/3207919071 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ffc0b2420 msgr2=0x7f5ffc15a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:36.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.399+0000 7f5ffb59e700 1 --2- 172.21.15.81:0/3207919071 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ffc0b2420 0x7f5ffc15a8f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5ff4009e60 tx=0x7f5ff4009780 comp rx=0 tx=0).stop 2023-10-06T03:23:36.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.399+0000 7f5ffb59e700 1 -- 172.21.15.81:0/3207919071 shutdown_connections 2023-10-06T03:23:36.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.399+0000 7f5ffb59e700 1 --2- 172.21.15.81:0/3207919071 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ffc0b2420 0x7f5ffc15a8f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:36.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.399+0000 7f5ffb59e700 1 --2- 172.21.15.81:0/3207919071 >> v2:172.21.15.83:3300/0 conn(0x7f5ffc0cc670 0x7f5ffc0ccd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:36.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.399+0000 7f5ffb59e700 1 -- 172.21.15.81:0/3207919071 >> 172.21.15.81:0/3207919071 conn(0x7f5ffc06ed10 msgr2=0x7f5ffc06f110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:36.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.399+0000 7f5ffb59e700 1 -- 172.21.15.81:0/3207919071 shutdown_connections 2023-10-06T03:23:36.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.399+0000 7f5ffb59e700 1 -- 172.21.15.81:0/3207919071 wait complete. 2023-10-06T03:23:36.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.401+0000 7f5ffb59e700 1 Processor -- start 2023-10-06T03:23:36.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.401+0000 7f5ffb59e700 1 -- start start 2023-10-06T03:23:36.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.402+0000 7f5ffb59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ffc0b2420 0x7f5ffc1535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:36.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.402+0000 7f5ffb59e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ffc0cc670 0x7f5ffc13c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:36.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.402+0000 7f5ffb59e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ffc15a450 0x7f5ffc13ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:36.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.402+0000 7f5ffb59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ffc14d5c0 con 0x7f5ffc0b2420 2023-10-06T03:23:36.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.402+0000 7f5ffb59e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ffc15bb30 con 0x7f5ffc15a450 2023-10-06T03:23:36.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.402+0000 7f5ffb59e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ffc15be10 con 0x7f5ffc0cc670 2023-10-06T03:23:36.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.402+0000 7f5ffa59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ffc0b2420 0x7f5ffc1535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:36.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.402+0000 7f5ffad9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ffc15a450 0x7f5ffc13ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:36.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.402+0000 7f5ffa59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ffc0b2420 0x7f5ffc1535c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44300/0 (socket says 172.21.15.81:44300) 2023-10-06T03:23:36.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.402+0000 7f5ffa59c700 1 -- 172.21.15.81:0/2424211647 learned_addr learned my addr 172.21.15.81:0/2424211647 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:36.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.402+0000 7f5ff9d9b700 1 --2- 172.21.15.81:0/2424211647 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ffc0cc670 0x7f5ffc13c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:36.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.402+0000 7f5ff9d9b700 1 -- 172.21.15.81:0/2424211647 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ffc15a450 msgr2=0x7f5ffc13ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:36.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.402+0000 7f5ff9d9b700 1 --2- 172.21.15.81:0/2424211647 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ffc15a450 0x7f5ffc13ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:36.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.402+0000 7f5ff9d9b700 1 -- 172.21.15.81:0/2424211647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ffc0b2420 msgr2=0x7f5ffc1535c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:36.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.402+0000 7f5ff9d9b700 1 --2- 172.21.15.81:0/2424211647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ffc0b2420 0x7f5ffc1535c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:36.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.402+0000 7f5ff9d9b700 1 -- 172.21.15.81:0/2424211647 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fec0094f0 con 0x7f5ffc0cc670 2023-10-06T03:23:36.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.402+0000 7f5ffad9d700 1 --2- 172.21.15.81:0/2424211647 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ffc15a450 0x7f5ffc13ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:23:36.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.403+0000 7f5ff9d9b700 1 --2- 172.21.15.81:0/2424211647 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ffc0cc670 0x7f5ffc13c920 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5ff000c590 tx=0x7f5ff0007ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:36.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.403+0000 7f5fea7fc700 1 -- 172.21.15.81:0/2424211647 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff0011590 con 0x7f5ffc0cc670 2023-10-06T03:23:36.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.403+0000 7f5fea7fc700 1 -- 172.21.15.81:0/2424211647 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff0011710 con 0x7f5ffc0cc670 2023-10-06T03:23:36.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.403+0000 7f5ffb59e700 1 -- 172.21.15.81:0/2424211647 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ff4009a20 con 0x7f5ffc0cc670 2023-10-06T03:23:36.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.403+0000 7f5fea7fc700 1 -- 172.21.15.81:0/2424211647 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff0011ad0 con 0x7f5ffc0cc670 2023-10-06T03:23:36.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.403+0000 7f5ffb59e700 1 -- 172.21.15.81:0/2424211647 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ffc15c3d0 con 0x7f5ffc0cc670 2023-10-06T03:23:36.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.404+0000 7f5ffb59e700 1 -- 172.21.15.81:0/2424211647 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ffc04c3c0 con 0x7f5ffc0cc670 2023-10-06T03:23:36.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.405+0000 7f5fea7fc700 1 -- 172.21.15.81:0/2424211647 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5ff001b3b0 con 0x7f5ffc0cc670 2023-10-06T03:23:36.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.406+0000 7f5fea7fc700 1 --2- 172.21.15.81:0/2424211647 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f5fdc066f30 0x7f5fdc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:36.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.406+0000 7f5fea7fc700 1 -- 172.21.15.81:0/2424211647 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f5ff0083790 con 0x7f5ffc0cc670 2023-10-06T03:23:36.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.406+0000 7f5ffa59c700 1 --2- 172.21.15.81:0/2424211647 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f5fdc066f30 0x7f5fdc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:36.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.406+0000 7f5ffa59c700 1 --2- 172.21.15.81:0/2424211647 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f5fdc066f30 0x7f5fdc0693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5fec006e80 tx=0x7f5fec009250 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:36.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.411+0000 7f5fea7fc700 1 -- 172.21.15.81:0/2424211647 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ff0050b50 con 0x7f5ffc0cc670 2023-10-06T03:23:36.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.653+0000 7f5ffb59e700 1 -- 172.21.15.81:0/2424211647 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ffc04bb80 con 0x7f5ffc0cc670 2023-10-06T03:23:36.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.653+0000 7f5fea7fc700 1 -- 172.21.15.81:0/2424211647 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3521 (secure 0 0 0) 0x7f5ff0017020 con 0x7f5ffc0cc670 2023-10-06T03:23:36.654 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:23:36.655 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1255569320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1255569320},{"type":"v1","addr":"172.21.15.83:6835","nonce":1255569320}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1673166762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1673166762},{"type":"v1","addr":"172.21.15.81:6835","nonce":1673166762}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3689326153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3689326153},{"type":"v1","addr":"172.21.15.81:6837","nonce":3689326153}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6833/745669616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":745669616},{"type":"v1","addr":"172.21.15.83:6833","nonce":745669616}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-10-06T03:23:36.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.655+0000 7f5ffb59e700 1 -- 172.21.15.81:0/2424211647 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f5fdc066f30 msgr2=0x7f5fdc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:36.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.655+0000 7f5ffb59e700 1 --2- 172.21.15.81:0/2424211647 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f5fdc066f30 0x7f5fdc0693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5fec006e80 tx=0x7f5fec009250 comp rx=0 tx=0).stop 2023-10-06T03:23:36.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.655+0000 7f5ffb59e700 1 -- 172.21.15.81:0/2424211647 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ffc0cc670 msgr2=0x7f5ffc13c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:36.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.655+0000 7f5ffb59e700 1 --2- 172.21.15.81:0/2424211647 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ffc0cc670 0x7f5ffc13c920 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5ff000c590 tx=0x7f5ff0007ec0 comp rx=0 tx=0).stop 2023-10-06T03:23:36.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.656+0000 7f5ffb59e700 1 -- 172.21.15.81:0/2424211647 shutdown_connections 2023-10-06T03:23:36.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.656+0000 7f5ffb59e700 1 --2- 172.21.15.81:0/2424211647 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ffc15a450 0x7f5ffc13ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:36.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.656+0000 7f5ffb59e700 1 --2- 172.21.15.81:0/2424211647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ffc0b2420 0x7f5ffc1535c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:36.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.656+0000 7f5ffb59e700 1 --2- 172.21.15.81:0/2424211647 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f5fdc066f30 0x7f5fdc0693e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:36.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.656+0000 7f5ffb59e700 1 --2- 172.21.15.81:0/2424211647 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ffc0cc670 0x7f5ffc13c920 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:36.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.656+0000 7f5ffb59e700 1 -- 172.21.15.81:0/2424211647 >> 172.21.15.81:0/2424211647 conn(0x7f5ffc06ed10 msgr2=0x7f5ffc14fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:36.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.656+0000 7f5ffb59e700 1 -- 172.21.15.81:0/2424211647 shutdown_connections 2023-10-06T03:23:36.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.656+0000 7f5ffb59e700 1 -- 172.21.15.81:0/2424211647 wait complete. 2023-10-06T03:23:36.658 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 3 2023-10-06T03:23:36.675 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:23:36.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.857+0000 7f618d5ff700 1 Processor -- start 2023-10-06T03:23:36.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.857+0000 7f618d5ff700 1 -- start start 2023-10-06T03:23:36.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.858+0000 7f618d5ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f61881557f0 0x7f6188156c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:36.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.859+0000 7f618d5ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6188069ee0 0x7f618806a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:36.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.859+0000 7f618d5ff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61880c9c60 con 0x7f6188155bc0 2023-10-06T03:23:36.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.859+0000 7f618d5ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f618806df20 con 0x7f61881557f0 2023-10-06T03:23:36.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.859+0000 7f618d5ff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f618806a860 con 0x7f6188069ee0 2023-10-06T03:23:36.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.859+0000 7f6186ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f61881557f0 0x7f6188156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:36.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.859+0000 7f6186ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f61881557f0 0x7f6188156c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44308/0 (socket says 172.21.15.81:44308) 2023-10-06T03:23:36.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.859+0000 7f617ffff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6188155bc0 0x7f61880c6cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:55198/0 (socket says 172.21.15.81:55198) 2023-10-06T03:23:36.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.859+0000 7f6186ffd700 1 -- 172.21.15.81:0/907752599 learned_addr learned my addr 172.21.15.81:0/907752599 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:36.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.859+0000 7f61877fe700 1 --2- 172.21.15.81:0/907752599 >> v2:172.21.15.83:3300/0 conn(0x7f6188069ee0 0x7f618806a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:36.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.859+0000 7f6186ffd700 1 -- 172.21.15.81:0/907752599 >> v2:172.21.15.83:3300/0 conn(0x7f6188069ee0 msgr2=0x7f618806a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:36.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.859+0000 7f6186ffd700 1 --2- 172.21.15.81:0/907752599 >> v2:172.21.15.83:3300/0 conn(0x7f6188069ee0 0x7f618806a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:36.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.859+0000 7f6186ffd700 1 -- 172.21.15.81:0/907752599 >> v1:172.21.15.81:6789/0 conn(0x7f6188155bc0 legacy=0x7f61880c6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:36.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.859+0000 7f6186ffd700 1 -- 172.21.15.81:0/907752599 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f618806dc60 con 0x7f61881557f0 2023-10-06T03:23:36.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.859+0000 7f61867fc700 1 -- 172.21.15.81:0/907752599 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2132715530 0 0) 0x7f61880c9c60 con 0x7f6188155bc0 2023-10-06T03:23:36.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.860+0000 7f6186ffd700 1 --2- 172.21.15.81:0/907752599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61881557f0 0x7f6188156c90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f61880aebb0 tx=0x7f6178009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49f5a4261402378 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:36.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.860+0000 7f61867fc700 1 -- 172.21.15.81:0/907752599 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6178009e70 con 0x7f61881557f0 2023-10-06T03:23:36.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.860+0000 7f61867fc700 1 -- 172.21.15.81:0/907752599 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f617800b860 con 0x7f61881557f0 2023-10-06T03:23:36.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.860+0000 7f61867fc700 1 -- 172.21.15.81:0/907752599 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617800bc00 con 0x7f61881557f0 2023-10-06T03:23:36.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.860+0000 7f618d5ff700 1 -- 172.21.15.81:0/907752599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61881557f0 msgr2=0x7f6188156c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:36.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.860+0000 7f618d5ff700 1 --2- 172.21.15.81:0/907752599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61881557f0 0x7f6188156c90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f61880aebb0 tx=0x7f6178009250 comp rx=0 tx=0).stop 2023-10-06T03:23:36.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.860+0000 7f618d5ff700 1 -- 172.21.15.81:0/907752599 shutdown_connections 2023-10-06T03:23:36.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.860+0000 7f618d5ff700 1 --2- 172.21.15.81:0/907752599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61881557f0 0x7f6188156c90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:36.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.860+0000 7f618d5ff700 1 --2- 172.21.15.81:0/907752599 >> v2:172.21.15.83:3300/0 conn(0x7f6188069ee0 0x7f618806a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:36.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.860+0000 7f618d5ff700 1 -- 172.21.15.81:0/907752599 >> 172.21.15.81:0/907752599 conn(0x7f61880cc090 msgr2=0x7f61880cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:36.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.861+0000 7f618d5ff700 1 -- 172.21.15.81:0/907752599 shutdown_connections 2023-10-06T03:23:36.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.861+0000 7f618d5ff700 1 -- 172.21.15.81:0/907752599 wait complete. 2023-10-06T03:23:36.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.862+0000 7f618d5ff700 1 Processor -- start 2023-10-06T03:23:36.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.862+0000 7f618d5ff700 1 -- start start 2023-10-06T03:23:36.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.863+0000 7f618d5ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6188069ee0 0x7f6188141a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:36.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.863+0000 7f618d5ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61881557f0 0x7f61880c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:36.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.863+0000 7f618d5ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6188155bc0 0x7f61880ca160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:36.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.863+0000 7f618d5ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6188159780 con 0x7f61881557f0 2023-10-06T03:23:36.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.863+0000 7f618d5ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61880b1b50 con 0x7f6188155bc0 2023-10-06T03:23:36.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.863+0000 7f618d5ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61880b0f40 con 0x7f6188069ee0 2023-10-06T03:23:36.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.863+0000 7f617ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61881557f0 0x7f61880c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:36.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.863+0000 7f617ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61881557f0 0x7f61880c9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44320/0 (socket says 172.21.15.81:44320) 2023-10-06T03:23:36.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.863+0000 7f617ffff700 1 -- 172.21.15.81:0/1137228216 learned_addr learned my addr 172.21.15.81:0/1137228216 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:36.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.863+0000 7f61877fe700 1 --2- 172.21.15.81:0/1137228216 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6188155bc0 0x7f61880ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:36.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.863+0000 7f6186ffd700 1 --2- 172.21.15.81:0/1137228216 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6188069ee0 0x7f6188141a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:36.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.864+0000 7f617ffff700 1 -- 172.21.15.81:0/1137228216 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6188069ee0 msgr2=0x7f6188141a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:36.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.864+0000 7f617ffff700 1 --2- 172.21.15.81:0/1137228216 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6188069ee0 0x7f6188141a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:36.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.864+0000 7f617ffff700 1 -- 172.21.15.81:0/1137228216 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6188155bc0 msgr2=0x7f61880ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:36.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.864+0000 7f617ffff700 1 --2- 172.21.15.81:0/1137228216 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6188155bc0 0x7f61880ca160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:36.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.864+0000 7f617ffff700 1 -- 172.21.15.81:0/1137228216 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61780094f0 con 0x7f61881557f0 2023-10-06T03:23:36.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.864+0000 7f617ffff700 1 --2- 172.21.15.81:0/1137228216 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61881557f0 0x7f61880c9c20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f61700011e0 tx=0x7f6170007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:36.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.864+0000 7f617effd700 1 -- 172.21.15.81:0/1137228216 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6170005a70 con 0x7f61881557f0 2023-10-06T03:23:36.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.864+0000 7f617effd700 1 -- 172.21.15.81:0/1137228216 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6170005bd0 con 0x7f61881557f0 2023-10-06T03:23:36.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.864+0000 7f617effd700 1 -- 172.21.15.81:0/1137228216 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61700070d0 con 0x7f61881557f0 2023-10-06T03:23:36.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.864+0000 7f618d5ff700 1 -- 172.21.15.81:0/1137228216 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61880b1220 con 0x7f61881557f0 2023-10-06T03:23:36.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.864+0000 7f618d5ff700 1 -- 172.21.15.81:0/1137228216 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61880b17e0 con 0x7f61881557f0 2023-10-06T03:23:36.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.865+0000 7f618d5ff700 1 -- 172.21.15.81:0/1137228216 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61880b1d00 con 0x7f61881557f0 2023-10-06T03:23:36.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.867+0000 7f617effd700 1 -- 172.21.15.81:0/1137228216 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6170007440 con 0x7f61881557f0 2023-10-06T03:23:36.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.868+0000 7f617effd700 1 --2- 172.21.15.81:0/1137228216 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f6168066f30 0x7f61680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:36.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.868+0000 7f617effd700 1 -- 172.21.15.81:0/1137228216 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f6170083b50 con 0x7f61881557f0 2023-10-06T03:23:36.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.868+0000 7f6186ffd700 1 --2- 172.21.15.81:0/1137228216 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f6168066f30 0x7f61680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:36.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.869+0000 7f6186ffd700 1 --2- 172.21.15.81:0/1137228216 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f6168066f30 0x7f61680693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f61880aebb0 tx=0x7f6178017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:36.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:36.872+0000 7f617effd700 1 -- 172.21.15.81:0/1137228216 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6170050f90 con 0x7f61881557f0 2023-10-06T03:23:37.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.063+0000 7f618d5ff700 1 -- 172.21.15.81:0/1137228216 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f61880b1cc0 con 0x7f61881557f0 2023-10-06T03:23:37.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.064+0000 7f617effd700 1 -- 172.21.15.81:0/1137228216 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+13600 (secure 0 0 0) 0x7f6170017090 con 0x7f61881557f0 2023-10-06T03:23:37.065 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:23:37.065 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":16,"fsid":"1807b5d7-9be8-43ad-aaf8-99a4273430b3","created":"2023-10-06T03:23:20.805306+0000","modified":"2023-10-06T03:23:35.863689+0000","last_up_change":"2023-10-06T03:23:32.735796+0000","last_in_change":"2023-10-06T03:23:24.109024+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:33.198850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:33.606744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"14fb667d-a677-4978-a477-80027f889d36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":85563},{"type":"v1","addr":"172.21.15.81:6818","nonce":85563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":85563},{"type":"v1","addr":"172.21.15.81:6822","nonce":85563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":85563},{"type":"v1","addr":"172.21.15.81:6830","nonce":85563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":85563},{"type":"v1","addr":"172.21.15.81:6826","nonce":85563}]},"public_addr":"172.21.15.81:6818/85563","cluster_addr":"172.21.15.81:6822/85563","heartbeat_back_addr":"172.21.15.81:6830/85563","heartbeat_front_addr":"172.21.15.81:6826/85563","state":["exists","up"]},{"osd":1,"uuid":"974d8a86-1829-4176-89ce-18e6038857f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":85561},{"type":"v1","addr":"172.21.15.81:6801","nonce":85561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":85561},{"type":"v1","addr":"172.21.15.81:6803","nonce":85561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":85561},{"type":"v1","addr":"172.21.15.81:6807","nonce":85561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":85561},{"type":"v1","addr":"172.21.15.81:6805","nonce":85561}]},"public_addr":"172.21.15.81:6801/85561","cluster_addr":"172.21.15.81:6803/85561","heartbeat_back_addr":"172.21.15.81:6807/85561","heartbeat_front_addr":"172.21.15.81:6805/85561","state":["exists","up"]},{"osd":2,"uuid":"ffbfe056-46bc-46e0-bf49-4d8f8650e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":85564},{"type":"v1","addr":"172.21.15.81:6809","nonce":85564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":85564},{"type":"v1","addr":"172.21.15.81:6811","nonce":85564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":85564},{"type":"v1","addr":"172.21.15.81:6815","nonce":85564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":85564},{"type":"v1","addr":"172.21.15.81:6813","nonce":85564}]},"public_addr":"172.21.15.81:6809/85564","cluster_addr":"172.21.15.81:6811/85564","heartbeat_back_addr":"172.21.15.81:6815/85564","heartbeat_front_addr":"172.21.15.81:6813/85564","state":["exists","up"]},{"osd":3,"uuid":"ef9a8314-3d37-4ea1-858a-e704d5695002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":85562},{"type":"v1","addr":"172.21.15.81:6819","nonce":85562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":85562},{"type":"v1","addr":"172.21.15.81:6823","nonce":85562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":85562},{"type":"v1","addr":"172.21.15.81:6831","nonce":85562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":85562},{"type":"v1","addr":"172.21.15.81:6827","nonce":85562}]},"public_addr":"172.21.15.81:6819/85562","cluster_addr":"172.21.15.81:6823/85562","heartbeat_back_addr":"172.21.15.81:6831/85562","heartbeat_front_addr":"172.21.15.81:6827/85562","state":["exists","up"]},{"osd":4,"uuid":"d83506a0-2c96-4bcb-a9fa-05e43dc329df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":85785},{"type":"v1","addr":"172.21.15.83:6801","nonce":85785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":85785},{"type":"v1","addr":"172.21.15.83:6803","nonce":85785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":85785},{"type":"v1","addr":"172.21.15.83:6807","nonce":85785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":85785},{"type":"v1","addr":"172.21.15.83:6805","nonce":85785}]},"public_addr":"172.21.15.83:6801/85785","cluster_addr":"172.21.15.83:6803/85785","heartbeat_back_addr":"172.21.15.83:6807/85785","heartbeat_front_addr":"172.21.15.83:6805/85785","state":["exists","up"]},{"osd":5,"uuid":"10687c63-a3d5-472f-acc0-4f61847b6e0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":85818},{"type":"v1","addr":"172.21.15.83:6825","nonce":85818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":85818},{"type":"v1","addr":"172.21.15.83:6827","nonce":85818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":85818},{"type":"v1","addr":"172.21.15.83:6831","nonce":85818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":85818},{"type":"v1","addr":"172.21.15.83:6829","nonce":85818}]},"public_addr":"172.21.15.83:6825/85818","cluster_addr":"172.21.15.83:6827/85818","heartbeat_back_addr":"172.21.15.83:6831/85818","heartbeat_front_addr":"172.21.15.83:6829/85818","state":["exists","up"]},{"osd":6,"uuid":"2e9daf76-5607-4a29-9a58-6e270700d223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":85787},{"type":"v1","addr":"172.21.15.83:6811","nonce":85787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":85787},{"type":"v1","addr":"172.21.15.83:6815","nonce":85787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":85787},{"type":"v1","addr":"172.21.15.83:6823","nonce":85787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6817","nonce":85787},{"type":"v1","addr":"172.21.15.83:6819","nonce":85787}]},"public_addr":"172.21.15.83:6811/85787","cluster_addr":"172.21.15.83:6815/85787","heartbeat_back_addr":"172.21.15.83:6823/85787","heartbeat_front_addr":"172.21.15.83:6819/85787","state":["exists","up"]},{"osd":7,"uuid":"5019e1ff-233a-4a5a-91ca-8afccb7ab6e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":85786},{"type":"v1","addr":"172.21.15.83:6810","nonce":85786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":85786},{"type":"v1","addr":"172.21.15.83:6814","nonce":85786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":85786},{"type":"v1","addr":"172.21.15.83:6822","nonce":85786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":85786},{"type":"v1","addr":"172.21.15.83:6818","nonce":85786}]},"public_addr":"172.21.15.83:6810/85786","cluster_addr":"172.21.15.83:6814/85786","heartbeat_back_addr":"172.21.15.83:6822/85786","heartbeat_front_addr":"172.21.15.83:6818/85786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.393431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.360031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.407428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.391613+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.403211+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.438142+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.496181+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.472323+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:23:37.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.066+0000 7f618d5ff700 1 -- 172.21.15.81:0/1137228216 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f6168066f30 msgr2=0x7f61680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:37.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.066+0000 7f618d5ff700 1 --2- 172.21.15.81:0/1137228216 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f6168066f30 0x7f61680693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f61880aebb0 tx=0x7f6178017000 comp rx=0 tx=0).stop 2023-10-06T03:23:37.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.066+0000 7f618d5ff700 1 -- 172.21.15.81:0/1137228216 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61881557f0 msgr2=0x7f61880c9c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:37.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.066+0000 7f618d5ff700 1 --2- 172.21.15.81:0/1137228216 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61881557f0 0x7f61880c9c20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f61700011e0 tx=0x7f6170007e10 comp rx=0 tx=0).stop 2023-10-06T03:23:37.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.067+0000 7f618d5ff700 1 -- 172.21.15.81:0/1137228216 shutdown_connections 2023-10-06T03:23:37.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.067+0000 7f618d5ff700 1 --2- 172.21.15.81:0/1137228216 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6188155bc0 0x7f61880ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:37.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.067+0000 7f618d5ff700 1 --2- 172.21.15.81:0/1137228216 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f6168066f30 0x7f61680693e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:37.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.067+0000 7f618d5ff700 1 --2- 172.21.15.81:0/1137228216 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6188069ee0 0x7f6188141a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:37.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.067+0000 7f618d5ff700 1 --2- 172.21.15.81:0/1137228216 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61881557f0 0x7f61880c9c20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:37.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.067+0000 7f618d5ff700 1 -- 172.21.15.81:0/1137228216 >> 172.21.15.81:0/1137228216 conn(0x7f61880cc090 msgr2=0x7f6188157e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:37.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.067+0000 7f618d5ff700 1 -- 172.21.15.81:0/1137228216 shutdown_connections 2023-10-06T03:23:37.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.067+0000 7f618d5ff700 1 -- 172.21.15.81:0/1137228216 wait complete. 2023-10-06T03:23:37.085 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:23:33.198850+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:23:33.606744+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T03:23:37.086 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:23:37.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.268+0000 7f910bbff700 1 Processor -- start 2023-10-06T03:23:37.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.268+0000 7f910bbff700 1 -- start start 2023-10-06T03:23:37.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.270+0000 7f910bbff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9104159890 0x7f9104068990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:37.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.270+0000 7f910bbff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f910406b3a0 0x7f910406b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:37.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.270+0000 7f910bbff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9104068500 con 0x7f91041594c0 2023-10-06T03:23:37.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.270+0000 7f910bbff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f910406bd60 con 0x7f910406b3a0 2023-10-06T03:23:37.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.270+0000 7f910bbff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91040aa940 con 0x7f9104159890 2023-10-06T03:23:37.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.270+0000 7f910999b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f91041594c0 0x7f910406c0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:55208/0 (socket says 172.21.15.81:55208) 2023-10-06T03:23:37.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.270+0000 7f910999b700 1 -- 172.21.15.81:0/1323045752 learned_addr learned my addr 172.21.15.81:0/1323045752 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:23:37.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.270+0000 7f910919a700 1 --2- 172.21.15.81:0/1323045752 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9104159890 0x7f9104068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:37.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.270+0000 7f910a19c700 1 --2- 172.21.15.81:0/1323045752 >> v2:172.21.15.83:3300/0 conn(0x7f910406b3a0 0x7f910406b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:37.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.270+0000 7f9108999700 1 -- 172.21.15.81:0/1323045752 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3203656120 0 0) 0x7f9104068500 con 0x7f91041594c0 2023-10-06T03:23:37.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.270+0000 7f9108999700 1 -- 172.21.15.81:0/1323045752 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90f0003570 con 0x7f91041594c0 2023-10-06T03:23:37.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.270+0000 7f910919a700 1 -- 172.21.15.81:0/1323045752 >> v2:172.21.15.83:3300/0 conn(0x7f910406b3a0 msgr2=0x7f910406b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:37.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.270+0000 7f910919a700 1 --2- 172.21.15.81:0/1323045752 >> v2:172.21.15.83:3300/0 conn(0x7f910406b3a0 0x7f910406b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:37.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.270+0000 7f910919a700 1 -- 172.21.15.81:0/1323045752 >> v1:172.21.15.81:6789/0 conn(0x7f91041594c0 legacy=0x7f910406c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:37.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.271+0000 7f910919a700 1 -- 172.21.15.81:0/1323045752 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91040aa380 con 0x7f9104159890 2023-10-06T03:23:37.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.271+0000 7f910a19c700 1 --2- 172.21.15.81:0/1323045752 >> v2:172.21.15.83:3300/0 conn(0x7f910406b3a0 0x7f910406b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:23:37.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.271+0000 7f910919a700 1 --2- 172.21.15.81:0/1323045752 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9104159890 0x7f9104068990 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f90f40098e0 tx=0x7f90f40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2aac3238737a1ce7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:37.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.271+0000 7f9108999700 1 -- 172.21.15.81:0/1323045752 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f4011630 con 0x7f9104159890 2023-10-06T03:23:37.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.271+0000 7f9108999700 1 -- 172.21.15.81:0/1323045752 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90f4011790 con 0x7f9104159890 2023-10-06T03:23:37.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.271+0000 7f9108999700 1 -- 172.21.15.81:0/1323045752 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f4011b30 con 0x7f9104159890 2023-10-06T03:23:37.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.271+0000 7f910bbff700 1 -- 172.21.15.81:0/1323045752 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9104159890 msgr2=0x7f9104068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:37.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.271+0000 7f910bbff700 1 --2- 172.21.15.81:0/1323045752 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9104159890 0x7f9104068990 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f90f40098e0 tx=0x7f90f40091a0 comp rx=0 tx=0).stop 2023-10-06T03:23:37.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.272+0000 7f910bbff700 1 -- 172.21.15.81:0/1323045752 shutdown_connections 2023-10-06T03:23:37.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.272+0000 7f910bbff700 1 --2- 172.21.15.81:0/1323045752 >> v2:172.21.15.83:3300/0 conn(0x7f910406b3a0 0x7f910406b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:37.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.272+0000 7f910bbff700 1 --2- 172.21.15.81:0/1323045752 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9104159890 0x7f9104068990 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:37.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.272+0000 7f910bbff700 1 -- 172.21.15.81:0/1323045752 >> 172.21.15.81:0/1323045752 conn(0x7f910406a910 msgr2=0x7f91040ae4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:37.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.272+0000 7f910bbff700 1 -- 172.21.15.81:0/1323045752 shutdown_connections 2023-10-06T03:23:37.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.272+0000 7f910bbff700 1 -- 172.21.15.81:0/1323045752 wait complete. 2023-10-06T03:23:37.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.273+0000 7f910bbff700 1 Processor -- start 2023-10-06T03:23:37.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.273+0000 7f910bbff700 1 -- start start 2023-10-06T03:23:37.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.274+0000 7f910bbff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f910406b3a0 0x7f9104141270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:37.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.274+0000 7f910bbff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f91041594c0 0x7f910415b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:37.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.274+0000 7f910bbff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9104159890 0x7f910415be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:37.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.274+0000 7f910bbff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f910415e6d0 con 0x7f9104159890 2023-10-06T03:23:37.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.274+0000 7f910bbff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f910415dac0 con 0x7f910406b3a0 2023-10-06T03:23:37.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.274+0000 7f910bbff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f910415dda0 con 0x7f91041594c0 2023-10-06T03:23:37.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.274+0000 7f910a19c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9104159890 0x7f910415be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:37.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.274+0000 7f910a19c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9104159890 0x7f910415be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44322/0 (socket says 172.21.15.81:44322) 2023-10-06T03:23:37.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.274+0000 7f910a19c700 1 -- 172.21.15.81:0/3069812365 learned_addr learned my addr 172.21.15.81:0/3069812365 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:37.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.275+0000 7f910a19c700 1 -- 172.21.15.81:0/3069812365 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f91041594c0 msgr2=0x7f910415b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:37.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.275+0000 7f910a19c700 1 --2- 172.21.15.81:0/3069812365 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f91041594c0 0x7f910415b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:37.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.275+0000 7f910a19c700 1 -- 172.21.15.81:0/3069812365 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f910406b3a0 msgr2=0x7f9104141270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:37.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.275+0000 7f910a19c700 1 --2- 172.21.15.81:0/3069812365 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f910406b3a0 0x7f9104141270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:37.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.275+0000 7f910a19c700 1 -- 172.21.15.81:0/3069812365 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90fc009a20 con 0x7f9104159890 2023-10-06T03:23:37.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.275+0000 7f910a19c700 1 --2- 172.21.15.81:0/3069812365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9104159890 0x7f910415be50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f90fc009fc0 tx=0x7f90fc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:37.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.275+0000 7f90f9ffb700 1 -- 172.21.15.81:0/3069812365 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90fc00ccd0 con 0x7f9104159890 2023-10-06T03:23:37.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.275+0000 7f90f9ffb700 1 -- 172.21.15.81:0/3069812365 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90fc00f040 con 0x7f9104159890 2023-10-06T03:23:37.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.275+0000 7f90f9ffb700 1 -- 172.21.15.81:0/3069812365 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90fc0146d0 con 0x7f9104159890 2023-10-06T03:23:37.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.275+0000 7f910bbff700 1 -- 172.21.15.81:0/3069812365 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90f4009420 con 0x7f9104159890 2023-10-06T03:23:37.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.275+0000 7f910bbff700 1 -- 172.21.15.81:0/3069812365 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f910415e360 con 0x7f9104159890 2023-10-06T03:23:37.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.276+0000 7f910bbff700 1 -- 172.21.15.81:0/3069812365 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f910404c3c0 con 0x7f9104159890 2023-10-06T03:23:37.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.277+0000 7f90f9ffb700 1 -- 172.21.15.81:0/3069812365 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f90fc003020 con 0x7f9104159890 2023-10-06T03:23:37.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.279+0000 7f90f9ffb700 1 --2- 172.21.15.81:0/3069812365 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f90e8066f30 0x7f90e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:37.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.279+0000 7f90f9ffb700 1 -- 172.21.15.81:0/3069812365 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f90fc084df0 con 0x7f9104159890 2023-10-06T03:23:37.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.279+0000 7f910999b700 1 --2- 172.21.15.81:0/3069812365 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f90e8066f30 0x7f90e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:37.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.279+0000 7f910999b700 1 --2- 172.21.15.81:0/3069812365 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f90e8066f30 0x7f90e80693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f91000058d0 tx=0x7f91000079d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:37.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.283+0000 7f90f9ffb700 1 -- 172.21.15.81:0/3069812365 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f90fc0521b0 con 0x7f9104159890 2023-10-06T03:23:37.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.471+0000 7f910bbff700 1 -- 172.21.15.81:0/3069812365 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f91040aa660 con 0x7f9104159890 2023-10-06T03:23:37.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.471+0000 7f90f9ffb700 1 -- 172.21.15.81:0/3069812365 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7f90fc0557d0 con 0x7f9104159890 2023-10-06T03:23:37.472 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-10-06T03:23:37.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.473+0000 7f910bbff700 1 -- 172.21.15.81:0/3069812365 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f90e8066f30 msgr2=0x7f90e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:37.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.473+0000 7f910bbff700 1 --2- 172.21.15.81:0/3069812365 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f90e8066f30 0x7f90e80693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f91000058d0 tx=0x7f91000079d0 comp rx=0 tx=0).stop 2023-10-06T03:23:37.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.473+0000 7f910bbff700 1 -- 172.21.15.81:0/3069812365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9104159890 msgr2=0x7f910415be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:37.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.473+0000 7f910bbff700 1 --2- 172.21.15.81:0/3069812365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9104159890 0x7f910415be50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f90fc009fc0 tx=0x7f90fc00b040 comp rx=0 tx=0).stop 2023-10-06T03:23:37.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.473+0000 7f910bbff700 1 -- 172.21.15.81:0/3069812365 shutdown_connections 2023-10-06T03:23:37.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.473+0000 7f910bbff700 1 --2- 172.21.15.81:0/3069812365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9104159890 0x7f910415be50 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:37.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.473+0000 7f910bbff700 1 --2- 172.21.15.81:0/3069812365 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f910406b3a0 0x7f9104141270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:37.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.473+0000 7f910bbff700 1 --2- 172.21.15.81:0/3069812365 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f90e8066f30 0x7f90e80693e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:37.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.473+0000 7f910bbff700 1 --2- 172.21.15.81:0/3069812365 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f91041594c0 0x7f910415b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:37.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.473+0000 7f910bbff700 1 -- 172.21.15.81:0/3069812365 >> 172.21.15.81:0/3069812365 conn(0x7f910406a910 msgr2=0x7f91041549e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:37.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.474+0000 7f910bbff700 1 -- 172.21.15.81:0/3069812365 shutdown_connections 2023-10-06T03:23:37.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.474+0000 7f910bbff700 1 -- 172.21.15.81:0/3069812365 wait complete. 2023-10-06T03:23:37.492 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:23:37.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.674+0000 7f362599d700 1 Processor -- start 2023-10-06T03:23:37.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.674+0000 7f362599d700 1 -- start start 2023-10-06T03:23:37.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.675+0000 7f362599d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f36201535a0 0x7f362015ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:37.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.675+0000 7f362599d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f362015a560 0x7f3620153970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:37.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.675+0000 7f362599d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f362015bef0 con 0x7f3620157670 2023-10-06T03:23:37.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.675+0000 7f362599d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36200d1160 con 0x7f36201535a0 2023-10-06T03:23:37.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.675+0000 7f362599d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f362015a9b0 con 0x7f362015a560 2023-10-06T03:23:37.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.675+0000 7f362519c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3620157670 0x7f36200b1cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:55218/0 (socket says 172.21.15.81:55218) 2023-10-06T03:23:37.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.675+0000 7f362519c700 1 -- 172.21.15.81:0/1239461965 learned_addr learned my addr 172.21.15.81:0/1239461965 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:23:37.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.676+0000 7f361ffff700 1 --2- 172.21.15.81:0/1239461965 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f362015a560 0x7f3620153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:37.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.676+0000 7f362499b700 1 --2- 172.21.15.81:0/1239461965 >> v2:172.21.15.83:3300/0 conn(0x7f36201535a0 0x7f362015ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:37.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.676+0000 7f361f7fe700 1 -- 172.21.15.81:0/1239461965 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4067481995 0 0) 0x7f362015bef0 con 0x7f3620157670 2023-10-06T03:23:37.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.676+0000 7f361f7fe700 1 -- 172.21.15.81:0/1239461965 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3610003570 con 0x7f3620157670 2023-10-06T03:23:37.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.676+0000 7f361ffff700 1 -- 172.21.15.81:0/1239461965 >> v2:172.21.15.83:3300/0 conn(0x7f36201535a0 msgr2=0x7f362015ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:37.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.676+0000 7f361ffff700 1 --2- 172.21.15.81:0/1239461965 >> v2:172.21.15.83:3300/0 conn(0x7f36201535a0 0x7f362015ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:37.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.676+0000 7f361ffff700 1 -- 172.21.15.81:0/1239461965 >> v1:172.21.15.81:6789/0 conn(0x7f3620157670 legacy=0x7f36200b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:37.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.676+0000 7f361ffff700 1 -- 172.21.15.81:0/1239461965 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3620153eb0 con 0x7f362015a560 2023-10-06T03:23:37.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.676+0000 7f361ffff700 1 --2- 172.21.15.81:0/1239461965 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f362015a560 0x7f3620153970 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f360c0098e0 tx=0x7f360c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69a2a8ecc57811d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:37.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.676+0000 7f361f7fe700 1 -- 172.21.15.81:0/1239461965 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360c011630 con 0x7f362015a560 2023-10-06T03:23:37.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.676+0000 7f361f7fe700 1 -- 172.21.15.81:0/1239461965 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f360c011790 con 0x7f362015a560 2023-10-06T03:23:37.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.676+0000 7f361f7fe700 1 -- 172.21.15.81:0/1239461965 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360c011b30 con 0x7f362015a560 2023-10-06T03:23:37.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.677+0000 7f362599d700 1 -- 172.21.15.81:0/1239461965 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f362015a560 msgr2=0x7f3620153970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:37.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.677+0000 7f362599d700 1 --2- 172.21.15.81:0/1239461965 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f362015a560 0x7f3620153970 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f360c0098e0 tx=0x7f360c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:23:37.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.677+0000 7f362599d700 1 -- 172.21.15.81:0/1239461965 shutdown_connections 2023-10-06T03:23:37.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.677+0000 7f362599d700 1 --2- 172.21.15.81:0/1239461965 >> v2:172.21.15.83:3300/0 conn(0x7f36201535a0 0x7f362015ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:37.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.677+0000 7f362599d700 1 --2- 172.21.15.81:0/1239461965 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f362015a560 0x7f3620153970 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:37.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.677+0000 7f362599d700 1 -- 172.21.15.81:0/1239461965 >> 172.21.15.81:0/1239461965 conn(0x7f3620068230 msgr2=0x7f3620068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:37.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.677+0000 7f362599d700 1 -- 172.21.15.81:0/1239461965 shutdown_connections 2023-10-06T03:23:37.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.677+0000 7f362599d700 1 -- 172.21.15.81:0/1239461965 wait complete. 2023-10-06T03:23:37.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.678+0000 7f362599d700 1 Processor -- start 2023-10-06T03:23:37.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.679+0000 7f362599d700 1 -- start start 2023-10-06T03:23:37.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.679+0000 7f362599d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36201535a0 0x7f362013f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:37.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.679+0000 7f362599d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3620157670 0x7f362013ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:37.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.679+0000 7f362599d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f362015a560 0x7f362015c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:37.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.679+0000 7f362599d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f362015dfd0 con 0x7f362015a560 2023-10-06T03:23:37.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.679+0000 7f362599d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f362015d3c0 con 0x7f36201535a0 2023-10-06T03:23:37.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.679+0000 7f362599d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f362015d6a0 con 0x7f3620157670 2023-10-06T03:23:37.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.680+0000 7f362519c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f362015a560 0x7f362015c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:37.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.680+0000 7f362519c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f362015a560 0x7f362015c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44326/0 (socket says 172.21.15.81:44326) 2023-10-06T03:23:37.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.680+0000 7f362519c700 1 -- 172.21.15.81:0/1313972447 learned_addr learned my addr 172.21.15.81:0/1313972447 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:37.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.680+0000 7f361ffff700 1 --2- 172.21.15.81:0/1313972447 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3620157670 0x7f362013ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:37.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.680+0000 7f362499b700 1 --2- 172.21.15.81:0/1313972447 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36201535a0 0x7f362013f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:37.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.680+0000 7f362519c700 1 -- 172.21.15.81:0/1313972447 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3620157670 msgr2=0x7f362013ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:37.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.680+0000 7f362519c700 1 --2- 172.21.15.81:0/1313972447 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3620157670 0x7f362013ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:37.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.680+0000 7f362519c700 1 -- 172.21.15.81:0/1313972447 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36201535a0 msgr2=0x7f362013f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:37.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.680+0000 7f362519c700 1 --2- 172.21.15.81:0/1313972447 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36201535a0 0x7f362013f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:37.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.680+0000 7f362519c700 1 -- 172.21.15.81:0/1313972447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f360c009420 con 0x7f362015a560 2023-10-06T03:23:37.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.680+0000 7f362519c700 1 --2- 172.21.15.81:0/1313972447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f362015a560 0x7f362015c9e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3618001460 tx=0x7f3618001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:37.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.680+0000 7f361cff9700 1 -- 172.21.15.81:0/1313972447 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f361800a890 con 0x7f362015a560 2023-10-06T03:23:37.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.681+0000 7f361cff9700 1 -- 172.21.15.81:0/1313972447 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f361800a9f0 con 0x7f362015a560 2023-10-06T03:23:37.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.681+0000 7f361cff9700 1 -- 172.21.15.81:0/1313972447 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f361800ad70 con 0x7f362015a560 2023-10-06T03:23:37.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.681+0000 7f362599d700 1 -- 172.21.15.81:0/1313972447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f362015d980 con 0x7f362015a560 2023-10-06T03:23:37.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.681+0000 7f362599d700 1 -- 172.21.15.81:0/1313972447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f362013f200 con 0x7f362015a560 2023-10-06T03:23:37.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.682+0000 7f362599d700 1 -- 172.21.15.81:0/1313972447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f362004c3c0 con 0x7f362015a560 2023-10-06T03:23:37.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.682+0000 7f361cff9700 1 -- 172.21.15.81:0/1313972447 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3618007300 con 0x7f362015a560 2023-10-06T03:23:37.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.683+0000 7f361cff9700 1 --2- 172.21.15.81:0/1313972447 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f3604066f30 0x7f36040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:37.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.683+0000 7f361cff9700 1 -- 172.21.15.81:0/1313972447 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f36180847b0 con 0x7f362015a560 2023-10-06T03:23:37.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.683+0000 7f362499b700 1 --2- 172.21.15.81:0/1313972447 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f3604066f30 0x7f36040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:37.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.684+0000 7f362499b700 1 --2- 172.21.15.81:0/1313972447 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f3604066f30 0x7f36040693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3614009db0 tx=0x7f36140091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:37.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.687+0000 7f361cff9700 1 -- 172.21.15.81:0/1313972447 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3618051b60 con 0x7f362015a560 2023-10-06T03:23:37.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.883+0000 7f362599d700 1 -- 172.21.15.81:0/1313972447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f362015e110 con 0x7f362015a560 2023-10-06T03:23:37.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.883+0000 7f361cff9700 1 -- 172.21.15.81:0/1313972447 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3618055180 con 0x7f362015a560 2023-10-06T03:23:37.885 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-06T03:23:37.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.885+0000 7f362599d700 1 -- 172.21.15.81:0/1313972447 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f3604066f30 msgr2=0x7f36040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:37.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.885+0000 7f362599d700 1 --2- 172.21.15.81:0/1313972447 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f3604066f30 0x7f36040693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3614009db0 tx=0x7f36140091a0 comp rx=0 tx=0).stop 2023-10-06T03:23:37.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.885+0000 7f362599d700 1 -- 172.21.15.81:0/1313972447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f362015a560 msgr2=0x7f362015c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:37.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.885+0000 7f362599d700 1 --2- 172.21.15.81:0/1313972447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f362015a560 0x7f362015c9e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3618001460 tx=0x7f3618001ae0 comp rx=0 tx=0).stop 2023-10-06T03:23:37.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.885+0000 7f362599d700 1 -- 172.21.15.81:0/1313972447 shutdown_connections 2023-10-06T03:23:37.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.885+0000 7f362599d700 1 --2- 172.21.15.81:0/1313972447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f362015a560 0x7f362015c9e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:37.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.885+0000 7f362599d700 1 --2- 172.21.15.81:0/1313972447 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36201535a0 0x7f362013f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:37.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.885+0000 7f362599d700 1 --2- 172.21.15.81:0/1313972447 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f3604066f30 0x7f36040693e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:37.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.886+0000 7f362599d700 1 --2- 172.21.15.81:0/1313972447 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3620157670 0x7f362013ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:37.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.886+0000 7f362599d700 1 -- 172.21.15.81:0/1313972447 >> 172.21.15.81:0/1313972447 conn(0x7f3620068230 msgr2=0x7f3620159ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:37.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.886+0000 7f362599d700 1 -- 172.21.15.81:0/1313972447 shutdown_connections 2023-10-06T03:23:37.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:37.886+0000 7f362599d700 1 -- 172.21.15.81:0/1313972447 wait complete. 2023-10-06T03:23:37.904 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T03:23:38.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.084+0000 7f97b79ff700 1 Processor -- start 2023-10-06T03:23:38.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.084+0000 7f97b79ff700 1 -- start start 2023-10-06T03:23:38.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.085+0000 7f97b79ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f97b01557f0 0x7f97b0156c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:38.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.085+0000 7f97b79ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f97b0155bc0 0x7f97b00c6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:38.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.085+0000 7f97b79ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f97b0069ee0 0x7f97b006a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:38.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.085+0000 7f97b79ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97b006df20 con 0x7f97b0155bc0 2023-10-06T03:23:38.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.085+0000 7f97b79ff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97b00c9c60 con 0x7f97b0069ee0 2023-10-06T03:23:38.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.085+0000 7f97b79ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97b006dc60 con 0x7f97b01557f0 2023-10-06T03:23:38.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.086+0000 7f97b4f9a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f97b0155bc0 0x7f97b00c6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:38.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.086+0000 7f97b4f9a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f97b0155bc0 0x7f97b00c6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44336/0 (socket says 172.21.15.81:44336) 2023-10-06T03:23:38.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.086+0000 7f97b4f9a700 1 -- 172.21.15.81:0/1842920187 learned_addr learned my addr 172.21.15.81:0/1842920187 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:38.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.086+0000 7f97b5f9c700 1 --2- 172.21.15.81:0/1842920187 >> v2:172.21.15.83:3300/0 conn(0x7f97b0069ee0 0x7f97b006a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:38.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.086+0000 7f97b579b700 1 --2- 172.21.15.81:0/1842920187 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f97b01557f0 0x7f97b0156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:38.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.086+0000 7f97b4f9a700 1 -- 172.21.15.81:0/1842920187 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f97b01557f0 msgr2=0x7f97b0156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:38.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.086+0000 7f97b4f9a700 1 --2- 172.21.15.81:0/1842920187 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f97b01557f0 0x7f97b0156c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:38.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.086+0000 7f97b4f9a700 1 -- 172.21.15.81:0/1842920187 >> v2:172.21.15.83:3300/0 conn(0x7f97b0069ee0 msgr2=0x7f97b006a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:38.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.086+0000 7f97b4f9a700 1 --2- 172.21.15.81:0/1842920187 >> v2:172.21.15.83:3300/0 conn(0x7f97b0069ee0 0x7f97b006a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:38.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.086+0000 7f97b4f9a700 1 -- 172.21.15.81:0/1842920187 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b006a880 con 0x7f97b0155bc0 2023-10-06T03:23:38.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.086+0000 7f97b579b700 1 --2- 172.21.15.81:0/1842920187 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f97b01557f0 0x7f97b0156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:23:38.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.086+0000 7f97b4f9a700 1 --2- 172.21.15.81:0/1842920187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97b0155bc0 0x7f97b00c6cb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f97b00cc040 tx=0x7f97a0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=716a246e19548e60 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:38.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.086+0000 7f97a7fff700 1 -- 172.21.15.81:0/1842920187 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a000b860 con 0x7f97b0155bc0 2023-10-06T03:23:38.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.087+0000 7f97a7fff700 1 -- 172.21.15.81:0/1842920187 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a000b9c0 con 0x7f97b0155bc0 2023-10-06T03:23:38.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.087+0000 7f97a7fff700 1 -- 172.21.15.81:0/1842920187 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a000bd60 con 0x7f97b0155bc0 2023-10-06T03:23:38.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.087+0000 7f97b79ff700 1 -- 172.21.15.81:0/1842920187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97b0155bc0 msgr2=0x7f97b00c6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:38.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.087+0000 7f97b79ff700 1 --2- 172.21.15.81:0/1842920187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97b0155bc0 0x7f97b00c6cb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f97b00cc040 tx=0x7f97a0009250 comp rx=0 tx=0).stop 2023-10-06T03:23:38.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.087+0000 7f97b79ff700 1 -- 172.21.15.81:0/1842920187 shutdown_connections 2023-10-06T03:23:38.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.087+0000 7f97b79ff700 1 --2- 172.21.15.81:0/1842920187 >> v2:172.21.15.83:3300/0 conn(0x7f97b0069ee0 0x7f97b006a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:38.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.087+0000 7f97b79ff700 1 --2- 172.21.15.81:0/1842920187 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f97b01557f0 0x7f97b0156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:38.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.087+0000 7f97b79ff700 1 --2- 172.21.15.81:0/1842920187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97b0155bc0 0x7f97b00c6cb0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:38.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.087+0000 7f97b79ff700 1 -- 172.21.15.81:0/1842920187 >> 172.21.15.81:0/1842920187 conn(0x7f97b00cc090 msgr2=0x7f97b00cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:38.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.087+0000 7f97b79ff700 1 -- 172.21.15.81:0/1842920187 shutdown_connections 2023-10-06T03:23:38.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.087+0000 7f97b79ff700 1 -- 172.21.15.81:0/1842920187 wait complete. 2023-10-06T03:23:38.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.089+0000 7f97b79ff700 1 Processor -- start 2023-10-06T03:23:38.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.089+0000 7f97b79ff700 1 -- start start 2023-10-06T03:23:38.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.090+0000 7f97b79ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f97b0069ee0 0x7f97b0158830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:38.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.090+0000 7f97b79ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f97b01557f0 0x7f97b0143f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:38.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.090+0000 7f97b79ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97b0155bc0 0x7f97b00aee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:38.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.090+0000 7f97b79ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b00c5c10 con 0x7f97b0155bc0 2023-10-06T03:23:38.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.090+0000 7f97b79ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b00c5000 con 0x7f97b0069ee0 2023-10-06T03:23:38.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.090+0000 7f97b79ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97b00c52e0 con 0x7f97b01557f0 2023-10-06T03:23:38.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.090+0000 7f97b5f9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97b0155bc0 0x7f97b00aee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:38.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.090+0000 7f97b5f9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97b0155bc0 0x7f97b00aee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44338/0 (socket says 172.21.15.81:44338) 2023-10-06T03:23:38.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.090+0000 7f97b5f9c700 1 -- 172.21.15.81:0/2982057290 learned_addr learned my addr 172.21.15.81:0/2982057290 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:38.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.090+0000 7f97b579b700 1 --2- 172.21.15.81:0/2982057290 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f97b0069ee0 0x7f97b0158830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:38.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.090+0000 7f97b4f9a700 1 --2- 172.21.15.81:0/2982057290 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f97b01557f0 0x7f97b0143f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:38.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.090+0000 7f97b5f9c700 1 -- 172.21.15.81:0/2982057290 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f97b01557f0 msgr2=0x7f97b0143f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:38.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.090+0000 7f97b5f9c700 1 --2- 172.21.15.81:0/2982057290 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f97b01557f0 0x7f97b0143f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:38.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.090+0000 7f97b5f9c700 1 -- 172.21.15.81:0/2982057290 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f97b0069ee0 msgr2=0x7f97b0158830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:38.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.090+0000 7f97b5f9c700 1 --2- 172.21.15.81:0/2982057290 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f97b0069ee0 0x7f97b0158830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:38.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.090+0000 7f97b5f9c700 1 -- 172.21.15.81:0/2982057290 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a00094f0 con 0x7f97b0155bc0 2023-10-06T03:23:38.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.091+0000 7f97b5f9c700 1 --2- 172.21.15.81:0/2982057290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97b0155bc0 0x7f97b00aee30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f97a8007f20 tx=0x7f97a8009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:38.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.091+0000 7f97a57fa700 1 -- 172.21.15.81:0/2982057290 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a800eb90 con 0x7f97b0155bc0 2023-10-06T03:23:38.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.091+0000 7f97a57fa700 1 -- 172.21.15.81:0/2982057290 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a800ed10 con 0x7f97b0155bc0 2023-10-06T03:23:38.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.091+0000 7f97a57fa700 1 -- 172.21.15.81:0/2982057290 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a8014670 con 0x7f97b0155bc0 2023-10-06T03:23:38.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.091+0000 7f97b79ff700 1 -- 172.21.15.81:0/2982057290 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97b00c55c0 con 0x7f97b0155bc0 2023-10-06T03:23:38.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.091+0000 7f97b79ff700 1 -- 172.21.15.81:0/2982057290 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97b0158d70 con 0x7f97b0155bc0 2023-10-06T03:23:38.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.092+0000 7f97b79ff700 1 -- 172.21.15.81:0/2982057290 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97b004c3c0 con 0x7f97b0155bc0 2023-10-06T03:23:38.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.093+0000 7f97a57fa700 1 -- 172.21.15.81:0/2982057290 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f97a80149e0 con 0x7f97b0155bc0 2023-10-06T03:23:38.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.094+0000 7f97a57fa700 1 --2- 172.21.15.81:0/2982057290 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f9794066f30 0x7f97940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:38.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.094+0000 7f97a57fa700 1 -- 172.21.15.81:0/2982057290 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f97a80849e0 con 0x7f97b0155bc0 2023-10-06T03:23:38.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.094+0000 7f97b579b700 1 --2- 172.21.15.81:0/2982057290 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f9794066f30 0x7f97940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:38.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.094+0000 7f97b579b700 1 --2- 172.21.15.81:0/2982057290 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f9794066f30 0x7f97940693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f97ac00adc0 tx=0x7f97ac006f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:38.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.097+0000 7f97a57fa700 1 -- 172.21.15.81:0/2982057290 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f97a8051da0 con 0x7f97b0155bc0 2023-10-06T03:23:38.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.292+0000 7f97b79ff700 1 -- 172.21.15.81:0/2982057290 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f97b006ac40 con 0x7f97b0155bc0 2023-10-06T03:23:38.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.292+0000 7f97a57fa700 1 -- 172.21.15.81:0/2982057290 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+126 (secure 0 0 0) 0x7f97a80553c0 con 0x7f97b0155bc0 2023-10-06T03:23:38.293 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:23:38.293 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2023-10-06T03:23:38.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T03:23:38.294 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2023-10-06T03:23:38.294 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": "rbd" 2023-10-06T03:23:38.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T03:23:38.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T03:23:38.294 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 2, 2023-10-06T03:23:38.294 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2023-10-06T03:23:38.294 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T03:23:38.294 INFO:teuthology.orchestra.run.smithi081.stdout:] 2023-10-06T03:23:38.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.294+0000 7f97b79ff700 1 -- 172.21.15.81:0/2982057290 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f9794066f30 msgr2=0x7f97940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:38.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.294+0000 7f97b79ff700 1 --2- 172.21.15.81:0/2982057290 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f9794066f30 0x7f97940693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f97ac00adc0 tx=0x7f97ac006f90 comp rx=0 tx=0).stop 2023-10-06T03:23:38.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.294+0000 7f97b79ff700 1 -- 172.21.15.81:0/2982057290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97b0155bc0 msgr2=0x7f97b00aee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:38.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.294+0000 7f97b79ff700 1 --2- 172.21.15.81:0/2982057290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97b0155bc0 0x7f97b00aee30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f97a8007f20 tx=0x7f97a8009860 comp rx=0 tx=0).stop 2023-10-06T03:23:38.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.294+0000 7f97b79ff700 1 -- 172.21.15.81:0/2982057290 shutdown_connections 2023-10-06T03:23:38.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.294+0000 7f97b79ff700 1 --2- 172.21.15.81:0/2982057290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97b0155bc0 0x7f97b00aee30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:38.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.294+0000 7f97b79ff700 1 --2- 172.21.15.81:0/2982057290 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f97b0069ee0 0x7f97b0158830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:38.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.294+0000 7f97b79ff700 1 --2- 172.21.15.81:0/2982057290 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f9794066f30 0x7f97940693e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:38.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.295+0000 7f97b79ff700 1 --2- 172.21.15.81:0/2982057290 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f97b01557f0 0x7f97b0143f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:38.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.295+0000 7f97b79ff700 1 -- 172.21.15.81:0/2982057290 >> 172.21.15.81:0/2982057290 conn(0x7f97b00cc090 msgr2=0x7f97b0063500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:38.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.295+0000 7f97b79ff700 1 -- 172.21.15.81:0/2982057290 shutdown_connections 2023-10-06T03:23:38.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.295+0000 7f97b79ff700 1 -- 172.21.15.81:0/2982057290 wait complete. 2023-10-06T03:23:38.313 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T03:23:38.313 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T03:23:38.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.497+0000 7f8e453ff700 1 Processor -- start 2023-10-06T03:23:38.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.497+0000 7f8e453ff700 1 -- start start 2023-10-06T03:23:38.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.498+0000 7f8e453ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8e400af9b0 0x7f8e400cfe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:38.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.498+0000 7f8e453ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e400ce820 0x7f8e400ccca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:38.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.498+0000 7f8e453ff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e400cf980 con 0x7f8e400af5e0 2023-10-06T03:23:38.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.498+0000 7f8e453ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e400ced70 con 0x7f8e400af9b0 2023-10-06T03:23:38.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.498+0000 7f8e453ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e400cf050 con 0x7f8e400ce820 2023-10-06T03:23:38.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.498+0000 7f8e3e7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8e400af9b0 0x7f8e400cfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:38.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.498+0000 7f8e3e7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8e400af9b0 0x7f8e400cfe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44346/0 (socket says 172.21.15.81:44346) 2023-10-06T03:23:38.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.498+0000 7f8e3e7fc700 1 -- 172.21.15.81:0/1997878400 learned_addr learned my addr 172.21.15.81:0/1997878400 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:38.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.499+0000 7f8e3f7fe700 1 --2- 172.21.15.81:0/1997878400 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e400ce820 0x7f8e400ccca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:38.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.499+0000 7f8e3e7fc700 1 -- 172.21.15.81:0/1997878400 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e400ce820 msgr2=0x7f8e400ccca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:38.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.499+0000 7f8e3e7fc700 1 --2- 172.21.15.81:0/1997878400 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e400ce820 0x7f8e400ccca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:38.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.499+0000 7f8e3e7fc700 1 -- 172.21.15.81:0/1997878400 >> v1:172.21.15.83:6789/0 conn(0x7f8e400af5e0 legacy=0x7f8e4015db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:38.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.499+0000 7f8e3e7fc700 1 -- 172.21.15.81:0/1997878400 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e400cf330 con 0x7f8e400af9b0 2023-10-06T03:23:38.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.499+0000 7f8e3e7fc700 1 --2- 172.21.15.81:0/1997878400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e400af9b0 0x7f8e400cfe10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8e340099b0 tx=0x7f8e34009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d48e29f2b092e3c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:38.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.499+0000 7f8e3dffb700 1 -- 172.21.15.81:0/1997878400 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3400b860 con 0x7f8e400af9b0 2023-10-06T03:23:38.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.499+0000 7f8e3dffb700 1 -- 172.21.15.81:0/1997878400 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3400b9c0 con 0x7f8e400af9b0 2023-10-06T03:23:38.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.499+0000 7f8e3dffb700 1 -- 172.21.15.81:0/1997878400 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3400bd60 con 0x7f8e400af9b0 2023-10-06T03:23:38.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.500+0000 7f8e453ff700 1 -- 172.21.15.81:0/1997878400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e400af9b0 msgr2=0x7f8e400cfe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:38.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.500+0000 7f8e453ff700 1 --2- 172.21.15.81:0/1997878400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e400af9b0 0x7f8e400cfe10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8e340099b0 tx=0x7f8e34009250 comp rx=0 tx=0).stop 2023-10-06T03:23:38.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.500+0000 7f8e453ff700 1 -- 172.21.15.81:0/1997878400 shutdown_connections 2023-10-06T03:23:38.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.500+0000 7f8e453ff700 1 --2- 172.21.15.81:0/1997878400 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e400ce820 0x7f8e400ccca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:38.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.500+0000 7f8e453ff700 1 --2- 172.21.15.81:0/1997878400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e400af9b0 0x7f8e400cfe10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:38.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.500+0000 7f8e453ff700 1 -- 172.21.15.81:0/1997878400 >> 172.21.15.81:0/1997878400 conn(0x7f8e4006ed10 msgr2=0x7f8e4006f110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:38.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.500+0000 7f8e453ff700 1 -- 172.21.15.81:0/1997878400 shutdown_connections 2023-10-06T03:23:38.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.500+0000 7f8e453ff700 1 -- 172.21.15.81:0/1997878400 wait complete. 2023-10-06T03:23:38.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.501+0000 7f8e453ff700 1 Processor -- start 2023-10-06T03:23:38.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.501+0000 7f8e453ff700 1 -- start start 2023-10-06T03:23:38.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.502+0000 7f8e453ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e400af5e0 0x7f8e400b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:38.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.502+0000 7f8e453ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e400af9b0 0x7f8e40157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:38.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.502+0000 7f8e453ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e400ce820 0x7f8e4015ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:38.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.502+0000 7f8e453ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e40157660 con 0x7f8e400ce820 2023-10-06T03:23:38.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.502+0000 7f8e453ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4015b590 con 0x7f8e400af9b0 2023-10-06T03:23:38.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.502+0000 7f8e453ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4015b870 con 0x7f8e400af5e0 2023-10-06T03:23:38.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.502+0000 7f8e3f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e400ce820 0x7f8e4015ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:38.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.502+0000 7f8e3f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e400ce820 0x7f8e4015ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44352/0 (socket says 172.21.15.81:44352) 2023-10-06T03:23:38.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.502+0000 7f8e3f7fe700 1 -- 172.21.15.81:0/3998477592 learned_addr learned my addr 172.21.15.81:0/3998477592 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:38.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.503+0000 7f8e3e7fc700 1 --2- 172.21.15.81:0/3998477592 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e400af9b0 0x7f8e40157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:38.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.503+0000 7f8e3effd700 1 --2- 172.21.15.81:0/3998477592 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e400af5e0 0x7f8e400b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:38.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.503+0000 7f8e3f7fe700 1 -- 172.21.15.81:0/3998477592 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e400af5e0 msgr2=0x7f8e400b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:38.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.503+0000 7f8e3f7fe700 1 --2- 172.21.15.81:0/3998477592 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e400af5e0 0x7f8e400b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:38.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.503+0000 7f8e3f7fe700 1 -- 172.21.15.81:0/3998477592 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e400af9b0 msgr2=0x7f8e40157120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:38.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.503+0000 7f8e3f7fe700 1 --2- 172.21.15.81:0/3998477592 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e400af9b0 0x7f8e40157120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:38.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.503+0000 7f8e3f7fe700 1 -- 172.21.15.81:0/3998477592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e340094f0 con 0x7f8e400ce820 2023-10-06T03:23:38.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.503+0000 7f8e3e7fc700 1 --2- 172.21.15.81:0/3998477592 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e400af9b0 0x7f8e40157120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:23:38.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.503+0000 7f8e3f7fe700 1 --2- 172.21.15.81:0/3998477592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e400ce820 0x7f8e4015ad20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8e38007f30 tx=0x7f8e380098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:38.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.503+0000 7f8e26ffd700 1 -- 172.21.15.81:0/3998477592 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3800ecf0 con 0x7f8e400ce820 2023-10-06T03:23:38.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.503+0000 7f8e26ffd700 1 -- 172.21.15.81:0/3998477592 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3800ee50 con 0x7f8e400ce820 2023-10-06T03:23:38.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.503+0000 7f8e453ff700 1 -- 172.21.15.81:0/3998477592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e4015bb50 con 0x7f8e400ce820 2023-10-06T03:23:38.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.503+0000 7f8e26ffd700 1 -- 172.21.15.81:0/3998477592 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e38014670 con 0x7f8e400ce820 2023-10-06T03:23:38.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.503+0000 7f8e453ff700 1 -- 172.21.15.81:0/3998477592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e4015b260 con 0x7f8e400ce820 2023-10-06T03:23:38.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.504+0000 7f8e453ff700 1 -- 172.21.15.81:0/3998477592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e400c7640 con 0x7f8e400ce820 2023-10-06T03:23:38.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.505+0000 7f8e26ffd700 1 -- 172.21.15.81:0/3998477592 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8e380149e0 con 0x7f8e400ce820 2023-10-06T03:23:38.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.506+0000 7f8e26ffd700 1 --2- 172.21.15.81:0/3998477592 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f8e2c066f30 0x7f8e2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:38.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.506+0000 7f8e26ffd700 1 -- 172.21.15.81:0/3998477592 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f8e38084b90 con 0x7f8e400ce820 2023-10-06T03:23:38.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.506+0000 7f8e3effd700 1 --2- 172.21.15.81:0/3998477592 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f8e2c066f30 0x7f8e2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:38.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.507+0000 7f8e3effd700 1 --2- 172.21.15.81:0/3998477592 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f8e2c066f30 0x7f8e2c0693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8e300037c0 tx=0x7f8e30009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:38.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.510+0000 7f8e26ffd700 1 -- 172.21.15.81:0/3998477592 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8e400c7640 con 0x7f8e400ce820 2023-10-06T03:23:38.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.705+0000 7f8e453ff700 1 -- 172.21.15.81:0/3998477592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f8e400c7640 con 0x7f8e400ce820 2023-10-06T03:23:38.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.891+0000 7f8e26ffd700 1 -- 172.21.15.81:0/3998477592 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f8e400c7640 con 0x7f8e400ce820 2023-10-06T03:23:38.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.894+0000 7f8e453ff700 1 -- 172.21.15.81:0/3998477592 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f8e2c066f30 msgr2=0x7f8e2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:38.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.894+0000 7f8e453ff700 1 --2- 172.21.15.81:0/3998477592 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f8e2c066f30 0x7f8e2c0693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8e300037c0 tx=0x7f8e30009040 comp rx=0 tx=0).stop 2023-10-06T03:23:38.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.894+0000 7f8e453ff700 1 -- 172.21.15.81:0/3998477592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e400ce820 msgr2=0x7f8e4015ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:38.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.894+0000 7f8e453ff700 1 --2- 172.21.15.81:0/3998477592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e400ce820 0x7f8e4015ad20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8e38007f30 tx=0x7f8e380098e0 comp rx=0 tx=0).stop 2023-10-06T03:23:38.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.894+0000 7f8e453ff700 1 -- 172.21.15.81:0/3998477592 shutdown_connections 2023-10-06T03:23:38.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.894+0000 7f8e453ff700 1 --2- 172.21.15.81:0/3998477592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e400ce820 0x7f8e4015ad20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:38.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.894+0000 7f8e453ff700 1 --2- 172.21.15.81:0/3998477592 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f8e2c066f30 0x7f8e2c0693e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:38.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.894+0000 7f8e453ff700 1 --2- 172.21.15.81:0/3998477592 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e400af5e0 0x7f8e400b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:38.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.894+0000 7f8e453ff700 1 --2- 172.21.15.81:0/3998477592 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e400af9b0 0x7f8e40157120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:38.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.894+0000 7f8e453ff700 1 -- 172.21.15.81:0/3998477592 >> 172.21.15.81:0/3998477592 conn(0x7f8e4006ed10 msgr2=0x7f8e40158e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:38.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.894+0000 7f8e453ff700 1 -- 172.21.15.81:0/3998477592 shutdown_connections 2023-10-06T03:23:38.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:38.894+0000 7f8e453ff700 1 -- 172.21.15.81:0/3998477592 wait complete. 2023-10-06T03:23:38.901 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2023-10-06T03:23:38.917 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-10-06T03:23:39.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.103+0000 7f6af31ff700 1 Processor -- start 2023-10-06T03:23:39.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.103+0000 7f6af31ff700 1 -- start start 2023-10-06T03:23:39.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.105+0000 7f6af31ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6aec0ca640 0x7f6aec15a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:39.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.105+0000 7f6af31ff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aec0cb580 con 0x7f6aec13fd70 2023-10-06T03:23:39.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.105+0000 7f6af31ff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aec0c6800 con 0x7f6aec15ad10 2023-10-06T03:23:39.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.105+0000 7f6af31ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aec0caac0 con 0x7f6aec0ca640 2023-10-06T03:23:39.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.105+0000 7f6aebfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6aec0ca640 0x7f6aec15a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:39.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.105+0000 7f6aebfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6aec0ca640 0x7f6aec15a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44354/0 (socket says 172.21.15.81:44354) 2023-10-06T03:23:39.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.105+0000 7f6aebfff700 1 -- 172.21.15.81:0/3315405912 learned_addr learned my addr 172.21.15.81:0/3315405912 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:39.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.105+0000 7f6af0f9b700 1 --1- 172.21.15.81:0/3315405912 >> v1:172.21.15.81:6789/0 conn(0x7f6aec13fd70 0x7f6aec15a0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:55220/0 (socket says 172.21.15.81:55220) 2023-10-06T03:23:39.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.105+0000 7f6aeb7fe700 1 -- 172.21.15.81:0/3315405912 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3320969269 0 0) 0x7f6aec0cb580 con 0x7f6aec13fd70 2023-10-06T03:23:39.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.106+0000 7f6aeb7fe700 1 -- 172.21.15.81:0/3315405912 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6adc003570 con 0x7f6aec13fd70 2023-10-06T03:23:39.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.106+0000 7f6aeb7fe700 1 -- 172.21.15.81:0/3315405912 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3943905338 0 0) 0x7f6aec0c6800 con 0x7f6aec15ad10 2023-10-06T03:23:39.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.106+0000 7f6aebfff700 1 -- 172.21.15.81:0/3315405912 >> v1:172.21.15.83:6789/0 conn(0x7f6aec15ad10 legacy=0x7f6aec0c6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:39.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.106+0000 7f6aebfff700 1 -- 172.21.15.81:0/3315405912 >> v1:172.21.15.81:6789/0 conn(0x7f6aec13fd70 legacy=0x7f6aec15a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:39.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.106+0000 7f6aebfff700 1 -- 172.21.15.81:0/3315405912 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aec069880 con 0x7f6aec0ca640 2023-10-06T03:23:39.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.106+0000 7f6aebfff700 1 --2- 172.21.15.81:0/3315405912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6aec0ca640 0x7f6aec15a7d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6ad80099b0 tx=0x7f6ad8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6816c361bc931ef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:39.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.106+0000 7f6aeb7fe700 1 -- 172.21.15.81:0/3315405912 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad8009ea0 con 0x7f6aec0ca640 2023-10-06T03:23:39.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.106+0000 7f6aeb7fe700 1 -- 172.21.15.81:0/3315405912 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad800b860 con 0x7f6aec0ca640 2023-10-06T03:23:39.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.106+0000 7f6aeb7fe700 1 -- 172.21.15.81:0/3315405912 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad800bbe0 con 0x7f6aec0ca640 2023-10-06T03:23:39.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.107+0000 7f6af31ff700 1 -- 172.21.15.81:0/3315405912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6aec0ca640 msgr2=0x7f6aec15a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:39.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.107+0000 7f6af31ff700 1 --2- 172.21.15.81:0/3315405912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6aec0ca640 0x7f6aec15a7d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6ad80099b0 tx=0x7f6ad8009250 comp rx=0 tx=0).stop 2023-10-06T03:23:39.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.107+0000 7f6af31ff700 1 -- 172.21.15.81:0/3315405912 shutdown_connections 2023-10-06T03:23:39.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.107+0000 7f6af31ff700 1 --2- 172.21.15.81:0/3315405912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6aec0ca640 0x7f6aec15a7d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:39.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.107+0000 7f6af31ff700 1 -- 172.21.15.81:0/3315405912 >> 172.21.15.81:0/3315405912 conn(0x7f6aec0cc090 msgr2=0x7f6aec0cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:39.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.107+0000 7f6af31ff700 1 -- 172.21.15.81:0/3315405912 shutdown_connections 2023-10-06T03:23:39.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.107+0000 7f6af31ff700 1 -- 172.21.15.81:0/3315405912 wait complete. 2023-10-06T03:23:39.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.108+0000 7f6af31ff700 1 Processor -- start 2023-10-06T03:23:39.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.108+0000 7f6af31ff700 1 -- start start 2023-10-06T03:23:39.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.109+0000 7f6af31ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6aec0ca640 0x7f6aec14aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:39.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.109+0000 7f6af31ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6aec13fd70 0x7f6aec14ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:39.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.109+0000 7f6af31ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6aec15ad10 0x7f6aec14f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:39.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.109+0000 7f6af31ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aec155980 con 0x7f6aec15ad10 2023-10-06T03:23:39.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.109+0000 7f6af31ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aec154d70 con 0x7f6aec0ca640 2023-10-06T03:23:39.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.109+0000 7f6af31ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aec155050 con 0x7f6aec13fd70 2023-10-06T03:23:39.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.109+0000 7f6af179c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6aec15ad10 0x7f6aec14f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:39.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.109+0000 7f6af179c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6aec15ad10 0x7f6aec14f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44364/0 (socket says 172.21.15.81:44364) 2023-10-06T03:23:39.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.109+0000 7f6af179c700 1 -- 172.21.15.81:0/1644120938 learned_addr learned my addr 172.21.15.81:0/1644120938 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:39.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.110+0000 7f6aebfff700 1 --2- 172.21.15.81:0/1644120938 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6aec13fd70 0x7f6aec14ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:39.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.110+0000 7f6af0f9b700 1 --2- 172.21.15.81:0/1644120938 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6aec0ca640 0x7f6aec14aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:39.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.110+0000 7f6af179c700 1 -- 172.21.15.81:0/1644120938 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6aec13fd70 msgr2=0x7f6aec14ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:39.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.110+0000 7f6af179c700 1 --2- 172.21.15.81:0/1644120938 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6aec13fd70 0x7f6aec14ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:39.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.110+0000 7f6af179c700 1 -- 172.21.15.81:0/1644120938 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6aec0ca640 msgr2=0x7f6aec14aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:39.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.110+0000 7f6af179c700 1 --2- 172.21.15.81:0/1644120938 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6aec0ca640 0x7f6aec14aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:39.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.110+0000 7f6af179c700 1 -- 172.21.15.81:0/1644120938 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad80094f0 con 0x7f6aec15ad10 2023-10-06T03:23:39.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.110+0000 7f6af179c700 1 --2- 172.21.15.81:0/1644120938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6aec15ad10 0x7f6aec14f010 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4001560 tx=0x7f6ae40016c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:39.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.110+0000 7f6ae8ff9700 1 -- 172.21.15.81:0/1644120938 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae4012630 con 0x7f6aec15ad10 2023-10-06T03:23:39.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.110+0000 7f6ae8ff9700 1 -- 172.21.15.81:0/1644120938 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae4012790 con 0x7f6aec15ad10 2023-10-06T03:23:39.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.110+0000 7f6af31ff700 1 -- 172.21.15.81:0/1644120938 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aec155330 con 0x7f6aec15ad10 2023-10-06T03:23:39.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.110+0000 7f6ae8ff9700 1 -- 172.21.15.81:0/1644120938 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae4012b50 con 0x7f6aec15ad10 2023-10-06T03:23:39.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.110+0000 7f6af31ff700 1 -- 172.21.15.81:0/1644120938 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aec14af70 con 0x7f6aec15ad10 2023-10-06T03:23:39.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.111+0000 7f6af31ff700 1 -- 172.21.15.81:0/1644120938 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6aec155af0 con 0x7f6aec15ad10 2023-10-06T03:23:39.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.112+0000 7f6ae8ff9700 1 -- 172.21.15.81:0/1644120938 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6ae4003030 con 0x7f6aec15ad10 2023-10-06T03:23:39.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.113+0000 7f6ae8ff9700 1 --2- 172.21.15.81:0/1644120938 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f6ad0066f30 0x7f6ad00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:39.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.113+0000 7f6ae8ff9700 1 -- 172.21.15.81:0/1644120938 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f6ae4084590 con 0x7f6aec15ad10 2023-10-06T03:23:39.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.114+0000 7f6af0f9b700 1 --2- 172.21.15.81:0/1644120938 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f6ad0066f30 0x7f6ad00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:39.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.114+0000 7f6af0f9b700 1 --2- 172.21.15.81:0/1644120938 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f6ad0066f30 0x7f6ad00693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6ae0000c00 tx=0x7f6ae0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:39.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.118+0000 7f6ae8ff9700 1 -- 172.21.15.81:0/1644120938 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6ae4051890 con 0x7f6aec15ad10 2023-10-06T03:23:39.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.310+0000 7f6af31ff700 1 -- 172.21.15.81:0/1644120938 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f6aec04c3c0 con 0x7f6aec15ad10 2023-10-06T03:23:39.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.902+0000 7f6ae8ff9700 1 -- 172.21.15.81:0/1644120938 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) v1 ==== 171+0+0 (secure 0 0 0) 0x7f6ae4054eb0 con 0x7f6aec15ad10 2023-10-06T03:23:39.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.909+0000 7f6af31ff700 1 -- 172.21.15.81:0/1644120938 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f6ad0066f30 msgr2=0x7f6ad00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:39.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.909+0000 7f6af31ff700 1 --2- 172.21.15.81:0/1644120938 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f6ad0066f30 0x7f6ad00693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6ae0000c00 tx=0x7f6ae0009040 comp rx=0 tx=0).stop 2023-10-06T03:23:39.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.909+0000 7f6af31ff700 1 -- 172.21.15.81:0/1644120938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6aec15ad10 msgr2=0x7f6aec14f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:39.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.909+0000 7f6af31ff700 1 --2- 172.21.15.81:0/1644120938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6aec15ad10 0x7f6aec14f010 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4001560 tx=0x7f6ae40016c0 comp rx=0 tx=0).stop 2023-10-06T03:23:39.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.917+0000 7f6af31ff700 1 -- 172.21.15.81:0/1644120938 shutdown_connections 2023-10-06T03:23:39.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.917+0000 7f6af31ff700 1 --2- 172.21.15.81:0/1644120938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6aec15ad10 0x7f6aec14f010 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:39.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.917+0000 7f6af31ff700 1 --2- 172.21.15.81:0/1644120938 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6aec0ca640 0x7f6aec14aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:39.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.917+0000 7f6af31ff700 1 --2- 172.21.15.81:0/1644120938 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f6ad0066f30 0x7f6ad00693e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:39.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.917+0000 7f6af31ff700 1 --2- 172.21.15.81:0/1644120938 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6aec13fd70 0x7f6aec14ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:39.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.917+0000 7f6af31ff700 1 -- 172.21.15.81:0/1644120938 >> 172.21.15.81:0/1644120938 conn(0x7f6aec0cc090 msgr2=0x7f6aec063500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:39.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.920+0000 7f6af31ff700 1 -- 172.21.15.81:0/1644120938 shutdown_connections 2023-10-06T03:23:39.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:39.920+0000 7f6af31ff700 1 -- 172.21.15.81:0/1644120938 wait complete. 2023-10-06T03:23:39.924 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2023-10-06T03:23:39.946 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T03:23:40.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.130+0000 7ff6f97ff700 1 Processor -- start 2023-10-06T03:23:40.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.130+0000 7ff6f97ff700 1 -- start start 2023-10-06T03:23:40.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.131+0000 7ff6f97ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff6f4159380 0x7ff6f415d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:40.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.131+0000 7ff6f97ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff6f406a150 0x7ff6f40c8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:40.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.131+0000 7ff6f97ff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6f415d6a0 con 0x7ff6f4159750 2023-10-06T03:23:40.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.131+0000 7ff6f97ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6f40caba0 con 0x7ff6f4159380 2023-10-06T03:23:40.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.131+0000 7ff6f97ff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6f4068a00 con 0x7ff6f406a150 2023-10-06T03:23:40.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.131+0000 7ff6f2ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff6f4159380 0x7ff6f415d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:40.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.131+0000 7ff6f2ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff6f4159380 0x7ff6f415d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46414/0 (socket says 172.21.15.81:46414) 2023-10-06T03:23:40.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.132+0000 7ff6f2ffd700 1 -- 172.21.15.81:0/2012730119 learned_addr learned my addr 172.21.15.81:0/2012730119 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:40.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.131+0000 7ff6f27fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff6f4159750 0x7ff6f40b1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59262/0 (socket says 172.21.15.81:59262) 2023-10-06T03:23:40.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.132+0000 7ff6f37fe700 1 --2- 172.21.15.81:0/2012730119 >> v2:172.21.15.83:3300/0 conn(0x7ff6f406a150 0x7ff6f40c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:40.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.132+0000 7ff6f2ffd700 1 -- 172.21.15.81:0/2012730119 >> v2:172.21.15.83:3300/0 conn(0x7ff6f406a150 msgr2=0x7ff6f40c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:40.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.132+0000 7ff6f2ffd700 1 --2- 172.21.15.81:0/2012730119 >> v2:172.21.15.83:3300/0 conn(0x7ff6f406a150 0x7ff6f40c8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:40.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.132+0000 7ff6f2ffd700 1 -- 172.21.15.81:0/2012730119 >> v1:172.21.15.81:6789/0 conn(0x7ff6f4159750 legacy=0x7ff6f40b1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:40.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.132+0000 7ff6f2ffd700 1 -- 172.21.15.81:0/2012730119 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f415d8d0 con 0x7ff6f4159380 2023-10-06T03:23:40.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.132+0000 7ff6f2ffd700 1 --2- 172.21.15.81:0/2012730119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6f4159380 0x7ff6f415d160 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4064f50 tx=0x7ff6e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39c3be3a5cedaaf6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:40.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.132+0000 7ff6f1ffb700 1 -- 172.21.15.81:0/2012730119 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e400b860 con 0x7ff6f4159380 2023-10-06T03:23:40.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.132+0000 7ff6f1ffb700 1 -- 172.21.15.81:0/2012730119 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6e400b9c0 con 0x7ff6f4159380 2023-10-06T03:23:40.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.132+0000 7ff6f1ffb700 1 -- 172.21.15.81:0/2012730119 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e400bd60 con 0x7ff6f4159380 2023-10-06T03:23:40.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.133+0000 7ff6f97ff700 1 -- 172.21.15.81:0/2012730119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6f4159380 msgr2=0x7ff6f415d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:40.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.133+0000 7ff6f97ff700 1 --2- 172.21.15.81:0/2012730119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6f4159380 0x7ff6f415d160 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4064f50 tx=0x7ff6e4009250 comp rx=0 tx=0).stop 2023-10-06T03:23:40.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.133+0000 7ff6f97ff700 1 -- 172.21.15.81:0/2012730119 shutdown_connections 2023-10-06T03:23:40.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.133+0000 7ff6f97ff700 1 --2- 172.21.15.81:0/2012730119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6f4159380 0x7ff6f415d160 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:40.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.133+0000 7ff6f97ff700 1 --2- 172.21.15.81:0/2012730119 >> v2:172.21.15.83:3300/0 conn(0x7ff6f406a150 0x7ff6f40c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:40.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.133+0000 7ff6f97ff700 1 -- 172.21.15.81:0/2012730119 >> 172.21.15.81:0/2012730119 conn(0x7ff6f40ce290 msgr2=0x7ff6f40ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:40.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.133+0000 7ff6f97ff700 1 -- 172.21.15.81:0/2012730119 shutdown_connections 2023-10-06T03:23:40.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.133+0000 7ff6f97ff700 1 -- 172.21.15.81:0/2012730119 wait complete. 2023-10-06T03:23:40.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.134+0000 7ff6f97ff700 1 Processor -- start 2023-10-06T03:23:40.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.134+0000 7ff6f97ff700 1 -- start start 2023-10-06T03:23:40.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.135+0000 7ff6f97ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff6f406a150 0x7ff6f416a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:40.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.135+0000 7ff6f97ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6f4159380 0x7ff6f41550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:40.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.135+0000 7ff6f97ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6f4159750 0x7ff6f40acb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:40.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.135+0000 7ff6f97ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f40b25d0 con 0x7ff6f4159750 2023-10-06T03:23:40.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.135+0000 7ff6f97ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f416a700 con 0x7ff6f406a150 2023-10-06T03:23:40.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.135+0000 7ff6f97ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f4155630 con 0x7ff6f4159380 2023-10-06T03:23:40.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.136+0000 7ff6f37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6f4159750 0x7ff6f40acb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:40.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.136+0000 7ff6f37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6f4159750 0x7ff6f40acb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46424/0 (socket says 172.21.15.81:46424) 2023-10-06T03:23:40.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.136+0000 7ff6f37fe700 1 -- 172.21.15.81:0/353020647 learned_addr learned my addr 172.21.15.81:0/353020647 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:40.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.136+0000 7ff6f2ffd700 1 --2- 172.21.15.81:0/353020647 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff6f406a150 0x7ff6f416a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:40.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.136+0000 7ff6f27fc700 1 --2- 172.21.15.81:0/353020647 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6f4159380 0x7ff6f41550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:40.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.136+0000 7ff6f37fe700 1 -- 172.21.15.81:0/353020647 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6f4159380 msgr2=0x7ff6f41550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:40.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.136+0000 7ff6f37fe700 1 --2- 172.21.15.81:0/353020647 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6f4159380 0x7ff6f41550f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:40.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.136+0000 7ff6f37fe700 1 -- 172.21.15.81:0/353020647 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff6f406a150 msgr2=0x7ff6f416a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:40.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.136+0000 7ff6f37fe700 1 --2- 172.21.15.81:0/353020647 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff6f406a150 0x7ff6f416a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:40.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.136+0000 7ff6f37fe700 1 -- 172.21.15.81:0/353020647 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e40094f0 con 0x7ff6f4159750 2023-10-06T03:23:40.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.136+0000 7ff6f37fe700 1 --2- 172.21.15.81:0/353020647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6f4159750 0x7ff6f40acb00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec007f20 tx=0x7ff6ec009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:40.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.136+0000 7ff6daffd700 1 -- 172.21.15.81:0/353020647 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec00eb90 con 0x7ff6f4159750 2023-10-06T03:23:40.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.136+0000 7ff6daffd700 1 -- 172.21.15.81:0/353020647 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6ec00ed10 con 0x7ff6f4159750 2023-10-06T03:23:40.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.136+0000 7ff6daffd700 1 -- 172.21.15.81:0/353020647 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec014670 con 0x7ff6f4159750 2023-10-06T03:23:40.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.136+0000 7ff6f97ff700 1 -- 172.21.15.81:0/353020647 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6f40b1fc0 con 0x7ff6f4159750 2023-10-06T03:23:40.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.137+0000 7ff6f97ff700 1 -- 172.21.15.81:0/353020647 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6f415a8c0 con 0x7ff6f4159750 2023-10-06T03:23:40.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.137+0000 7ff6f97ff700 1 -- 172.21.15.81:0/353020647 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6f404c3c0 con 0x7ff6f4159750 2023-10-06T03:23:40.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.138+0000 7ff6daffd700 1 -- 172.21.15.81:0/353020647 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff6ec0149e0 con 0x7ff6f4159750 2023-10-06T03:23:40.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.139+0000 7ff6daffd700 1 --2- 172.21.15.81:0/353020647 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff6e0066f30 0x7ff6e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:40.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.139+0000 7ff6daffd700 1 -- 172.21.15.81:0/353020647 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5958+0+0 (secure 0 0 0) 0x7ff6ec084cd0 con 0x7ff6f4159750 2023-10-06T03:23:40.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.140+0000 7ff6f2ffd700 1 --2- 172.21.15.81:0/353020647 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff6e0066f30 0x7ff6e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:40.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.140+0000 7ff6f2ffd700 1 --2- 172.21.15.81:0/353020647 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff6e0066f30 0x7ff6e00693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4064f50 tx=0x7ff6e4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:40.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.144+0000 7ff6daffd700 1 -- 172.21.15.81:0/353020647 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff6ec051da0 con 0x7ff6f4159750 2023-10-06T03:23:40.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.375+0000 7ff6f97ff700 1 -- 172.21.15.81:0/353020647 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ff6f4157ec0 con 0x7ff6f4159750 2023-10-06T03:23:40.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.900+0000 7ff6daffd700 1 -- 172.21.15.81:0/353020647 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7ff6ec0553c0 con 0x7ff6f4159750 2023-10-06T03:23:40.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.903+0000 7ff6f97ff700 1 -- 172.21.15.81:0/353020647 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff6e0066f30 msgr2=0x7ff6e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:40.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.903+0000 7ff6f97ff700 1 --2- 172.21.15.81:0/353020647 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff6e0066f30 0x7ff6e00693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4064f50 tx=0x7ff6e4017000 comp rx=0 tx=0).stop 2023-10-06T03:23:40.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.903+0000 7ff6f97ff700 1 -- 172.21.15.81:0/353020647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6f4159750 msgr2=0x7ff6f40acb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:40.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.903+0000 7ff6f97ff700 1 --2- 172.21.15.81:0/353020647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6f4159750 0x7ff6f40acb00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec007f20 tx=0x7ff6ec009860 comp rx=0 tx=0).stop 2023-10-06T03:23:40.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.903+0000 7ff6f97ff700 1 -- 172.21.15.81:0/353020647 shutdown_connections 2023-10-06T03:23:40.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.903+0000 7ff6f97ff700 1 --2- 172.21.15.81:0/353020647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6f4159750 0x7ff6f40acb00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:40.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.903+0000 7ff6f97ff700 1 --2- 172.21.15.81:0/353020647 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff6f406a150 0x7ff6f416a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:40.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.903+0000 7ff6f97ff700 1 --2- 172.21.15.81:0/353020647 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff6e0066f30 0x7ff6e00693e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:40.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.903+0000 7ff6f97ff700 1 --2- 172.21.15.81:0/353020647 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6f4159380 0x7ff6f41550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:40.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.903+0000 7ff6f97ff700 1 -- 172.21.15.81:0/353020647 >> 172.21.15.81:0/353020647 conn(0x7ff6f40ce290 msgr2=0x7ff6f40adaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:40.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.903+0000 7ff6f97ff700 1 -- 172.21.15.81:0/353020647 shutdown_connections 2023-10-06T03:23:40.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:40.903+0000 7ff6f97ff700 1 -- 172.21.15.81:0/353020647 wait complete. 2023-10-06T03:23:40.906 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 3 and data pool 4 2023-10-06T03:23:40.924 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-10-06T03:23:40.924 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-10-06T03:23:40.933 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:23:40.975 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:23:41.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.114+0000 7fb5411ff700 1 Processor -- start 2023-10-06T03:23:41.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.114+0000 7fb5411ff700 1 -- start start 2023-10-06T03:23:41.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.115+0000 7fb5411ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb53c1592d0 0x7fb53c0b0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:41.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.115+0000 7fb5411ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb53c0ccc50 0x7fb53c0cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:41.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.115+0000 7fb5411ff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb53c0cb3f0 con 0x7fb53c1596a0 2023-10-06T03:23:41.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.115+0000 7fb5411ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb53c0b0550 con 0x7fb53c1592d0 2023-10-06T03:23:41.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.115+0000 7fb5411ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c0caab0 con 0x7fb53c0ccc50 2023-10-06T03:23:41.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.115+0000 7fb53ad9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb53c1592d0 0x7fb53c0b0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:41.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.115+0000 7fb53ad9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb53c1592d0 0x7fb53c0b0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46432/0 (socket says 172.21.15.81:46432) 2023-10-06T03:23:41.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.115+0000 7fb53ad9d700 1 -- 172.21.15.81:0/1629558762 learned_addr learned my addr 172.21.15.81:0/1629558762 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:41.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.115+0000 7fb53a59c700 1 --1- 172.21.15.81:0/1629558762 >> v1:172.21.15.81:6789/0 conn(0x7fb53c1596a0 0x7fb53c0cfd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59272/0 (socket says 172.21.15.81:59272) 2023-10-06T03:23:41.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.116+0000 7fb53b59e700 1 --2- 172.21.15.81:0/1629558762 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb53c0ccc50 0x7fb53c0cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:41.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.116+0000 7fb53ad9d700 1 -- 172.21.15.81:0/1629558762 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb53c0ccc50 msgr2=0x7fb53c0cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:41.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.116+0000 7fb53ad9d700 1 --2- 172.21.15.81:0/1629558762 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb53c0ccc50 0x7fb53c0cd0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:41.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.116+0000 7fb53ad9d700 1 -- 172.21.15.81:0/1629558762 >> v1:172.21.15.81:6789/0 conn(0x7fb53c1596a0 legacy=0x7fb53c0cfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:41.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.116+0000 7fb53ad9d700 1 -- 172.21.15.81:0/1629558762 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb53c0cacc0 con 0x7fb53c1592d0 2023-10-06T03:23:41.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.116+0000 7fb539d9b700 1 -- 172.21.15.81:0/1629558762 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2770726183 0 0) 0x7fb53c0cb3f0 con 0x7fb53c1596a0 2023-10-06T03:23:41.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.116+0000 7fb53ad9d700 1 --2- 172.21.15.81:0/1629558762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb53c1592d0 0x7fb53c0b0010 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb52c0099b0 tx=0x7fb52c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b044d77aae2cbae8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:41.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.116+0000 7fb539d9b700 1 -- 172.21.15.81:0/1629558762 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52c009ea0 con 0x7fb53c1592d0 2023-10-06T03:23:41.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.116+0000 7fb539d9b700 1 -- 172.21.15.81:0/1629558762 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb52c00b860 con 0x7fb53c1592d0 2023-10-06T03:23:41.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.116+0000 7fb539d9b700 1 -- 172.21.15.81:0/1629558762 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52c00bc00 con 0x7fb53c1592d0 2023-10-06T03:23:41.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.117+0000 7fb5411ff700 1 -- 172.21.15.81:0/1629558762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb53c1592d0 msgr2=0x7fb53c0b0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:41.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.117+0000 7fb5411ff700 1 --2- 172.21.15.81:0/1629558762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb53c1592d0 0x7fb53c0b0010 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb52c0099b0 tx=0x7fb52c009250 comp rx=0 tx=0).stop 2023-10-06T03:23:41.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.117+0000 7fb5411ff700 1 -- 172.21.15.81:0/1629558762 shutdown_connections 2023-10-06T03:23:41.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.117+0000 7fb5411ff700 1 --2- 172.21.15.81:0/1629558762 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb53c0ccc50 0x7fb53c0cd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:41.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.117+0000 7fb5411ff700 1 --2- 172.21.15.81:0/1629558762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb53c1592d0 0x7fb53c0b0010 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:41.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.117+0000 7fb5411ff700 1 -- 172.21.15.81:0/1629558762 >> 172.21.15.81:0/1629558762 conn(0x7fb53c06ed10 msgr2=0x7fb53c06f110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:41.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.117+0000 7fb5411ff700 1 -- 172.21.15.81:0/1629558762 shutdown_connections 2023-10-06T03:23:41.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.117+0000 7fb5411ff700 1 -- 172.21.15.81:0/1629558762 wait complete. 2023-10-06T03:23:41.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.118+0000 7fb5411ff700 1 Processor -- start 2023-10-06T03:23:41.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.118+0000 7fb5411ff700 1 -- start start 2023-10-06T03:23:41.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.119+0000 7fb5411ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb53c0ccc50 0x7fb53c14c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:41.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.119+0000 7fb5411ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb53c1592d0 0x7fb53c0b3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:41.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.119+0000 7fb5411ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb53c1596a0 0x7fb53c0b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:41.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.119+0000 7fb5411ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c0c7f30 con 0x7fb53c0ccc50 2023-10-06T03:23:41.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.119+0000 7fb5411ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c0b5b60 con 0x7fb53c1596a0 2023-10-06T03:23:41.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.119+0000 7fb5411ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c0b5e40 con 0x7fb53c1592d0 2023-10-06T03:23:41.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.120+0000 7fb53ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb53c0ccc50 0x7fb53c14c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:41.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.120+0000 7fb53ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb53c0ccc50 0x7fb53c14c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46434/0 (socket says 172.21.15.81:46434) 2023-10-06T03:23:41.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.120+0000 7fb53ad9d700 1 -- 172.21.15.81:0/4049163797 learned_addr learned my addr 172.21.15.81:0/4049163797 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:41.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.120+0000 7fb53a59c700 1 --2- 172.21.15.81:0/4049163797 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb53c1592d0 0x7fb53c0b3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:41.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.120+0000 7fb53b59e700 1 --2- 172.21.15.81:0/4049163797 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb53c1596a0 0x7fb53c0b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:41.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.120+0000 7fb53ad9d700 1 -- 172.21.15.81:0/4049163797 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb53c1592d0 msgr2=0x7fb53c0b3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:41.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.120+0000 7fb53ad9d700 1 --2- 172.21.15.81:0/4049163797 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb53c1592d0 0x7fb53c0b3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:41.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.120+0000 7fb53ad9d700 1 -- 172.21.15.81:0/4049163797 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb53c1596a0 msgr2=0x7fb53c0b4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:41.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.120+0000 7fb53ad9d700 1 --2- 172.21.15.81:0/4049163797 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb53c1596a0 0x7fb53c0b4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:41.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.120+0000 7fb53ad9d700 1 -- 172.21.15.81:0/4049163797 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb52c0094f0 con 0x7fb53c0ccc50 2023-10-06T03:23:41.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.120+0000 7fb53ad9d700 1 --2- 172.21.15.81:0/4049163797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb53c0ccc50 0x7fb53c14c7d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb52c006fd0 tx=0x7fb52c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:41.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.120+0000 7fb522ffd700 1 -- 172.21.15.81:0/4049163797 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52c000d10 con 0x7fb53c0ccc50 2023-10-06T03:23:41.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.120+0000 7fb522ffd700 1 -- 172.21.15.81:0/4049163797 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb52c00b9d0 con 0x7fb53c0ccc50 2023-10-06T03:23:41.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.120+0000 7fb522ffd700 1 -- 172.21.15.81:0/4049163797 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52c025420 con 0x7fb53c0ccc50 2023-10-06T03:23:41.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.120+0000 7fb5411ff700 1 -- 172.21.15.81:0/4049163797 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb53c0b6120 con 0x7fb53c0ccc50 2023-10-06T03:23:41.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.121+0000 7fb5411ff700 1 -- 172.21.15.81:0/4049163797 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb53c14cd10 con 0x7fb53c0ccc50 2023-10-06T03:23:41.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.122+0000 7fb5411ff700 1 -- 172.21.15.81:0/4049163797 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb53c0c83a0 con 0x7fb53c0ccc50 2023-10-06T03:23:41.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.122+0000 7fb522ffd700 1 -- 172.21.15.81:0/4049163797 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb52c023070 con 0x7fb53c0ccc50 2023-10-06T03:23:41.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.123+0000 7fb522ffd700 1 --2- 172.21.15.81:0/4049163797 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb528066f30 0x7fb5280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:41.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.124+0000 7fb522ffd700 1 -- 172.21.15.81:0/4049163797 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb52c085c00 con 0x7fb53c0ccc50 2023-10-06T03:23:41.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.124+0000 7fb53a59c700 1 --2- 172.21.15.81:0/4049163797 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb528066f30 0x7fb5280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:41.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.124+0000 7fb53a59c700 1 --2- 172.21.15.81:0/4049163797 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb528066f30 0x7fb5280693e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb53c0d1350 tx=0x7fb530007ef0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:41.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.128+0000 7fb522ffd700 1 -- 172.21.15.81:0/4049163797 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb52c08c080 con 0x7fb53c0ccc50 2023-10-06T03:23:41.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.330+0000 7fb5411ff700 1 -- 172.21.15.81:0/4049163797 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fb53c04c3c0 con 0x7fb53c0ccc50 2023-10-06T03:23:41.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.648+0000 7fb522ffd700 1 -- 172.21.15.81:0/4049163797 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) v1 ==== 157+0+0 (secure 0 0 0) 0x7fb52c02a0e0 con 0x7fb53c0ccc50 2023-10-06T03:23:41.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.651+0000 7fb5411ff700 1 -- 172.21.15.81:0/4049163797 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb528066f30 msgr2=0x7fb5280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:41.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.651+0000 7fb5411ff700 1 --2- 172.21.15.81:0/4049163797 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb528066f30 0x7fb5280693e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb53c0d1350 tx=0x7fb530007ef0 comp rx=0 tx=0).stop 2023-10-06T03:23:41.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.651+0000 7fb5411ff700 1 -- 172.21.15.81:0/4049163797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb53c0ccc50 msgr2=0x7fb53c14c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:41.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.651+0000 7fb5411ff700 1 --2- 172.21.15.81:0/4049163797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb53c0ccc50 0x7fb53c14c7d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb52c006fd0 tx=0x7fb52c017000 comp rx=0 tx=0).stop 2023-10-06T03:23:41.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.651+0000 7fb5411ff700 1 -- 172.21.15.81:0/4049163797 shutdown_connections 2023-10-06T03:23:41.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.651+0000 7fb5411ff700 1 --2- 172.21.15.81:0/4049163797 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb53c1596a0 0x7fb53c0b4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:41.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.651+0000 7fb5411ff700 1 --2- 172.21.15.81:0/4049163797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb53c0ccc50 0x7fb53c14c7d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:41.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.651+0000 7fb5411ff700 1 --2- 172.21.15.81:0/4049163797 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb528066f30 0x7fb5280693e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:41.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.651+0000 7fb5411ff700 1 --2- 172.21.15.81:0/4049163797 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb53c1592d0 0x7fb53c0b3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:41.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.651+0000 7fb5411ff700 1 -- 172.21.15.81:0/4049163797 >> 172.21.15.81:0/4049163797 conn(0x7fb53c06ed10 msgr2=0x7fb53c0d08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:41.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.651+0000 7fb5411ff700 1 -- 172.21.15.81:0/4049163797 shutdown_connections 2023-10-06T03:23:41.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.651+0000 7fb5411ff700 1 -- 172.21.15.81:0/4049163797 wait complete. 2023-10-06T03:23:41.670 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T03:23:41.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.859+0000 7f8eb9d9d700 1 Processor -- start 2023-10-06T03:23:41.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.859+0000 7f8eb9d9d700 1 -- start start 2023-10-06T03:23:41.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.860+0000 7f8eb9d9d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f8eb41535a0 0x7f8eb415ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:41.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.860+0000 7f8eb9d9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8eb4157670 0x7f8eb40b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:41.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.860+0000 7f8eb9d9d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8eb415bef0 con 0x7f8eb415a560 2023-10-06T03:23:41.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.860+0000 7f8eb9d9d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eb40d1160 con 0x7f8eb41535a0 2023-10-06T03:23:41.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.860+0000 7f8eb9d9d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb415a9e0 con 0x7f8eb4157670 2023-10-06T03:23:41.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.861+0000 7f8eb3fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8eb415a560 0x7f8eb4153970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59282/0 (socket says 172.21.15.81:59282) 2023-10-06T03:23:41.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.861+0000 7f8eb3fff700 1 -- 172.21.15.81:0/3531018446 learned_addr learned my addr 172.21.15.81:0/3531018446 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:23:41.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.861+0000 7f8eb959c700 1 --2- 172.21.15.81:0/3531018446 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8eb4157670 0x7f8eb40b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:41.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.861+0000 7f8eb8d9b700 1 --2- 172.21.15.81:0/3531018446 >> v2:172.21.15.83:3300/0 conn(0x7f8eb41535a0 0x7f8eb415ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:41.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.861+0000 7f8eb37fe700 1 -- 172.21.15.81:0/3531018446 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2957399332 0 0) 0x7f8eb415bef0 con 0x7f8eb415a560 2023-10-06T03:23:41.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.861+0000 7f8eb37fe700 1 -- 172.21.15.81:0/3531018446 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ea4003570 con 0x7f8eb415a560 2023-10-06T03:23:41.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.861+0000 7f8eb37fe700 1 -- 172.21.15.81:0/3531018446 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1991641154 0 0) 0x7f8ea4003570 con 0x7f8eb415a560 2023-10-06T03:23:41.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.861+0000 7f8eb37fe700 1 -- 172.21.15.81:0/3531018446 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8eb4157670 msgr2=0x7f8eb40b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:41.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.861+0000 7f8eb37fe700 1 --2- 172.21.15.81:0/3531018446 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8eb4157670 0x7f8eb40b1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:41.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.861+0000 7f8eb37fe700 1 -- 172.21.15.81:0/3531018446 >> v2:172.21.15.83:3300/0 conn(0x7f8eb41535a0 msgr2=0x7f8eb415ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:41.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.861+0000 7f8eb37fe700 1 --2- 172.21.15.81:0/3531018446 >> v2:172.21.15.83:3300/0 conn(0x7f8eb41535a0 0x7f8eb415ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:41.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.861+0000 7f8eb37fe700 1 -- 172.21.15.81:0/3531018446 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb415b2e0 con 0x7f8eb415a560 2023-10-06T03:23:41.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.861+0000 7f8eb37fe700 1 -- 172.21.15.81:0/3531018446 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2513016936 0 0) 0x7f8ea0001470 con 0x7f8eb415a560 2023-10-06T03:23:41.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.861+0000 7f8eb37fe700 1 -- 172.21.15.81:0/3531018446 >> v1:172.21.15.81:6789/0 conn(0x7f8eb415a560 legacy=0x7f8eb4153970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:41.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.861+0000 7f8eb37fe700 1 --2- 172.21.15.81:0/3531018446 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ea4003a60 0x7f8ea4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:41.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.861+0000 7f8eb37fe700 1 --2- 172.21.15.81:0/3531018446 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8eb4157670 0x7f8ea4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:41.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.861+0000 7f8eb37fe700 1 --2- 172.21.15.81:0/3531018446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ea4004d50 0x7f8ea40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:41.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.862+0000 7f8eb37fe700 1 -- 172.21.15.81:0/3531018446 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb40d1160 con 0x7f8ea4004d50 2023-10-06T03:23:41.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.862+0000 7f8eb37fe700 1 -- 172.21.15.81:0/3531018446 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb415a9e0 con 0x7f8ea4003a60 2023-10-06T03:23:41.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.862+0000 7f8eb37fe700 1 -- 172.21.15.81:0/3531018446 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea400ba60 con 0x7f8eb4157670 2023-10-06T03:23:41.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.862+0000 7f8eb8d9b700 1 --2- 172.21.15.81:0/3531018446 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ea4003a60 0x7f8ea4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:41.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.862+0000 7f8eb3fff700 1 --2- 172.21.15.81:0/3531018446 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8eb4157670 0x7f8ea4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:41.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.862+0000 7f8eb959c700 1 --2- 172.21.15.81:0/3531018446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ea4004d50 0x7f8ea40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:41.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.862+0000 7f8eb8d9b700 1 -- 172.21.15.81:0/3531018446 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8eb4157670 msgr2=0x7f8ea4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:41.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.862+0000 7f8eb8d9b700 1 --2- 172.21.15.81:0/3531018446 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8eb4157670 0x7f8ea4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:41.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.862+0000 7f8eb8d9b700 1 -- 172.21.15.81:0/3531018446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ea4004d50 msgr2=0x7f8ea40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:41.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.862+0000 7f8eb8d9b700 1 --2- 172.21.15.81:0/3531018446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ea4004d50 0x7f8ea40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:41.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.862+0000 7f8eb8d9b700 1 -- 172.21.15.81:0/3531018446 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea4003570 con 0x7f8ea4003a60 2023-10-06T03:23:41.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.862+0000 7f8eb3fff700 1 --2- 172.21.15.81:0/3531018446 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8eb4157670 0x7f8ea4004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:23:41.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.862+0000 7f8eb959c700 1 --2- 172.21.15.81:0/3531018446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ea4004d50 0x7f8ea40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:23:41.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.862+0000 7f8eb8d9b700 1 --2- 172.21.15.81:0/3531018446 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ea4003a60 0x7f8ea4003e70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8009c00 tx=0x7f8ea80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6794355ac85f5c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:41.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.863+0000 7f8eb37fe700 1 -- 172.21.15.81:0/3531018446 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea800e710 con 0x7f8ea4003a60 2023-10-06T03:23:41.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.863+0000 7f8eb37fe700 1 -- 172.21.15.81:0/3531018446 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea800e870 con 0x7f8ea4003a60 2023-10-06T03:23:41.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.863+0000 7f8eb37fe700 1 -- 172.21.15.81:0/3531018446 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea800ec30 con 0x7f8ea4003a60 2023-10-06T03:23:41.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.863+0000 7f8eb9d9d700 1 -- 172.21.15.81:0/3531018446 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ea4003a60 msgr2=0x7f8ea4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:41.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.863+0000 7f8eb9d9d700 1 --2- 172.21.15.81:0/3531018446 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ea4003a60 0x7f8ea4003e70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8009c00 tx=0x7f8ea80091a0 comp rx=0 tx=0).stop 2023-10-06T03:23:41.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.863+0000 7f8eb959c700 1 -- 172.21.15.81:0/3531018446 reap_dead start 2023-10-06T03:23:41.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.863+0000 7f8eb9d9d700 1 -- 172.21.15.81:0/3531018446 shutdown_connections 2023-10-06T03:23:41.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.863+0000 7f8eb9d9d700 1 -- 172.21.15.81:0/3531018446 >> 172.21.15.81:0/3531018446 conn(0x7f8eb4068230 msgr2=0x7f8eb4068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:41.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.863+0000 7f8eb9d9d700 1 -- 172.21.15.81:0/3531018446 shutdown_connections 2023-10-06T03:23:41.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.863+0000 7f8eb9d9d700 1 -- 172.21.15.81:0/3531018446 wait complete. 2023-10-06T03:23:41.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.865+0000 7f8eb9d9d700 1 Processor -- start 2023-10-06T03:23:41.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.865+0000 7f8eb9d9d700 1 -- start start 2023-10-06T03:23:41.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.866+0000 7f8eb9d9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ea4003a60 0x7f8eb414fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:41.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.866+0000 7f8eb9d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8eb4150640 0x7f8eb415ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:41.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.866+0000 7f8eb9d9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8eb415c920 0x7f8eb40cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:41.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.866+0000 7f8eb9d9d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb4150380 con 0x7f8eb4150640 2023-10-06T03:23:41.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.866+0000 7f8eb9d9d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb415c490 con 0x7f8ea4003a60 2023-10-06T03:23:41.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.866+0000 7f8eb9d9d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb415f280 con 0x7f8eb415c920 2023-10-06T03:23:41.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.866+0000 7f8eb3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8eb4150640 0x7f8eb415ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:41.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.866+0000 7f8eb3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8eb4150640 0x7f8eb415ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46448/0 (socket says 172.21.15.81:46448) 2023-10-06T03:23:41.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.866+0000 7f8eb3fff700 1 -- 172.21.15.81:0/2811118149 learned_addr learned my addr 172.21.15.81:0/2811118149 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:41.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.866+0000 7f8eb8d9b700 1 --2- 172.21.15.81:0/2811118149 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ea4003a60 0x7f8eb414fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:41.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.866+0000 7f8eb959c700 1 --2- 172.21.15.81:0/2811118149 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8eb415c920 0x7f8eb40cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:41.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.866+0000 7f8eb3fff700 1 -- 172.21.15.81:0/2811118149 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8eb415c920 msgr2=0x7f8eb40cebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:41.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.866+0000 7f8eb3fff700 1 --2- 172.21.15.81:0/2811118149 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8eb415c920 0x7f8eb40cebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:41.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.866+0000 7f8eb3fff700 1 -- 172.21.15.81:0/2811118149 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ea4003a60 msgr2=0x7f8eb414fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:41.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.866+0000 7f8eb3fff700 1 --2- 172.21.15.81:0/2811118149 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ea4003a60 0x7f8eb414fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:41.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.866+0000 7f8eb3fff700 1 -- 172.21.15.81:0/2811118149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb4155400 con 0x7f8eb4150640 2023-10-06T03:23:41.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.866+0000 7f8eb959c700 1 --2- 172.21.15.81:0/2811118149 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8eb415c920 0x7f8eb40cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:23:41.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.866+0000 7f8eb3fff700 1 --2- 172.21.15.81:0/2811118149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8eb4150640 0x7f8eb415ed40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0007710 tx=0x7f8ea0001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:41.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.867+0000 7f8eb0ff9700 1 -- 172.21.15.81:0/2811118149 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea0018030 con 0x7f8eb4150640 2023-10-06T03:23:41.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.867+0000 7f8eb0ff9700 1 -- 172.21.15.81:0/2811118149 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea000f9f0 con 0x7f8eb4150640 2023-10-06T03:23:41.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.867+0000 7f8eb9d9d700 1 -- 172.21.15.81:0/2811118149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eb41556e0 con 0x7f8eb4150640 2023-10-06T03:23:41.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.867+0000 7f8eb0ff9700 1 -- 172.21.15.81:0/2811118149 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea000fd70 con 0x7f8eb4150640 2023-10-06T03:23:41.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.867+0000 7f8eb9d9d700 1 -- 172.21.15.81:0/2811118149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eb415cdc0 con 0x7f8eb4150640 2023-10-06T03:23:41.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.868+0000 7f8eb9d9d700 1 -- 172.21.15.81:0/2811118149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eb4155c00 con 0x7f8eb4150640 2023-10-06T03:23:41.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.869+0000 7f8eb0ff9700 1 -- 172.21.15.81:0/2811118149 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8ea001b070 con 0x7f8eb4150640 2023-10-06T03:23:41.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.869+0000 7f8eb0ff9700 1 --2- 172.21.15.81:0/2811118149 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f8e98066f30 0x7f8e980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:41.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.869+0000 7f8eb0ff9700 1 -- 172.21.15.81:0/2811118149 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6284+0+0 (secure 0 0 0) 0x7f8ea0019070 con 0x7f8eb4150640 2023-10-06T03:23:41.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.870+0000 7f8eb8d9b700 1 --2- 172.21.15.81:0/2811118149 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f8e98066f30 0x7f8e980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:41.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.870+0000 7f8eb8d9b700 1 --2- 172.21.15.81:0/2811118149 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f8e98066f30 0x7f8e980693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8eb41575d0 tx=0x7f8ea801a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:41.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:41.874+0000 7f8eb0ff9700 1 -- 172.21.15.81:0/2811118149 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8eb4155c00 con 0x7f8eb4150640 2023-10-06T03:23:42.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:42.069+0000 7f8eb9d9d700 1 -- 172.21.15.81:0/2811118149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f8eb415c260 con 0x7f8eb4150640 2023-10-06T03:23:43.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:43.928+0000 7f8eb0ff9700 1 -- 172.21.15.81:0/2811118149 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) v1 ==== 228+0+0 (secure 0 0 0) 0x7f8eb415c260 con 0x7f8eb4150640 2023-10-06T03:23:43.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:43.933+0000 7f8eb9d9d700 1 -- 172.21.15.81:0/2811118149 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f8e98066f30 msgr2=0x7f8e980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:43.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:43.933+0000 7f8eb9d9d700 1 --2- 172.21.15.81:0/2811118149 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f8e98066f30 0x7f8e980693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8eb41575d0 tx=0x7f8ea801a000 comp rx=0 tx=0).stop 2023-10-06T03:23:43.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:43.933+0000 7f8eb9d9d700 1 -- 172.21.15.81:0/2811118149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8eb4150640 msgr2=0x7f8eb415ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:43.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:43.933+0000 7f8eb9d9d700 1 --2- 172.21.15.81:0/2811118149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8eb4150640 0x7f8eb415ed40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0007710 tx=0x7f8ea0001e90 comp rx=0 tx=0).stop 2023-10-06T03:23:43.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:43.933+0000 7f8eb9d9d700 1 -- 172.21.15.81:0/2811118149 shutdown_connections 2023-10-06T03:23:43.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:43.933+0000 7f8eb9d9d700 1 --2- 172.21.15.81:0/2811118149 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f8e98066f30 0x7f8e980693e0 secure :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8eb41575d0 tx=0x7f8ea801a000 comp rx=0 tx=0).stop 2023-10-06T03:23:43.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:43.933+0000 7f8eb9d9d700 1 --2- 172.21.15.81:0/2811118149 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8eb415c920 0x7f8eb40cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:43.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:43.933+0000 7f8eb9d9d700 1 --2- 172.21.15.81:0/2811118149 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ea4003a60 0x7f8eb414fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:43.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:43.933+0000 7f8eb9d9d700 1 --2- 172.21.15.81:0/2811118149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8eb4150640 0x7f8eb415ed40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:43.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:43.933+0000 7f8eb9d9d700 1 -- 172.21.15.81:0/2811118149 >> 172.21.15.81:0/2811118149 conn(0x7f8eb4068230 msgr2=0x7f8eb40b5900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:43.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:43.935+0000 7f8eb9d9d700 1 -- 172.21.15.81:0/2811118149 shutdown_connections 2023-10-06T03:23:43.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:43.936+0000 7f8eb9d9d700 1 -- 172.21.15.81:0/2811118149 wait complete. 2023-10-06T03:23:43.944 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data_ec' created 2023-10-06T03:23:43.963 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-10-06T03:23:44.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.151+0000 7fa6c31ff700 1 Processor -- start 2023-10-06T03:23:44.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.151+0000 7fa6c31ff700 1 -- start start 2023-10-06T03:23:44.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.152+0000 7fa6c31ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa6bc15a5a0 0x7fa6bc0c1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:44.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.152+0000 7fa6c31ff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6bc0c7880 con 0x7fa6bc13fd50 2023-10-06T03:23:44.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.152+0000 7fa6c31ff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6bc0c7b60 con 0x7fa6bc13f980 2023-10-06T03:23:44.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.152+0000 7fa6c31ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6bc0c8490 con 0x7fa6bc15a5a0 2023-10-06T03:23:44.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.153+0000 7fa6c179c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa6bc15a5a0 0x7fa6bc0c1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:44.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.153+0000 7fa6bbfff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa6bc13fd50 0x7fa6bc159e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59292/0 (socket says 172.21.15.81:59292) 2023-10-06T03:23:44.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.153+0000 7fa6c179c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa6bc15a5a0 0x7fa6bc0c1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46460/0 (socket says 172.21.15.81:46460) 2023-10-06T03:23:44.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.153+0000 7fa6bbfff700 1 -- 172.21.15.81:0/3386040465 learned_addr learned my addr 172.21.15.81:0/3386040465 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:23:44.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.153+0000 7fa6c179c700 1 -- 172.21.15.81:0/3386040465 >> v1:172.21.15.83:6789/0 conn(0x7fa6bc13f980 legacy=0x7fa6bc0c70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:44.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.153+0000 7fa6c179c700 1 -- 172.21.15.81:0/3386040465 >> v1:172.21.15.81:6789/0 conn(0x7fa6bc13fd50 legacy=0x7fa6bc159e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:44.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.153+0000 7fa6c179c700 1 -- 172.21.15.81:0/3386040465 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6bc0c7e40 con 0x7fa6bc15a5a0 2023-10-06T03:23:44.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.153+0000 7fa6c179c700 1 --2- 172.21.15.81:0/3386040465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6bc15a5a0 0x7fa6bc0c1090 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc0c8440 tx=0x7fa6b4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28c37227cbedbbd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:44.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.153+0000 7fa6bb7fe700 1 -- 172.21.15.81:0/3386040465 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b4016070 con 0x7fa6bc15a5a0 2023-10-06T03:23:44.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.154+0000 7fa6bb7fe700 1 -- 172.21.15.81:0/3386040465 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6b400bc30 con 0x7fa6bc15a5a0 2023-10-06T03:23:44.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.154+0000 7fa6bb7fe700 1 -- 172.21.15.81:0/3386040465 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b400e070 con 0x7fa6bc15a5a0 2023-10-06T03:23:44.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.154+0000 7fa6c31ff700 1 -- 172.21.15.81:0/3386040465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6bc15a5a0 msgr2=0x7fa6bc0c1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:44.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.154+0000 7fa6c31ff700 1 --2- 172.21.15.81:0/3386040465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6bc15a5a0 0x7fa6bc0c1090 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc0c8440 tx=0x7fa6b4009780 comp rx=0 tx=0).stop 2023-10-06T03:23:44.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.154+0000 7fa6c31ff700 1 -- 172.21.15.81:0/3386040465 shutdown_connections 2023-10-06T03:23:44.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.154+0000 7fa6c31ff700 1 --2- 172.21.15.81:0/3386040465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6bc15a5a0 0x7fa6bc0c1090 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:44.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.154+0000 7fa6c31ff700 1 -- 172.21.15.81:0/3386040465 >> 172.21.15.81:0/3386040465 conn(0x7fa6bc0cc050 msgr2=0x7fa6bc0cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:44.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.154+0000 7fa6c31ff700 1 -- 172.21.15.81:0/3386040465 shutdown_connections 2023-10-06T03:23:44.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.154+0000 7fa6c31ff700 1 -- 172.21.15.81:0/3386040465 wait complete. 2023-10-06T03:23:44.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.156+0000 7fa6c31ff700 1 Processor -- start 2023-10-06T03:23:44.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.156+0000 7fa6c31ff700 1 -- start start 2023-10-06T03:23:44.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.157+0000 7fa6c31ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6bc13f980 0x7fa6bc06b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:44.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.157+0000 7fa6c31ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6bc13fd50 0x7fa6bc0b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:44.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.157+0000 7fa6c31ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa6bc15a5a0 0x7fa6bc169840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:44.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.157+0000 7fa6c31ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6bc16ce80 con 0x7fa6bc13fd50 2023-10-06T03:23:44.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.157+0000 7fa6c31ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6bc0b1930 con 0x7fa6bc13f980 2023-10-06T03:23:44.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.157+0000 7fa6c31ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6bc16a060 con 0x7fa6bc15a5a0 2023-10-06T03:23:44.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.157+0000 7fa6bbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6bc13fd50 0x7fa6bc0b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:44.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.157+0000 7fa6bbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6bc13fd50 0x7fa6bc0b13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46464/0 (socket says 172.21.15.81:46464) 2023-10-06T03:23:44.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.157+0000 7fa6bbfff700 1 -- 172.21.15.81:0/3171624081 learned_addr learned my addr 172.21.15.81:0/3171624081 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:44.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.157+0000 7fa6c179c700 1 --2- 172.21.15.81:0/3171624081 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa6bc15a5a0 0x7fa6bc169840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:44.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.157+0000 7fa6bbfff700 1 -- 172.21.15.81:0/3171624081 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa6bc15a5a0 msgr2=0x7fa6bc169840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:44.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.157+0000 7fa6bbfff700 1 --2- 172.21.15.81:0/3171624081 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa6bc15a5a0 0x7fa6bc169840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:44.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.157+0000 7fa6bbfff700 1 -- 172.21.15.81:0/3171624081 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6bc13f980 msgr2=0x7fa6bc06b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:44.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.157+0000 7fa6c0f9b700 1 --2- 172.21.15.81:0/3171624081 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6bc13f980 0x7fa6bc06b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:44.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.157+0000 7fa6bbfff700 1 --2- 172.21.15.81:0/3171624081 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6bc13f980 0x7fa6bc06b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:44.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.157+0000 7fa6bbfff700 1 -- 172.21.15.81:0/3171624081 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b4009a20 con 0x7fa6bc13fd50 2023-10-06T03:23:44.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.157+0000 7fa6c179c700 1 --2- 172.21.15.81:0/3171624081 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa6bc15a5a0 0x7fa6bc169840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:23:44.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.157+0000 7fa6c0f9b700 1 --2- 172.21.15.81:0/3171624081 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6bc13f980 0x7fa6bc06b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:23:44.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.157+0000 7fa6bbfff700 1 --2- 172.21.15.81:0/3171624081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6bc13fd50 0x7fa6bc0b13f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa6a800c7c0 tx=0x7fa6a8007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:44.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.158+0000 7fa6b8ff9700 1 -- 172.21.15.81:0/3171624081 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a8005b30 con 0x7fa6bc13fd50 2023-10-06T03:23:44.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.158+0000 7fa6b8ff9700 1 -- 172.21.15.81:0/3171624081 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a8005cb0 con 0x7fa6bc13fd50 2023-10-06T03:23:44.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.158+0000 7fa6b8ff9700 1 -- 172.21.15.81:0/3171624081 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a8004a80 con 0x7fa6bc13fd50 2023-10-06T03:23:44.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.158+0000 7fa6c31ff700 1 -- 172.21.15.81:0/3171624081 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6bc16a340 con 0x7fa6bc13fd50 2023-10-06T03:23:44.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.158+0000 7fa6c31ff700 1 -- 172.21.15.81:0/3171624081 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6bc16d0d0 con 0x7fa6bc13fd50 2023-10-06T03:23:44.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.159+0000 7fa6c31ff700 1 -- 172.21.15.81:0/3171624081 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6bc04c3c0 con 0x7fa6bc13fd50 2023-10-06T03:23:44.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.160+0000 7fa6b8ff9700 1 -- 172.21.15.81:0/3171624081 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa6a80070f0 con 0x7fa6bc13fd50 2023-10-06T03:23:44.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.160+0000 7fa6b8ff9700 1 --2- 172.21.15.81:0/3171624081 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa6a0066f30 0x7fa6a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:44.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.161+0000 7fa6b8ff9700 1 -- 172.21.15.81:0/3171624081 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6777+0+0 (secure 0 0 0) 0x7fa6a8083e10 con 0x7fa6bc13fd50 2023-10-06T03:23:44.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.161+0000 7fa6c0f9b700 1 --2- 172.21.15.81:0/3171624081 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa6a0066f30 0x7fa6a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:44.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.161+0000 7fa6c0f9b700 1 --2- 172.21.15.81:0/3171624081 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa6a0066f30 0x7fa6a00693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc16cde0 tx=0x7fa6b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:44.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.165+0000 7fa6b8ff9700 1 -- 172.21.15.81:0/3171624081 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa6a8087030 con 0x7fa6bc13fd50 2023-10-06T03:23:44.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.356+0000 7fa6c31ff700 1 -- 172.21.15.81:0/3171624081 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fa6bc0c8120 con 0x7fa6bc13fd50 2023-10-06T03:23:44.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.930+0000 7fa6b8ff9700 1 -- 172.21.15.81:0/3171624081 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa6a8018070 con 0x7fa6bc13fd50 2023-10-06T03:23:44.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.942+0000 7fa6c31ff700 1 -- 172.21.15.81:0/3171624081 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa6a0066f30 msgr2=0x7fa6a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:44.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.942+0000 7fa6c31ff700 1 --2- 172.21.15.81:0/3171624081 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa6a0066f30 0x7fa6a00693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc16cde0 tx=0x7fa6b0009040 comp rx=0 tx=0).stop 2023-10-06T03:23:44.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.942+0000 7fa6c31ff700 1 -- 172.21.15.81:0/3171624081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6bc13fd50 msgr2=0x7fa6bc0b13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:44.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.942+0000 7fa6c31ff700 1 --2- 172.21.15.81:0/3171624081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6bc13fd50 0x7fa6bc0b13f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa6a800c7c0 tx=0x7fa6a8007f70 comp rx=0 tx=0).stop 2023-10-06T03:23:44.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.945+0000 7fa6c31ff700 1 -- 172.21.15.81:0/3171624081 shutdown_connections 2023-10-06T03:23:44.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.945+0000 7fa6c31ff700 1 --2- 172.21.15.81:0/3171624081 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa6a0066f30 0x7fa6a00693e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:44.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.945+0000 7fa6c31ff700 1 --2- 172.21.15.81:0/3171624081 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa6bc15a5a0 0x7fa6bc169840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:44.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.946+0000 7fa6c31ff700 1 --2- 172.21.15.81:0/3171624081 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6bc13f980 0x7fa6bc06b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:44.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.946+0000 7fa6c31ff700 1 --2- 172.21.15.81:0/3171624081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6bc13fd50 0x7fa6bc0b13f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:44.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.946+0000 7fa6c31ff700 1 -- 172.21.15.81:0/3171624081 >> 172.21.15.81:0/3171624081 conn(0x7fa6bc0cc050 msgr2=0x7fa6bc0c57d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:44.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.954+0000 7fa6c31ff700 1 -- 172.21.15.81:0/3171624081 shutdown_connections 2023-10-06T03:23:44.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:44.958+0000 7fa6c31ff700 1 -- 172.21.15.81:0/3171624081 wait complete. 2023-10-06T03:23:44.968 INFO:teuthology.orchestra.run.smithi081.stderr:set pool 5 allow_ec_overwrites to true 2023-10-06T03:23:44.983 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-10-06T03:23:45.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.166+0000 7ff7757ff700 1 Processor -- start 2023-10-06T03:23:45.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.166+0000 7ff7757ff700 1 -- start start 2023-10-06T03:23:45.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.167+0000 7ff7757ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff770143150 0x7ff7700cea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:45.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.167+0000 7ff7757ff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7700b3e70 con 0x7ff7700b24c0 2023-10-06T03:23:45.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.167+0000 7ff7757ff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7700cf820 con 0x7ff7700b20f0 2023-10-06T03:23:45.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.167+0000 7ff7757ff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7700d00c0 con 0x7ff770143150 2023-10-06T03:23:45.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.167+0000 7ff76f7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff7700b24c0 0x7ff7700cef50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59308/0 (socket says 172.21.15.81:59308) 2023-10-06T03:23:45.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.167+0000 7ff76f7fe700 1 -- 172.21.15.81:0/266095704 learned_addr learned my addr 172.21.15.81:0/266095704 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:23:45.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.168+0000 7ff76e7fc700 1 --2- 172.21.15.81:0/266095704 >> v2:172.21.15.83:3300/0 conn(0x7ff770143150 0x7ff7700cea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:45.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.168+0000 7ff76dffb700 1 -- 172.21.15.81:0/266095704 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2232853721 0 0) 0x7ff7700b3e70 con 0x7ff7700b24c0 2023-10-06T03:23:45.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.168+0000 7ff76dffb700 1 -- 172.21.15.81:0/266095704 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff758003570 con 0x7ff7700b24c0 2023-10-06T03:23:45.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.168+0000 7ff76dffb700 1 -- 172.21.15.81:0/266095704 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1798835765 0 0) 0x7ff758003570 con 0x7ff7700b24c0 2023-10-06T03:23:45.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.168+0000 7ff76e7fc700 1 -- 172.21.15.81:0/266095704 >> v1:172.21.15.83:6789/0 conn(0x7ff7700b20f0 legacy=0x7ff770142a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:45.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.168+0000 7ff76e7fc700 1 -- 172.21.15.81:0/266095704 >> v1:172.21.15.81:6789/0 conn(0x7ff7700b24c0 legacy=0x7ff7700cef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:45.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.168+0000 7ff76e7fc700 1 -- 172.21.15.81:0/266095704 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7700cfb00 con 0x7ff770143150 2023-10-06T03:23:45.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.168+0000 7ff76e7fc700 1 --2- 172.21.15.81:0/266095704 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff770143150 0x7ff7700cea10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff7640098e0 tx=0x7ff7640091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c7be3498120ab64 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:45.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.169+0000 7ff76dffb700 1 -- 172.21.15.81:0/266095704 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7680017f0 con 0x7ff770143150 2023-10-06T03:23:45.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.169+0000 7ff76dffb700 1 -- 172.21.15.81:0/266095704 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff764011420 con 0x7ff770143150 2023-10-06T03:23:45.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.169+0000 7ff76dffb700 1 -- 172.21.15.81:0/266095704 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7640117c0 con 0x7ff770143150 2023-10-06T03:23:45.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.169+0000 7ff7757ff700 1 -- 172.21.15.81:0/266095704 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff770143150 msgr2=0x7ff7700cea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:45.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.169+0000 7ff7757ff700 1 --2- 172.21.15.81:0/266095704 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff770143150 0x7ff7700cea10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff7640098e0 tx=0x7ff7640091a0 comp rx=0 tx=0).stop 2023-10-06T03:23:45.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.169+0000 7ff7757ff700 1 -- 172.21.15.81:0/266095704 shutdown_connections 2023-10-06T03:23:45.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.169+0000 7ff7757ff700 1 --2- 172.21.15.81:0/266095704 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff770143150 0x7ff7700cea10 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:45.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.169+0000 7ff7757ff700 1 -- 172.21.15.81:0/266095704 >> 172.21.15.81:0/266095704 conn(0x7ff77006ed10 msgr2=0x7ff77006f110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:45.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.169+0000 7ff7757ff700 1 -- 172.21.15.81:0/266095704 shutdown_connections 2023-10-06T03:23:45.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.169+0000 7ff7757ff700 1 -- 172.21.15.81:0/266095704 wait complete. 2023-10-06T03:23:45.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.171+0000 7ff7757ff700 1 Processor -- start 2023-10-06T03:23:45.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.171+0000 7ff7757ff700 1 -- start start 2023-10-06T03:23:45.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.172+0000 7ff7757ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff7700b20f0 0x7ff77013dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:45.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.172+0000 7ff7757ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7700b24c0 0x7ff770152f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:45.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.172+0000 7ff7757ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff770143150 0x7ff770157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:45.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.172+0000 7ff7757ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77013f020 con 0x7ff7700b24c0 2023-10-06T03:23:45.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.172+0000 7ff7757ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff770154500 con 0x7ff770143150 2023-10-06T03:23:45.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.172+0000 7ff7757ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7701538f0 con 0x7ff7700b20f0 2023-10-06T03:23:45.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.172+0000 7ff76e7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7700b24c0 0x7ff770152f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:45.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.172+0000 7ff76e7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7700b24c0 0x7ff770152f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46480/0 (socket says 172.21.15.81:46480) 2023-10-06T03:23:45.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.172+0000 7ff76e7fc700 1 -- 172.21.15.81:0/1335739682 learned_addr learned my addr 172.21.15.81:0/1335739682 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:45.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.172+0000 7ff76e7fc700 1 -- 172.21.15.81:0/1335739682 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff7700b20f0 msgr2=0x7ff77013dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:45.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.172+0000 7ff76effd700 1 --2- 172.21.15.81:0/1335739682 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff7700b20f0 0x7ff77013dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:45.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.172+0000 7ff76f7fe700 1 --2- 172.21.15.81:0/1335739682 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff770143150 0x7ff770157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:45.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.172+0000 7ff76e7fc700 1 --2- 172.21.15.81:0/1335739682 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff7700b20f0 0x7ff77013dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:45.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.172+0000 7ff76e7fc700 1 -- 172.21.15.81:0/1335739682 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff770143150 msgr2=0x7ff770157cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:45.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.172+0000 7ff76e7fc700 1 --2- 172.21.15.81:0/1335739682 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff770143150 0x7ff770157cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:45.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.172+0000 7ff76e7fc700 1 -- 172.21.15.81:0/1335739682 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff764009420 con 0x7ff7700b24c0 2023-10-06T03:23:45.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.172+0000 7ff76effd700 1 --2- 172.21.15.81:0/1335739682 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff7700b20f0 0x7ff77013dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:23:45.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.172+0000 7ff76f7fe700 1 --2- 172.21.15.81:0/1335739682 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff770143150 0x7ff770157cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:23:45.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.172+0000 7ff76e7fc700 1 --2- 172.21.15.81:0/1335739682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7700b24c0 0x7ff770152f10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff7640091e0 tx=0x7ff764016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:45.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.173+0000 7ff756ffd700 1 -- 172.21.15.81:0/1335739682 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76401cc90 con 0x7ff7700b24c0 2023-10-06T03:23:45.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.173+0000 7ff756ffd700 1 -- 172.21.15.81:0/1335739682 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff76401cdf0 con 0x7ff7700b24c0 2023-10-06T03:23:45.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.173+0000 7ff756ffd700 1 -- 172.21.15.81:0/1335739682 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76401a6a0 con 0x7ff7700b24c0 2023-10-06T03:23:45.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.173+0000 7ff7757ff700 1 -- 172.21.15.81:0/1335739682 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff770153bd0 con 0x7ff7700b24c0 2023-10-06T03:23:45.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.173+0000 7ff7757ff700 1 -- 172.21.15.81:0/1335739682 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff770154190 con 0x7ff7700b24c0 2023-10-06T03:23:45.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.174+0000 7ff7757ff700 1 -- 172.21.15.81:0/1335739682 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff770154890 con 0x7ff7700b24c0 2023-10-06T03:23:45.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.175+0000 7ff756ffd700 1 -- 172.21.15.81:0/1335739682 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff76401aa90 con 0x7ff7700b24c0 2023-10-06T03:23:45.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.176+0000 7ff756ffd700 1 --2- 172.21.15.81:0/1335739682 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff75c066f30 0x7ff75c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:45.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.176+0000 7ff756ffd700 1 -- 172.21.15.81:0/1335739682 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6777+0+0 (secure 0 0 0) 0x7ff764086410 con 0x7ff7700b24c0 2023-10-06T03:23:45.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.176+0000 7ff76effd700 1 --2- 172.21.15.81:0/1335739682 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff75c066f30 0x7ff75c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:45.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.177+0000 7ff76effd700 1 --2- 172.21.15.81:0/1335739682 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff75c066f30 0x7ff75c0693e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff7600017a0 tx=0x7ff760009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:45.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.180+0000 7ff756ffd700 1 -- 172.21.15.81:0/1335739682 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff770154890 con 0x7ff7700b24c0 2023-10-06T03:23:45.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.418+0000 7ff7757ff700 1 -- 172.21.15.81:0/1335739682 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7ff770154890 con 0x7ff7700b24c0 2023-10-06T03:23:45.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.952+0000 7ff756ffd700 1 -- 172.21.15.81:0/1335739682 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7ff770154890 con 0x7ff7700b24c0 2023-10-06T03:23:45.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.955+0000 7ff7757ff700 1 -- 172.21.15.81:0/1335739682 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff75c066f30 msgr2=0x7ff75c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:45.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.955+0000 7ff7757ff700 1 --2- 172.21.15.81:0/1335739682 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff75c066f30 0x7ff75c0693e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff7600017a0 tx=0x7ff760009040 comp rx=0 tx=0).stop 2023-10-06T03:23:45.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.955+0000 7ff7757ff700 1 -- 172.21.15.81:0/1335739682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7700b24c0 msgr2=0x7ff770152f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:45.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.955+0000 7ff7757ff700 1 --2- 172.21.15.81:0/1335739682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7700b24c0 0x7ff770152f10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff7640091e0 tx=0x7ff764016000 comp rx=0 tx=0).stop 2023-10-06T03:23:45.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.955+0000 7ff7757ff700 1 -- 172.21.15.81:0/1335739682 shutdown_connections 2023-10-06T03:23:45.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.955+0000 7ff7757ff700 1 --2- 172.21.15.81:0/1335739682 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff770143150 0x7ff770157cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:45.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.955+0000 7ff7757ff700 1 --2- 172.21.15.81:0/1335739682 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff75c066f30 0x7ff75c0693e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:45.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.955+0000 7ff7757ff700 1 --2- 172.21.15.81:0/1335739682 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff7700b20f0 0x7ff77013dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:45.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.955+0000 7ff7757ff700 1 --2- 172.21.15.81:0/1335739682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7700b24c0 0x7ff770152f10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:45.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.955+0000 7ff7757ff700 1 -- 172.21.15.81:0/1335739682 >> 172.21.15.81:0/1335739682 conn(0x7ff77006ed10 msgr2=0x7ff7700b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:45.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.955+0000 7ff7757ff700 1 -- 172.21.15.81:0/1335739682 shutdown_connections 2023-10-06T03:23:45.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:45.955+0000 7ff7757ff700 1 -- 172.21.15.81:0/1335739682 wait complete. 2023-10-06T03:23:45.957 INFO:teuthology.orchestra.run.smithi081.stderr:added data pool 5 to fsmap 2023-10-06T03:23:45.973 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:23:46.061 INFO:tasks.ceph.mds.b.smithi083.stderr:2023-10-06T03:23:46.058+0000 7f0b72bf1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T03:23:46.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.153+0000 7f710759d700 1 Processor -- start 2023-10-06T03:23:46.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.153+0000 7f710759d700 1 -- start start 2023-10-06T03:23:46.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.154+0000 7f710759d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f71000af1a0 0x7f71000b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:46.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.154+0000 7f710759d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71000b2d80 con 0x7f71000af570 2023-10-06T03:23:46.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.154+0000 7f710759d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71000b2170 con 0x7f71000675e0 2023-10-06T03:23:46.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.154+0000 7f710759d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71000b1f60 con 0x7f71000af1a0 2023-10-06T03:23:46.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.154+0000 7f7105d9a700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f71000af570 0x7f71000affe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59318/0 (socket says 172.21.15.81:59318) 2023-10-06T03:23:46.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.154+0000 7f7105d9a700 1 -- 172.21.15.81:0/3113763135 learned_addr learned my addr 172.21.15.81:0/3113763135 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:23:46.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.155+0000 7f710659b700 1 --2- 172.21.15.81:0/3113763135 >> v2:172.21.15.83:3300/0 conn(0x7f71000af1a0 0x7f71000b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:46.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.155+0000 7f7105599700 1 -- 172.21.15.81:0/3113763135 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 333168948 0 0) 0x7f71000b2d80 con 0x7f71000af570 2023-10-06T03:23:46.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.155+0000 7f7105599700 1 -- 172.21.15.81:0/3113763135 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70ec003570 con 0x7f71000af570 2023-10-06T03:23:46.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.155+0000 7f7105599700 1 -- 172.21.15.81:0/3113763135 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3351424804 0 0) 0x7f70ec003570 con 0x7f71000af570 2023-10-06T03:23:46.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.155+0000 7f7105599700 1 -- 172.21.15.81:0/3113763135 >> v2:172.21.15.83:3300/0 conn(0x7f71000af1a0 msgr2=0x7f71000b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:46.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.155+0000 7f7105599700 1 --2- 172.21.15.81:0/3113763135 >> v2:172.21.15.83:3300/0 conn(0x7f71000af1a0 0x7f71000b1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:46.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.155+0000 7f7105599700 1 -- 172.21.15.81:0/3113763135 >> v1:172.21.15.83:6789/0 conn(0x7f71000675e0 legacy=0x7f7100158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:46.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.155+0000 7f7105599700 1 -- 172.21.15.81:0/3113763135 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71000b2450 con 0x7f71000af570 2023-10-06T03:23:46.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.155+0000 7f7105599700 1 -- 172.21.15.81:0/3113763135 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2513016936 0 0) 0x7f70f0001470 con 0x7f71000af570 2023-10-06T03:23:46.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.155+0000 7f7105599700 1 -- 172.21.15.81:0/3113763135 >> v1:172.21.15.81:6789/0 conn(0x7f71000af570 legacy=0x7f71000affe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:46.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.155+0000 7f7105599700 1 --2- 172.21.15.81:0/3113763135 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70ec003ab0 0x7f70ec003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:46.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.155+0000 7f7105599700 1 --2- 172.21.15.81:0/3113763135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70ec004810 0x7f70ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:46.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.155+0000 7f7105599700 1 --2- 172.21.15.81:0/3113763135 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f70ec005210 0x7f70ec00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:46.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.155+0000 7f7105599700 1 -- 172.21.15.81:0/3113763135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71000b1f60 con 0x7f70ec004810 2023-10-06T03:23:46.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.155+0000 7f7105599700 1 -- 172.21.15.81:0/3113763135 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70ec00c130 con 0x7f70ec003ab0 2023-10-06T03:23:46.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.155+0000 7f7105599700 1 -- 172.21.15.81:0/3113763135 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70ec00c2f0 con 0x7f70ec005210 2023-10-06T03:23:46.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.155+0000 7f7105d9a700 1 --2- 172.21.15.81:0/3113763135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70ec004810 0x7f70ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:46.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.155+0000 7f710659b700 1 --2- 172.21.15.81:0/3113763135 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70ec003ab0 0x7f70ec003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:46.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.156+0000 7f7106d9c700 1 --2- 172.21.15.81:0/3113763135 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f70ec005210 0x7f70ec00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:46.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.156+0000 7f7105d9a700 1 -- 172.21.15.81:0/3113763135 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f70ec005210 msgr2=0x7f70ec00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:46.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.156+0000 7f7105d9a700 1 --2- 172.21.15.81:0/3113763135 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f70ec005210 0x7f70ec00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:46.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.156+0000 7f7105d9a700 1 -- 172.21.15.81:0/3113763135 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70ec003ab0 msgr2=0x7f70ec003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:46.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.156+0000 7f7105d9a700 1 --2- 172.21.15.81:0/3113763135 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70ec003ab0 0x7f70ec003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:46.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.156+0000 7f7105d9a700 1 -- 172.21.15.81:0/3113763135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ec003570 con 0x7f70ec004810 2023-10-06T03:23:46.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.156+0000 7f7106d9c700 1 -- 172.21.15.81:0/3113763135 reap_dead start 2023-10-06T03:23:46.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.156+0000 7f7105d9a700 1 --2- 172.21.15.81:0/3113763135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70ec004810 0x7f70ec004c80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f70f000c2d0 tx=0x7f70f0001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f48afabfce99686 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:46.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.156+0000 7f7105599700 1 -- 172.21.15.81:0/3113763135 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f000cb60 con 0x7f70ec004810 2023-10-06T03:23:46.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.156+0000 7f7105599700 1 -- 172.21.15.81:0/3113763135 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f000cce0 con 0x7f70ec004810 2023-10-06T03:23:46.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.156+0000 7f7105599700 1 -- 172.21.15.81:0/3113763135 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f0005b70 con 0x7f70ec004810 2023-10-06T03:23:46.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.157+0000 7f710759d700 1 -- 172.21.15.81:0/3113763135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70ec004810 msgr2=0x7f70ec004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:46.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.157+0000 7f710759d700 1 --2- 172.21.15.81:0/3113763135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70ec004810 0x7f70ec004c80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f70f000c2d0 tx=0x7f70f0001d80 comp rx=0 tx=0).stop 2023-10-06T03:23:46.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.157+0000 7f710759d700 1 -- 172.21.15.81:0/3113763135 shutdown_connections 2023-10-06T03:23:46.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.157+0000 7f710759d700 1 --2- 172.21.15.81:0/3113763135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70ec004810 0x7f70ec004c80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:46.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.157+0000 7f710759d700 1 -- 172.21.15.81:0/3113763135 >> 172.21.15.81:0/3113763135 conn(0x7f71000cdad0 msgr2=0x7f710006c430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:46.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.157+0000 7f710759d700 1 -- 172.21.15.81:0/3113763135 shutdown_connections 2023-10-06T03:23:46.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.157+0000 7f710759d700 1 -- 172.21.15.81:0/3113763135 wait complete. 2023-10-06T03:23:46.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.158+0000 7f710759d700 1 Processor -- start 2023-10-06T03:23:46.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.158+0000 7f710759d700 1 -- start start 2023-10-06T03:23:46.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.159+0000 7f710759d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70ec004810 0x7f710014e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:46.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.159+0000 7f710759d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f71000c4600 0x7f71000c4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:46.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.159+0000 7f710759d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7100098120 0x7f7100098570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:46.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.159+0000 7f710759d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7100099a80 con 0x7f7100098120 2023-10-06T03:23:46.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.159+0000 7f710759d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71000c4fb0 con 0x7f70ec004810 2023-10-06T03:23:46.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.159+0000 7f710759d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7100098e70 con 0x7f71000c4600 2023-10-06T03:23:46.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.160+0000 7f7106d9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7100098120 0x7f7100098570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:46.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.160+0000 7f7106d9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7100098120 0x7f7100098570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46500/0 (socket says 172.21.15.81:46500) 2023-10-06T03:23:46.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.160+0000 7f7106d9c700 1 -- 172.21.15.81:0/1418272637 learned_addr learned my addr 172.21.15.81:0/1418272637 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:46.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.160+0000 7f710659b700 1 --2- 172.21.15.81:0/1418272637 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70ec004810 0x7f710014e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:46.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.160+0000 7f7105d9a700 1 --2- 172.21.15.81:0/1418272637 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f71000c4600 0x7f71000c4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:46.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.160+0000 7f7106d9c700 1 -- 172.21.15.81:0/1418272637 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f71000c4600 msgr2=0x7f71000c4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:46.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.160+0000 7f7106d9c700 1 --2- 172.21.15.81:0/1418272637 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f71000c4600 0x7f71000c4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:46.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.160+0000 7f7106d9c700 1 -- 172.21.15.81:0/1418272637 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70ec004810 msgr2=0x7f710014e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:46.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.160+0000 7f7106d9c700 1 --2- 172.21.15.81:0/1418272637 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70ec004810 0x7f710014e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:46.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.160+0000 7f7106d9c700 1 -- 172.21.15.81:0/1418272637 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7100099150 con 0x7f7100098120 2023-10-06T03:23:46.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.160+0000 7f7106d9c700 1 --2- 172.21.15.81:0/1418272637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7100098120 0x7f7100098570 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f71000ccfd0 tx=0x7f70f8001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:46.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.160+0000 7f70f67fc700 1 -- 172.21.15.81:0/1418272637 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f8006db0 con 0x7f7100098120 2023-10-06T03:23:46.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.160+0000 7f70f67fc700 1 -- 172.21.15.81:0/1418272637 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f800c5a0 con 0x7f7100098120 2023-10-06T03:23:46.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.160+0000 7f710759d700 1 -- 172.21.15.81:0/1418272637 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7100099430 con 0x7f7100098120 2023-10-06T03:23:46.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.160+0000 7f70f67fc700 1 -- 172.21.15.81:0/1418272637 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f800c960 con 0x7f7100098120 2023-10-06T03:23:46.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.161+0000 7f710759d700 1 -- 172.21.15.81:0/1418272637 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7100098ab0 con 0x7f7100098120 2023-10-06T03:23:46.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.162+0000 7f710759d700 1 -- 172.21.15.81:0/1418272637 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71000c1da0 con 0x7f7100098120 2023-10-06T03:23:46.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.162+0000 7f70f67fc700 1 -- 172.21.15.81:0/1418272637 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f70f800ccd0 con 0x7f7100098120 2023-10-06T03:23:46.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.163+0000 7f70f67fc700 1 --2- 172.21.15.81:0/1418272637 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f70e4066f30 0x7f70e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:46.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.163+0000 7f70f67fc700 1 -- 172.21.15.81:0/1418272637 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f70f80848f0 con 0x7f7100098120 2023-10-06T03:23:46.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.163+0000 7f710659b700 1 --2- 172.21.15.81:0/1418272637 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f70e4066f30 0x7f70e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:46.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.164+0000 7f710659b700 1 --2- 172.21.15.81:0/1418272637 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f70e4066f30 0x7f70e40693e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7100066510 tx=0x7f70fc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:46.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.167+0000 7f70f67fc700 1 -- 172.21.15.81:0/1418272637 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f71000c1da0 con 0x7f7100098120 2023-10-06T03:23:46.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.400+0000 7f710759d700 1 -- 172.21.15.81:0/1418272637 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f71000c1da0 con 0x7f7100098120 2023-10-06T03:23:46.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.401+0000 7f70f67fc700 1 -- 172.21.15.81:0/1418272637 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4590 (secure 0 0 0) 0x7f71000c1da0 con 0x7f7100098120 2023-10-06T03:23:46.402 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:23:46.402 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1255569320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1255569320},{"type":"v1","addr":"172.21.15.83:6835","nonce":1255569320}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1673166762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1673166762},{"type":"v1","addr":"172.21.15.81:6835","nonce":1673166762}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3689326153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3689326153},{"type":"v1","addr":"172.21.15.81:6837","nonce":3689326153}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:23:40.376852+0000","modified":"2023-10-06T03:23:45.940754+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6833/745669616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":745669616},{"type":"v1","addr":"172.21.15.83:6833","nonce":745669616}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-10-06T03:23:46.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.403+0000 7f710759d700 1 -- 172.21.15.81:0/1418272637 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f70e4066f30 msgr2=0x7f70e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:46.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.403+0000 7f710759d700 1 --2- 172.21.15.81:0/1418272637 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f70e4066f30 0x7f70e40693e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7100066510 tx=0x7f70fc008040 comp rx=0 tx=0).stop 2023-10-06T03:23:46.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.403+0000 7f710759d700 1 -- 172.21.15.81:0/1418272637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7100098120 msgr2=0x7f7100098570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:46.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.403+0000 7f710759d700 1 --2- 172.21.15.81:0/1418272637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7100098120 0x7f7100098570 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f71000ccfd0 tx=0x7f70f8001640 comp rx=0 tx=0).stop 2023-10-06T03:23:46.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.403+0000 7f710759d700 1 -- 172.21.15.81:0/1418272637 shutdown_connections 2023-10-06T03:23:46.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.403+0000 7f710759d700 1 --2- 172.21.15.81:0/1418272637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7100098120 0x7f7100098570 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:46.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.403+0000 7f710759d700 1 --2- 172.21.15.81:0/1418272637 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70ec004810 0x7f710014e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:46.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.403+0000 7f710759d700 1 --2- 172.21.15.81:0/1418272637 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f70e4066f30 0x7f70e40693e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:46.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.403+0000 7f710759d700 1 --2- 172.21.15.81:0/1418272637 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f71000c4600 0x7f71000c4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:46.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.403+0000 7f710759d700 1 -- 172.21.15.81:0/1418272637 >> 172.21.15.81:0/1418272637 conn(0x7f71000cdad0 msgr2=0x7f71000c9400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:46.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.403+0000 7f710759d700 1 -- 172.21.15.81:0/1418272637 shutdown_connections 2023-10-06T03:23:46.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.403+0000 7f710759d700 1 -- 172.21.15.81:0/1418272637 wait complete. 2023-10-06T03:23:46.406 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 7 2023-10-06T03:23:46.422 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:23:46.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.602+0000 7f687bfff700 1 Processor -- start 2023-10-06T03:23:46.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.602+0000 7f687bfff700 1 -- start start 2023-10-06T03:23:46.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.603+0000 7f687bfff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6874153a90 0x7f687415a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:46.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.603+0000 7f687bfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f68740b23b0 0x7f68740cb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:46.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.603+0000 7f687bfff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68740b2850 con 0x7f6874153e60 2023-10-06T03:23:46.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.603+0000 7f687bfff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6874067cf0 con 0x7f68740b23b0 2023-10-06T03:23:46.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.603+0000 7f687bfff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68740c9f50 con 0x7f6874153a90 2023-10-06T03:23:46.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.603+0000 7f687a59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f68740b23b0 0x7f68740cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:46.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.603+0000 7f687a59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f68740b23b0 0x7f68740cb860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46512/0 (socket says 172.21.15.81:46512) 2023-10-06T03:23:46.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.603+0000 7f687a59c700 1 -- 172.21.15.81:0/3967507794 learned_addr learned my addr 172.21.15.81:0/3967507794 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:46.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.603+0000 7f687959a700 1 --1- 172.21.15.81:0/3967507794 >> v1:172.21.15.81:6789/0 conn(0x7f6874153e60 0x7f68740675e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59322/0 (socket says 172.21.15.81:59322) 2023-10-06T03:23:46.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.604+0000 7f6879d9b700 1 --2- 172.21.15.81:0/3967507794 >> v2:172.21.15.83:3300/0 conn(0x7f6874153a90 0x7f687415a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:46.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.604+0000 7f687a59c700 1 -- 172.21.15.81:0/3967507794 >> v2:172.21.15.83:3300/0 conn(0x7f6874153a90 msgr2=0x7f687415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:46.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.604+0000 7f687a59c700 1 --2- 172.21.15.81:0/3967507794 >> v2:172.21.15.83:3300/0 conn(0x7f6874153a90 0x7f687415a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:46.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.604+0000 7f687a59c700 1 -- 172.21.15.81:0/3967507794 >> v1:172.21.15.81:6789/0 conn(0x7f6874153e60 legacy=0x7f68740675e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:46.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.604+0000 7f687a59c700 1 -- 172.21.15.81:0/3967507794 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68740ca230 con 0x7f68740b23b0 2023-10-06T03:23:46.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.604+0000 7f6878d99700 1 -- 172.21.15.81:0/3967507794 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2416488022 0 0) 0x7f68740b2850 con 0x7f6874153e60 2023-10-06T03:23:46.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.604+0000 7f687a59c700 1 --2- 172.21.15.81:0/3967507794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68740b23b0 0x7f68740cb860 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f687406d940 tx=0x7f686c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e72e619d8f694df server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:46.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.604+0000 7f6878d99700 1 -- 172.21.15.81:0/3967507794 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686c00e070 con 0x7f68740b23b0 2023-10-06T03:23:46.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.604+0000 7f6878d99700 1 -- 172.21.15.81:0/3967507794 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f686c00ba50 con 0x7f68740b23b0 2023-10-06T03:23:46.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.604+0000 7f6878d99700 1 -- 172.21.15.81:0/3967507794 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686c0092e0 con 0x7f68740b23b0 2023-10-06T03:23:46.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.605+0000 7f687bfff700 1 -- 172.21.15.81:0/3967507794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68740b23b0 msgr2=0x7f68740cb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:46.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.605+0000 7f687bfff700 1 --2- 172.21.15.81:0/3967507794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68740b23b0 0x7f68740cb860 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f687406d940 tx=0x7f686c009840 comp rx=0 tx=0).stop 2023-10-06T03:23:46.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.605+0000 7f687bfff700 1 -- 172.21.15.81:0/3967507794 shutdown_connections 2023-10-06T03:23:46.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.605+0000 7f687bfff700 1 --2- 172.21.15.81:0/3967507794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68740b23b0 0x7f68740cb860 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:46.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.605+0000 7f687bfff700 1 --2- 172.21.15.81:0/3967507794 >> v2:172.21.15.83:3300/0 conn(0x7f6874153a90 0x7f687415a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:46.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.605+0000 7f687bfff700 1 -- 172.21.15.81:0/3967507794 >> 172.21.15.81:0/3967507794 conn(0x7f68740cd3c0 msgr2=0x7f68740b1860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:46.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.605+0000 7f687bfff700 1 -- 172.21.15.81:0/3967507794 shutdown_connections 2023-10-06T03:23:46.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.605+0000 7f687bfff700 1 -- 172.21.15.81:0/3967507794 wait complete. 2023-10-06T03:23:46.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.606+0000 7f687bfff700 1 Processor -- start 2023-10-06T03:23:46.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.607+0000 7f687bfff700 1 -- start start 2023-10-06T03:23:46.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.607+0000 7f687bfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68740b23b0 0x7f68740b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:46.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.607+0000 7f687bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6874153a90 0x7f687415b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:46.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.607+0000 7f687bfff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6874153e60 0x7f687414e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:46.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.608+0000 7f687bfff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68741590f0 con 0x7f6874153a90 2023-10-06T03:23:46.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.608+0000 7f687bfff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f687415bbd0 con 0x7f68740b23b0 2023-10-06T03:23:46.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.608+0000 7f687bfff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f687414e890 con 0x7f6874153e60 2023-10-06T03:23:46.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.608+0000 7f687959a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6874153a90 0x7f687415b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:46.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.608+0000 7f687959a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6874153a90 0x7f687415b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46516/0 (socket says 172.21.15.81:46516) 2023-10-06T03:23:46.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.608+0000 7f687959a700 1 -- 172.21.15.81:0/4143379983 learned_addr learned my addr 172.21.15.81:0/4143379983 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:46.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.608+0000 7f6879d9b700 1 --2- 172.21.15.81:0/4143379983 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68740b23b0 0x7f68740b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:46.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.608+0000 7f687a59c700 1 --2- 172.21.15.81:0/4143379983 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6874153e60 0x7f687414e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:46.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.608+0000 7f687959a700 1 -- 172.21.15.81:0/4143379983 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6874153e60 msgr2=0x7f687414e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:46.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.608+0000 7f687959a700 1 --2- 172.21.15.81:0/4143379983 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6874153e60 0x7f687414e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:46.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.608+0000 7f687959a700 1 -- 172.21.15.81:0/4143379983 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68740b23b0 msgr2=0x7f68740b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:46.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.608+0000 7f687959a700 1 --2- 172.21.15.81:0/4143379983 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68740b23b0 0x7f68740b1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:46.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.608+0000 7f687959a700 1 -- 172.21.15.81:0/4143379983 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f686c009ae0 con 0x7f6874153a90 2023-10-06T03:23:46.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.608+0000 7f687959a700 1 --2- 172.21.15.81:0/4143379983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6874153a90 0x7f687415b580 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f686400c5e0 tx=0x7f6864007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:46.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.608+0000 7f6869ffb700 1 -- 172.21.15.81:0/4143379983 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6864005a70 con 0x7f6874153a90 2023-10-06T03:23:46.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.609+0000 7f6869ffb700 1 -- 172.21.15.81:0/4143379983 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6864005bf0 con 0x7f6874153a90 2023-10-06T03:23:46.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.609+0000 7f687bfff700 1 -- 172.21.15.81:0/4143379983 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68740c6fa0 con 0x7f6874153a90 2023-10-06T03:23:46.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.609+0000 7f6869ffb700 1 -- 172.21.15.81:0/4143379983 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68640070d0 con 0x7f6874153a90 2023-10-06T03:23:46.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.609+0000 7f687bfff700 1 -- 172.21.15.81:0/4143379983 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68740c6950 con 0x7f6874153a90 2023-10-06T03:23:46.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.610+0000 7f687bfff700 1 -- 172.21.15.81:0/4143379983 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68740c7130 con 0x7f6874153a90 2023-10-06T03:23:46.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.611+0000 7f6869ffb700 1 -- 172.21.15.81:0/4143379983 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6864007480 con 0x7f6874153a90 2023-10-06T03:23:46.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.611+0000 7f6869ffb700 1 --2- 172.21.15.81:0/4143379983 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f6858066f30 0x7f68580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:46.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.612+0000 7f6869ffb700 1 -- 172.21.15.81:0/4143379983 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f6864083f00 con 0x7f6874153a90 2023-10-06T03:23:46.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.612+0000 7f6879d9b700 1 --2- 172.21.15.81:0/4143379983 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f6858066f30 0x7f68580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:46.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.612+0000 7f6879d9b700 1 --2- 172.21.15.81:0/4143379983 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f6858066f30 0x7f68580693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6870006fd0 tx=0x7f6870008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:46.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.615+0000 7f6869ffb700 1 -- 172.21.15.81:0/4143379983 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6864050c80 con 0x7f6874153a90 2023-10-06T03:23:46.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.811+0000 7f687bfff700 1 -- 172.21.15.81:0/4143379983 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f687404c3c0 con 0x7f6874153a90 2023-10-06T03:23:46.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.812+0000 7f6869ffb700 1 -- 172.21.15.81:0/4143379983 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18659 (secure 0 0 0) 0x7f6864017020 con 0x7f6874153a90 2023-10-06T03:23:46.813 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:23:46.814 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"fsid":"1807b5d7-9be8-43ad-aaf8-99a4273430b3","created":"2023-10-06T03:23:20.805306+0000","modified":"2023-10-06T03:23:45.419616+0000","last_up_change":"2023-10-06T03:23:32.735796+0000","last_in_change":"2023-10-06T03:23:24.109024+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:33.198850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:33.606744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:23:38.742266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:23:39.347944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:23:42.959054+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"14fb667d-a677-4978-a477-80027f889d36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":85563},{"type":"v1","addr":"172.21.15.81:6818","nonce":85563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":85563},{"type":"v1","addr":"172.21.15.81:6822","nonce":85563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":85563},{"type":"v1","addr":"172.21.15.81:6830","nonce":85563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":85563},{"type":"v1","addr":"172.21.15.81:6826","nonce":85563}]},"public_addr":"172.21.15.81:6818/85563","cluster_addr":"172.21.15.81:6822/85563","heartbeat_back_addr":"172.21.15.81:6830/85563","heartbeat_front_addr":"172.21.15.81:6826/85563","state":["exists","up"]},{"osd":1,"uuid":"974d8a86-1829-4176-89ce-18e6038857f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":85561},{"type":"v1","addr":"172.21.15.81:6801","nonce":85561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":85561},{"type":"v1","addr":"172.21.15.81:6803","nonce":85561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":85561},{"type":"v1","addr":"172.21.15.81:6807","nonce":85561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":85561},{"type":"v1","addr":"172.21.15.81:6805","nonce":85561}]},"public_addr":"172.21.15.81:6801/85561","cluster_addr":"172.21.15.81:6803/85561","heartbeat_back_addr":"172.21.15.81:6807/85561","heartbeat_front_addr":"172.21.15.81:6805/85561","state":["exists","up"]},{"osd":2,"uuid":"ffbfe056-46bc-46e0-bf49-4d8f8650e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":85564},{"type":"v1","addr":"172.21.15.81:6809","nonce":85564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":85564},{"type":"v1","addr":"172.21.15.81:6811","nonce":85564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":85564},{"type":"v1","addr":"172.21.15.81:6815","nonce":85564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":85564},{"type":"v1","addr":"172.21.15.81:6813","nonce":85564}]},"public_addr":"172.21.15.81:6809/85564","cluster_addr":"172.21.15.81:6811/85564","heartbeat_back_addr":"172.21.15.81:6815/85564","heartbeat_front_addr":"172.21.15.81:6813/85564","state":["exists","up"]},{"osd":3,"uuid":"ef9a8314-3d37-4ea1-858a-e704d5695002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":85562},{"type":"v1","addr":"172.21.15.81:6819","nonce":85562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":85562},{"type":"v1","addr":"172.21.15.81:6823","nonce":85562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":85562},{"type":"v1","addr":"172.21.15.81:6831","nonce":85562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":85562},{"type":"v1","addr":"172.21.15.81:6827","nonce":85562}]},"public_addr":"172.21.15.81:6819/85562","cluster_addr":"172.21.15.81:6823/85562","heartbeat_back_addr":"172.21.15.81:6831/85562","heartbeat_front_addr":"172.21.15.81:6827/85562","state":["exists","up"]},{"osd":4,"uuid":"d83506a0-2c96-4bcb-a9fa-05e43dc329df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":85785},{"type":"v1","addr":"172.21.15.83:6801","nonce":85785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":85785},{"type":"v1","addr":"172.21.15.83:6803","nonce":85785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":85785},{"type":"v1","addr":"172.21.15.83:6807","nonce":85785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":85785},{"type":"v1","addr":"172.21.15.83:6805","nonce":85785}]},"public_addr":"172.21.15.83:6801/85785","cluster_addr":"172.21.15.83:6803/85785","heartbeat_back_addr":"172.21.15.83:6807/85785","heartbeat_front_addr":"172.21.15.83:6805/85785","state":["exists","up"]},{"osd":5,"uuid":"10687c63-a3d5-472f-acc0-4f61847b6e0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":85818},{"type":"v1","addr":"172.21.15.83:6825","nonce":85818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":85818},{"type":"v1","addr":"172.21.15.83:6827","nonce":85818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":85818},{"type":"v1","addr":"172.21.15.83:6831","nonce":85818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":85818},{"type":"v1","addr":"172.21.15.83:6829","nonce":85818}]},"public_addr":"172.21.15.83:6825/85818","cluster_addr":"172.21.15.83:6827/85818","heartbeat_back_addr":"172.21.15.83:6831/85818","heartbeat_front_addr":"172.21.15.83:6829/85818","state":["exists","up"]},{"osd":6,"uuid":"2e9daf76-5607-4a29-9a58-6e270700d223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":85787},{"type":"v1","addr":"172.21.15.83:6811","nonce":85787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":85787},{"type":"v1","addr":"172.21.15.83:6815","nonce":85787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":85787},{"type":"v1","addr":"172.21.15.83:6823","nonce":85787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6817","nonce":85787},{"type":"v1","addr":"172.21.15.83:6819","nonce":85787}]},"public_addr":"172.21.15.83:6811/85787","cluster_addr":"172.21.15.83:6815/85787","heartbeat_back_addr":"172.21.15.83:6823/85787","heartbeat_front_addr":"172.21.15.83:6819/85787","state":["exists","up"]},{"osd":7,"uuid":"5019e1ff-233a-4a5a-91ca-8afccb7ab6e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":85786},{"type":"v1","addr":"172.21.15.83:6810","nonce":85786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":85786},{"type":"v1","addr":"172.21.15.83:6814","nonce":85786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":85786},{"type":"v1","addr":"172.21.15.83:6822","nonce":85786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":85786},{"type":"v1","addr":"172.21.15.83:6818","nonce":85786}]},"public_addr":"172.21.15.83:6810/85786","cluster_addr":"172.21.15.83:6814/85786","heartbeat_back_addr":"172.21.15.83:6822/85786","heartbeat_front_addr":"172.21.15.83:6818/85786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.393431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.360031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.407428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.391613+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.403211+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.438142+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.496181+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.472323+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:23:46.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.815+0000 7f687bfff700 1 -- 172.21.15.81:0/4143379983 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f6858066f30 msgr2=0x7f68580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:46.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.815+0000 7f687bfff700 1 --2- 172.21.15.81:0/4143379983 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f6858066f30 0x7f68580693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6870006fd0 tx=0x7f6870008040 comp rx=0 tx=0).stop 2023-10-06T03:23:46.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.815+0000 7f687bfff700 1 -- 172.21.15.81:0/4143379983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6874153a90 msgr2=0x7f687415b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:46.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.815+0000 7f687bfff700 1 --2- 172.21.15.81:0/4143379983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6874153a90 0x7f687415b580 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f686400c5e0 tx=0x7f6864007f50 comp rx=0 tx=0).stop 2023-10-06T03:23:46.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.815+0000 7f687bfff700 1 -- 172.21.15.81:0/4143379983 shutdown_connections 2023-10-06T03:23:46.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.815+0000 7f687bfff700 1 --2- 172.21.15.81:0/4143379983 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f6858066f30 0x7f68580693e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:46.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.815+0000 7f687bfff700 1 --2- 172.21.15.81:0/4143379983 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6874153e60 0x7f687414e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:46.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.815+0000 7f687bfff700 1 --2- 172.21.15.81:0/4143379983 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68740b23b0 0x7f68740b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:46.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.815+0000 7f687bfff700 1 --2- 172.21.15.81:0/4143379983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6874153a90 0x7f687415b580 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:46.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.815+0000 7f687bfff700 1 -- 172.21.15.81:0/4143379983 >> 172.21.15.81:0/4143379983 conn(0x7f68740cd3c0 msgr2=0x7f68741513c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:46.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.815+0000 7f687bfff700 1 -- 172.21.15.81:0/4143379983 shutdown_connections 2023-10-06T03:23:46.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:46.815+0000 7f687bfff700 1 -- 172.21.15.81:0/4143379983 wait complete. 2023-10-06T03:23:46.833 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:23:47.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.014+0000 7f42b3fff700 1 Processor -- start 2023-10-06T03:23:47.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.014+0000 7f42b3fff700 1 -- start start 2023-10-06T03:23:47.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.015+0000 7f42b3fff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f42b406a1d0 0x7f42b40ca350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:47.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.015+0000 7f42b3fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f42b40ce770 0x7f42b40686f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:47.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.015+0000 7f42b3fff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42b406c310 con 0x7f42b415a450 2023-10-06T03:23:47.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.015+0000 7f42b3fff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42b40cb560 con 0x7f42b40ce770 2023-10-06T03:23:47.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.015+0000 7f42b3fff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42b40ca950 con 0x7f42b406a1d0 2023-10-06T03:23:47.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.015+0000 7f42b37fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f42b40ce770 0x7f42b40686f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:47.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.015+0000 7f42b27fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f42b415a450 0x7f42b40ce060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59330/0 (socket says 172.21.15.81:59330) 2023-10-06T03:23:47.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.015+0000 7f42b37fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f42b40ce770 0x7f42b40686f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46526/0 (socket says 172.21.15.81:46526) 2023-10-06T03:23:47.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.015+0000 7f42b27fc700 1 -- 172.21.15.81:0/3472237794 learned_addr learned my addr 172.21.15.81:0/3472237794 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:23:47.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.015+0000 7f42b2ffd700 1 --2- 172.21.15.81:0/3472237794 >> v2:172.21.15.83:3300/0 conn(0x7f42b406a1d0 0x7f42b40ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:47.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.016+0000 7f42b37fe700 1 -- 172.21.15.81:0/3472237794 >> v2:172.21.15.83:3300/0 conn(0x7f42b406a1d0 msgr2=0x7f42b40ca350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:47.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.016+0000 7f42b37fe700 1 --2- 172.21.15.81:0/3472237794 >> v2:172.21.15.83:3300/0 conn(0x7f42b406a1d0 0x7f42b40ca350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:47.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.016+0000 7f42b37fe700 1 -- 172.21.15.81:0/3472237794 >> v1:172.21.15.81:6789/0 conn(0x7f42b415a450 legacy=0x7f42b40ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:47.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.016+0000 7f42b37fe700 1 -- 172.21.15.81:0/3472237794 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b40cac30 con 0x7f42b40ce770 2023-10-06T03:23:47.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.016+0000 7f42b1ffb700 1 -- 172.21.15.81:0/3472237794 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1959000748 0 0) 0x7f42b406c310 con 0x7f42b415a450 2023-10-06T03:23:47.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.016+0000 7f42b37fe700 1 --2- 172.21.15.81:0/3472237794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42b40ce770 0x7f42b40686f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f42b406f140 tx=0x7f42ac009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d24f4050d8d572a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:47.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.016+0000 7f42b1ffb700 1 -- 172.21.15.81:0/3472237794 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ac00e070 con 0x7f42b40ce770 2023-10-06T03:23:47.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.016+0000 7f42b1ffb700 1 -- 172.21.15.81:0/3472237794 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42ac00bc30 con 0x7f42b40ce770 2023-10-06T03:23:47.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.016+0000 7f42b1ffb700 1 -- 172.21.15.81:0/3472237794 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ac012430 con 0x7f42b40ce770 2023-10-06T03:23:47.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.017+0000 7f42b3fff700 1 -- 172.21.15.81:0/3472237794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42b40ce770 msgr2=0x7f42b40686f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:47.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.017+0000 7f42b3fff700 1 --2- 172.21.15.81:0/3472237794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42b40ce770 0x7f42b40686f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f42b406f140 tx=0x7f42ac009780 comp rx=0 tx=0).stop 2023-10-06T03:23:47.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.017+0000 7f42b3fff700 1 -- 172.21.15.81:0/3472237794 shutdown_connections 2023-10-06T03:23:47.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.017+0000 7f42b3fff700 1 --2- 172.21.15.81:0/3472237794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42b40ce770 0x7f42b40686f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:47.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.017+0000 7f42b3fff700 1 --2- 172.21.15.81:0/3472237794 >> v2:172.21.15.83:3300/0 conn(0x7f42b406a1d0 0x7f42b40ca350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:47.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.017+0000 7f42b3fff700 1 -- 172.21.15.81:0/3472237794 >> 172.21.15.81:0/3472237794 conn(0x7f42b406d570 msgr2=0x7f42b406d970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:47.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.017+0000 7f42b3fff700 1 -- 172.21.15.81:0/3472237794 shutdown_connections 2023-10-06T03:23:47.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.017+0000 7f42b3fff700 1 -- 172.21.15.81:0/3472237794 wait complete. 2023-10-06T03:23:47.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.018+0000 7f42b3fff700 1 Processor -- start 2023-10-06T03:23:47.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.018+0000 7f42b3fff700 1 -- start start 2023-10-06T03:23:47.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.019+0000 7f42b3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42b406a1d0 0x7f42b40b3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:47.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.019+0000 7f42b3fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42b40ce770 0x7f42b4158690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:47.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.019+0000 7f42b3fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f42b415a450 0x7f42b40ab340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:47.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.019+0000 7f42b3fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b40b11f0 con 0x7f42b406a1d0 2023-10-06T03:23:47.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.019+0000 7f42b3fff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b40aa7d0 con 0x7f42b415a450 2023-10-06T03:23:47.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.019+0000 7f42b3fff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42b40aaab0 con 0x7f42b40ce770 2023-10-06T03:23:47.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.019+0000 7f42b2ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42b406a1d0 0x7f42b40b3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:47.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.019+0000 7f42b2ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42b406a1d0 0x7f42b40b3650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46542/0 (socket says 172.21.15.81:46542) 2023-10-06T03:23:47.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.019+0000 7f42b2ffd700 1 -- 172.21.15.81:0/2111956233 learned_addr learned my addr 172.21.15.81:0/2111956233 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:47.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.020+0000 7f42b2ffd700 1 -- 172.21.15.81:0/2111956233 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42b40ce770 msgr2=0x7f42b4158690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:47.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.020+0000 7f42b2ffd700 1 --2- 172.21.15.81:0/2111956233 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42b40ce770 0x7f42b4158690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:47.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.020+0000 7f42b2ffd700 1 -- 172.21.15.81:0/2111956233 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f42b415a450 msgr2=0x7f42b40ab340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:47.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.020+0000 7f42b2ffd700 1 --2- 172.21.15.81:0/2111956233 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f42b415a450 0x7f42b40ab340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:47.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.020+0000 7f42b2ffd700 1 -- 172.21.15.81:0/2111956233 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42ac009a20 con 0x7f42b406a1d0 2023-10-06T03:23:47.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.020+0000 7f42b2ffd700 1 --2- 172.21.15.81:0/2111956233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42b406a1d0 0x7f42b40b3650 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f42a400d890 tx=0x7f42a4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:47.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.020+0000 7f429affd700 1 -- 172.21.15.81:0/2111956233 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a400b600 con 0x7f42b406a1d0 2023-10-06T03:23:47.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.020+0000 7f429affd700 1 -- 172.21.15.81:0/2111956233 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42a400b760 con 0x7f42b406a1d0 2023-10-06T03:23:47.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.020+0000 7f429affd700 1 -- 172.21.15.81:0/2111956233 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a400bae0 con 0x7f42b406a1d0 2023-10-06T03:23:47.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.020+0000 7f42b3fff700 1 -- 172.21.15.81:0/2111956233 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42b40aad90 con 0x7f42b406a1d0 2023-10-06T03:23:47.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.020+0000 7f42b3fff700 1 -- 172.21.15.81:0/2111956233 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42b40b3b90 con 0x7f42b406a1d0 2023-10-06T03:23:47.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.021+0000 7f42b3fff700 1 -- 172.21.15.81:0/2111956233 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42b406e460 con 0x7f42b406a1d0 2023-10-06T03:23:47.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.022+0000 7f429affd700 1 -- 172.21.15.81:0/2111956233 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f42a401e460 con 0x7f42b406a1d0 2023-10-06T03:23:47.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.024+0000 7f429affd700 1 --2- 172.21.15.81:0/2111956233 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f42a0066f30 0x7f42a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:47.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.024+0000 7f429affd700 1 -- 172.21.15.81:0/2111956233 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f42a40850d0 con 0x7f42b406a1d0 2023-10-06T03:23:47.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.024+0000 7f42b27fc700 1 --2- 172.21.15.81:0/2111956233 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f42a0066f30 0x7f42a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:47.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.025+0000 7f42b27fc700 1 --2- 172.21.15.81:0/2111956233 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f42a0066f30 0x7f42a00693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f42b416d950 tx=0x7f42a8007bd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:47.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.028+0000 7f429affd700 1 -- 172.21.15.81:0/2111956233 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f42a4051e50 con 0x7f42b406a1d0 2023-10-06T03:23:47.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.219+0000 7f42b3fff700 1 -- 172.21.15.81:0/2111956233 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42b404bb80 con 0x7f42b406a1d0 2023-10-06T03:23:47.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.220+0000 7f429affd700 1 -- 172.21.15.81:0/2111956233 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18659 (secure 0 0 0) 0x7f42a4055470 con 0x7f42b406a1d0 2023-10-06T03:23:47.221 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:23:47.221 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"fsid":"1807b5d7-9be8-43ad-aaf8-99a4273430b3","created":"2023-10-06T03:23:20.805306+0000","modified":"2023-10-06T03:23:45.419616+0000","last_up_change":"2023-10-06T03:23:32.735796+0000","last_in_change":"2023-10-06T03:23:24.109024+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:33.198850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:33.606744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:23:38.742266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:23:39.347944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:23:42.959054+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"14fb667d-a677-4978-a477-80027f889d36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":85563},{"type":"v1","addr":"172.21.15.81:6818","nonce":85563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":85563},{"type":"v1","addr":"172.21.15.81:6822","nonce":85563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":85563},{"type":"v1","addr":"172.21.15.81:6830","nonce":85563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":85563},{"type":"v1","addr":"172.21.15.81:6826","nonce":85563}]},"public_addr":"172.21.15.81:6818/85563","cluster_addr":"172.21.15.81:6822/85563","heartbeat_back_addr":"172.21.15.81:6830/85563","heartbeat_front_addr":"172.21.15.81:6826/85563","state":["exists","up"]},{"osd":1,"uuid":"974d8a86-1829-4176-89ce-18e6038857f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":85561},{"type":"v1","addr":"172.21.15.81:6801","nonce":85561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":85561},{"type":"v1","addr":"172.21.15.81:6803","nonce":85561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":85561},{"type":"v1","addr":"172.21.15.81:6807","nonce":85561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":85561},{"type":"v1","addr":"172.21.15.81:6805","nonce":85561}]},"public_addr":"172.21.15.81:6801/85561","cluster_addr":"172.21.15.81:6803/85561","heartbeat_back_addr":"172.21.15.81:6807/85561","heartbeat_front_addr":"172.21.15.81:6805/85561","state":["exists","up"]},{"osd":2,"uuid":"ffbfe056-46bc-46e0-bf49-4d8f8650e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":85564},{"type":"v1","addr":"172.21.15.81:6809","nonce":85564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":85564},{"type":"v1","addr":"172.21.15.81:6811","nonce":85564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":85564},{"type":"v1","addr":"172.21.15.81:6815","nonce":85564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":85564},{"type":"v1","addr":"172.21.15.81:6813","nonce":85564}]},"public_addr":"172.21.15.81:6809/85564","cluster_addr":"172.21.15.81:6811/85564","heartbeat_back_addr":"172.21.15.81:6815/85564","heartbeat_front_addr":"172.21.15.81:6813/85564","state":["exists","up"]},{"osd":3,"uuid":"ef9a8314-3d37-4ea1-858a-e704d5695002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":85562},{"type":"v1","addr":"172.21.15.81:6819","nonce":85562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":85562},{"type":"v1","addr":"172.21.15.81:6823","nonce":85562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":85562},{"type":"v1","addr":"172.21.15.81:6831","nonce":85562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":85562},{"type":"v1","addr":"172.21.15.81:6827","nonce":85562}]},"public_addr":"172.21.15.81:6819/85562","cluster_addr":"172.21.15.81:6823/85562","heartbeat_back_addr":"172.21.15.81:6831/85562","heartbeat_front_addr":"172.21.15.81:6827/85562","state":["exists","up"]},{"osd":4,"uuid":"d83506a0-2c96-4bcb-a9fa-05e43dc329df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":85785},{"type":"v1","addr":"172.21.15.83:6801","nonce":85785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":85785},{"type":"v1","addr":"172.21.15.83:6803","nonce":85785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":85785},{"type":"v1","addr":"172.21.15.83:6807","nonce":85785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":85785},{"type":"v1","addr":"172.21.15.83:6805","nonce":85785}]},"public_addr":"172.21.15.83:6801/85785","cluster_addr":"172.21.15.83:6803/85785","heartbeat_back_addr":"172.21.15.83:6807/85785","heartbeat_front_addr":"172.21.15.83:6805/85785","state":["exists","up"]},{"osd":5,"uuid":"10687c63-a3d5-472f-acc0-4f61847b6e0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":85818},{"type":"v1","addr":"172.21.15.83:6825","nonce":85818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":85818},{"type":"v1","addr":"172.21.15.83:6827","nonce":85818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":85818},{"type":"v1","addr":"172.21.15.83:6831","nonce":85818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":85818},{"type":"v1","addr":"172.21.15.83:6829","nonce":85818}]},"public_addr":"172.21.15.83:6825/85818","cluster_addr":"172.21.15.83:6827/85818","heartbeat_back_addr":"172.21.15.83:6831/85818","heartbeat_front_addr":"172.21.15.83:6829/85818","state":["exists","up"]},{"osd":6,"uuid":"2e9daf76-5607-4a29-9a58-6e270700d223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":85787},{"type":"v1","addr":"172.21.15.83:6811","nonce":85787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":85787},{"type":"v1","addr":"172.21.15.83:6815","nonce":85787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":85787},{"type":"v1","addr":"172.21.15.83:6823","nonce":85787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6817","nonce":85787},{"type":"v1","addr":"172.21.15.83:6819","nonce":85787}]},"public_addr":"172.21.15.83:6811/85787","cluster_addr":"172.21.15.83:6815/85787","heartbeat_back_addr":"172.21.15.83:6823/85787","heartbeat_front_addr":"172.21.15.83:6819/85787","state":["exists","up"]},{"osd":7,"uuid":"5019e1ff-233a-4a5a-91ca-8afccb7ab6e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":85786},{"type":"v1","addr":"172.21.15.83:6810","nonce":85786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":85786},{"type":"v1","addr":"172.21.15.83:6814","nonce":85786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":85786},{"type":"v1","addr":"172.21.15.83:6822","nonce":85786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":85786},{"type":"v1","addr":"172.21.15.83:6818","nonce":85786}]},"public_addr":"172.21.15.83:6810/85786","cluster_addr":"172.21.15.83:6814/85786","heartbeat_back_addr":"172.21.15.83:6822/85786","heartbeat_front_addr":"172.21.15.83:6818/85786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.393431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.360031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.407428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.391613+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.403211+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.438142+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.496181+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.472323+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:23:47.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.223+0000 7f42b3fff700 1 -- 172.21.15.81:0/2111956233 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f42a0066f30 msgr2=0x7f42a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:47.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.223+0000 7f42b3fff700 1 --2- 172.21.15.81:0/2111956233 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f42a0066f30 0x7f42a00693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f42b416d950 tx=0x7f42a8007bd0 comp rx=0 tx=0).stop 2023-10-06T03:23:47.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.223+0000 7f42b3fff700 1 -- 172.21.15.81:0/2111956233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42b406a1d0 msgr2=0x7f42b40b3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:47.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.223+0000 7f42b3fff700 1 --2- 172.21.15.81:0/2111956233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42b406a1d0 0x7f42b40b3650 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f42a400d890 tx=0x7f42a4008040 comp rx=0 tx=0).stop 2023-10-06T03:23:47.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.223+0000 7f42b3fff700 1 -- 172.21.15.81:0/2111956233 shutdown_connections 2023-10-06T03:23:47.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.223+0000 7f42b3fff700 1 --2- 172.21.15.81:0/2111956233 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f42b415a450 0x7f42b40ab340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:47.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.223+0000 7f42b3fff700 1 --2- 172.21.15.81:0/2111956233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42b406a1d0 0x7f42b40b3650 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:47.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.223+0000 7f42b3fff700 1 --2- 172.21.15.81:0/2111956233 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f42a0066f30 0x7f42a00693e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:47.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.223+0000 7f42b3fff700 1 --2- 172.21.15.81:0/2111956233 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42b40ce770 0x7f42b4158690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:47.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.223+0000 7f42b3fff700 1 -- 172.21.15.81:0/2111956233 >> 172.21.15.81:0/2111956233 conn(0x7f42b406d570 msgr2=0x7f42b4159540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:47.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.223+0000 7f42b3fff700 1 -- 172.21.15.81:0/2111956233 shutdown_connections 2023-10-06T03:23:47.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.223+0000 7f42b3fff700 1 -- 172.21.15.81:0/2111956233 wait complete. 2023-10-06T03:23:47.254 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:23:47.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.432+0000 7fb01cd9d700 1 Processor -- start 2023-10-06T03:23:47.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.432+0000 7fb01cd9d700 1 -- start start 2023-10-06T03:23:47.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.433+0000 7fb01cd9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb0180b2420 0x7fb0181643d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:47.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.433+0000 7fb01cd9d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0180b4760 con 0x7fb0180ccd40 2023-10-06T03:23:47.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.433+0000 7fb01cd9d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0180cd320 con 0x7fb0180cc670 2023-10-06T03:23:47.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.433+0000 7fb01cd9d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0180b60f0 con 0x7fb0180b2420 2023-10-06T03:23:47.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.434+0000 7fb016ffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb0180ccd40 0x7fb0180b1d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59332/0 (socket says 172.21.15.81:59332) 2023-10-06T03:23:47.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.434+0000 7fb016ffd700 1 -- 172.21.15.81:0/3868985066 learned_addr learned my addr 172.21.15.81:0/3868985066 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:23:47.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.434+0000 7fb017fff700 1 --2- 172.21.15.81:0/3868985066 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb0180b2420 0x7fb0181643d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:47.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.434+0000 7fb0167fc700 1 -- 172.21.15.81:0/3868985066 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2272793599 0 0) 0x7fb0180b4760 con 0x7fb0180ccd40 2023-10-06T03:23:47.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.434+0000 7fb0167fc700 1 -- 172.21.15.81:0/3868985066 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb000003570 con 0x7fb0180ccd40 2023-10-06T03:23:47.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.434+0000 7fb0167fc700 1 -- 172.21.15.81:0/3868985066 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 900383218 0 0) 0x7fb0180cd320 con 0x7fb0180cc670 2023-10-06T03:23:47.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.434+0000 7fb0167fc700 1 -- 172.21.15.81:0/3868985066 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0180b4760 con 0x7fb0180cc670 2023-10-06T03:23:47.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.434+0000 7fb017fff700 1 -- 172.21.15.81:0/3868985066 >> v1:172.21.15.83:6789/0 conn(0x7fb0180cc670 legacy=0x7fb01815a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:47.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.434+0000 7fb017fff700 1 -- 172.21.15.81:0/3868985066 >> v1:172.21.15.81:6789/0 conn(0x7fb0180ccd40 legacy=0x7fb0180b1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:47.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.434+0000 7fb017fff700 1 -- 172.21.15.81:0/3868985066 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0180b3e30 con 0x7fb0180b2420 2023-10-06T03:23:47.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.435+0000 7fb017fff700 1 --2- 172.21.15.81:0/3868985066 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb0180b2420 0x7fb0181643d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb010009e90 tx=0x7fb010009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abf2d82e78d50682 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:47.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.435+0000 7fb0167fc700 1 -- 172.21.15.81:0/3868985066 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01000e070 con 0x7fb0180b2420 2023-10-06T03:23:47.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.435+0000 7fb0167fc700 1 -- 172.21.15.81:0/3868985066 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01000bb80 con 0x7fb0180b2420 2023-10-06T03:23:47.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.435+0000 7fb0167fc700 1 -- 172.21.15.81:0/3868985066 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb010012430 con 0x7fb0180b2420 2023-10-06T03:23:47.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.435+0000 7fb01cd9d700 1 -- 172.21.15.81:0/3868985066 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb0180b2420 msgr2=0x7fb0181643d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:47.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.435+0000 7fb01cd9d700 1 --2- 172.21.15.81:0/3868985066 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb0180b2420 0x7fb0181643d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb010009e90 tx=0x7fb010009780 comp rx=0 tx=0).stop 2023-10-06T03:23:47.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.435+0000 7fb01cd9d700 1 -- 172.21.15.81:0/3868985066 shutdown_connections 2023-10-06T03:23:47.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.435+0000 7fb01cd9d700 1 --2- 172.21.15.81:0/3868985066 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb0180b2420 0x7fb0181643d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:47.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.435+0000 7fb01cd9d700 1 -- 172.21.15.81:0/3868985066 >> 172.21.15.81:0/3868985066 conn(0x7fb01806ed10 msgr2=0x7fb01806f110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:47.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.435+0000 7fb01cd9d700 1 -- 172.21.15.81:0/3868985066 shutdown_connections 2023-10-06T03:23:47.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.436+0000 7fb01cd9d700 1 -- 172.21.15.81:0/3868985066 wait complete. 2023-10-06T03:23:47.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.437+0000 7fb01cd9d700 1 Processor -- start 2023-10-06T03:23:47.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.437+0000 7fb01cd9d700 1 -- start start 2023-10-06T03:23:47.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.438+0000 7fb01cd9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb0180b2420 0x7fb018158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:47.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.438+0000 7fb01cd9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0180cc670 0x7fb018153650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:47.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.438+0000 7fb01cd9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb0180ccd40 0x7fb0180cf980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:47.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.438+0000 7fb01cd9d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01816dc00 con 0x7fb0180cc670 2023-10-06T03:23:47.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.438+0000 7fb01cd9d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01816d010 con 0x7fb0180ccd40 2023-10-06T03:23:47.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.438+0000 7fb01cd9d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb01816d2d0 con 0x7fb0180b2420 2023-10-06T03:23:47.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.438+0000 7fb016ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0180cc670 0x7fb018153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:47.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.438+0000 7fb017fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb0180ccd40 0x7fb0180cf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:47.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.438+0000 7fb016ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0180cc670 0x7fb018153650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46546/0 (socket says 172.21.15.81:46546) 2023-10-06T03:23:47.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.438+0000 7fb016ffd700 1 -- 172.21.15.81:0/451509820 learned_addr learned my addr 172.21.15.81:0/451509820 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:47.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.438+0000 7fb0177fe700 1 --2- 172.21.15.81:0/451509820 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb0180b2420 0x7fb018158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:47.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.439+0000 7fb016ffd700 1 -- 172.21.15.81:0/451509820 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb0180b2420 msgr2=0x7fb018158860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:47.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.439+0000 7fb016ffd700 1 --2- 172.21.15.81:0/451509820 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb0180b2420 0x7fb018158860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:47.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.439+0000 7fb016ffd700 1 -- 172.21.15.81:0/451509820 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb0180ccd40 msgr2=0x7fb0180cf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:47.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.439+0000 7fb016ffd700 1 --2- 172.21.15.81:0/451509820 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb0180ccd40 0x7fb0180cf980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:47.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.439+0000 7fb016ffd700 1 -- 172.21.15.81:0/451509820 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb010009a20 con 0x7fb0180cc670 2023-10-06T03:23:47.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.439+0000 7fb016ffd700 1 --2- 172.21.15.81:0/451509820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0180cc670 0x7fb018153650 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb00c00c790 tx=0x7fb00c007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:47.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.439+0000 7fafff7fe700 1 -- 172.21.15.81:0/451509820 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00c005b30 con 0x7fb0180cc670 2023-10-06T03:23:47.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.439+0000 7fafff7fe700 1 -- 172.21.15.81:0/451509820 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb00c005cd0 con 0x7fb0180cc670 2023-10-06T03:23:47.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.439+0000 7fb01cd9d700 1 -- 172.21.15.81:0/451509820 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb01816d5b0 con 0x7fb0180cc670 2023-10-06T03:23:47.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.439+0000 7fafff7fe700 1 -- 172.21.15.81:0/451509820 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00c007320 con 0x7fb0180cc670 2023-10-06T03:23:47.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.439+0000 7fb01cd9d700 1 -- 172.21.15.81:0/451509820 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb018158da0 con 0x7fb0180cc670 2023-10-06T03:23:47.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.440+0000 7fb01cd9d700 1 -- 172.21.15.81:0/451509820 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb01804c3c0 con 0x7fb0180cc670 2023-10-06T03:23:47.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.441+0000 7fafff7fe700 1 -- 172.21.15.81:0/451509820 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb00c012400 con 0x7fb0180cc670 2023-10-06T03:23:47.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.442+0000 7fafff7fe700 1 --2- 172.21.15.81:0/451509820 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb004066f30 0x7fb0040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:47.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.443+0000 7fafff7fe700 1 -- 172.21.15.81:0/451509820 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fb00c083c80 con 0x7fb0180cc670 2023-10-06T03:23:47.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.443+0000 7fb0177fe700 1 --2- 172.21.15.81:0/451509820 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb004066f30 0x7fb0040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:47.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.443+0000 7fb0177fe700 1 --2- 172.21.15.81:0/451509820 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb004066f30 0x7fb0040693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb008007fd0 tx=0x7fb008007d50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:47.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.446+0000 7fafff7fe700 1 -- 172.21.15.81:0/451509820 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb00c04b5a0 con 0x7fb0180cc670 2023-10-06T03:23:47.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.681+0000 7fb01cd9d700 1 -- 172.21.15.81:0/451509820 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb01804bb80 con 0x7fb0180cc670 2023-10-06T03:23:47.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.682+0000 7fafff7fe700 1 -- 172.21.15.81:0/451509820 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4590 (secure 0 0 0) 0x7fb00c017020 con 0x7fb0180cc670 2023-10-06T03:23:47.683 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:23:47.683 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1255569320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1255569320},{"type":"v1","addr":"172.21.15.83:6835","nonce":1255569320}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1673166762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1673166762},{"type":"v1","addr":"172.21.15.81:6835","nonce":1673166762}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3689326153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3689326153},{"type":"v1","addr":"172.21.15.81:6837","nonce":3689326153}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:23:40.376852+0000","modified":"2023-10-06T03:23:45.940754+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6833/745669616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":745669616},{"type":"v1","addr":"172.21.15.83:6833","nonce":745669616}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-10-06T03:23:47.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.684+0000 7fb01cd9d700 1 -- 172.21.15.81:0/451509820 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb004066f30 msgr2=0x7fb0040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:47.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.684+0000 7fb01cd9d700 1 --2- 172.21.15.81:0/451509820 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb004066f30 0x7fb0040693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb008007fd0 tx=0x7fb008007d50 comp rx=0 tx=0).stop 2023-10-06T03:23:47.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.684+0000 7fb01cd9d700 1 -- 172.21.15.81:0/451509820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0180cc670 msgr2=0x7fb018153650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:47.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.684+0000 7fb01cd9d700 1 --2- 172.21.15.81:0/451509820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0180cc670 0x7fb018153650 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb00c00c790 tx=0x7fb00c007e80 comp rx=0 tx=0).stop 2023-10-06T03:23:47.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.684+0000 7fb01cd9d700 1 -- 172.21.15.81:0/451509820 shutdown_connections 2023-10-06T03:23:47.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.684+0000 7fb01cd9d700 1 --2- 172.21.15.81:0/451509820 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb0180ccd40 0x7fb0180cf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:47.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.684+0000 7fb01cd9d700 1 --2- 172.21.15.81:0/451509820 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb004066f30 0x7fb0040693e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:47.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.684+0000 7fb01cd9d700 1 --2- 172.21.15.81:0/451509820 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb0180b2420 0x7fb018158860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:47.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.684+0000 7fb01cd9d700 1 --2- 172.21.15.81:0/451509820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0180cc670 0x7fb018153650 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:47.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.684+0000 7fb01cd9d700 1 -- 172.21.15.81:0/451509820 >> 172.21.15.81:0/451509820 conn(0x7fb01806ed10 msgr2=0x7fb0181592a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:47.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.684+0000 7fb01cd9d700 1 -- 172.21.15.81:0/451509820 shutdown_connections 2023-10-06T03:23:47.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.684+0000 7fb01cd9d700 1 -- 172.21.15.81:0/451509820 wait complete. 2023-10-06T03:23:47.687 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 7 2023-10-06T03:23:47.703 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:23:47.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.883+0000 7f6dff5ff700 1 Processor -- start 2023-10-06T03:23:47.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.883+0000 7f6dff5ff700 1 -- start start 2023-10-06T03:23:47.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.884+0000 7f6dff5ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6df813f9c0 0x7f6df80ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:47.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.884+0000 7f6dff5ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6df815a5c0 0x7f6df80c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:47.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.884+0000 7f6dff5ff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6df80cafe0 con 0x7f6df80cab60 2023-10-06T03:23:47.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.884+0000 7f6dff5ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6df80cb2c0 con 0x7f6df813f9c0 2023-10-06T03:23:47.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.884+0000 7f6dff5ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6df80cb5a0 con 0x7f6df815a5c0 2023-10-06T03:23:47.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.885+0000 7f6dfd39b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6df813f9c0 0x7f6df80ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:47.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.885+0000 7f6dfd39b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6df813f9c0 0x7f6df80ca620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46548/0 (socket says 172.21.15.81:46548) 2023-10-06T03:23:47.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.885+0000 7f6dfd39b700 1 -- 172.21.15.81:0/373654396 learned_addr learned my addr 172.21.15.81:0/373654396 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:47.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.885+0000 7f6dfcb9a700 1 --1- 172.21.15.81:0/373654396 >> v1:172.21.15.81:6789/0 conn(0x7f6df80cab60 0x7f6df8159eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59346/0 (socket says 172.21.15.81:59346) 2023-10-06T03:23:47.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.885+0000 7f6dfd39b700 1 -- 172.21.15.81:0/373654396 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6df815a5c0 msgr2=0x7f6df80c6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:47.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.885+0000 7f6dfdb9c700 1 --2- 172.21.15.81:0/373654396 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6df815a5c0 0x7f6df80c6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:47.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.885+0000 7f6deffff700 1 -- 172.21.15.81:0/373654396 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2246110803 0 0) 0x7f6df80cafe0 con 0x7f6df80cab60 2023-10-06T03:23:47.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.885+0000 7f6dfd39b700 1 --2- 172.21.15.81:0/373654396 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6df815a5c0 0x7f6df80c6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:47.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.885+0000 7f6dfd39b700 1 -- 172.21.15.81:0/373654396 >> v1:172.21.15.81:6789/0 conn(0x7f6df80cab60 legacy=0x7f6df8159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:47.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.885+0000 7f6dfd39b700 1 -- 172.21.15.81:0/373654396 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df80cb880 con 0x7f6df813f9c0 2023-10-06T03:23:47.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.885+0000 7f6dfdb9c700 1 --2- 172.21.15.81:0/373654396 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6df815a5c0 0x7f6df80c6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:23:47.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.885+0000 7f6dfd39b700 1 --2- 172.21.15.81:0/373654396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6df813f9c0 0x7f6df80ca620 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6df400bc50 tx=0x7f6df400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4680002be13fe0d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:47.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.885+0000 7f6deffff700 1 -- 172.21.15.81:0/373654396 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df400be60 con 0x7f6df813f9c0 2023-10-06T03:23:47.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.886+0000 7f6deffff700 1 -- 172.21.15.81:0/373654396 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6df400de00 con 0x7f6df813f9c0 2023-10-06T03:23:47.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.886+0000 7f6deffff700 1 -- 172.21.15.81:0/373654396 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df40196b0 con 0x7f6df813f9c0 2023-10-06T03:23:47.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.886+0000 7f6dff5ff700 1 -- 172.21.15.81:0/373654396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6df813f9c0 msgr2=0x7f6df80ca620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:47.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.886+0000 7f6dff5ff700 1 --2- 172.21.15.81:0/373654396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6df813f9c0 0x7f6df80ca620 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6df400bc50 tx=0x7f6df400b4f0 comp rx=0 tx=0).stop 2023-10-06T03:23:47.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.886+0000 7f6dff5ff700 1 -- 172.21.15.81:0/373654396 shutdown_connections 2023-10-06T03:23:47.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.886+0000 7f6dff5ff700 1 --2- 172.21.15.81:0/373654396 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6df815a5c0 0x7f6df80c6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:47.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.886+0000 7f6dff5ff700 1 --2- 172.21.15.81:0/373654396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6df813f9c0 0x7f6df80ca620 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:47.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.886+0000 7f6dff5ff700 1 -- 172.21.15.81:0/373654396 >> 172.21.15.81:0/373654396 conn(0x7f6df80cc090 msgr2=0x7f6df80cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:47.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.886+0000 7f6dff5ff700 1 -- 172.21.15.81:0/373654396 shutdown_connections 2023-10-06T03:23:47.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.886+0000 7f6dff5ff700 1 -- 172.21.15.81:0/373654396 wait complete. 2023-10-06T03:23:47.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.888+0000 7f6dff5ff700 1 Processor -- start 2023-10-06T03:23:47.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.888+0000 7f6dff5ff700 1 -- start start 2023-10-06T03:23:47.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.889+0000 7f6dff5ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6df813f9c0 0x7f6df80b0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:47.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.889+0000 7f6dff5ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6df815a5c0 0x7f6df80b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:47.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.889+0000 7f6dff5ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6df813ebf0 0x7f6df80c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:47.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.889+0000 7f6dff5ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df8159070 con 0x7f6df815a5c0 2023-10-06T03:23:47.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.889+0000 7f6dff5ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df80b13f0 con 0x7f6df813ebf0 2023-10-06T03:23:47.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.889+0000 7f6dff5ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6df80b1110 con 0x7f6df813f9c0 2023-10-06T03:23:47.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.889+0000 7f6dfcb9a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6df815a5c0 0x7f6df80b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:47.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.889+0000 7f6dfcb9a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6df815a5c0 0x7f6df80b18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46560/0 (socket says 172.21.15.81:46560) 2023-10-06T03:23:47.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.889+0000 7f6dfcb9a700 1 -- 172.21.15.81:0/2377756751 learned_addr learned my addr 172.21.15.81:0/2377756751 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:47.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.889+0000 7f6dfdb9c700 1 --2- 172.21.15.81:0/2377756751 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6df813ebf0 0x7f6df80c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:47.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.889+0000 7f6dfd39b700 1 --2- 172.21.15.81:0/2377756751 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6df813f9c0 0x7f6df80b0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:47.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.889+0000 7f6dfcb9a700 1 -- 172.21.15.81:0/2377756751 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6df813f9c0 msgr2=0x7f6df80b0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:47.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.889+0000 7f6dfcb9a700 1 --2- 172.21.15.81:0/2377756751 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6df813f9c0 0x7f6df80b0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:47.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.889+0000 7f6dfcb9a700 1 -- 172.21.15.81:0/2377756751 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6df813ebf0 msgr2=0x7f6df80c7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:47.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.889+0000 7f6dfcb9a700 1 --2- 172.21.15.81:0/2377756751 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6df813ebf0 0x7f6df80c7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:47.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.889+0000 7f6dfcb9a700 1 -- 172.21.15.81:0/2377756751 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df400b790 con 0x7f6df815a5c0 2023-10-06T03:23:47.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.889+0000 7f6dfdb9c700 1 --2- 172.21.15.81:0/2377756751 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6df813ebf0 0x7f6df80c7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:23:47.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.889+0000 7f6dfcb9a700 1 --2- 172.21.15.81:0/2377756751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6df815a5c0 0x7f6df80b18a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6de80011e0 tx=0x7f6de8007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:47.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.890+0000 7f6ded7fa700 1 -- 172.21.15.81:0/2377756751 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de8005a70 con 0x7f6df815a5c0 2023-10-06T03:23:47.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.890+0000 7f6ded7fa700 1 -- 172.21.15.81:0/2377756751 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de8005bd0 con 0x7f6df815a5c0 2023-10-06T03:23:47.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.890+0000 7f6ded7fa700 1 -- 172.21.15.81:0/2377756751 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de80070d0 con 0x7f6df815a5c0 2023-10-06T03:23:47.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.890+0000 7f6dff5ff700 1 -- 172.21.15.81:0/2377756751 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6df80c3740 con 0x7f6df815a5c0 2023-10-06T03:23:47.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.890+0000 7f6dff5ff700 1 -- 172.21.15.81:0/2377756751 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6df80c3d00 con 0x7f6df815a5c0 2023-10-06T03:23:47.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.891+0000 7f6dff5ff700 1 -- 172.21.15.81:0/2377756751 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6df804c3c0 con 0x7f6df815a5c0 2023-10-06T03:23:47.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.892+0000 7f6ded7fa700 1 -- 172.21.15.81:0/2377756751 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6de8007480 con 0x7f6df815a5c0 2023-10-06T03:23:47.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.892+0000 7f6ded7fa700 1 --2- 172.21.15.81:0/2377756751 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f6ddc066f30 0x7f6ddc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:47.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.892+0000 7f6ded7fa700 1 -- 172.21.15.81:0/2377756751 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f6de8083dd0 con 0x7f6df815a5c0 2023-10-06T03:23:47.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.893+0000 7f6dfd39b700 1 --2- 172.21.15.81:0/2377756751 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f6ddc066f30 0x7f6ddc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:47.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.893+0000 7f6dfd39b700 1 --2- 172.21.15.81:0/2377756751 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f6ddc066f30 0x7f6ddc0693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6df400bc50 tx=0x7f6df401b000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:47.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:47.896+0000 7f6ded7fa700 1 -- 172.21.15.81:0/2377756751 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6de804b5a0 con 0x7f6df815a5c0 2023-10-06T03:23:48.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.092+0000 7f6dff5ff700 1 -- 172.21.15.81:0/2377756751 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6df806f720 con 0x7f6df815a5c0 2023-10-06T03:23:48.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.093+0000 7f6ded7fa700 1 -- 172.21.15.81:0/2377756751 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18659 (secure 0 0 0) 0x7f6de8085020 con 0x7f6df815a5c0 2023-10-06T03:23:48.094 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:23:48.094 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"fsid":"1807b5d7-9be8-43ad-aaf8-99a4273430b3","created":"2023-10-06T03:23:20.805306+0000","modified":"2023-10-06T03:23:45.419616+0000","last_up_change":"2023-10-06T03:23:32.735796+0000","last_in_change":"2023-10-06T03:23:24.109024+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:33.198850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:33.606744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:23:38.742266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:23:39.347944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:23:42.959054+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"14fb667d-a677-4978-a477-80027f889d36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":85563},{"type":"v1","addr":"172.21.15.81:6818","nonce":85563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":85563},{"type":"v1","addr":"172.21.15.81:6822","nonce":85563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":85563},{"type":"v1","addr":"172.21.15.81:6830","nonce":85563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":85563},{"type":"v1","addr":"172.21.15.81:6826","nonce":85563}]},"public_addr":"172.21.15.81:6818/85563","cluster_addr":"172.21.15.81:6822/85563","heartbeat_back_addr":"172.21.15.81:6830/85563","heartbeat_front_addr":"172.21.15.81:6826/85563","state":["exists","up"]},{"osd":1,"uuid":"974d8a86-1829-4176-89ce-18e6038857f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":85561},{"type":"v1","addr":"172.21.15.81:6801","nonce":85561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":85561},{"type":"v1","addr":"172.21.15.81:6803","nonce":85561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":85561},{"type":"v1","addr":"172.21.15.81:6807","nonce":85561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":85561},{"type":"v1","addr":"172.21.15.81:6805","nonce":85561}]},"public_addr":"172.21.15.81:6801/85561","cluster_addr":"172.21.15.81:6803/85561","heartbeat_back_addr":"172.21.15.81:6807/85561","heartbeat_front_addr":"172.21.15.81:6805/85561","state":["exists","up"]},{"osd":2,"uuid":"ffbfe056-46bc-46e0-bf49-4d8f8650e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":85564},{"type":"v1","addr":"172.21.15.81:6809","nonce":85564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":85564},{"type":"v1","addr":"172.21.15.81:6811","nonce":85564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":85564},{"type":"v1","addr":"172.21.15.81:6815","nonce":85564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":85564},{"type":"v1","addr":"172.21.15.81:6813","nonce":85564}]},"public_addr":"172.21.15.81:6809/85564","cluster_addr":"172.21.15.81:6811/85564","heartbeat_back_addr":"172.21.15.81:6815/85564","heartbeat_front_addr":"172.21.15.81:6813/85564","state":["exists","up"]},{"osd":3,"uuid":"ef9a8314-3d37-4ea1-858a-e704d5695002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":85562},{"type":"v1","addr":"172.21.15.81:6819","nonce":85562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":85562},{"type":"v1","addr":"172.21.15.81:6823","nonce":85562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":85562},{"type":"v1","addr":"172.21.15.81:6831","nonce":85562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":85562},{"type":"v1","addr":"172.21.15.81:6827","nonce":85562}]},"public_addr":"172.21.15.81:6819/85562","cluster_addr":"172.21.15.81:6823/85562","heartbeat_back_addr":"172.21.15.81:6831/85562","heartbeat_front_addr":"172.21.15.81:6827/85562","state":["exists","up"]},{"osd":4,"uuid":"d83506a0-2c96-4bcb-a9fa-05e43dc329df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":85785},{"type":"v1","addr":"172.21.15.83:6801","nonce":85785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":85785},{"type":"v1","addr":"172.21.15.83:6803","nonce":85785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":85785},{"type":"v1","addr":"172.21.15.83:6807","nonce":85785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":85785},{"type":"v1","addr":"172.21.15.83:6805","nonce":85785}]},"public_addr":"172.21.15.83:6801/85785","cluster_addr":"172.21.15.83:6803/85785","heartbeat_back_addr":"172.21.15.83:6807/85785","heartbeat_front_addr":"172.21.15.83:6805/85785","state":["exists","up"]},{"osd":5,"uuid":"10687c63-a3d5-472f-acc0-4f61847b6e0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":85818},{"type":"v1","addr":"172.21.15.83:6825","nonce":85818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":85818},{"type":"v1","addr":"172.21.15.83:6827","nonce":85818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":85818},{"type":"v1","addr":"172.21.15.83:6831","nonce":85818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":85818},{"type":"v1","addr":"172.21.15.83:6829","nonce":85818}]},"public_addr":"172.21.15.83:6825/85818","cluster_addr":"172.21.15.83:6827/85818","heartbeat_back_addr":"172.21.15.83:6831/85818","heartbeat_front_addr":"172.21.15.83:6829/85818","state":["exists","up"]},{"osd":6,"uuid":"2e9daf76-5607-4a29-9a58-6e270700d223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":85787},{"type":"v1","addr":"172.21.15.83:6811","nonce":85787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":85787},{"type":"v1","addr":"172.21.15.83:6815","nonce":85787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":85787},{"type":"v1","addr":"172.21.15.83:6823","nonce":85787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6817","nonce":85787},{"type":"v1","addr":"172.21.15.83:6819","nonce":85787}]},"public_addr":"172.21.15.83:6811/85787","cluster_addr":"172.21.15.83:6815/85787","heartbeat_back_addr":"172.21.15.83:6823/85787","heartbeat_front_addr":"172.21.15.83:6819/85787","state":["exists","up"]},{"osd":7,"uuid":"5019e1ff-233a-4a5a-91ca-8afccb7ab6e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":85786},{"type":"v1","addr":"172.21.15.83:6810","nonce":85786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":85786},{"type":"v1","addr":"172.21.15.83:6814","nonce":85786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":85786},{"type":"v1","addr":"172.21.15.83:6822","nonce":85786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":85786},{"type":"v1","addr":"172.21.15.83:6818","nonce":85786}]},"public_addr":"172.21.15.83:6810/85786","cluster_addr":"172.21.15.83:6814/85786","heartbeat_back_addr":"172.21.15.83:6822/85786","heartbeat_front_addr":"172.21.15.83:6818/85786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.393431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.360031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.407428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.391613+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.403211+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.438142+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.496181+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.472323+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:23:48.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.095+0000 7f6dff5ff700 1 -- 172.21.15.81:0/2377756751 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f6ddc066f30 msgr2=0x7f6ddc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:48.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.095+0000 7f6dff5ff700 1 --2- 172.21.15.81:0/2377756751 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f6ddc066f30 0x7f6ddc0693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6df400bc50 tx=0x7f6df401b000 comp rx=0 tx=0).stop 2023-10-06T03:23:48.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.095+0000 7f6dff5ff700 1 -- 172.21.15.81:0/2377756751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6df815a5c0 msgr2=0x7f6df80b18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:48.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.095+0000 7f6dff5ff700 1 --2- 172.21.15.81:0/2377756751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6df815a5c0 0x7f6df80b18a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6de80011e0 tx=0x7f6de8007e10 comp rx=0 tx=0).stop 2023-10-06T03:23:48.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.095+0000 7f6dff5ff700 1 -- 172.21.15.81:0/2377756751 shutdown_connections 2023-10-06T03:23:48.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.095+0000 7f6dff5ff700 1 --2- 172.21.15.81:0/2377756751 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6df813ebf0 0x7f6df80c7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:48.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.095+0000 7f6dff5ff700 1 --2- 172.21.15.81:0/2377756751 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f6ddc066f30 0x7f6ddc0693e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:48.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.095+0000 7f6dff5ff700 1 --2- 172.21.15.81:0/2377756751 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6df813f9c0 0x7f6df80b0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:48.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.095+0000 7f6dff5ff700 1 --2- 172.21.15.81:0/2377756751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6df815a5c0 0x7f6df80b18a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:48.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.095+0000 7f6dff5ff700 1 -- 172.21.15.81:0/2377756751 >> 172.21.15.81:0/2377756751 conn(0x7f6df80cc090 msgr2=0x7f6df806e430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:48.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.095+0000 7f6dff5ff700 1 -- 172.21.15.81:0/2377756751 shutdown_connections 2023-10-06T03:23:48.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.095+0000 7f6dff5ff700 1 -- 172.21.15.81:0/2377756751 wait complete. 2023-10-06T03:23:48.521 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T03:23:40.376852+0000', 'modified': '2023-10-06T03:23:45.940754+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4291}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4291': {'gid': 4291, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.83:6833/745669616', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.83:6832', 'nonce': 745669616}, {'type': 'v1', 'addr': '172.21.15.83:6833', 'nonce': 745669616}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 1} 2023-10-06T03:23:48.522 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T03:23:48.522 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-06T03:23:48.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.712+0000 7fc390d9d700 1 Processor -- start 2023-10-06T03:23:48.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.712+0000 7fc390d9d700 1 -- start start 2023-10-06T03:23:48.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.713+0000 7fc390d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc38c0af1a0 0x7fc38c0b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:48.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.713+0000 7fc390d9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc38c0af570 0x7fc38c0affe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:48.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.713+0000 7fc390d9d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc38c0b2d80 con 0x7fc38c0675e0 2023-10-06T03:23:48.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.713+0000 7fc390d9d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc38c0b1f60 con 0x7fc38c0af1a0 2023-10-06T03:23:48.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.713+0000 7fc390d9d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc38c0b2170 con 0x7fc38c0af570 2023-10-06T03:23:48.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.713+0000 7fc38b7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc38c0af1a0 0x7fc38c0b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:48.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.713+0000 7fc38b7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc38c0af1a0 0x7fc38c0b1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46574/0 (socket says 172.21.15.81:46574) 2023-10-06T03:23:48.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.713+0000 7fc38b7fe700 1 -- 172.21.15.81:0/1237240799 learned_addr learned my addr 172.21.15.81:0/1237240799 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:48.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.713+0000 7fc38affd700 1 --2- 172.21.15.81:0/1237240799 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc38c0af570 0x7fc38c0affe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:48.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.714+0000 7fc38b7fe700 1 -- 172.21.15.81:0/1237240799 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc38c0af570 msgr2=0x7fc38c0affe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:48.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.714+0000 7fc38b7fe700 1 --2- 172.21.15.81:0/1237240799 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc38c0af570 0x7fc38c0affe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:48.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.714+0000 7fc38b7fe700 1 -- 172.21.15.81:0/1237240799 >> v1:172.21.15.83:6789/0 conn(0x7fc38c0675e0 legacy=0x7fc38c158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:48.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.714+0000 7fc38b7fe700 1 -- 172.21.15.81:0/1237240799 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc38c0b2450 con 0x7fc38c0af1a0 2023-10-06T03:23:48.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.714+0000 7fc38b7fe700 1 --2- 172.21.15.81:0/1237240799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc38c0af1a0 0x7fc38c0b1a20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc37c0099b0 tx=0x7fc37c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24b24d3dd9117537 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:48.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.714+0000 7fc38a7fc700 1 -- 172.21.15.81:0/1237240799 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37c009ea0 con 0x7fc38c0af1a0 2023-10-06T03:23:48.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.714+0000 7fc38a7fc700 1 -- 172.21.15.81:0/1237240799 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc37c00b860 con 0x7fc38c0af1a0 2023-10-06T03:23:48.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.714+0000 7fc38a7fc700 1 -- 172.21.15.81:0/1237240799 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37c00bc00 con 0x7fc38c0af1a0 2023-10-06T03:23:48.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.715+0000 7fc390d9d700 1 -- 172.21.15.81:0/1237240799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc38c0af1a0 msgr2=0x7fc38c0b1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:48.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.715+0000 7fc390d9d700 1 --2- 172.21.15.81:0/1237240799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc38c0af1a0 0x7fc38c0b1a20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc37c0099b0 tx=0x7fc37c009250 comp rx=0 tx=0).stop 2023-10-06T03:23:48.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.715+0000 7fc390d9d700 1 -- 172.21.15.81:0/1237240799 shutdown_connections 2023-10-06T03:23:48.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.715+0000 7fc390d9d700 1 --2- 172.21.15.81:0/1237240799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc38c0af1a0 0x7fc38c0b1a20 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:48.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.715+0000 7fc390d9d700 1 --2- 172.21.15.81:0/1237240799 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc38c0af570 0x7fc38c0affe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:48.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.715+0000 7fc390d9d700 1 -- 172.21.15.81:0/1237240799 >> 172.21.15.81:0/1237240799 conn(0x7fc38c0cdad0 msgr2=0x7fc38c06c430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:48.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.715+0000 7fc390d9d700 1 -- 172.21.15.81:0/1237240799 shutdown_connections 2023-10-06T03:23:48.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.715+0000 7fc390d9d700 1 -- 172.21.15.81:0/1237240799 wait complete. 2023-10-06T03:23:48.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.716+0000 7fc390d9d700 1 Processor -- start 2023-10-06T03:23:48.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.716+0000 7fc390d9d700 1 -- start start 2023-10-06T03:23:48.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.717+0000 7fc390d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc38c0675e0 0x7fc38c0c3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:48.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.717+0000 7fc390d9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc38c0af1a0 0x7fc38c16d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:48.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.717+0000 7fc390d9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc38c0af570 0x7fc38c16d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:48.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.717+0000 7fc390d9d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc38c0c4470 con 0x7fc38c0675e0 2023-10-06T03:23:48.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.717+0000 7fc390d9d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc38c0c3860 con 0x7fc38c0af570 2023-10-06T03:23:48.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.717+0000 7fc390d9d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc38c0c3b40 con 0x7fc38c0af1a0 2023-10-06T03:23:48.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.717+0000 7fc38b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc38c0675e0 0x7fc38c0c3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:48.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.717+0000 7fc38b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc38c0675e0 0x7fc38c0c3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46576/0 (socket says 172.21.15.81:46576) 2023-10-06T03:23:48.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.717+0000 7fc38b7fe700 1 -- 172.21.15.81:0/3514175166 learned_addr learned my addr 172.21.15.81:0/3514175166 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:48.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.717+0000 7fc38affd700 1 --2- 172.21.15.81:0/3514175166 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc38c0af1a0 0x7fc38c16d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:48.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.718+0000 7fc38bfff700 1 --2- 172.21.15.81:0/3514175166 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc38c0af570 0x7fc38c16d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:48.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.718+0000 7fc38b7fe700 1 -- 172.21.15.81:0/3514175166 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc38c0af1a0 msgr2=0x7fc38c16d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:48.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.718+0000 7fc38b7fe700 1 --2- 172.21.15.81:0/3514175166 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc38c0af1a0 0x7fc38c16d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:48.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.718+0000 7fc38b7fe700 1 -- 172.21.15.81:0/3514175166 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc38c0af570 msgr2=0x7fc38c16d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:48.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.718+0000 7fc38b7fe700 1 --2- 172.21.15.81:0/3514175166 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc38c0af570 0x7fc38c16d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:48.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.718+0000 7fc38b7fe700 1 -- 172.21.15.81:0/3514175166 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc37c0094f0 con 0x7fc38c0675e0 2023-10-06T03:23:48.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.718+0000 7fc38b7fe700 1 --2- 172.21.15.81:0/3514175166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc38c0675e0 0x7fc38c0c3030 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc38c0ac4c0 tx=0x7fc37c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:48.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.718+0000 7fc3737fe700 1 -- 172.21.15.81:0/3514175166 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37c00bbe0 con 0x7fc38c0675e0 2023-10-06T03:23:48.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.718+0000 7fc3737fe700 1 -- 172.21.15.81:0/3514175166 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc37c011420 con 0x7fc38c0675e0 2023-10-06T03:23:48.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.718+0000 7fc3737fe700 1 -- 172.21.15.81:0/3514175166 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37c0117c0 con 0x7fc38c0675e0 2023-10-06T03:23:48.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.718+0000 7fc390d9d700 1 -- 172.21.15.81:0/3514175166 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc38c0c3e20 con 0x7fc38c0675e0 2023-10-06T03:23:48.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.718+0000 7fc390d9d700 1 -- 172.21.15.81:0/3514175166 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc38c0c3570 con 0x7fc38c0675e0 2023-10-06T03:23:48.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.720+0000 7fc3737fe700 1 -- 172.21.15.81:0/3514175166 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc37c011bf0 con 0x7fc38c0675e0 2023-10-06T03:23:48.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.722+0000 7fc3737fe700 1 --2- 172.21.15.81:0/3514175166 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc378066f30 0x7fc3780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:48.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.722+0000 7fc3737fe700 1 -- 172.21.15.81:0/3514175166 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fc37c086310 con 0x7fc38c0675e0 2023-10-06T03:23:48.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.722+0000 7fc38affd700 1 --2- 172.21.15.81:0/3514175166 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc378066f30 0x7fc3780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:48.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.722+0000 7fc38affd700 1 --2- 172.21.15.81:0/3514175166 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc378066f30 0x7fc3780693e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc380009d10 tx=0x7fc3800091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:48.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.724+0000 7fc3a06bfb80 1 Processor -- start 2023-10-06T03:23:48.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.724+0000 7fc3a06bfb80 1 -- start start 2023-10-06T03:23:48.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.725+0000 7fc3a06bfb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55773ea2fe50 0x55773ea0acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:48.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.725+0000 7fc3a06bfb80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55773ea102c0 0x55773ea0b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:48.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.725+0000 7fc3a06bfb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55773ea11a10 0x55773ea0b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:48.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.725+0000 7fc3a06bfb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55773e965a70 con 0x55773ea11a10 2023-10-06T03:23:48.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.725+0000 7fc3a06bfb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55773e963270 con 0x55773ea2fe50 2023-10-06T03:23:48.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.725+0000 7fc3a06bfb80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x55773e95f060 con 0x55773ea102c0 2023-10-06T03:23:48.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.725+0000 7fc38bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55773ea11a10 0x55773ea0b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:48.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.725+0000 7fc38bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55773ea11a10 0x55773ea0b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46590/0 (socket says 172.21.15.81:46590) 2023-10-06T03:23:48.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.725+0000 7fc38bfff700 1 -- 172.21.15.81:0/4052335773 learned_addr learned my addr 172.21.15.81:0/4052335773 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:48.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.725+0000 7fc38b7fe700 1 --2- 172.21.15.81:0/4052335773 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55773ea2fe50 0x55773ea0acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:48.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.725+0000 7fc38affd700 1 --2- 172.21.15.81:0/4052335773 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55773ea102c0 0x55773ea0b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:48.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.725+0000 7fc38bfff700 1 -- 172.21.15.81:0/4052335773 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55773ea102c0 msgr2=0x55773ea0b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:48.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.725+0000 7fc38bfff700 1 --2- 172.21.15.81:0/4052335773 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55773ea102c0 0x55773ea0b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:48.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.725+0000 7fc38bfff700 1 -- 172.21.15.81:0/4052335773 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55773ea2fe50 msgr2=0x55773ea0acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:48.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.725+0000 7fc38bfff700 1 --2- 172.21.15.81:0/4052335773 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55773ea2fe50 0x55773ea0acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:48.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.725+0000 7fc38bfff700 1 -- 172.21.15.81:0/4052335773 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55773e7f9270 con 0x55773ea11a10 2023-10-06T03:23:48.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.725+0000 7fc38affd700 1 --2- 172.21.15.81:0/4052335773 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55773ea102c0 0x55773ea0b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:23:48.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.726+0000 7fc38bfff700 1 --2- 172.21.15.81:0/4052335773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55773ea11a10 0x55773ea0b740 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc384003d60 tx=0x7fc384009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b70f048d99c868e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:48.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.726+0000 7fc370ff9700 1 -- 172.21.15.81:0/4052335773 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3840032e0 con 0x55773ea11a10 2023-10-06T03:23:48.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.726+0000 7fc370ff9700 1 -- 172.21.15.81:0/4052335773 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38400e650 con 0x55773ea11a10 2023-10-06T03:23:48.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.726+0000 7fc370ff9700 1 -- 172.21.15.81:0/4052335773 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38400e9d0 con 0x55773ea11a10 2023-10-06T03:23:48.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.727+0000 7fc3a06bfb80 1 -- 172.21.15.81:0/4052335773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55773ea11a10 msgr2=0x55773ea0b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:48.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.727+0000 7fc3a06bfb80 1 --2- 172.21.15.81:0/4052335773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55773ea11a10 0x55773ea0b740 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc384003d60 tx=0x7fc384009040 comp rx=0 tx=0).stop 2023-10-06T03:23:48.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.727+0000 7fc3a06bfb80 1 -- 172.21.15.81:0/4052335773 shutdown_connections 2023-10-06T03:23:48.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.727+0000 7fc3a06bfb80 1 --2- 172.21.15.81:0/4052335773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55773ea11a10 0x55773ea0b740 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:48.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.727+0000 7fc3a06bfb80 1 --2- 172.21.15.81:0/4052335773 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55773ea2fe50 0x55773ea0acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:48.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.727+0000 7fc3a06bfb80 1 --2- 172.21.15.81:0/4052335773 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55773ea102c0 0x55773ea0b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:48.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.727+0000 7fc3a06bfb80 1 -- 172.21.15.81:0/4052335773 >> 172.21.15.81:0/4052335773 conn(0x55773ea0fe80 msgr2=0x55773ea106b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:48.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.727+0000 7fc3a06bfb80 1 -- 172.21.15.81:0/4052335773 shutdown_connections 2023-10-06T03:23:48.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.727+0000 7fc3a06bfb80 1 -- 172.21.15.81:0/4052335773 wait complete. 2023-10-06T03:23:48.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.728+0000 7fc3a06bfb80 1 -- start start 2023-10-06T03:23:48.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.728+0000 7fc3a06bfb80 1 Processor -- start 2023-10-06T03:23:48.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.729+0000 7fc3a06bfb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55773ea102c0 0x55773ea55080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:48.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.729+0000 7fc3a06bfb80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55773ea11a10 0x55773ea30810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:48.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.729+0000 7fc3a06bfb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55773ea2fe50 0x55773ea1bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:48.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.729+0000 7fc3a06bfb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55773e90a890 con 0x55773ea2fe50 2023-10-06T03:23:48.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.729+0000 7fc3a06bfb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55773e925ea0 con 0x55773ea102c0 2023-10-06T03:23:48.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.729+0000 7fc3a06bfb80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x55773e7e1e30 con 0x55773ea11a10 2023-10-06T03:23:48.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.729+0000 7fc3a06bfb80 10 client.0 _ll_register_callbacks cb 0x55773e9d2020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:23:48.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.729+0000 7fc38bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55773ea2fe50 0x55773ea1bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:48.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.729+0000 7fc38bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55773ea2fe50 0x55773ea1bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46592/0 (socket says 172.21.15.81:46592) 2023-10-06T03:23:48.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.729+0000 7fc38bfff700 1 -- 172.21.15.81:0/694585298 learned_addr learned my addr 172.21.15.81:0/694585298 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:48.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.729+0000 7fc38b7fe700 1 --2- 172.21.15.81:0/694585298 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55773ea102c0 0x55773ea55080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:48.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.729+0000 7fc38affd700 1 --2- 172.21.15.81:0/694585298 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55773ea11a10 0x55773ea30810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:48.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.729+0000 7fc38bfff700 1 -- 172.21.15.81:0/694585298 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55773ea11a10 msgr2=0x55773ea30810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:48.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.729+0000 7fc38bfff700 1 --2- 172.21.15.81:0/694585298 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55773ea11a10 0x55773ea30810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:48.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.729+0000 7fc38bfff700 1 -- 172.21.15.81:0/694585298 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55773ea102c0 msgr2=0x55773ea55080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:48.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.729+0000 7fc38bfff700 1 --2- 172.21.15.81:0/694585298 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55773ea102c0 0x55773ea55080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:48.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.729+0000 7fc38bfff700 1 -- 172.21.15.81:0/694585298 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc38400f040 con 0x55773ea2fe50 2023-10-06T03:23:48.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.730+0000 7fc38bfff700 1 --2- 172.21.15.81:0/694585298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55773ea2fe50 0x55773ea1bc40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc384013000 tx=0x7fc384019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58277b792f9a3ea5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:48.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.730+0000 7fc369ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-06T03:23:48.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.730+0000 7fc369ffb700 1 -- 172.21.15.81:0/694585298 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38400e7c0 con 0x55773ea2fe50 2023-10-06T03:23:48.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.730+0000 7fc369ffb700 1 -- 172.21.15.81:0/694585298 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fc38400e920 con 0x55773ea2fe50 2023-10-06T03:23:48.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.730+0000 7fc3a06bfb80 1 -- 172.21.15.81:0/694585298 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55773ea03940 con 0x55773ea2fe50 2023-10-06T03:23:48.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.730+0000 7fc369ffb700 1 -- 172.21.15.81:0/694585298 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc384006db0 con 0x55773ea2fe50 2023-10-06T03:23:48.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.730+0000 7fc3a06bfb80 10 client.4443 fetch_fsmap learned FSMap version 7 2023-10-06T03:23:48.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.730+0000 7fc3a06bfb80 1 -- 172.21.15.81:0/694585298 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55773e79bfe0 con 0x55773ea2fe50 2023-10-06T03:23:48.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.730+0000 7fc369ffb700 1 -- 172.21.15.81:0/694585298 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55773ea03940 con 0x55773ea2fe50 2023-10-06T03:23:48.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.730+0000 7fc369ffb700 1 -- 172.21.15.81:0/694585298 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 7) v1 ==== 3108+0+0 (secure 0 0 0) 0x7fc384023200 con 0x55773ea2fe50 2023-10-06T03:23:48.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.730+0000 7fc3a06bfb80 10 client.4443 fetch_fsmap finished waiting for FSMap version 7 2023-10-06T03:23:48.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.730+0000 7fc3a06bfb80 10 client.4443 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T03:23:48.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.731+0000 7fc3a06bfb80 20 client.4443 populate_metadata read hostname 'smithi081' 2023-10-06T03:23:48.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.731+0000 7fc3a06bfb80 1 --2- 172.21.15.81:0/694585298 >> [v2:172.21.15.83:6832/745669616,v1:172.21.15.83:6833/745669616] conn(0x55773ea3d710 0x55773ea3dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:48.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.731+0000 7fc3a06bfb80 4 client.4443 mds_command: new command op to 4291 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:23:48.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.731+0000 7fc3a06bfb80 1 -- 172.21.15.81:0/694585298 --> [v2:172.21.15.83:6832/745669616,v1:172.21.15.83:6833/745669616] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55773e9e0870 con 0x55773ea3d710 2023-10-06T03:23:48.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.731+0000 7fc38b7fe700 1 --2- 172.21.15.81:0/694585298 >> [v2:172.21.15.83:6832/745669616,v1:172.21.15.83:6833/745669616] conn(0x55773ea3d710 0x55773ea3dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:48.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.731+0000 7fc38b7fe700 1 --2- 172.21.15.81:0/694585298 >> [v2:172.21.15.83:6832/745669616,v1:172.21.15.83:6833/745669616] conn(0x55773ea3d710 0x55773ea3dae0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53a3d99905b78d9e server_cookie=c943568822c1fa3f in_seq=0 out_seq=0 2023-10-06T03:23:48.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.731+0000 7fc369ffb700 10 client.4443 ms_handle_connect on v2:172.21.15.83:6832/745669616 2023-10-06T03:23:48.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.732+0000 7fc369ffb700 1 -- 172.21.15.81:0/694585298 <== mds.0 v2:172.21.15.83:6832/745669616 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55773e9e0870 con 0x55773ea3d710 2023-10-06T03:23:48.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.732+0000 7fc369ffb700 10 client.4443 handle_command_reply: tid=0 2023-10-06T03:23:48.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.732+0000 7fc3a06bfb80 1 client.4443 shutdown 2023-10-06T03:23:48.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.733+0000 7fc3a06bfb80 1 -- 172.21.15.81:0/694585298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55773ea2fe50 msgr2=0x55773ea1bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:48.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.733+0000 7fc3a06bfb80 1 --2- 172.21.15.81:0/694585298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55773ea2fe50 0x55773ea1bc40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc384013000 tx=0x7fc384019000 comp rx=0 tx=0).stop 2023-10-06T03:23:48.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.733+0000 7fc3a06bfb80 1 -- 172.21.15.81:0/694585298 shutdown_connections 2023-10-06T03:23:48.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.733+0000 7fc3a06bfb80 1 --2- 172.21.15.81:0/694585298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55773ea2fe50 0x55773ea1bc40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:48.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.733+0000 7fc3a06bfb80 1 --2- 172.21.15.81:0/694585298 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55773ea102c0 0x55773ea55080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:48.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.733+0000 7fc3a06bfb80 1 --2- 172.21.15.81:0/694585298 >> [v2:172.21.15.83:6832/745669616,v1:172.21.15.83:6833/745669616] conn(0x55773ea3d710 0x55773ea3dae0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:48.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.733+0000 7fc3a06bfb80 1 --2- 172.21.15.81:0/694585298 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55773ea11a10 0x55773ea30810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:48.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.733+0000 7fc3a06bfb80 1 -- 172.21.15.81:0/694585298 >> 172.21.15.81:0/694585298 conn(0x55773ea0fe80 msgr2=0x55773ea0eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:48.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.733+0000 7fc369ffb700 0 client.4443 ms_handle_reset on v2:172.21.15.83:6832/745669616 2023-10-06T03:23:48.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.733+0000 7fc3a06bfb80 1 -- 172.21.15.81:0/694585298 shutdown_connections 2023-10-06T03:23:48.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.733+0000 7fc3a06bfb80 1 -- 172.21.15.81:0/694585298 wait complete. 2023-10-06T03:23:48.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.733+0000 7fc3a06bfb80 20 client.4443 trim_cache size 0 max 16384 2023-10-06T03:23:48.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.750+0000 7fc3a06bfb80 1 Processor -- start 2023-10-06T03:23:48.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.750+0000 7fc3a06bfb80 1 -- start start 2023-10-06T03:23:48.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.751+0000 7fc3a06bfb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55773ea102c0 0x55773ea05b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:48.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.751+0000 7fc3a06bfb80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55773ea11a10 0x55773ea05400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:48.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.751+0000 7fc3a06bfb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55773ea2fe50 0x55773ea64310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:48.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.751+0000 7fc3a06bfb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55773ea3e650 con 0x55773ea102c0 2023-10-06T03:23:48.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.751+0000 7fc3a06bfb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55773ea38940 con 0x55773ea2fe50 2023-10-06T03:23:48.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.751+0000 7fc3a06bfb80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x55773ea582c0 con 0x55773ea11a10 2023-10-06T03:23:48.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.751+0000 7fc38b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55773ea102c0 0x55773ea05b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:48.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.751+0000 7fc38b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55773ea102c0 0x55773ea05b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46604/0 (socket says 172.21.15.81:46604) 2023-10-06T03:23:48.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.751+0000 7fc38b7fe700 1 -- 172.21.15.81:0/711182053 learned_addr learned my addr 172.21.15.81:0/711182053 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:48.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.751+0000 7fc38affd700 1 --2- 172.21.15.81:0/711182053 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55773ea11a10 0x55773ea05400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:48.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.751+0000 7fc38bfff700 1 --2- 172.21.15.81:0/711182053 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55773ea2fe50 0x55773ea64310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:48.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.751+0000 7fc38b7fe700 1 -- 172.21.15.81:0/711182053 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55773ea11a10 msgr2=0x55773ea05400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:48.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.751+0000 7fc38b7fe700 1 --2- 172.21.15.81:0/711182053 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55773ea11a10 0x55773ea05400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:48.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.751+0000 7fc38b7fe700 1 -- 172.21.15.81:0/711182053 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55773ea2fe50 msgr2=0x55773ea64310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:48.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.751+0000 7fc38b7fe700 1 --2- 172.21.15.81:0/711182053 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55773ea2fe50 0x55773ea64310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:48.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.751+0000 7fc38b7fe700 1 -- 172.21.15.81:0/711182053 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc38c0ad9f0 con 0x55773ea102c0 2023-10-06T03:23:48.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.751+0000 7fc38bfff700 1 --2- 172.21.15.81:0/711182053 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55773ea2fe50 0x55773ea64310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:23:48.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.751+0000 7fc38affd700 1 --2- 172.21.15.81:0/711182053 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55773ea11a10 0x55773ea05400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:23:48.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.751+0000 7fc38b7fe700 1 --2- 172.21.15.81:0/711182053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55773ea102c0 0x55773ea05b90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc37c056a50 tx=0x7fc37c027040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1a71aa3dcf262d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:48.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.752+0000 7fc3717fa700 1 -- 172.21.15.81:0/711182053 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37c072070 con 0x55773ea102c0 2023-10-06T03:23:48.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.752+0000 7fc3717fa700 1 -- 172.21.15.81:0/711182053 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc37c059fa0 con 0x55773ea102c0 2023-10-06T03:23:48.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.752+0000 7fc3717fa700 1 -- 172.21.15.81:0/711182053 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37c011ea0 con 0x55773ea102c0 2023-10-06T03:23:48.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.752+0000 7fc3a06bfb80 1 -- 172.21.15.81:0/711182053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55773ea102c0 msgr2=0x55773ea05b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:48.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.752+0000 7fc3a06bfb80 1 --2- 172.21.15.81:0/711182053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55773ea102c0 0x55773ea05b90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc37c056a50 tx=0x7fc37c027040 comp rx=0 tx=0).stop 2023-10-06T03:23:48.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.752+0000 7fc3a06bfb80 1 -- 172.21.15.81:0/711182053 shutdown_connections 2023-10-06T03:23:48.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.752+0000 7fc3a06bfb80 1 --2- 172.21.15.81:0/711182053 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55773ea2fe50 0x55773ea64310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:48.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.752+0000 7fc3a06bfb80 1 --2- 172.21.15.81:0/711182053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55773ea102c0 0x55773ea05b90 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:48.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.752+0000 7fc3a06bfb80 1 --2- 172.21.15.81:0/711182053 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55773ea11a10 0x55773ea05400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:48.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.752+0000 7fc3a06bfb80 1 -- 172.21.15.81:0/711182053 >> 172.21.15.81:0/711182053 conn(0x55773ea0fe80 msgr2=0x55773ea38090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:48.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.752+0000 7fc3a06bfb80 1 -- 172.21.15.81:0/711182053 shutdown_connections 2023-10-06T03:23:48.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.752+0000 7fc3a06bfb80 1 -- 172.21.15.81:0/711182053 wait complete. 2023-10-06T03:23:48.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.753+0000 7fc3a06bfb80 1 -- start start 2023-10-06T03:23:48.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.753+0000 7fc3a06bfb80 1 Processor -- start 2023-10-06T03:23:48.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.754+0000 7fc3a06bfb80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55773ea102c0 0x55773ea677d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:48.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.754+0000 7fc3a06bfb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55773ea11a10 0x55773ea64310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:48.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.754+0000 7fc3a06bfb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55773ea2fe50 0x55773ea64850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:48.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.754+0000 7fc3a06bfb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55773ea55d80 con 0x55773ea2fe50 2023-10-06T03:23:48.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.754+0000 7fc3a06bfb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55773ea6e6d0 con 0x55773ea11a10 2023-10-06T03:23:48.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.754+0000 7fc3a06bfb80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x55773ea6e970 con 0x55773ea102c0 2023-10-06T03:23:48.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.754+0000 7fc3a06bfb80 10 client.0 _ll_register_callbacks cb 0x55773e9d2020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:23:48.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.754+0000 7fc38bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55773ea2fe50 0x55773ea64850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:48.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.754+0000 7fc38bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55773ea2fe50 0x55773ea64850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46612/0 (socket says 172.21.15.81:46612) 2023-10-06T03:23:48.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.754+0000 7fc38bfff700 1 -- 172.21.15.81:0/1065027987 learned_addr learned my addr 172.21.15.81:0/1065027987 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:48.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.754+0000 7fc38b7fe700 1 --2- 172.21.15.81:0/1065027987 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55773ea102c0 0x55773ea677d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:48.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.754+0000 7fc38affd700 1 --2- 172.21.15.81:0/1065027987 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55773ea11a10 0x55773ea64310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:48.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.754+0000 7fc38bfff700 1 -- 172.21.15.81:0/1065027987 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55773ea102c0 msgr2=0x55773ea677d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:48.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.754+0000 7fc38bfff700 1 --2- 172.21.15.81:0/1065027987 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55773ea102c0 0x55773ea677d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:48.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.755+0000 7fc38bfff700 1 -- 172.21.15.81:0/1065027987 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55773ea11a10 msgr2=0x55773ea64310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:48.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.755+0000 7fc38bfff700 1 --2- 172.21.15.81:0/1065027987 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55773ea11a10 0x55773ea64310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:48.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.755+0000 7fc38bfff700 1 -- 172.21.15.81:0/1065027987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc38c0c3570 con 0x55773ea2fe50 2023-10-06T03:23:48.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.755+0000 7fc38b7fe700 1 --2- 172.21.15.81:0/1065027987 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55773ea102c0 0x55773ea677d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:23:48.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.755+0000 7fc38bfff700 1 --2- 172.21.15.81:0/1065027987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55773ea2fe50 0x55773ea64850 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc384004290 tx=0x7fc38401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b831ff0053f3c1c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:48.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.755+0000 7fc369ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-06T03:23:48.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.755+0000 7fc369ffb700 1 -- 172.21.15.81:0/1065027987 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc384003810 con 0x55773ea2fe50 2023-10-06T03:23:48.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.755+0000 7fc369ffb700 1 -- 172.21.15.81:0/1065027987 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fc384003070 con 0x55773ea2fe50 2023-10-06T03:23:48.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.755+0000 7fc3a06bfb80 1 -- 172.21.15.81:0/1065027987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc38400e650 con 0x55773ea2fe50 2023-10-06T03:23:48.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.755+0000 7fc369ffb700 1 -- 172.21.15.81:0/1065027987 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc384003250 con 0x55773ea2fe50 2023-10-06T03:23:48.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.755+0000 7fc3a06bfb80 10 client.4449 fetch_fsmap learned FSMap version 7 2023-10-06T03:23:48.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.755+0000 7fc3a06bfb80 1 -- 172.21.15.81:0/1065027987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55773e92d780 con 0x55773ea2fe50 2023-10-06T03:23:48.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.755+0000 7fc369ffb700 1 -- 172.21.15.81:0/1065027987 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38400e650 con 0x55773ea2fe50 2023-10-06T03:23:48.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.756+0000 7fc369ffb700 1 -- 172.21.15.81:0/1065027987 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 7) v1 ==== 3108+0+0 (secure 0 0 0) 0x7fc38400e7c0 con 0x55773ea2fe50 2023-10-06T03:23:48.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.756+0000 7fc3a06bfb80 10 client.4449 fetch_fsmap finished waiting for FSMap version 7 2023-10-06T03:23:48.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.756+0000 7fc3a06bfb80 10 client.4449 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T03:23:48.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.756+0000 7fc3a06bfb80 20 client.4449 populate_metadata read hostname 'smithi081' 2023-10-06T03:23:48.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.756+0000 7fc3a06bfb80 1 --2- 172.21.15.81:0/1065027987 >> [v2:172.21.15.83:6832/745669616,v1:172.21.15.83:6833/745669616] conn(0x55773eabb300 0x55773eabb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:48.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.756+0000 7fc3a06bfb80 4 client.4449 mds_command: new command op to 4291 tid=0[{"prefix": "status"}] 2023-10-06T03:23:48.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.756+0000 7fc3a06bfb80 1 -- 172.21.15.81:0/1065027987 --> [v2:172.21.15.83:6832/745669616,v1:172.21.15.83:6833/745669616] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55773e901e00 con 0x55773eabb300 2023-10-06T03:23:48.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.756+0000 7fc38b7fe700 1 --2- 172.21.15.81:0/1065027987 >> [v2:172.21.15.83:6832/745669616,v1:172.21.15.83:6833/745669616] conn(0x55773eabb300 0x55773eabb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:48.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.756+0000 7fc369ffb700 10 client.4449 ms_handle_connect on v2:172.21.15.83:6832/745669616 2023-10-06T03:23:48.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.756+0000 7fc38b7fe700 1 --2- 172.21.15.81:0/1065027987 >> [v2:172.21.15.83:6832/745669616,v1:172.21.15.83:6833/745669616] conn(0x55773eabb300 0x55773eabb6d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2c69cb1af9ad3f7 server_cookie=c747b0e14a3fa0f0 in_seq=0 out_seq=0 2023-10-06T03:23:48.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.757+0000 7fc369ffb700 1 -- 172.21.15.81:0/1065027987 <== mds.0 v2:172.21.15.83:6832/745669616 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55773e901e00 con 0x55773eabb300 2023-10-06T03:23:48.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.757+0000 7fc369ffb700 10 client.4449 handle_command_reply: tid=0 2023-10-06T03:23:48.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.757+0000 7fc3a06bfb80 1 client.4449 shutdown 2023-10-06T03:23:48.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.757+0000 7fc3a06bfb80 1 -- 172.21.15.81:0/1065027987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55773ea2fe50 msgr2=0x55773ea64850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:48.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.757+0000 7fc3a06bfb80 1 --2- 172.21.15.81:0/1065027987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55773ea2fe50 0x55773ea64850 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc384004290 tx=0x7fc38401e000 comp rx=0 tx=0).stop 2023-10-06T03:23:48.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.757+0000 7fc3a06bfb80 1 -- 172.21.15.81:0/1065027987 shutdown_connections 2023-10-06T03:23:48.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.757+0000 7fc3a06bfb80 1 --2- 172.21.15.81:0/1065027987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55773ea2fe50 0x55773ea64850 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:48.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.757+0000 7fc3a06bfb80 1 --2- 172.21.15.81:0/1065027987 >> [v2:172.21.15.83:6832/745669616,v1:172.21.15.83:6833/745669616] conn(0x55773eabb300 0x55773eabb6d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:48.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.757+0000 7fc3a06bfb80 1 --2- 172.21.15.81:0/1065027987 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55773ea102c0 0x55773ea677d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:48.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.757+0000 7fc3a06bfb80 1 --2- 172.21.15.81:0/1065027987 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55773ea11a10 0x55773ea64310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:48.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.757+0000 7fc369ffb700 0 client.4449 ms_handle_reset on v2:172.21.15.83:6832/745669616 2023-10-06T03:23:48.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.757+0000 7fc3a06bfb80 1 -- 172.21.15.81:0/1065027987 >> 172.21.15.81:0/1065027987 conn(0x55773ea0fe80 msgr2=0x55773ea38090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:48.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.757+0000 7fc3a06bfb80 1 -- 172.21.15.81:0/1065027987 shutdown_connections 2023-10-06T03:23:48.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.757+0000 7fc3a06bfb80 1 -- 172.21.15.81:0/1065027987 wait complete. 2023-10-06T03:23:48.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.757+0000 7fc3a06bfb80 20 client.4449 trim_cache size 0 max 16384 2023-10-06T03:23:48.764 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T03:23:48.764 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "1807b5d7-9be8-43ad-aaf8-99a4273430b3", 2023-10-06T03:23:48.764 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2023-10-06T03:23:48.765 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 4291, 2023-10-06T03:23:48.765 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2023-10-06T03:23:48.765 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2023-10-06T03:23:48.765 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2023-10-06T03:23:48.765 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 7.8565950659999997, 2023-10-06T03:23:48.765 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 7, 2023-10-06T03:23:48.765 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 24, 2023-10-06T03:23:48.765 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 24, 2023-10-06T03:23:48.765 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 13.709750474 2023-10-06T03:23:48.765 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T03:23:48.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.758+0000 7fc390d9d700 1 -- 172.21.15.81:0/3514175166 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc378066f30 msgr2=0x7fc3780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:48.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.758+0000 7fc390d9d700 1 --2- 172.21.15.81:0/3514175166 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc378066f30 0x7fc3780693e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc380009d10 tx=0x7fc3800091a0 comp rx=0 tx=0).stop 2023-10-06T03:23:48.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.758+0000 7fc390d9d700 1 -- 172.21.15.81:0/3514175166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc38c0675e0 msgr2=0x7fc38c0c3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:48.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.758+0000 7fc390d9d700 1 --2- 172.21.15.81:0/3514175166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc38c0675e0 0x7fc38c0c3030 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc38c0ac4c0 tx=0x7fc37c017000 comp rx=0 tx=0).stop 2023-10-06T03:23:48.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.758+0000 7fc390d9d700 1 -- 172.21.15.81:0/3514175166 shutdown_connections 2023-10-06T03:23:48.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.758+0000 7fc390d9d700 1 --2- 172.21.15.81:0/3514175166 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc38c0af570 0x7fc38c16d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:48.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.758+0000 7fc390d9d700 1 --2- 172.21.15.81:0/3514175166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc38c0675e0 0x7fc38c0c3030 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:48.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.758+0000 7fc390d9d700 1 --2- 172.21.15.81:0/3514175166 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc378066f30 0x7fc3780693e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:48.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.758+0000 7fc390d9d700 1 --2- 172.21.15.81:0/3514175166 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc38c0af1a0 0x7fc38c16d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:48.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.758+0000 7fc390d9d700 1 -- 172.21.15.81:0/3514175166 >> 172.21.15.81:0/3514175166 conn(0x7fc38c0cdad0 msgr2=0x7fc38c0969d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:48.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.758+0000 7fc390d9d700 1 -- 172.21.15.81:0/3514175166 shutdown_connections 2023-10-06T03:23:48.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.758+0000 7fc390d9d700 1 -- 172.21.15.81:0/3514175166 wait complete. 2023-10-06T03:23:48.776 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:23:48.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.956+0000 7f883119d700 1 Processor -- start 2023-10-06T03:23:48.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.956+0000 7f883119d700 1 -- start start 2023-10-06T03:23:48.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.957+0000 7f883119d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f882c0ccd40 0x7f882c0b1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:48.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.957+0000 7f883119d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f882c0b2250 0x7f882c0b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:48.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.957+0000 7f883119d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f882c0b4760 con 0x7f882c0cc670 2023-10-06T03:23:48.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.957+0000 7f883119d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f882c0b60f0 con 0x7f882c0b2250 2023-10-06T03:23:48.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.957+0000 7f883119d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f882c0cd320 con 0x7f882c0ccd40 2023-10-06T03:23:48.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.957+0000 7f883099c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f882c0b2250 0x7f882c0b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:48.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.957+0000 7f883099c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f882c0b2250 0x7f882c0b4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46614/0 (socket says 172.21.15.81:46614) 2023-10-06T03:23:48.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.957+0000 7f883099c700 1 -- 172.21.15.81:0/1218921367 learned_addr learned my addr 172.21.15.81:0/1218921367 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:48.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.957+0000 7f882b7fe700 1 --2- 172.21.15.81:0/1218921367 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f882c0ccd40 0x7f882c0b1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:48.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.958+0000 7f883099c700 1 -- 172.21.15.81:0/1218921367 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f882c0ccd40 msgr2=0x7f882c0b1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:48.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.958+0000 7f883099c700 1 --2- 172.21.15.81:0/1218921367 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f882c0ccd40 0x7f882c0b1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:48.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.958+0000 7f883099c700 1 -- 172.21.15.81:0/1218921367 >> v1:172.21.15.83:6789/0 conn(0x7f882c0cc670 legacy=0x7f882c15a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:48.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.958+0000 7f883099c700 1 -- 172.21.15.81:0/1218921367 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f882c0b2660 con 0x7f882c0b2250 2023-10-06T03:23:48.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.958+0000 7f883099c700 1 --2- 172.21.15.81:0/1218921367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f882c0b2250 0x7f882c0b4bf0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8824009f20 tx=0x7f8824009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=943ab68c64650db4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:48.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.963+0000 7f882affd700 1 -- 172.21.15.81:0/1218921367 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882400e070 con 0x7f882c0b2250 2023-10-06T03:23:48.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.963+0000 7f882affd700 1 -- 172.21.15.81:0/1218921367 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f882400b9d0 con 0x7f882c0b2250 2023-10-06T03:23:48.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.963+0000 7f882affd700 1 -- 172.21.15.81:0/1218921367 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88240092e0 con 0x7f882c0b2250 2023-10-06T03:23:48.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.963+0000 7f883119d700 1 -- 172.21.15.81:0/1218921367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f882c0b2250 msgr2=0x7f882c0b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:48.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.963+0000 7f883119d700 1 --2- 172.21.15.81:0/1218921367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f882c0b2250 0x7f882c0b4bf0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8824009f20 tx=0x7f8824009840 comp rx=0 tx=0).stop 2023-10-06T03:23:48.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.964+0000 7f883119d700 1 -- 172.21.15.81:0/1218921367 shutdown_connections 2023-10-06T03:23:48.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.964+0000 7f883119d700 1 --2- 172.21.15.81:0/1218921367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f882c0b2250 0x7f882c0b4bf0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:48.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.964+0000 7f883119d700 1 --2- 172.21.15.81:0/1218921367 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f882c0ccd40 0x7f882c0b1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:48.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.964+0000 7f883119d700 1 -- 172.21.15.81:0/1218921367 >> 172.21.15.81:0/1218921367 conn(0x7f882c06ed10 msgr2=0x7f882c06f110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:48.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.964+0000 7f883119d700 1 -- 172.21.15.81:0/1218921367 shutdown_connections 2023-10-06T03:23:48.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.964+0000 7f883119d700 1 -- 172.21.15.81:0/1218921367 wait complete. 2023-10-06T03:23:48.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.965+0000 7f883119d700 1 Processor -- start 2023-10-06T03:23:48.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.965+0000 7f883119d700 1 -- start start 2023-10-06T03:23:48.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.966+0000 7f883119d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f882c0b2250 0x7f882c15be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:48.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.966+0000 7f883119d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f882c0cc670 0x7f882c1514a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:48.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.966+0000 7f883119d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f882c0ccd40 0x7f882c147440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:48.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.966+0000 7f883119d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f882c14ba20 con 0x7f882c0ccd40 2023-10-06T03:23:48.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.966+0000 7f883119d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f882c1519e0 con 0x7f882c0b2250 2023-10-06T03:23:48.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.966+0000 7f883119d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f882c151c70 con 0x7f882c0cc670 2023-10-06T03:23:48.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.966+0000 7f883099c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f882c0ccd40 0x7f882c147440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:48.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.967+0000 7f883099c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f882c0ccd40 0x7f882c147440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46628/0 (socket says 172.21.15.81:46628) 2023-10-06T03:23:48.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.967+0000 7f883099c700 1 -- 172.21.15.81:0/3573350161 learned_addr learned my addr 172.21.15.81:0/3573350161 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:48.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.967+0000 7f882b7fe700 1 --2- 172.21.15.81:0/3573350161 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f882c0cc670 0x7f882c1514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:48.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.967+0000 7f882bfff700 1 --2- 172.21.15.81:0/3573350161 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f882c0b2250 0x7f882c15be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:48.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.967+0000 7f883099c700 1 -- 172.21.15.81:0/3573350161 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f882c0cc670 msgr2=0x7f882c1514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:48.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.967+0000 7f883099c700 1 --2- 172.21.15.81:0/3573350161 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f882c0cc670 0x7f882c1514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:48.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.967+0000 7f883099c700 1 -- 172.21.15.81:0/3573350161 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f882c0b2250 msgr2=0x7f882c15be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:48.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.967+0000 7f883099c700 1 --2- 172.21.15.81:0/3573350161 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f882c0b2250 0x7f882c15be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:48.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.967+0000 7f883099c700 1 -- 172.21.15.81:0/3573350161 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8824009ae0 con 0x7f882c0ccd40 2023-10-06T03:23:48.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.967+0000 7f882bfff700 1 --2- 172.21.15.81:0/3573350161 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f882c0b2250 0x7f882c15be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:23:48.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.967+0000 7f883099c700 1 --2- 172.21.15.81:0/3573350161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f882c0ccd40 0x7f882c147440 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f882400b610 tx=0x7f8824018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:48.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.967+0000 7f8813fff700 1 -- 172.21.15.81:0/3573350161 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8824008c30 con 0x7f882c0ccd40 2023-10-06T03:23:48.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.967+0000 7f8813fff700 1 -- 172.21.15.81:0/3573350161 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8824008d90 con 0x7f882c0ccd40 2023-10-06T03:23:48.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.968+0000 7f8813fff700 1 -- 172.21.15.81:0/3573350161 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8824025690 con 0x7f882c0ccd40 2023-10-06T03:23:48.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.968+0000 7f883119d700 1 -- 172.21.15.81:0/3573350161 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f882c14b3d0 con 0x7f882c0ccd40 2023-10-06T03:23:48.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.968+0000 7f883119d700 1 -- 172.21.15.81:0/3573350161 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f882c14b080 con 0x7f882c0ccd40 2023-10-06T03:23:48.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.969+0000 7f883119d700 1 -- 172.21.15.81:0/3573350161 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f882c14bb90 con 0x7f882c0ccd40 2023-10-06T03:23:48.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.970+0000 7f8813fff700 1 -- 172.21.15.81:0/3573350161 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8824003040 con 0x7f882c0ccd40 2023-10-06T03:23:48.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.970+0000 7f8813fff700 1 --2- 172.21.15.81:0/3573350161 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f8818066f30 0x7f88180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:48.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.971+0000 7f8813fff700 1 -- 172.21.15.81:0/3573350161 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f88240865c0 con 0x7f882c0ccd40 2023-10-06T03:23:48.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.971+0000 7f882bfff700 1 --2- 172.21.15.81:0/3573350161 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f8818066f30 0x7f88180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:48.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.971+0000 7f882bfff700 1 --2- 172.21.15.81:0/3573350161 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f8818066f30 0x7f88180693e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f881c001840 tx=0x7f881c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:48.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:48.975+0000 7f8813fff700 1 -- 172.21.15.81:0/3573350161 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f88240533e0 con 0x7f882c0ccd40 2023-10-06T03:23:49.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:49.208+0000 7f883119d700 1 -- 172.21.15.81:0/3573350161 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f882c04c3c0 con 0x7f882c0ccd40 2023-10-06T03:23:49.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:49.209+0000 7f8813fff700 1 -- 172.21.15.81:0/3573350161 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f8824056a00 con 0x7f882c0ccd40 2023-10-06T03:23:49.210 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T03:23:49.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:49.211+0000 7f883119d700 1 -- 172.21.15.81:0/3573350161 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f8818066f30 msgr2=0x7f88180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:49.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:49.211+0000 7f883119d700 1 --2- 172.21.15.81:0/3573350161 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f8818066f30 0x7f88180693e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f881c001840 tx=0x7f881c009040 comp rx=0 tx=0).stop 2023-10-06T03:23:49.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:49.211+0000 7f883119d700 1 -- 172.21.15.81:0/3573350161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f882c0ccd40 msgr2=0x7f882c147440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:49.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:49.211+0000 7f883119d700 1 --2- 172.21.15.81:0/3573350161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f882c0ccd40 0x7f882c147440 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f882400b610 tx=0x7f8824018000 comp rx=0 tx=0).stop 2023-10-06T03:23:49.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:49.211+0000 7f883119d700 1 -- 172.21.15.81:0/3573350161 shutdown_connections 2023-10-06T03:23:49.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:49.211+0000 7f883119d700 1 --2- 172.21.15.81:0/3573350161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f882c0ccd40 0x7f882c147440 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:49.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:49.211+0000 7f883119d700 1 --2- 172.21.15.81:0/3573350161 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f882c0b2250 0x7f882c15be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:49.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:49.211+0000 7f883119d700 1 --2- 172.21.15.81:0/3573350161 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f8818066f30 0x7f88180693e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:49.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:49.211+0000 7f883119d700 1 --2- 172.21.15.81:0/3573350161 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f882c0cc670 0x7f882c1514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:49.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:49.211+0000 7f883119d700 1 -- 172.21.15.81:0/3573350161 >> 172.21.15.81:0/3573350161 conn(0x7f882c06ed10 msgr2=0x7f882c1592a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:49.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:49.211+0000 7f883119d700 1 -- 172.21.15.81:0/3573350161 shutdown_connections 2023-10-06T03:23:49.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:49.211+0000 7f883119d700 1 -- 172.21.15.81:0/3573350161 wait complete. 2023-10-06T03:23:49.229 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T03:23:49.229 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:23:49.229 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2023-10-06T03:23:49.230 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-10-06T03:23:49.230 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-10-06T03:23:49.230 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T03:23:49.230 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T03:23:49.230 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:23:49.230 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-10-06T03:23:49.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:23:49.230 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2023-10-06T03:23:49.267 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:23:49.267 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:23:49.267 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:23:49.267 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:23:49.267 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-10-06T03:23:49.267 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:23:49.267 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:23:49.267 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:23:49.267 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2023-10-06T03:23:49.268 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:23:49.268 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:23:49.268 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2023-10-06T03:23:49.268 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:23:49.268 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:23:49.268 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:23:49.268 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:23:49.268 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T03:23:49.268 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42269sec preferred_lft 42269sec 2023-10-06T03:23:49.268 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2023-10-06T03:23:49.268 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:23:49.269 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T03:23:49.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:23:49.269 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-06T03:23:49.269 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-06T03:23:49.269 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add name ceph-brx type bridge 2023-10-06T03:23:49.269 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr flush dev ceph-brx 2023-10-06T03:23:49.270 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set ceph-brx up 2023-10-06T03:23:49.270 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T03:23:49.270 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-06T03:23:49.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:23:49.725 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:23:49.788 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-10-06T03:23:49.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:23:49.791 DEBUG:teuthology.orchestra.run.smithi081:> route 2023-10-06T03:23:49.846 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2023-10-06T03:23:49.846 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:23:49.847 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:23:49.847 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T03:23:49.847 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:23:49.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:23:49.848 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-06T03:23:49.848 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-06T03:23:49.848 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:23:49.848 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:23:49.848 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:23:49.848 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-06T03:23:50.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:23:50.532 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-10-06T03:23:50.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:23:50.568 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list-id 2023-10-06T03:23:50.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:23:50.644 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-06T03:23:50.644 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-06T03:23:50.645 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-06T03:23:50.645 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-10-06T03:23:50.645 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-06T03:23:50.810 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-10-06T03:23:50.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:23:50.811 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-06T03:23:50.811 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-06T03:23:50.811 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-10-06T03:23:50.811 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T03:23:50.811 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-10-06T03:23:50.812 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-10-06T03:23:50.812 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-10-06T03:23:50.812 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-06T03:23:51.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:23:51.059 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-06T03:23:51.059 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-06T03:23:51.059 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2023-10-06T03:23:51.060 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T03:23:51.060 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-06T03:23:51.215 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-10-06T03:23:51.215 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:23:51.215 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-10-06T03:23:51.251 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-10-06T03:23:51.251 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:23:51.251 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-10-06T03:23:51.326 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2023-10-06T03:23:51.428 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T03:23:51.429 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T03:23:51.491 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T03:23:51.493 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T03:23:51.494 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:23:51.494 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2023-10-06T03:23:51.530 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T03:23:51.530 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-10-06T03:23:51.575 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2023-10-06T03:23:51.637 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T03:23:51.637 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T03:23:51.697 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T03:23:51.700 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T03:23:51.700 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:23:51.700 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2023-10-06T03:23:51.741 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi081.stderr:2023-10-06T03:23:51.740+0000 7fd7b03b9540 -1 init, newargv = 0x55f352161390 newargc=15 2023-10-06T03:23:51.742 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi081.stderr:ceph-fuse[93138]: starting ceph client 2023-10-06T03:23:51.751 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi081.stderr:ceph-fuse[93138]: starting fuse 2023-10-06T03:23:52.838 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2023-10-06T03:23:52.906 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T03:23:52.907 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T03:23:52.971 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T03:23:52.973 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T03:23:52.974 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:23:52.974 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2023-10-06T03:23:53.010 INFO:teuthology.orchestra.run.smithi081.stdout:43 2023-10-06T03:23:53.010 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-10-06T03:23:53.010 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T03:23:53.010 DEBUG:teuthology.orchestra.run.smithi081:> import glob 2023-10-06T03:23:53.011 DEBUG:teuthology.orchestra.run.smithi081:> import re 2023-10-06T03:23:53.011 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-10-06T03:23:53.011 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2023-10-06T03:23:53.011 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-06T03:23:53.011 DEBUG:teuthology.orchestra.run.smithi081:> def _find_admin_socket(client_name): 2023-10-06T03:23:53.011 DEBUG:teuthology.orchestra.run.smithi081:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-10-06T03:23:53.011 DEBUG:teuthology.orchestra.run.smithi081:> files = glob.glob(asok_path) 2023-10-06T03:23:53.011 DEBUG:teuthology.orchestra.run.smithi081:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-10-06T03:23:53.011 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-06T03:23:53.011 DEBUG:teuthology.orchestra.run.smithi081:> # Given a non-glob path, it better be there 2023-10-06T03:23:53.011 DEBUG:teuthology.orchestra.run.smithi081:> if "*" not in asok_path: 2023-10-06T03:23:53.011 DEBUG:teuthology.orchestra.run.smithi081:> assert(len(files) == 1) 2023-10-06T03:23:53.012 DEBUG:teuthology.orchestra.run.smithi081:> return files[0] 2023-10-06T03:23:53.012 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-06T03:23:53.012 DEBUG:teuthology.orchestra.run.smithi081:> for f in files: 2023-10-06T03:23:53.012 DEBUG:teuthology.orchestra.run.smithi081:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T03:23:53.012 DEBUG:teuthology.orchestra.run.smithi081:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T03:23:53.012 DEBUG:teuthology.orchestra.run.smithi081:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T03:23:53.012 DEBUG:teuthology.orchestra.run.smithi081:> contents = proc_f.read() 2023-10-06T03:23:53.012 DEBUG:teuthology.orchestra.run.smithi081:> if mountpoint in contents: 2023-10-06T03:23:53.012 DEBUG:teuthology.orchestra.run.smithi081:> return f 2023-10-06T03:23:53.012 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T03:23:53.012 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-06T03:23:53.012 DEBUG:teuthology.orchestra.run.smithi081:> print(_find_admin_socket("client.admin")) 2023-10-06T03:23:53.012 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-10-06T03:23:53.183 INFO:teuthology.orchestra.run.smithi081.stdout:/var/run/ceph/ceph-client.admin.93138.asok 2023-10-06T03:23:53.362 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.93138.asok 2023-10-06T03:23:53.362 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:23:53.362 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.93138.asok status 2023-10-06T03:23:53.573 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T03:23:53.573 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": { 2023-10-06T03:23:53.573 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T03:23:53.573 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T03:23:53.573 INFO:teuthology.orchestra.run.smithi081.stdout: "entity_id": "admin", 2023-10-06T03:23:53.573 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": "smithi081", 2023-10-06T03:23:53.573 INFO:teuthology.orchestra.run.smithi081.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-10-06T03:23:53.573 INFO:teuthology.orchestra.run.smithi081.stdout: "pid": "93138", 2023-10-06T03:23:53.574 INFO:teuthology.orchestra.run.smithi081.stdout: "root": "/" 2023-10-06T03:23:53.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T03:23:53.574 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_count": 0, 2023-10-06T03:23:53.574 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_pinned_count": 0, 2023-10-06T03:23:53.574 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 4461, 2023-10-06T03:23:53.574 INFO:teuthology.orchestra.run.smithi081.stdout: "inst": { 2023-10-06T03:23:53.574 INFO:teuthology.orchestra.run.smithi081.stdout: "name": { 2023-10-06T03:23:53.574 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2023-10-06T03:23:53.574 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4461 2023-10-06T03:23:53.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T03:23:53.574 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2023-10-06T03:23:53.574 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T03:23:53.575 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2023-10-06T03:23:53.575 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2697185739 2023-10-06T03:23:53.575 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T03:23:53.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T03:23:53.575 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2023-10-06T03:23:53.575 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-06T03:23:53.575 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2023-10-06T03:23:53.575 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2697185739 2023-10-06T03:23:53.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T03:23:53.575 INFO:teuthology.orchestra.run.smithi081.stdout: "inst_str": "client.4461 192.168.0.1:0/2697185739", 2023-10-06T03:23:53.575 INFO:teuthology.orchestra.run.smithi081.stdout: "addr_str": "192.168.0.1:0/2697185739", 2023-10-06T03:23:53.575 INFO:teuthology.orchestra.run.smithi081.stdout: "inode_count": 1, 2023-10-06T03:23:53.576 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_epoch": 7, 2023-10-06T03:23:53.576 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch": 24, 2023-10-06T03:23:53.576 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch_barrier": 0, 2023-10-06T03:23:53.576 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklisted": false, 2023-10-06T03:23:53.576 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs" 2023-10-06T03:23:53.576 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T03:23:53.587 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:23:53.587 DEBUG:teuthology.orchestra.run.smithi081:> stat --file-system '--printf=%T 2023-10-06T03:23:53.587 DEBUG:teuthology.orchestra.run.smithi081:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-10-06T03:23:53.624 INFO:teuthology.orchestra.run.smithi081.stdout:fuseblk 2023-10-06T03:23:53.624 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-10-06T03:23:53.625 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:23:53.625 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-10-06T03:23:53.727 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:23:53.727 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-10-06T03:23:53.844 INFO:teuthology.orchestra.run.smithi081.stdout:# file: . 2023-10-06T03:23:53.844 INFO:teuthology.orchestra.run.smithi081.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-10-06T03:23:53.844 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:23:53.845 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi081.front.sepia.ceph.com... 2023-10-06T03:23:53.845 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:23:53.845 DEBUG:teuthology.orchestra.run.smithi081:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-10-06T03:23:53.903 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi081.stderr:ceph-fuse[93138]: fuse finished with error 0 and tester_r 0 2023-10-06T03:23:53.909 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T03:23:53.930 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-10-06T03:23:53.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:23:53.930 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-10-06T03:23:54.022 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:23:54.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.204+0000 7f85141ff700 1 Processor -- start 2023-10-06T03:23:54.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.204+0000 7f85141ff700 1 -- start start 2023-10-06T03:23:54.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.205+0000 7f85141ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f850c13f9c0 0x7f850c0ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:54.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.205+0000 7f85141ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f850c0cab60 0x7f850c159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:54.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.205+0000 7f85141ff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f850c0cafe0 con 0x7f850c13fd90 2023-10-06T03:23:54.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.205+0000 7f85141ff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f850c0cb2c0 con 0x7f850c13f9c0 2023-10-06T03:23:54.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.205+0000 7f85141ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f850c0cb5a0 con 0x7f850c0cab60 2023-10-06T03:23:54.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.206+0000 7f8511f9b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f850c13f9c0 0x7f850c0ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:54.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.206+0000 7f851179a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f850c0cab60 0x7f850c159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:54.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.206+0000 7f851279c700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f850c13fd90 0x7f850c06e470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:36794/0 (socket says 172.21.15.81:36794) 2023-10-06T03:23:54.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.206+0000 7f851279c700 1 -- 172.21.15.81:0/350829413 learned_addr learned my addr 172.21.15.81:0/350829413 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:23:54.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.206+0000 7f8511f9b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f850c13f9c0 0x7f850c0ca620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:52554/0 (socket says 172.21.15.81:52554) 2023-10-06T03:23:54.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.206+0000 7f8510f99700 1 -- 172.21.15.81:0/350829413 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 727227449 0 0) 0x7f850c0cafe0 con 0x7f850c13fd90 2023-10-06T03:23:54.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.206+0000 7f8510f99700 1 -- 172.21.15.81:0/350829413 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84f8003570 con 0x7f850c13fd90 2023-10-06T03:23:54.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.206+0000 7f851179a700 1 -- 172.21.15.81:0/350829413 >> v2:172.21.15.83:3300/0 conn(0x7f850c13f9c0 msgr2=0x7f850c0ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:54.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.206+0000 7f851179a700 1 --2- 172.21.15.81:0/350829413 >> v2:172.21.15.83:3300/0 conn(0x7f850c13f9c0 0x7f850c0ca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:54.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.206+0000 7f851179a700 1 -- 172.21.15.81:0/350829413 >> v1:172.21.15.83:6789/0 conn(0x7f850c13fd90 legacy=0x7f850c06e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:54.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.206+0000 7f851179a700 1 -- 172.21.15.81:0/350829413 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f850c0cb880 con 0x7f850c0cab60 2023-10-06T03:23:54.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.206+0000 7f8511f9b700 1 --2- 172.21.15.81:0/350829413 >> v2:172.21.15.83:3300/0 conn(0x7f850c13f9c0 0x7f850c0ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:23:54.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.207+0000 7f851179a700 1 --2- 172.21.15.81:0/350829413 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f850c0cab60 0x7f850c159eb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f84fc00bb90 tx=0x7f84fc00b430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11d658175709d13e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:54.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.207+0000 7f8510f99700 1 -- 172.21.15.81:0/350829413 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84fc00da70 con 0x7f850c0cab60 2023-10-06T03:23:54.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.207+0000 7f8510f99700 1 -- 172.21.15.81:0/350829413 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84fc00dbd0 con 0x7f850c0cab60 2023-10-06T03:23:54.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.207+0000 7f8510f99700 1 -- 172.21.15.81:0/350829413 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84fc019480 con 0x7f850c0cab60 2023-10-06T03:23:54.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.208+0000 7f85141ff700 1 -- 172.21.15.81:0/350829413 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f850c0cab60 msgr2=0x7f850c159eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:54.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.208+0000 7f85141ff700 1 --2- 172.21.15.81:0/350829413 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f850c0cab60 0x7f850c159eb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f84fc00bb90 tx=0x7f84fc00b430 comp rx=0 tx=0).stop 2023-10-06T03:23:54.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.208+0000 7f85141ff700 1 -- 172.21.15.81:0/350829413 shutdown_connections 2023-10-06T03:23:54.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.208+0000 7f85141ff700 1 --2- 172.21.15.81:0/350829413 >> v2:172.21.15.83:3300/0 conn(0x7f850c13f9c0 0x7f850c0ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:54.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.208+0000 7f85141ff700 1 --2- 172.21.15.81:0/350829413 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f850c0cab60 0x7f850c159eb0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:54.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.208+0000 7f85141ff700 1 -- 172.21.15.81:0/350829413 >> 172.21.15.81:0/350829413 conn(0x7f850c0cc090 msgr2=0x7f850c0cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:54.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.208+0000 7f85141ff700 1 -- 172.21.15.81:0/350829413 shutdown_connections 2023-10-06T03:23:54.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.208+0000 7f85141ff700 1 -- 172.21.15.81:0/350829413 wait complete. 2023-10-06T03:23:54.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.209+0000 7f85141ff700 1 Processor -- start 2023-10-06T03:23:54.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.209+0000 7f85141ff700 1 -- start start 2023-10-06T03:23:54.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.210+0000 7f85141ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f850c13f9c0 0x7f850c0ae3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:54.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.210+0000 7f85141ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f850c13fd90 0x7f850c168f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:54.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.210+0000 7f85141ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f850c0a5430 0x7f850c1694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:54.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.210+0000 7f85141ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f850c169e50 con 0x7f850c0a5430 2023-10-06T03:23:54.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.210+0000 7f85141ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f850c0b1d70 con 0x7f850c13f9c0 2023-10-06T03:23:54.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.210+0000 7f85141ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f850c0b17b0 con 0x7f850c13fd90 2023-10-06T03:23:54.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.210+0000 7f851279c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f850c0a5430 0x7f850c1694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:54.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.210+0000 7f851279c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f850c0a5430 0x7f850c1694b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38650/0 (socket says 172.21.15.81:38650) 2023-10-06T03:23:54.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.210+0000 7f851279c700 1 -- 172.21.15.81:0/1766284243 learned_addr learned my addr 172.21.15.81:0/1766284243 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:54.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.211+0000 7f8511f9b700 1 --2- 172.21.15.81:0/1766284243 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f850c13f9c0 0x7f850c0ae3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:54.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.211+0000 7f851179a700 1 --2- 172.21.15.81:0/1766284243 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f850c13fd90 0x7f850c168f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:54.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.211+0000 7f851279c700 1 -- 172.21.15.81:0/1766284243 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f850c13fd90 msgr2=0x7f850c168f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:54.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.211+0000 7f851279c700 1 --2- 172.21.15.81:0/1766284243 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f850c13fd90 0x7f850c168f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:54.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.211+0000 7f851279c700 1 -- 172.21.15.81:0/1766284243 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f850c13f9c0 msgr2=0x7f850c0ae3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:54.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.211+0000 7f851279c700 1 --2- 172.21.15.81:0/1766284243 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f850c13f9c0 0x7f850c0ae3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:54.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.211+0000 7f851279c700 1 -- 172.21.15.81:0/1766284243 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8508009420 con 0x7f850c0a5430 2023-10-06T03:23:54.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.211+0000 7f8511f9b700 1 --2- 172.21.15.81:0/1766284243 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f850c13f9c0 0x7f850c0ae3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:23:54.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.211+0000 7f851279c700 1 --2- 172.21.15.81:0/1766284243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f850c0a5430 0x7f850c1694b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f850400cc40 tx=0x7f8504001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:54.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.211+0000 7f8501ffb700 1 -- 172.21.15.81:0/1766284243 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850400a960 con 0x7f850c0a5430 2023-10-06T03:23:54.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.211+0000 7f8501ffb700 1 -- 172.21.15.81:0/1766284243 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f850400aac0 con 0x7f850c0a5430 2023-10-06T03:23:54.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.211+0000 7f85141ff700 1 -- 172.21.15.81:0/1766284243 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84fc00b6d0 con 0x7f850c0a5430 2023-10-06T03:23:54.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.211+0000 7f8501ffb700 1 -- 172.21.15.81:0/1766284243 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850400ae40 con 0x7f850c0a5430 2023-10-06T03:23:54.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.212+0000 7f85141ff700 1 -- 172.21.15.81:0/1766284243 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f850c0b01c0 con 0x7f850c0a5430 2023-10-06T03:23:54.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.212+0000 7f85141ff700 1 -- 172.21.15.81:0/1766284243 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f850c0b0020 con 0x7f850c0a5430 2023-10-06T03:23:54.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.213+0000 7f8501ffb700 1 -- 172.21.15.81:0/1766284243 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8504007300 con 0x7f850c0a5430 2023-10-06T03:23:54.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.214+0000 7f8501ffb700 1 --2- 172.21.15.81:0/1766284243 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f84f0066f30 0x7f84f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:54.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.214+0000 7f8501ffb700 1 -- 172.21.15.81:0/1766284243 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f8504084e30 con 0x7f850c0a5430 2023-10-06T03:23:54.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.214+0000 7f8511f9b700 1 --2- 172.21.15.81:0/1766284243 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f84f0066f30 0x7f84f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:54.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.215+0000 7f8511f9b700 1 --2- 172.21.15.81:0/1766284243 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f84f0066f30 0x7f84f00693e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f85080093f0 tx=0x7f8508008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:54.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.218+0000 7f8501ffb700 1 -- 172.21.15.81:0/1766284243 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f850c0b0020 con 0x7f850c0a5430 2023-10-06T03:23:54.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.414+0000 7f85141ff700 1 -- 172.21.15.81:0/1766284243 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f850c0b0020 con 0x7f850c0a5430 2023-10-06T03:23:54.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.415+0000 7f8501ffb700 1 -- 172.21.15.81:0/1766284243 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18659 (secure 0 0 0) 0x7f850c0b0020 con 0x7f850c0a5430 2023-10-06T03:23:54.417 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:23:54.417 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"fsid":"1807b5d7-9be8-43ad-aaf8-99a4273430b3","created":"2023-10-06T03:23:20.805306+0000","modified":"2023-10-06T03:23:45.419616+0000","last_up_change":"2023-10-06T03:23:32.735796+0000","last_in_change":"2023-10-06T03:23:24.109024+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:33.198850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:33.606744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:23:38.742266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:23:39.347944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:23:42.959054+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"14fb667d-a677-4978-a477-80027f889d36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":85563},{"type":"v1","addr":"172.21.15.81:6818","nonce":85563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":85563},{"type":"v1","addr":"172.21.15.81:6822","nonce":85563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":85563},{"type":"v1","addr":"172.21.15.81:6830","nonce":85563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":85563},{"type":"v1","addr":"172.21.15.81:6826","nonce":85563}]},"public_addr":"172.21.15.81:6818/85563","cluster_addr":"172.21.15.81:6822/85563","heartbeat_back_addr":"172.21.15.81:6830/85563","heartbeat_front_addr":"172.21.15.81:6826/85563","state":["exists","up"]},{"osd":1,"uuid":"974d8a86-1829-4176-89ce-18e6038857f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":85561},{"type":"v1","addr":"172.21.15.81:6801","nonce":85561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":85561},{"type":"v1","addr":"172.21.15.81:6803","nonce":85561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":85561},{"type":"v1","addr":"172.21.15.81:6807","nonce":85561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":85561},{"type":"v1","addr":"172.21.15.81:6805","nonce":85561}]},"public_addr":"172.21.15.81:6801/85561","cluster_addr":"172.21.15.81:6803/85561","heartbeat_back_addr":"172.21.15.81:6807/85561","heartbeat_front_addr":"172.21.15.81:6805/85561","state":["exists","up"]},{"osd":2,"uuid":"ffbfe056-46bc-46e0-bf49-4d8f8650e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":85564},{"type":"v1","addr":"172.21.15.81:6809","nonce":85564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":85564},{"type":"v1","addr":"172.21.15.81:6811","nonce":85564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":85564},{"type":"v1","addr":"172.21.15.81:6815","nonce":85564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":85564},{"type":"v1","addr":"172.21.15.81:6813","nonce":85564}]},"public_addr":"172.21.15.81:6809/85564","cluster_addr":"172.21.15.81:6811/85564","heartbeat_back_addr":"172.21.15.81:6815/85564","heartbeat_front_addr":"172.21.15.81:6813/85564","state":["exists","up"]},{"osd":3,"uuid":"ef9a8314-3d37-4ea1-858a-e704d5695002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":85562},{"type":"v1","addr":"172.21.15.81:6819","nonce":85562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":85562},{"type":"v1","addr":"172.21.15.81:6823","nonce":85562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":85562},{"type":"v1","addr":"172.21.15.81:6831","nonce":85562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":85562},{"type":"v1","addr":"172.21.15.81:6827","nonce":85562}]},"public_addr":"172.21.15.81:6819/85562","cluster_addr":"172.21.15.81:6823/85562","heartbeat_back_addr":"172.21.15.81:6831/85562","heartbeat_front_addr":"172.21.15.81:6827/85562","state":["exists","up"]},{"osd":4,"uuid":"d83506a0-2c96-4bcb-a9fa-05e43dc329df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":85785},{"type":"v1","addr":"172.21.15.83:6801","nonce":85785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":85785},{"type":"v1","addr":"172.21.15.83:6803","nonce":85785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":85785},{"type":"v1","addr":"172.21.15.83:6807","nonce":85785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":85785},{"type":"v1","addr":"172.21.15.83:6805","nonce":85785}]},"public_addr":"172.21.15.83:6801/85785","cluster_addr":"172.21.15.83:6803/85785","heartbeat_back_addr":"172.21.15.83:6807/85785","heartbeat_front_addr":"172.21.15.83:6805/85785","state":["exists","up"]},{"osd":5,"uuid":"10687c63-a3d5-472f-acc0-4f61847b6e0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":85818},{"type":"v1","addr":"172.21.15.83:6825","nonce":85818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":85818},{"type":"v1","addr":"172.21.15.83:6827","nonce":85818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":85818},{"type":"v1","addr":"172.21.15.83:6831","nonce":85818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":85818},{"type":"v1","addr":"172.21.15.83:6829","nonce":85818}]},"public_addr":"172.21.15.83:6825/85818","cluster_addr":"172.21.15.83:6827/85818","heartbeat_back_addr":"172.21.15.83:6831/85818","heartbeat_front_addr":"172.21.15.83:6829/85818","state":["exists","up"]},{"osd":6,"uuid":"2e9daf76-5607-4a29-9a58-6e270700d223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":85787},{"type":"v1","addr":"172.21.15.83:6811","nonce":85787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":85787},{"type":"v1","addr":"172.21.15.83:6815","nonce":85787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":85787},{"type":"v1","addr":"172.21.15.83:6823","nonce":85787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6817","nonce":85787},{"type":"v1","addr":"172.21.15.83:6819","nonce":85787}]},"public_addr":"172.21.15.83:6811/85787","cluster_addr":"172.21.15.83:6815/85787","heartbeat_back_addr":"172.21.15.83:6823/85787","heartbeat_front_addr":"172.21.15.83:6819/85787","state":["exists","up"]},{"osd":7,"uuid":"5019e1ff-233a-4a5a-91ca-8afccb7ab6e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":85786},{"type":"v1","addr":"172.21.15.83:6810","nonce":85786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":85786},{"type":"v1","addr":"172.21.15.83:6814","nonce":85786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":85786},{"type":"v1","addr":"172.21.15.83:6822","nonce":85786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":85786},{"type":"v1","addr":"172.21.15.83:6818","nonce":85786}]},"public_addr":"172.21.15.83:6810/85786","cluster_addr":"172.21.15.83:6814/85786","heartbeat_back_addr":"172.21.15.83:6822/85786","heartbeat_front_addr":"172.21.15.83:6818/85786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.393431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.360031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.407428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.391613+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.403211+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.438142+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.496181+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.472323+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:23:54.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.417+0000 7f85141ff700 1 -- 172.21.15.81:0/1766284243 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f84f0066f30 msgr2=0x7f84f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:54.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.417+0000 7f85141ff700 1 --2- 172.21.15.81:0/1766284243 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f84f0066f30 0x7f84f00693e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f85080093f0 tx=0x7f8508008040 comp rx=0 tx=0).stop 2023-10-06T03:23:54.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.417+0000 7f85141ff700 1 -- 172.21.15.81:0/1766284243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f850c0a5430 msgr2=0x7f850c1694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:54.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.417+0000 7f85141ff700 1 --2- 172.21.15.81:0/1766284243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f850c0a5430 0x7f850c1694b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f850400cc40 tx=0x7f8504001a00 comp rx=0 tx=0).stop 2023-10-06T03:23:54.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.417+0000 7f85141ff700 1 -- 172.21.15.81:0/1766284243 shutdown_connections 2023-10-06T03:23:54.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.417+0000 7f85141ff700 1 --2- 172.21.15.81:0/1766284243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f850c0a5430 0x7f850c1694b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:54.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.417+0000 7f85141ff700 1 --2- 172.21.15.81:0/1766284243 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f850c13f9c0 0x7f850c0ae3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:54.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.417+0000 7f85141ff700 1 --2- 172.21.15.81:0/1766284243 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f84f0066f30 0x7f84f00693e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:54.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.417+0000 7f85141ff700 1 --2- 172.21.15.81:0/1766284243 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f850c13fd90 0x7f850c168f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:54.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.417+0000 7f85141ff700 1 -- 172.21.15.81:0/1766284243 >> 172.21.15.81:0/1766284243 conn(0x7f850c0cc090 msgr2=0x7f850c13ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:54.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.417+0000 7f85141ff700 1 -- 172.21.15.81:0/1766284243 shutdown_connections 2023-10-06T03:23:54.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.417+0000 7f85141ff700 1 -- 172.21.15.81:0/1766284243 wait complete. 2023-10-06T03:23:54.437 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:23:54.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.613+0000 7fc6407ff700 1 Processor -- start 2023-10-06T03:23:54.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.613+0000 7fc6407ff700 1 -- start start 2023-10-06T03:23:54.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.614+0000 7fc6407ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc63813f9c0 0x7fc6380ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:54.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.614+0000 7fc6407ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc6380cab60 0x7fc638159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:54.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.614+0000 7fc6407ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc63813fd90 0x7fc63815a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:54.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.614+0000 7fc6407ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6380cafe0 con 0x7fc6380cab60 2023-10-06T03:23:54.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.614+0000 7fc6407ff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6380cb2c0 con 0x7fc63813f9c0 2023-10-06T03:23:54.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.614+0000 7fc6407ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6380cb5a0 con 0x7fc63813fd90 2023-10-06T03:23:54.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.615+0000 7fc63dd9a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc6380cab60 0x7fc638159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:54.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.615+0000 7fc63dd9a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc6380cab60 0x7fc638159eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38664/0 (socket says 172.21.15.81:38664) 2023-10-06T03:23:54.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.615+0000 7fc63dd9a700 1 -- 172.21.15.81:0/3776010661 learned_addr learned my addr 172.21.15.81:0/3776010661 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:54.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.615+0000 7fc63e59b700 1 --2- 172.21.15.81:0/3776010661 >> v2:172.21.15.83:3300/0 conn(0x7fc63813f9c0 0x7fc6380ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:54.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.615+0000 7fc63ed9c700 1 --2- 172.21.15.81:0/3776010661 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc63813fd90 0x7fc63815a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:54.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.615+0000 7fc63dd9a700 1 -- 172.21.15.81:0/3776010661 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc63813fd90 msgr2=0x7fc63815a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:54.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.615+0000 7fc63dd9a700 1 --2- 172.21.15.81:0/3776010661 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc63813fd90 0x7fc63815a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:54.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.615+0000 7fc63dd9a700 1 -- 172.21.15.81:0/3776010661 >> v2:172.21.15.83:3300/0 conn(0x7fc63813f9c0 msgr2=0x7fc6380ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:54.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.615+0000 7fc63dd9a700 1 --2- 172.21.15.81:0/3776010661 >> v2:172.21.15.83:3300/0 conn(0x7fc63813f9c0 0x7fc6380ca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:54.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.615+0000 7fc63dd9a700 1 -- 172.21.15.81:0/3776010661 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6380cb880 con 0x7fc6380cab60 2023-10-06T03:23:54.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.615+0000 7fc63e59b700 1 --2- 172.21.15.81:0/3776010661 >> v2:172.21.15.83:3300/0 conn(0x7fc63813f9c0 0x7fc6380ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:23:54.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.615+0000 7fc63dd9a700 1 --2- 172.21.15.81:0/3776010661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6380cab60 0x7fc638159eb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc638069010 tx=0x7fc628009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58fe9a1f82780d7d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:54.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.616+0000 7fc63d599700 1 -- 172.21.15.81:0/3776010661 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62800b860 con 0x7fc6380cab60 2023-10-06T03:23:54.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.616+0000 7fc63d599700 1 -- 172.21.15.81:0/3776010661 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc62800b9c0 con 0x7fc6380cab60 2023-10-06T03:23:54.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.616+0000 7fc63d599700 1 -- 172.21.15.81:0/3776010661 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62800bd60 con 0x7fc6380cab60 2023-10-06T03:23:54.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.616+0000 7fc6407ff700 1 -- 172.21.15.81:0/3776010661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6380cab60 msgr2=0x7fc638159eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:54.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.616+0000 7fc6407ff700 1 --2- 172.21.15.81:0/3776010661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6380cab60 0x7fc638159eb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc638069010 tx=0x7fc628009250 comp rx=0 tx=0).stop 2023-10-06T03:23:54.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.616+0000 7fc6407ff700 1 -- 172.21.15.81:0/3776010661 shutdown_connections 2023-10-06T03:23:54.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.616+0000 7fc6407ff700 1 --2- 172.21.15.81:0/3776010661 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc63813fd90 0x7fc63815a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:54.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.616+0000 7fc6407ff700 1 --2- 172.21.15.81:0/3776010661 >> v2:172.21.15.83:3300/0 conn(0x7fc63813f9c0 0x7fc6380ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:54.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.616+0000 7fc6407ff700 1 --2- 172.21.15.81:0/3776010661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6380cab60 0x7fc638159eb0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:54.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.616+0000 7fc6407ff700 1 -- 172.21.15.81:0/3776010661 >> 172.21.15.81:0/3776010661 conn(0x7fc6380cc090 msgr2=0x7fc6380cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:54.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.616+0000 7fc6407ff700 1 -- 172.21.15.81:0/3776010661 shutdown_connections 2023-10-06T03:23:54.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.616+0000 7fc6407ff700 1 -- 172.21.15.81:0/3776010661 wait complete. 2023-10-06T03:23:54.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.618+0000 7fc6407ff700 1 Processor -- start 2023-10-06T03:23:54.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.618+0000 7fc6407ff700 1 -- start start 2023-10-06T03:23:54.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.619+0000 7fc6407ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc63813f9c0 0x7fc63814bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:54.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.619+0000 7fc6407ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc63813fd90 0x7fc6380c4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:54.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.619+0000 7fc6407ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc6381493b0 0x7fc6380c4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:54.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.619+0000 7fc6407ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6380c5a60 con 0x7fc63813f9c0 2023-10-06T03:23:54.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.619+0000 7fc6407ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6380b1a10 con 0x7fc63813fd90 2023-10-06T03:23:54.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.619+0000 7fc6407ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6380aee30 con 0x7fc6381493b0 2023-10-06T03:23:54.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.619+0000 7fc63e59b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc63813f9c0 0x7fc63814bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:54.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.619+0000 7fc63e59b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc63813f9c0 0x7fc63814bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38672/0 (socket says 172.21.15.81:38672) 2023-10-06T03:23:54.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.619+0000 7fc63e59b700 1 -- 172.21.15.81:0/3469988298 learned_addr learned my addr 172.21.15.81:0/3469988298 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:54.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.619+0000 7fc63dd9a700 1 --2- 172.21.15.81:0/3469988298 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc63813fd90 0x7fc6380c4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:54.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.619+0000 7fc63ed9c700 1 --2- 172.21.15.81:0/3469988298 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc6381493b0 0x7fc6380c4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:54.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.619+0000 7fc63e59b700 1 -- 172.21.15.81:0/3469988298 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc6381493b0 msgr2=0x7fc6380c4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:54.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.619+0000 7fc63e59b700 1 --2- 172.21.15.81:0/3469988298 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc6381493b0 0x7fc6380c4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:54.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.619+0000 7fc63e59b700 1 -- 172.21.15.81:0/3469988298 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc63813fd90 msgr2=0x7fc6380c4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:54.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.619+0000 7fc63e59b700 1 --2- 172.21.15.81:0/3469988298 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc63813fd90 0x7fc6380c4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:54.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.619+0000 7fc63e59b700 1 -- 172.21.15.81:0/3469988298 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6280094f0 con 0x7fc63813f9c0 2023-10-06T03:23:54.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.620+0000 7fc63e59b700 1 --2- 172.21.15.81:0/3469988298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc63813f9c0 0x7fc63814bca0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc634010e30 tx=0x7fc63400b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:54.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.620+0000 7fc62e7fc700 1 -- 172.21.15.81:0/3469988298 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63400ee00 con 0x7fc63813f9c0 2023-10-06T03:23:54.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.620+0000 7fc62e7fc700 1 -- 172.21.15.81:0/3469988298 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc634019440 con 0x7fc63813f9c0 2023-10-06T03:23:54.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.620+0000 7fc6407ff700 1 -- 172.21.15.81:0/3469988298 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6380c4c80 con 0x7fc63813f9c0 2023-10-06T03:23:54.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.620+0000 7fc62e7fc700 1 -- 172.21.15.81:0/3469988298 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc634019800 con 0x7fc63813f9c0 2023-10-06T03:23:54.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.620+0000 7fc6407ff700 1 -- 172.21.15.81:0/3469988298 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6380af080 con 0x7fc63813f9c0 2023-10-06T03:23:54.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.621+0000 7fc6407ff700 1 -- 172.21.15.81:0/3469988298 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6380af6d0 con 0x7fc63813f9c0 2023-10-06T03:23:54.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.622+0000 7fc62e7fc700 1 -- 172.21.15.81:0/3469988298 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc634019b70 con 0x7fc63813f9c0 2023-10-06T03:23:54.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.623+0000 7fc62e7fc700 1 --2- 172.21.15.81:0/3469988298 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc61c066f30 0x7fc61c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:54.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.623+0000 7fc62e7fc700 1 -- 172.21.15.81:0/3469988298 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fc634087110 con 0x7fc63813f9c0 2023-10-06T03:23:54.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.623+0000 7fc63dd9a700 1 --2- 172.21.15.81:0/3469988298 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc61c066f30 0x7fc61c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:54.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.623+0000 7fc63dd9a700 1 --2- 172.21.15.81:0/3469988298 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc61c066f30 0x7fc61c0693e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc638069010 tx=0x7fc628017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:54.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.627+0000 7fc62e7fc700 1 -- 172.21.15.81:0/3469988298 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc6340525a0 con 0x7fc63813f9c0 2023-10-06T03:23:54.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.821+0000 7fc6407ff700 1 -- 172.21.15.81:0/3469988298 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc63804c3c0 con 0x7fc63813f9c0 2023-10-06T03:23:54.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.822+0000 7fc62e7fc700 1 -- 172.21.15.81:0/3469988298 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18659 (secure 0 0 0) 0x7fc63401e090 con 0x7fc63813f9c0 2023-10-06T03:23:54.824 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:23:54.824 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"fsid":"1807b5d7-9be8-43ad-aaf8-99a4273430b3","created":"2023-10-06T03:23:20.805306+0000","modified":"2023-10-06T03:23:45.419616+0000","last_up_change":"2023-10-06T03:23:32.735796+0000","last_in_change":"2023-10-06T03:23:24.109024+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:33.198850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:33.606744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:23:38.742266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:23:39.347944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:23:42.959054+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"14fb667d-a677-4978-a477-80027f889d36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":85563},{"type":"v1","addr":"172.21.15.81:6818","nonce":85563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":85563},{"type":"v1","addr":"172.21.15.81:6822","nonce":85563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":85563},{"type":"v1","addr":"172.21.15.81:6830","nonce":85563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":85563},{"type":"v1","addr":"172.21.15.81:6826","nonce":85563}]},"public_addr":"172.21.15.81:6818/85563","cluster_addr":"172.21.15.81:6822/85563","heartbeat_back_addr":"172.21.15.81:6830/85563","heartbeat_front_addr":"172.21.15.81:6826/85563","state":["exists","up"]},{"osd":1,"uuid":"974d8a86-1829-4176-89ce-18e6038857f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":85561},{"type":"v1","addr":"172.21.15.81:6801","nonce":85561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":85561},{"type":"v1","addr":"172.21.15.81:6803","nonce":85561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":85561},{"type":"v1","addr":"172.21.15.81:6807","nonce":85561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":85561},{"type":"v1","addr":"172.21.15.81:6805","nonce":85561}]},"public_addr":"172.21.15.81:6801/85561","cluster_addr":"172.21.15.81:6803/85561","heartbeat_back_addr":"172.21.15.81:6807/85561","heartbeat_front_addr":"172.21.15.81:6805/85561","state":["exists","up"]},{"osd":2,"uuid":"ffbfe056-46bc-46e0-bf49-4d8f8650e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":85564},{"type":"v1","addr":"172.21.15.81:6809","nonce":85564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":85564},{"type":"v1","addr":"172.21.15.81:6811","nonce":85564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":85564},{"type":"v1","addr":"172.21.15.81:6815","nonce":85564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":85564},{"type":"v1","addr":"172.21.15.81:6813","nonce":85564}]},"public_addr":"172.21.15.81:6809/85564","cluster_addr":"172.21.15.81:6811/85564","heartbeat_back_addr":"172.21.15.81:6815/85564","heartbeat_front_addr":"172.21.15.81:6813/85564","state":["exists","up"]},{"osd":3,"uuid":"ef9a8314-3d37-4ea1-858a-e704d5695002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":85562},{"type":"v1","addr":"172.21.15.81:6819","nonce":85562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":85562},{"type":"v1","addr":"172.21.15.81:6823","nonce":85562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":85562},{"type":"v1","addr":"172.21.15.81:6831","nonce":85562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":85562},{"type":"v1","addr":"172.21.15.81:6827","nonce":85562}]},"public_addr":"172.21.15.81:6819/85562","cluster_addr":"172.21.15.81:6823/85562","heartbeat_back_addr":"172.21.15.81:6831/85562","heartbeat_front_addr":"172.21.15.81:6827/85562","state":["exists","up"]},{"osd":4,"uuid":"d83506a0-2c96-4bcb-a9fa-05e43dc329df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":85785},{"type":"v1","addr":"172.21.15.83:6801","nonce":85785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":85785},{"type":"v1","addr":"172.21.15.83:6803","nonce":85785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":85785},{"type":"v1","addr":"172.21.15.83:6807","nonce":85785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":85785},{"type":"v1","addr":"172.21.15.83:6805","nonce":85785}]},"public_addr":"172.21.15.83:6801/85785","cluster_addr":"172.21.15.83:6803/85785","heartbeat_back_addr":"172.21.15.83:6807/85785","heartbeat_front_addr":"172.21.15.83:6805/85785","state":["exists","up"]},{"osd":5,"uuid":"10687c63-a3d5-472f-acc0-4f61847b6e0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":85818},{"type":"v1","addr":"172.21.15.83:6825","nonce":85818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":85818},{"type":"v1","addr":"172.21.15.83:6827","nonce":85818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":85818},{"type":"v1","addr":"172.21.15.83:6831","nonce":85818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":85818},{"type":"v1","addr":"172.21.15.83:6829","nonce":85818}]},"public_addr":"172.21.15.83:6825/85818","cluster_addr":"172.21.15.83:6827/85818","heartbeat_back_addr":"172.21.15.83:6831/85818","heartbeat_front_addr":"172.21.15.83:6829/85818","state":["exists","up"]},{"osd":6,"uuid":"2e9daf76-5607-4a29-9a58-6e270700d223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":85787},{"type":"v1","addr":"172.21.15.83:6811","nonce":85787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":85787},{"type":"v1","addr":"172.21.15.83:6815","nonce":85787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":85787},{"type":"v1","addr":"172.21.15.83:6823","nonce":85787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6817","nonce":85787},{"type":"v1","addr":"172.21.15.83:6819","nonce":85787}]},"public_addr":"172.21.15.83:6811/85787","cluster_addr":"172.21.15.83:6815/85787","heartbeat_back_addr":"172.21.15.83:6823/85787","heartbeat_front_addr":"172.21.15.83:6819/85787","state":["exists","up"]},{"osd":7,"uuid":"5019e1ff-233a-4a5a-91ca-8afccb7ab6e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":85786},{"type":"v1","addr":"172.21.15.83:6810","nonce":85786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":85786},{"type":"v1","addr":"172.21.15.83:6814","nonce":85786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":85786},{"type":"v1","addr":"172.21.15.83:6822","nonce":85786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":85786},{"type":"v1","addr":"172.21.15.83:6818","nonce":85786}]},"public_addr":"172.21.15.83:6810/85786","cluster_addr":"172.21.15.83:6814/85786","heartbeat_back_addr":"172.21.15.83:6822/85786","heartbeat_front_addr":"172.21.15.83:6818/85786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.393431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.360031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.407428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.391613+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.403211+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.438142+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.496181+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.472323+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:23:54.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.824+0000 7fc6407ff700 1 -- 172.21.15.81:0/3469988298 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc61c066f30 msgr2=0x7fc61c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:54.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.824+0000 7fc6407ff700 1 --2- 172.21.15.81:0/3469988298 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc61c066f30 0x7fc61c0693e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc638069010 tx=0x7fc628017000 comp rx=0 tx=0).stop 2023-10-06T03:23:54.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.824+0000 7fc6407ff700 1 -- 172.21.15.81:0/3469988298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc63813f9c0 msgr2=0x7fc63814bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:54.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.824+0000 7fc6407ff700 1 --2- 172.21.15.81:0/3469988298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc63813f9c0 0x7fc63814bca0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc634010e30 tx=0x7fc63400b710 comp rx=0 tx=0).stop 2023-10-06T03:23:54.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.824+0000 7fc6407ff700 1 -- 172.21.15.81:0/3469988298 shutdown_connections 2023-10-06T03:23:54.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.824+0000 7fc6407ff700 1 --2- 172.21.15.81:0/3469988298 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc61c066f30 0x7fc61c0693e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:54.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.824+0000 7fc6407ff700 1 --2- 172.21.15.81:0/3469988298 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc6381493b0 0x7fc6380c4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:54.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.824+0000 7fc6407ff700 1 --2- 172.21.15.81:0/3469988298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc63813f9c0 0x7fc63814bca0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:54.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.824+0000 7fc6407ff700 1 --2- 172.21.15.81:0/3469988298 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc63813fd90 0x7fc6380c4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:54.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.824+0000 7fc6407ff700 1 -- 172.21.15.81:0/3469988298 >> 172.21.15.81:0/3469988298 conn(0x7fc6380cc090 msgr2=0x7fc63806e430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:54.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.824+0000 7fc6407ff700 1 -- 172.21.15.81:0/3469988298 shutdown_connections 2023-10-06T03:23:54.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:54.824+0000 7fc6407ff700 1 -- 172.21.15.81:0/3469988298 wait complete. 2023-10-06T03:23:54.844 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T03:23:55.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.024+0000 7feb467ff700 1 Processor -- start 2023-10-06T03:23:55.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.024+0000 7feb467ff700 1 -- start start 2023-10-06T03:23:55.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.025+0000 7feb467ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7feb4013fd70 0x7feb400ca640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:55.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.026+0000 7feb467ff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb400cb580 con 0x7feb4015a0c0 2023-10-06T03:23:55.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.026+0000 7feb467ff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb400c6800 con 0x7feb4015ac50 2023-10-06T03:23:55.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.026+0000 7feb467ff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb40069880 con 0x7feb4013fd70 2023-10-06T03:23:55.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.026+0000 7feb3f7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7feb4015a0c0 0x7feb4015a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52898/0 (socket says 172.21.15.81:52898) 2023-10-06T03:23:55.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.026+0000 7feb3f7fe700 1 -- 172.21.15.81:0/3630436213 learned_addr learned my addr 172.21.15.81:0/3630436213 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:23:55.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.026+0000 7feb3ffff700 1 --2- 172.21.15.81:0/3630436213 >> v2:172.21.15.83:3300/0 conn(0x7feb4013fd70 0x7feb400ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:55.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.026+0000 7feb3effd700 1 -- 172.21.15.81:0/3630436213 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3579697156 0 0) 0x7feb400cb580 con 0x7feb4015a0c0 2023-10-06T03:23:55.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.026+0000 7feb3effd700 1 -- 172.21.15.81:0/3630436213 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb28003570 con 0x7feb4015a0c0 2023-10-06T03:23:55.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.026+0000 7feb3ffff700 1 -- 172.21.15.81:0/3630436213 >> v1:172.21.15.83:6789/0 conn(0x7feb4015ac50 legacy=0x7feb400c6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:55.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.026+0000 7feb3effd700 1 -- 172.21.15.81:0/3630436213 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1520231576 0 0) 0x7feb400c6800 con 0x7feb4015ac50 2023-10-06T03:23:55.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.026+0000 7feb3ffff700 1 -- 172.21.15.81:0/3630436213 >> v1:172.21.15.81:6789/0 conn(0x7feb4015a0c0 legacy=0x7feb4015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:55.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.026+0000 7feb3ffff700 1 -- 172.21.15.81:0/3630436213 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb400cace0 con 0x7feb4013fd70 2023-10-06T03:23:55.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.027+0000 7feb3ffff700 1 --2- 172.21.15.81:0/3630436213 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feb4013fd70 0x7feb400ca640 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7feb300098d0 tx=0x7feb30009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=113e58f3638aa43a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:55.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.027+0000 7feb3effd700 1 -- 172.21.15.81:0/3630436213 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb30005c10 con 0x7feb4013fd70 2023-10-06T03:23:55.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.027+0000 7feb3effd700 1 -- 172.21.15.81:0/3630436213 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb30005d70 con 0x7feb4013fd70 2023-10-06T03:23:55.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.027+0000 7feb3effd700 1 -- 172.21.15.81:0/3630436213 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb30006280 con 0x7feb4013fd70 2023-10-06T03:23:55.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.028+0000 7feb467ff700 1 -- 172.21.15.81:0/3630436213 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feb4013fd70 msgr2=0x7feb400ca640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:55.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.028+0000 7feb467ff700 1 --2- 172.21.15.81:0/3630436213 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feb4013fd70 0x7feb400ca640 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7feb300098d0 tx=0x7feb30009120 comp rx=0 tx=0).stop 2023-10-06T03:23:55.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.028+0000 7feb467ff700 1 -- 172.21.15.81:0/3630436213 shutdown_connections 2023-10-06T03:23:55.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.028+0000 7feb467ff700 1 --2- 172.21.15.81:0/3630436213 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feb4013fd70 0x7feb400ca640 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:55.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.028+0000 7feb467ff700 1 -- 172.21.15.81:0/3630436213 >> 172.21.15.81:0/3630436213 conn(0x7feb400cc090 msgr2=0x7feb400cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:55.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.028+0000 7feb467ff700 1 -- 172.21.15.81:0/3630436213 shutdown_connections 2023-10-06T03:23:55.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.028+0000 7feb467ff700 1 -- 172.21.15.81:0/3630436213 wait complete. 2023-10-06T03:23:55.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.029+0000 7feb467ff700 1 Processor -- start 2023-10-06T03:23:55.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.029+0000 7feb467ff700 1 -- start start 2023-10-06T03:23:55.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.030+0000 7feb467ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feb4013fd70 0x7feb4015b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:55.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.030+0000 7feb467ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb4015a0c0 0x7feb400c1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:55.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.030+0000 7feb467ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feb4015ac50 0x7feb4015b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:55.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.030+0000 7feb467ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb400c27c0 con 0x7feb4015a0c0 2023-10-06T03:23:55.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.030+0000 7feb467ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb40158270 con 0x7feb4013fd70 2023-10-06T03:23:55.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.030+0000 7feb467ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb40158530 con 0x7feb4015ac50 2023-10-06T03:23:55.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.030+0000 7feb3f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb4015a0c0 0x7feb400c1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:55.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.030+0000 7feb3f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb4015a0c0 0x7feb400c1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38684/0 (socket says 172.21.15.81:38684) 2023-10-06T03:23:55.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.031+0000 7feb3f7fe700 1 -- 172.21.15.81:0/2454883107 learned_addr learned my addr 172.21.15.81:0/2454883107 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:55.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.031+0000 7feb3ffff700 1 --2- 172.21.15.81:0/2454883107 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feb4013fd70 0x7feb4015b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:55.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.031+0000 7feb44d9c700 1 --2- 172.21.15.81:0/2454883107 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feb4015ac50 0x7feb4015b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:55.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.031+0000 7feb3f7fe700 1 -- 172.21.15.81:0/2454883107 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feb4015ac50 msgr2=0x7feb4015b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:55.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.031+0000 7feb3f7fe700 1 --2- 172.21.15.81:0/2454883107 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feb4015ac50 0x7feb4015b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:55.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.031+0000 7feb3f7fe700 1 -- 172.21.15.81:0/2454883107 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feb4013fd70 msgr2=0x7feb4015b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:55.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.031+0000 7feb3f7fe700 1 --2- 172.21.15.81:0/2454883107 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feb4013fd70 0x7feb4015b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:55.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.031+0000 7feb3f7fe700 1 -- 172.21.15.81:0/2454883107 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb300093c0 con 0x7feb4015a0c0 2023-10-06T03:23:55.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.031+0000 7feb3ffff700 1 --2- 172.21.15.81:0/2454883107 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feb4013fd70 0x7feb4015b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:23:55.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.031+0000 7feb3f7fe700 1 --2- 172.21.15.81:0/2454883107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb4015a0c0 0x7feb400c1840 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7feb3400c7c0 tx=0x7feb34007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:55.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.031+0000 7feb27fff700 1 -- 172.21.15.81:0/2454883107 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb34005b30 con 0x7feb4015a0c0 2023-10-06T03:23:55.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.031+0000 7feb27fff700 1 -- 172.21.15.81:0/2454883107 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb34005c90 con 0x7feb4015a0c0 2023-10-06T03:23:55.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.031+0000 7feb467ff700 1 -- 172.21.15.81:0/2454883107 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb40159c70 con 0x7feb4015a0c0 2023-10-06T03:23:55.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.031+0000 7feb27fff700 1 -- 172.21.15.81:0/2454883107 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb34007300 con 0x7feb4015a0c0 2023-10-06T03:23:55.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.031+0000 7feb467ff700 1 -- 172.21.15.81:0/2454883107 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb400c2200 con 0x7feb4015a0c0 2023-10-06T03:23:55.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.032+0000 7feb467ff700 1 -- 172.21.15.81:0/2454883107 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb4004c3c0 con 0x7feb4015a0c0 2023-10-06T03:23:55.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.033+0000 7feb27fff700 1 -- 172.21.15.81:0/2454883107 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feb34007670 con 0x7feb4015a0c0 2023-10-06T03:23:55.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.034+0000 7feb27fff700 1 --2- 172.21.15.81:0/2454883107 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7feb2c066f30 0x7feb2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:55.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.034+0000 7feb27fff700 1 -- 172.21.15.81:0/2454883107 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7feb34083fb0 con 0x7feb4015a0c0 2023-10-06T03:23:55.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.035+0000 7feb3ffff700 1 --2- 172.21.15.81:0/2454883107 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7feb2c066f30 0x7feb2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:55.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.035+0000 7feb3ffff700 1 --2- 172.21.15.81:0/2454883107 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7feb2c066f30 0x7feb2c0693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7feb30009390 tx=0x7feb30016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:55.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.038+0000 7feb27fff700 1 -- 172.21.15.81:0/2454883107 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feb34050d30 con 0x7feb4015a0c0 2023-10-06T03:23:55.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.270+0000 7feb467ff700 1 -- 172.21.15.81:0/2454883107 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7feb400ca3f0 con 0x7feb4015a0c0 2023-10-06T03:23:55.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.657+0000 7feb27fff700 1 -- 172.21.15.81:0/2454883107 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7feb34017020 con 0x7feb4015a0c0 2023-10-06T03:23:55.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.659+0000 7feb467ff700 1 -- 172.21.15.81:0/2454883107 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7feb2c066f30 msgr2=0x7feb2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:55.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.659+0000 7feb467ff700 1 --2- 172.21.15.81:0/2454883107 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7feb2c066f30 0x7feb2c0693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7feb30009390 tx=0x7feb30016000 comp rx=0 tx=0).stop 2023-10-06T03:23:55.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.659+0000 7feb467ff700 1 -- 172.21.15.81:0/2454883107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb4015a0c0 msgr2=0x7feb400c1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:55.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.659+0000 7feb467ff700 1 --2- 172.21.15.81:0/2454883107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb4015a0c0 0x7feb400c1840 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7feb3400c7c0 tx=0x7feb34007df0 comp rx=0 tx=0).stop 2023-10-06T03:23:55.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.660+0000 7feb467ff700 1 -- 172.21.15.81:0/2454883107 shutdown_connections 2023-10-06T03:23:55.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.660+0000 7feb467ff700 1 --2- 172.21.15.81:0/2454883107 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7feb2c066f30 0x7feb2c0693e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:55.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.660+0000 7feb467ff700 1 --2- 172.21.15.81:0/2454883107 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feb4015ac50 0x7feb4015b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:55.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.660+0000 7feb467ff700 1 --2- 172.21.15.81:0/2454883107 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feb4013fd70 0x7feb4015b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:55.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.660+0000 7feb467ff700 1 --2- 172.21.15.81:0/2454883107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb4015a0c0 0x7feb400c1840 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:55.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.660+0000 7feb467ff700 1 -- 172.21.15.81:0/2454883107 >> 172.21.15.81:0/2454883107 conn(0x7feb400cc090 msgr2=0x7feb400b1770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:55.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.660+0000 7feb467ff700 1 -- 172.21.15.81:0/2454883107 shutdown_connections 2023-10-06T03:23:55.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.660+0000 7feb467ff700 1 -- 172.21.15.81:0/2454883107 wait complete. 2023-10-06T03:23:55.680 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T03:23:55.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.862+0000 7fb409fff700 1 Processor -- start 2023-10-06T03:23:55.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.862+0000 7fb409fff700 1 -- start start 2023-10-06T03:23:55.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.863+0000 7fb409fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb404159380 0x7fb40415d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:55.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.863+0000 7fb409fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb404159750 0x7fb4040b1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:55.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.863+0000 7fb409fff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb40406a150 0x7fb4040c8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:55.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.863+0000 7fb409fff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4040caba0 con 0x7fb404159380 2023-10-06T03:23:55.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.863+0000 7fb409fff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb40415d6a0 con 0x7fb40406a150 2023-10-06T03:23:55.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.863+0000 7fb409fff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb404068a00 con 0x7fb404159750 2023-10-06T03:23:55.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.863+0000 7fb4037fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb404159380 0x7fb40415d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:55.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.864+0000 7fb4037fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb404159380 0x7fb40415d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38690/0 (socket says 172.21.15.81:38690) 2023-10-06T03:23:55.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.864+0000 7fb4037fe700 1 -- 172.21.15.81:0/3429196810 learned_addr learned my addr 172.21.15.81:0/3429196810 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:55.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.864+0000 7fb4037fe700 1 -- 172.21.15.81:0/3429196810 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb404159750 msgr2=0x7fb4040b1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:55.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.864+0000 7fb403fff700 1 --2- 172.21.15.81:0/3429196810 >> v2:172.21.15.83:3300/0 conn(0x7fb40406a150 0x7fb4040c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:55.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.864+0000 7fb402ffd700 1 --2- 172.21.15.81:0/3429196810 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb404159750 0x7fb4040b1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:55.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.864+0000 7fb4037fe700 1 --2- 172.21.15.81:0/3429196810 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb404159750 0x7fb4040b1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:55.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.864+0000 7fb4037fe700 1 -- 172.21.15.81:0/3429196810 >> v2:172.21.15.83:3300/0 conn(0x7fb40406a150 msgr2=0x7fb4040c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:55.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.864+0000 7fb4037fe700 1 --2- 172.21.15.81:0/3429196810 >> v2:172.21.15.83:3300/0 conn(0x7fb40406a150 0x7fb4040c8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:55.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.864+0000 7fb4037fe700 1 -- 172.21.15.81:0/3429196810 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb40415d8d0 con 0x7fb404159380 2023-10-06T03:23:55.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.864+0000 7fb403fff700 1 --2- 172.21.15.81:0/3429196810 >> v2:172.21.15.83:3300/0 conn(0x7fb40406a150 0x7fb4040c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:23:55.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.864+0000 7fb402ffd700 1 --2- 172.21.15.81:0/3429196810 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb404159750 0x7fb4040b1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:23:55.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.864+0000 7fb4037fe700 1 --2- 172.21.15.81:0/3429196810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb404159380 0x7fb40415d160 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb404069e50 tx=0x7fb3f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=850d98e9eb300404 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:55.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.864+0000 7fb4027fc700 1 -- 172.21.15.81:0/3429196810 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f400b860 con 0x7fb404159380 2023-10-06T03:23:55.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.865+0000 7fb4027fc700 1 -- 172.21.15.81:0/3429196810 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3f400b9c0 con 0x7fb404159380 2023-10-06T03:23:55.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.865+0000 7fb4027fc700 1 -- 172.21.15.81:0/3429196810 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f400bd60 con 0x7fb404159380 2023-10-06T03:23:55.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.865+0000 7fb409fff700 1 -- 172.21.15.81:0/3429196810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb404159380 msgr2=0x7fb40415d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:55.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.865+0000 7fb409fff700 1 --2- 172.21.15.81:0/3429196810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb404159380 0x7fb40415d160 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb404069e50 tx=0x7fb3f4009250 comp rx=0 tx=0).stop 2023-10-06T03:23:55.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.865+0000 7fb409fff700 1 -- 172.21.15.81:0/3429196810 shutdown_connections 2023-10-06T03:23:55.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.865+0000 7fb409fff700 1 --2- 172.21.15.81:0/3429196810 >> v2:172.21.15.83:3300/0 conn(0x7fb40406a150 0x7fb4040c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:55.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.865+0000 7fb409fff700 1 --2- 172.21.15.81:0/3429196810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb404159380 0x7fb40415d160 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:55.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.865+0000 7fb409fff700 1 --2- 172.21.15.81:0/3429196810 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb404159750 0x7fb4040b1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:55.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.865+0000 7fb409fff700 1 -- 172.21.15.81:0/3429196810 >> 172.21.15.81:0/3429196810 conn(0x7fb4040ce290 msgr2=0x7fb4040ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:55.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.865+0000 7fb409fff700 1 -- 172.21.15.81:0/3429196810 shutdown_connections 2023-10-06T03:23:55.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.865+0000 7fb409fff700 1 -- 172.21.15.81:0/3429196810 wait complete. 2023-10-06T03:23:55.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.867+0000 7fb409fff700 1 Processor -- start 2023-10-06T03:23:55.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.867+0000 7fb409fff700 1 -- start start 2023-10-06T03:23:55.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.868+0000 7fb409fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb40406a150 0x7fb40415b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:55.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.868+0000 7fb409fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb404159380 0x7fb404156340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:55.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.868+0000 7fb409fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb404159750 0x7fb4040aaad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:55.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.868+0000 7fb409fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4040b24f0 con 0x7fb404159380 2023-10-06T03:23:55.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.868+0000 7fb409fff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4040b1920 con 0x7fb40406a150 2023-10-06T03:23:55.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.868+0000 7fb409fff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4040b1bc0 con 0x7fb404159750 2023-10-06T03:23:55.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.868+0000 7fb402ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb404159380 0x7fb404156340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:55.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.868+0000 7fb402ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb404159380 0x7fb404156340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38694/0 (socket says 172.21.15.81:38694) 2023-10-06T03:23:55.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.868+0000 7fb402ffd700 1 -- 172.21.15.81:0/1247222084 learned_addr learned my addr 172.21.15.81:0/1247222084 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:55.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.868+0000 7fb4037fe700 1 --2- 172.21.15.81:0/1247222084 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb40406a150 0x7fb40415b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:55.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.868+0000 7fb403fff700 1 --2- 172.21.15.81:0/1247222084 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb404159750 0x7fb4040aaad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:55.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.868+0000 7fb402ffd700 1 -- 172.21.15.81:0/1247222084 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb404159750 msgr2=0x7fb4040aaad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:55.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.868+0000 7fb402ffd700 1 --2- 172.21.15.81:0/1247222084 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb404159750 0x7fb4040aaad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:55.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.868+0000 7fb402ffd700 1 -- 172.21.15.81:0/1247222084 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb40406a150 msgr2=0x7fb40415b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:55.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.868+0000 7fb402ffd700 1 --2- 172.21.15.81:0/1247222084 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb40406a150 0x7fb40415b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:55.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.868+0000 7fb402ffd700 1 -- 172.21.15.81:0/1247222084 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f40094f0 con 0x7fb404159380 2023-10-06T03:23:55.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.869+0000 7fb402ffd700 1 --2- 172.21.15.81:0/1247222084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb404159380 0x7fb404156340 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb3f800c800 tx=0x7fb3f8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:55.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.869+0000 7fb3eb7fe700 1 -- 172.21.15.81:0/1247222084 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f8011600 con 0x7fb404159380 2023-10-06T03:23:55.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.869+0000 7fb3eb7fe700 1 -- 172.21.15.81:0/1247222084 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3f8011760 con 0x7fb404159380 2023-10-06T03:23:55.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.869+0000 7fb409fff700 1 -- 172.21.15.81:0/1247222084 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4040b1ea0 con 0x7fb404159380 2023-10-06T03:23:55.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.869+0000 7fb3eb7fe700 1 -- 172.21.15.81:0/1247222084 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f8011b20 con 0x7fb404159380 2023-10-06T03:23:55.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.869+0000 7fb409fff700 1 -- 172.21.15.81:0/1247222084 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb40415b980 con 0x7fb404159380 2023-10-06T03:23:55.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.870+0000 7fb409fff700 1 -- 172.21.15.81:0/1247222084 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4040b2660 con 0x7fb404159380 2023-10-06T03:23:55.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.871+0000 7fb3eb7fe700 1 -- 172.21.15.81:0/1247222084 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb3f8018350 con 0x7fb404159380 2023-10-06T03:23:55.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.872+0000 7fb3eb7fe700 1 --2- 172.21.15.81:0/1247222084 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb3f0066f30 0x7fb3f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:55.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.872+0000 7fb3eb7fe700 1 -- 172.21.15.81:0/1247222084 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fb3f8084820 con 0x7fb404159380 2023-10-06T03:23:55.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.872+0000 7fb4037fe700 1 --2- 172.21.15.81:0/1247222084 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb3f0066f30 0x7fb3f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:55.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.873+0000 7fb4037fe700 1 --2- 172.21.15.81:0/1247222084 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb3f0066f30 0x7fb3f00693e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb404069e50 tx=0x7fb3f4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:55.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:55.876+0000 7fb3eb7fe700 1 -- 172.21.15.81:0/1247222084 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb3f8055030 con 0x7fb404159380 2023-10-06T03:23:56.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.112+0000 7fb409fff700 1 -- 172.21.15.81:0/1247222084 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb40404c3c0 con 0x7fb404159380 2023-10-06T03:23:56.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.664+0000 7fb3eb7fe700 1 -- 172.21.15.81:0/1247222084 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb3f8054bc0 con 0x7fb404159380 2023-10-06T03:23:56.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.668+0000 7fb409fff700 1 -- 172.21.15.81:0/1247222084 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb3f0066f30 msgr2=0x7fb3f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:56.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.668+0000 7fb409fff700 1 --2- 172.21.15.81:0/1247222084 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb3f0066f30 0x7fb3f00693e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb404069e50 tx=0x7fb3f4017000 comp rx=0 tx=0).stop 2023-10-06T03:23:56.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.668+0000 7fb409fff700 1 -- 172.21.15.81:0/1247222084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb404159380 msgr2=0x7fb404156340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:56.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.668+0000 7fb409fff700 1 --2- 172.21.15.81:0/1247222084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb404159380 0x7fb404156340 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb3f800c800 tx=0x7fb3f8008040 comp rx=0 tx=0).stop 2023-10-06T03:23:56.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.668+0000 7fb409fff700 1 -- 172.21.15.81:0/1247222084 shutdown_connections 2023-10-06T03:23:56.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.668+0000 7fb409fff700 1 --2- 172.21.15.81:0/1247222084 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb3f0066f30 0x7fb3f00693e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:56.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.668+0000 7fb409fff700 1 --2- 172.21.15.81:0/1247222084 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb404159750 0x7fb4040aaad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:56.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.668+0000 7fb409fff700 1 --2- 172.21.15.81:0/1247222084 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb40406a150 0x7fb40415b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:56.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.668+0000 7fb409fff700 1 --2- 172.21.15.81:0/1247222084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb404159380 0x7fb404156340 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:56.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.668+0000 7fb409fff700 1 -- 172.21.15.81:0/1247222084 >> 172.21.15.81:0/1247222084 conn(0x7fb4040ce290 msgr2=0x7fb4040af4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:56.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.668+0000 7fb409fff700 1 -- 172.21.15.81:0/1247222084 shutdown_connections 2023-10-06T03:23:56.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.668+0000 7fb409fff700 1 -- 172.21.15.81:0/1247222084 wait complete. 2023-10-06T03:23:56.689 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:23:56.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.871+0000 7f2398fff700 1 Processor -- start 2023-10-06T03:23:56.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.871+0000 7f2398fff700 1 -- start start 2023-10-06T03:23:56.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.872+0000 7f2398fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f239415a5c0 0x7f2394161250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:56.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.872+0000 7f2398fff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23940cad30 con 0x7f239413fd90 2023-10-06T03:23:56.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.872+0000 7f2398fff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23940cafe0 con 0x7f239413f9c0 2023-10-06T03:23:56.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.872+0000 7f2398fff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23940cb2c0 con 0x7f239415a5c0 2023-10-06T03:23:56.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.873+0000 7f2392d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f239415a5c0 0x7f2394161250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:56.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.873+0000 7f2392d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f239415a5c0 0x7f2394161250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38702/0 (socket says 172.21.15.81:38702) 2023-10-06T03:23:56.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.873+0000 7f2391d9b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f239413fd90 0x7f2394159eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52902/0 (socket says 172.21.15.81:52902) 2023-10-06T03:23:56.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.873+0000 7f2392d9d700 1 -- 172.21.15.81:0/2669815394 learned_addr learned my addr 172.21.15.81:0/2669815394 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:56.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.873+0000 7f2392d9d700 1 -- 172.21.15.81:0/2669815394 >> v1:172.21.15.83:6789/0 conn(0x7f239413f9c0 legacy=0x7f23940ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:56.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.873+0000 7f2392d9d700 1 -- 172.21.15.81:0/2669815394 >> v1:172.21.15.81:6789/0 conn(0x7f239413fd90 legacy=0x7f2394159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:56.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.873+0000 7f2392d9d700 1 -- 172.21.15.81:0/2669815394 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23940cb5a0 con 0x7f239415a5c0 2023-10-06T03:23:56.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.873+0000 7f239159a700 1 -- 172.21.15.81:0/2669815394 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 911840451 0 0) 0x7f23940cad30 con 0x7f239413fd90 2023-10-06T03:23:56.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.873+0000 7f2392d9d700 1 --2- 172.21.15.81:0/2669815394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f239415a5c0 0x7f2394161250 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f238c009f20 tx=0x7f238c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da0b25aabb82d494 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:56.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.874+0000 7f239159a700 1 -- 172.21.15.81:0/2669815394 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238c00e070 con 0x7f239415a5c0 2023-10-06T03:23:56.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.874+0000 7f239159a700 1 -- 172.21.15.81:0/2669815394 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f238c00ba80 con 0x7f239415a5c0 2023-10-06T03:23:56.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.874+0000 7f239159a700 1 -- 172.21.15.81:0/2669815394 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238c0092e0 con 0x7f239415a5c0 2023-10-06T03:23:56.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.874+0000 7f2398fff700 1 -- 172.21.15.81:0/2669815394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f239415a5c0 msgr2=0x7f2394161250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:56.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.874+0000 7f2398fff700 1 --2- 172.21.15.81:0/2669815394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f239415a5c0 0x7f2394161250 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f238c009f20 tx=0x7f238c009840 comp rx=0 tx=0).stop 2023-10-06T03:23:56.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.874+0000 7f2398fff700 1 -- 172.21.15.81:0/2669815394 shutdown_connections 2023-10-06T03:23:56.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.874+0000 7f2398fff700 1 --2- 172.21.15.81:0/2669815394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f239415a5c0 0x7f2394161250 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:56.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.874+0000 7f2398fff700 1 -- 172.21.15.81:0/2669815394 >> 172.21.15.81:0/2669815394 conn(0x7f23940cc090 msgr2=0x7f23940cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:56.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.874+0000 7f2398fff700 1 -- 172.21.15.81:0/2669815394 shutdown_connections 2023-10-06T03:23:56.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.874+0000 7f2398fff700 1 -- 172.21.15.81:0/2669815394 wait complete. 2023-10-06T03:23:56.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.876+0000 7f2398fff700 1 Processor -- start 2023-10-06T03:23:56.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.876+0000 7f2398fff700 1 -- start start 2023-10-06T03:23:56.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.877+0000 7f2398fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f239413f9c0 0x7f2394155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:56.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.877+0000 7f2398fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f239413fd90 0x7f23940c4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:56.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.877+0000 7f2398fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f239415a5c0 0x7f23940c6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:56.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.877+0000 7f2398fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f239416a940 con 0x7f239415a5c0 2023-10-06T03:23:56.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.877+0000 7f2398fff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2394156230 con 0x7f239413f9c0 2023-10-06T03:23:56.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.877+0000 7f2398fff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f239416ac40 con 0x7f239413fd90 2023-10-06T03:23:56.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.877+0000 7f2392d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f239415a5c0 0x7f23940c6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:56.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.877+0000 7f2392d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f239415a5c0 0x7f23940c6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38706/0 (socket says 172.21.15.81:38706) 2023-10-06T03:23:56.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.877+0000 7f2391d9b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f239413fd90 0x7f23940c4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:56.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.877+0000 7f2392d9d700 1 -- 172.21.15.81:0/1428632150 learned_addr learned my addr 172.21.15.81:0/1428632150 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:56.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.877+0000 7f239259c700 1 --2- 172.21.15.81:0/1428632150 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f239413f9c0 0x7f2394155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:56.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.877+0000 7f2392d9d700 1 -- 172.21.15.81:0/1428632150 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f239413fd90 msgr2=0x7f23940c4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:56.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.877+0000 7f2392d9d700 1 --2- 172.21.15.81:0/1428632150 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f239413fd90 0x7f23940c4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:56.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.877+0000 7f2392d9d700 1 -- 172.21.15.81:0/1428632150 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f239413f9c0 msgr2=0x7f2394155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:56.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.877+0000 7f2392d9d700 1 --2- 172.21.15.81:0/1428632150 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f239413f9c0 0x7f2394155cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:56.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.877+0000 7f2392d9d700 1 -- 172.21.15.81:0/1428632150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f238c009ae0 con 0x7f239415a5c0 2023-10-06T03:23:56.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.878+0000 7f2392d9d700 1 --2- 172.21.15.81:0/1428632150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f239415a5c0 0x7f23940c6950 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f238c009ab0 tx=0x7f238c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:56.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.878+0000 7f23827fc700 1 -- 172.21.15.81:0/1428632150 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238c00be90 con 0x7f239415a5c0 2023-10-06T03:23:56.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.878+0000 7f23827fc700 1 -- 172.21.15.81:0/1428632150 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f238c008d60 con 0x7f239415a5c0 2023-10-06T03:23:56.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.878+0000 7f23827fc700 1 -- 172.21.15.81:0/1428632150 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238c01c660 con 0x7f239415a5c0 2023-10-06T03:23:56.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.878+0000 7f2398fff700 1 -- 172.21.15.81:0/1428632150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2394169a70 con 0x7f239415a5c0 2023-10-06T03:23:56.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.878+0000 7f2398fff700 1 -- 172.21.15.81:0/1428632150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2394169d30 con 0x7f239415a5c0 2023-10-06T03:23:56.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.879+0000 7f2398fff700 1 -- 172.21.15.81:0/1428632150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f239404c3c0 con 0x7f239415a5c0 2023-10-06T03:23:56.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.880+0000 7f23827fc700 1 -- 172.21.15.81:0/1428632150 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f238c003040 con 0x7f239415a5c0 2023-10-06T03:23:56.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.881+0000 7f23827fc700 1 --2- 172.21.15.81:0/1428632150 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2374066f30 0x7f23740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:56.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.881+0000 7f23827fc700 1 -- 172.21.15.81:0/1428632150 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f238c086330 con 0x7f239415a5c0 2023-10-06T03:23:56.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.881+0000 7f239259c700 1 --2- 172.21.15.81:0/1428632150 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2374066f30 0x7f23740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:56.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.882+0000 7f239259c700 1 --2- 172.21.15.81:0/1428632150 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2374066f30 0x7f23740693e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2384003a80 tx=0x7f2384007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:56.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:56.885+0000 7f23827fc700 1 -- 172.21.15.81:0/1428632150 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f238c053130 con 0x7f239415a5c0 2023-10-06T03:23:57.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.120+0000 7f2398fff700 1 -- 172.21.15.81:0/1428632150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f239416aa80 con 0x7f239415a5c0 2023-10-06T03:23:57.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.120+0000 7f23827fc700 1 -- 172.21.15.81:0/1428632150 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4590 (secure 0 0 0) 0x7f239416aa80 con 0x7f239415a5c0 2023-10-06T03:23:57.122 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:23:57.122 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1255569320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1255569320},{"type":"v1","addr":"172.21.15.83:6835","nonce":1255569320}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1673166762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1673166762},{"type":"v1","addr":"172.21.15.81:6835","nonce":1673166762}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3689326153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3689326153},{"type":"v1","addr":"172.21.15.81:6837","nonce":3689326153}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:23:40.376852+0000","modified":"2023-10-06T03:23:56.657619+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6833/745669616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":745669616},{"type":"v1","addr":"172.21.15.83:6833","nonce":745669616}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T03:23:57.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.123+0000 7f2398fff700 1 -- 172.21.15.81:0/1428632150 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2374066f30 msgr2=0x7f23740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:57.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.123+0000 7f2398fff700 1 --2- 172.21.15.81:0/1428632150 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2374066f30 0x7f23740693e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2384003a80 tx=0x7f2384007ec0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.123+0000 7f2398fff700 1 -- 172.21.15.81:0/1428632150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f239415a5c0 msgr2=0x7f23940c6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:57.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.123+0000 7f2398fff700 1 --2- 172.21.15.81:0/1428632150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f239415a5c0 0x7f23940c6950 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f238c009ab0 tx=0x7f238c018000 comp rx=0 tx=0).stop 2023-10-06T03:23:57.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.123+0000 7f2398fff700 1 -- 172.21.15.81:0/1428632150 shutdown_connections 2023-10-06T03:23:57.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.123+0000 7f2398fff700 1 --2- 172.21.15.81:0/1428632150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f239415a5c0 0x7f23940c6950 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.123+0000 7f2398fff700 1 --2- 172.21.15.81:0/1428632150 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f239413f9c0 0x7f2394155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.123+0000 7f2398fff700 1 --2- 172.21.15.81:0/1428632150 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2374066f30 0x7f23740693e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.123+0000 7f2398fff700 1 --2- 172.21.15.81:0/1428632150 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f239413fd90 0x7f23940c4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.123+0000 7f2398fff700 1 -- 172.21.15.81:0/1428632150 >> 172.21.15.81:0/1428632150 conn(0x7f23940cc090 msgr2=0x7f23940ca0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:57.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.123+0000 7f2398fff700 1 -- 172.21.15.81:0/1428632150 shutdown_connections 2023-10-06T03:23:57.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.123+0000 7f2398fff700 1 -- 172.21.15.81:0/1428632150 wait complete. 2023-10-06T03:23:57.126 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2023-10-06T03:23:57.142 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:23:57.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.318+0000 7fa123fff700 1 Processor -- start 2023-10-06T03:23:57.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.318+0000 7fa123fff700 1 -- start start 2023-10-06T03:23:57.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.319+0000 7fa123fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa124156220 0x7fa1240ab7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:57.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.319+0000 7fa123fff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa1240a6730 0x7fa12406e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:57.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.319+0000 7fa123fff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1240b0910 con 0x7fa12406e920 2023-10-06T03:23:57.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.319+0000 7fa123fff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1240b0390 con 0x7fa1240a6730 2023-10-06T03:23:57.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.319+0000 7fa123fff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa124157800 con 0x7fa124156220 2023-10-06T03:23:57.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.320+0000 7fa1227fc700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa1240a6730 0x7fa12406e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:57.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.320+0000 7fa122ffd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa124156220 0x7fa1240ab7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:57.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.320+0000 7fa1227fc700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa1240a6730 0x7fa12406e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:52624/0 (socket says 172.21.15.81:52624) 2023-10-06T03:23:57.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.320+0000 7fa1227fc700 1 -- 172.21.15.81:0/3516623206 learned_addr learned my addr 172.21.15.81:0/3516623206 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:57.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.320+0000 7fa122ffd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa124156220 0x7fa1240ab7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:49658/0 (socket says 172.21.15.81:49658) 2023-10-06T03:23:57.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.320+0000 7fa1227fc700 1 -- 172.21.15.81:0/3516623206 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa124156220 msgr2=0x7fa1240ab7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:57.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.320+0000 7fa1227fc700 1 --2- 172.21.15.81:0/3516623206 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa124156220 0x7fa1240ab7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.320+0000 7fa1227fc700 1 -- 172.21.15.81:0/3516623206 >> v1:172.21.15.83:6789/0 conn(0x7fa12406e920 legacy=0x7fa1241565f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:57.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.321+0000 7fa1227fc700 1 -- 172.21.15.81:0/3516623206 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa12406ed50 con 0x7fa1240a6730 2023-10-06T03:23:57.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.321+0000 7fa1227fc700 1 --2- 172.21.15.81:0/3516623206 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa1240a6730 0x7fa12406e3e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa1180099b0 tx=0x7fa118009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1f9c29900c9f319 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:57.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.321+0000 7fa121ffb700 1 -- 172.21.15.81:0/3516623206 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa118009ea0 con 0x7fa1240a6730 2023-10-06T03:23:57.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.321+0000 7fa121ffb700 1 -- 172.21.15.81:0/3516623206 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa11800b860 con 0x7fa1240a6730 2023-10-06T03:23:57.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.321+0000 7fa121ffb700 1 -- 172.21.15.81:0/3516623206 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11800bc00 con 0x7fa1240a6730 2023-10-06T03:23:57.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.322+0000 7fa123fff700 1 -- 172.21.15.81:0/3516623206 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa1240a6730 msgr2=0x7fa12406e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:57.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.322+0000 7fa123fff700 1 --2- 172.21.15.81:0/3516623206 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa1240a6730 0x7fa12406e3e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa1180099b0 tx=0x7fa118009250 comp rx=0 tx=0).stop 2023-10-06T03:23:57.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.322+0000 7fa123fff700 1 -- 172.21.15.81:0/3516623206 shutdown_connections 2023-10-06T03:23:57.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.322+0000 7fa123fff700 1 --2- 172.21.15.81:0/3516623206 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa124156220 0x7fa1240ab7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.322+0000 7fa123fff700 1 --2- 172.21.15.81:0/3516623206 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa1240a6730 0x7fa12406e3e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.322+0000 7fa123fff700 1 -- 172.21.15.81:0/3516623206 >> 172.21.15.81:0/3516623206 conn(0x7fa1240cbef0 msgr2=0x7fa1240cc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:57.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.322+0000 7fa123fff700 1 -- 172.21.15.81:0/3516623206 shutdown_connections 2023-10-06T03:23:57.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.322+0000 7fa123fff700 1 -- 172.21.15.81:0/3516623206 wait complete. 2023-10-06T03:23:57.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.323+0000 7fa123fff700 1 Processor -- start 2023-10-06T03:23:57.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.323+0000 7fa123fff700 1 -- start start 2023-10-06T03:23:57.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.324+0000 7fa123fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa12406e920 0x7fa1240cb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:57.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.324+0000 7fa123fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1240a6730 0x7fa124149af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:57.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.324+0000 7fa123fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa124156220 0x7fa12406d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:57.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.324+0000 7fa123fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa12414a030 con 0x7fa1240a6730 2023-10-06T03:23:57.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.324+0000 7fa123fff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa12414a1c0 con 0x7fa124156220 2023-10-06T03:23:57.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.324+0000 7fa123fff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa12416a2e0 con 0x7fa12406e920 2023-10-06T03:23:57.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.324+0000 7fa1227fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1240a6730 0x7fa124149af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:57.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.324+0000 7fa1227fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1240a6730 0x7fa124149af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38716/0 (socket says 172.21.15.81:38716) 2023-10-06T03:23:57.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.324+0000 7fa1227fc700 1 -- 172.21.15.81:0/2211234265 learned_addr learned my addr 172.21.15.81:0/2211234265 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:57.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.324+0000 7fa122ffd700 1 --2- 172.21.15.81:0/2211234265 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa12406e920 0x7fa1240cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:57.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.324+0000 7fa1237fe700 1 --2- 172.21.15.81:0/2211234265 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa124156220 0x7fa12406d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:57.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.325+0000 7fa1227fc700 1 -- 172.21.15.81:0/2211234265 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa12406e920 msgr2=0x7fa1240cb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:57.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.325+0000 7fa1227fc700 1 --2- 172.21.15.81:0/2211234265 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa12406e920 0x7fa1240cb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.325+0000 7fa1227fc700 1 -- 172.21.15.81:0/2211234265 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa124156220 msgr2=0x7fa12406d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:57.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.325+0000 7fa1227fc700 1 --2- 172.21.15.81:0/2211234265 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa124156220 0x7fa12406d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.325+0000 7fa1227fc700 1 -- 172.21.15.81:0/2211234265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1180094f0 con 0x7fa1240a6730 2023-10-06T03:23:57.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.325+0000 7fa1227fc700 1 --2- 172.21.15.81:0/2211234265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1240a6730 0x7fa124149af0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa12406c600 tx=0x7fa118017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:57.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.325+0000 7fa10affd700 1 -- 172.21.15.81:0/2211234265 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa118000d10 con 0x7fa1240a6730 2023-10-06T03:23:57.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.325+0000 7fa10affd700 1 -- 172.21.15.81:0/2211234265 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa11800bbe0 con 0x7fa1240a6730 2023-10-06T03:23:57.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.325+0000 7fa10affd700 1 -- 172.21.15.81:0/2211234265 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa118011670 con 0x7fa1240a6730 2023-10-06T03:23:57.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.325+0000 7fa123fff700 1 -- 172.21.15.81:0/2211234265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa12416a5c0 con 0x7fa1240a6730 2023-10-06T03:23:57.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.326+0000 7fa123fff700 1 -- 172.21.15.81:0/2211234265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa12416ab80 con 0x7fa1240a6730 2023-10-06T03:23:57.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.326+0000 7fa123fff700 1 -- 172.21.15.81:0/2211234265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa124157240 con 0x7fa1240a6730 2023-10-06T03:23:57.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.327+0000 7fa10affd700 1 -- 172.21.15.81:0/2211234265 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa118011aa0 con 0x7fa1240a6730 2023-10-06T03:23:57.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.328+0000 7fa10affd700 1 --2- 172.21.15.81:0/2211234265 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa110066f30 0x7fa1100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:57.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.328+0000 7fa10affd700 1 -- 172.21.15.81:0/2211234265 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa118086190 con 0x7fa1240a6730 2023-10-06T03:23:57.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.329+0000 7fa122ffd700 1 --2- 172.21.15.81:0/2211234265 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa110066f30 0x7fa1100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:57.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.329+0000 7fa122ffd700 1 --2- 172.21.15.81:0/2211234265 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa110066f30 0x7fa1100693e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa1241557a0 tx=0x7fa1140091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:57.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.332+0000 7fa10affd700 1 -- 172.21.15.81:0/2211234265 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa118052fb0 con 0x7fa1240a6730 2023-10-06T03:23:57.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.522+0000 7fa123fff700 1 -- 172.21.15.81:0/2211234265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1240aee50 con 0x7fa1240a6730 2023-10-06T03:23:57.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.523+0000 7fa10affd700 1 -- 172.21.15.81:0/2211234265 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18659 (secure 0 0 0) 0x7fa11805de60 con 0x7fa1240a6730 2023-10-06T03:23:57.526 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:23:57.526 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"fsid":"1807b5d7-9be8-43ad-aaf8-99a4273430b3","created":"2023-10-06T03:23:20.805306+0000","modified":"2023-10-06T03:23:45.419616+0000","last_up_change":"2023-10-06T03:23:32.735796+0000","last_in_change":"2023-10-06T03:23:24.109024+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:33.198850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:33.606744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:23:38.742266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:23:39.347944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:23:42.959054+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"14fb667d-a677-4978-a477-80027f889d36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":85563},{"type":"v1","addr":"172.21.15.81:6818","nonce":85563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":85563},{"type":"v1","addr":"172.21.15.81:6822","nonce":85563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":85563},{"type":"v1","addr":"172.21.15.81:6830","nonce":85563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":85563},{"type":"v1","addr":"172.21.15.81:6826","nonce":85563}]},"public_addr":"172.21.15.81:6818/85563","cluster_addr":"172.21.15.81:6822/85563","heartbeat_back_addr":"172.21.15.81:6830/85563","heartbeat_front_addr":"172.21.15.81:6826/85563","state":["exists","up"]},{"osd":1,"uuid":"974d8a86-1829-4176-89ce-18e6038857f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":85561},{"type":"v1","addr":"172.21.15.81:6801","nonce":85561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":85561},{"type":"v1","addr":"172.21.15.81:6803","nonce":85561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":85561},{"type":"v1","addr":"172.21.15.81:6807","nonce":85561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":85561},{"type":"v1","addr":"172.21.15.81:6805","nonce":85561}]},"public_addr":"172.21.15.81:6801/85561","cluster_addr":"172.21.15.81:6803/85561","heartbeat_back_addr":"172.21.15.81:6807/85561","heartbeat_front_addr":"172.21.15.81:6805/85561","state":["exists","up"]},{"osd":2,"uuid":"ffbfe056-46bc-46e0-bf49-4d8f8650e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":85564},{"type":"v1","addr":"172.21.15.81:6809","nonce":85564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":85564},{"type":"v1","addr":"172.21.15.81:6811","nonce":85564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":85564},{"type":"v1","addr":"172.21.15.81:6815","nonce":85564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":85564},{"type":"v1","addr":"172.21.15.81:6813","nonce":85564}]},"public_addr":"172.21.15.81:6809/85564","cluster_addr":"172.21.15.81:6811/85564","heartbeat_back_addr":"172.21.15.81:6815/85564","heartbeat_front_addr":"172.21.15.81:6813/85564","state":["exists","up"]},{"osd":3,"uuid":"ef9a8314-3d37-4ea1-858a-e704d5695002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":85562},{"type":"v1","addr":"172.21.15.81:6819","nonce":85562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":85562},{"type":"v1","addr":"172.21.15.81:6823","nonce":85562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":85562},{"type":"v1","addr":"172.21.15.81:6831","nonce":85562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":85562},{"type":"v1","addr":"172.21.15.81:6827","nonce":85562}]},"public_addr":"172.21.15.81:6819/85562","cluster_addr":"172.21.15.81:6823/85562","heartbeat_back_addr":"172.21.15.81:6831/85562","heartbeat_front_addr":"172.21.15.81:6827/85562","state":["exists","up"]},{"osd":4,"uuid":"d83506a0-2c96-4bcb-a9fa-05e43dc329df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":85785},{"type":"v1","addr":"172.21.15.83:6801","nonce":85785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":85785},{"type":"v1","addr":"172.21.15.83:6803","nonce":85785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":85785},{"type":"v1","addr":"172.21.15.83:6807","nonce":85785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":85785},{"type":"v1","addr":"172.21.15.83:6805","nonce":85785}]},"public_addr":"172.21.15.83:6801/85785","cluster_addr":"172.21.15.83:6803/85785","heartbeat_back_addr":"172.21.15.83:6807/85785","heartbeat_front_addr":"172.21.15.83:6805/85785","state":["exists","up"]},{"osd":5,"uuid":"10687c63-a3d5-472f-acc0-4f61847b6e0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":85818},{"type":"v1","addr":"172.21.15.83:6825","nonce":85818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":85818},{"type":"v1","addr":"172.21.15.83:6827","nonce":85818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":85818},{"type":"v1","addr":"172.21.15.83:6831","nonce":85818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":85818},{"type":"v1","addr":"172.21.15.83:6829","nonce":85818}]},"public_addr":"172.21.15.83:6825/85818","cluster_addr":"172.21.15.83:6827/85818","heartbeat_back_addr":"172.21.15.83:6831/85818","heartbeat_front_addr":"172.21.15.83:6829/85818","state":["exists","up"]},{"osd":6,"uuid":"2e9daf76-5607-4a29-9a58-6e270700d223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":85787},{"type":"v1","addr":"172.21.15.83:6811","nonce":85787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":85787},{"type":"v1","addr":"172.21.15.83:6815","nonce":85787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":85787},{"type":"v1","addr":"172.21.15.83:6823","nonce":85787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6817","nonce":85787},{"type":"v1","addr":"172.21.15.83:6819","nonce":85787}]},"public_addr":"172.21.15.83:6811/85787","cluster_addr":"172.21.15.83:6815/85787","heartbeat_back_addr":"172.21.15.83:6823/85787","heartbeat_front_addr":"172.21.15.83:6819/85787","state":["exists","up"]},{"osd":7,"uuid":"5019e1ff-233a-4a5a-91ca-8afccb7ab6e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":85786},{"type":"v1","addr":"172.21.15.83:6810","nonce":85786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":85786},{"type":"v1","addr":"172.21.15.83:6814","nonce":85786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":85786},{"type":"v1","addr":"172.21.15.83:6822","nonce":85786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":85786},{"type":"v1","addr":"172.21.15.83:6818","nonce":85786}]},"public_addr":"172.21.15.83:6810/85786","cluster_addr":"172.21.15.83:6814/85786","heartbeat_back_addr":"172.21.15.83:6822/85786","heartbeat_front_addr":"172.21.15.83:6818/85786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.393431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.360031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.407428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.391613+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.403211+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.438142+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.496181+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.472323+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:23:57.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.525+0000 7fa123fff700 1 -- 172.21.15.81:0/2211234265 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa110066f30 msgr2=0x7fa1100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:57.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.525+0000 7fa123fff700 1 --2- 172.21.15.81:0/2211234265 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa110066f30 0x7fa1100693e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa1241557a0 tx=0x7fa1140091a0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.525+0000 7fa123fff700 1 -- 172.21.15.81:0/2211234265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1240a6730 msgr2=0x7fa124149af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:57.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.525+0000 7fa123fff700 1 --2- 172.21.15.81:0/2211234265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1240a6730 0x7fa124149af0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa12406c600 tx=0x7fa118017000 comp rx=0 tx=0).stop 2023-10-06T03:23:57.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.526+0000 7fa123fff700 1 -- 172.21.15.81:0/2211234265 shutdown_connections 2023-10-06T03:23:57.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.526+0000 7fa123fff700 1 --2- 172.21.15.81:0/2211234265 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa124156220 0x7fa12406d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.526+0000 7fa123fff700 1 --2- 172.21.15.81:0/2211234265 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa110066f30 0x7fa1100693e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.526+0000 7fa123fff700 1 --2- 172.21.15.81:0/2211234265 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa12406e920 0x7fa1240cb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.526+0000 7fa123fff700 1 --2- 172.21.15.81:0/2211234265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1240a6730 0x7fa124149af0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.526+0000 7fa123fff700 1 -- 172.21.15.81:0/2211234265 >> 172.21.15.81:0/2211234265 conn(0x7fa1240cbef0 msgr2=0x7fa1241506f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:57.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.526+0000 7fa123fff700 1 -- 172.21.15.81:0/2211234265 shutdown_connections 2023-10-06T03:23:57.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.526+0000 7fa123fff700 1 -- 172.21.15.81:0/2211234265 wait complete. 2023-10-06T03:23:57.545 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T03:23:57.545 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:23:57.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.726+0000 7fa30f7ff700 1 Processor -- start 2023-10-06T03:23:57.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.726+0000 7fa30f7ff700 1 -- start start 2023-10-06T03:23:57.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.728+0000 7fa30f7ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa308153a90 0x7fa30815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:57.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.728+0000 7fa30f7ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa308153e60 0x7fa3080b23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:57.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.728+0000 7fa30f7ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa3080675e0 0x7fa3080cb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:57.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.728+0000 7fa30f7ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3080b28f0 con 0x7fa3080675e0 2023-10-06T03:23:57.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.728+0000 7fa30f7ff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3080c9f50 con 0x7fa308153a90 2023-10-06T03:23:57.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.728+0000 7fa30f7ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3080ca230 con 0x7fa308153e60 2023-10-06T03:23:57.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.728+0000 7fa30dd9c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa3080675e0 0x7fa3080cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:57.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.728+0000 7fa30d59b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa308153a90 0x7fa30815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:57.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.728+0000 7fa30dd9c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa3080675e0 0x7fa3080cb860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38726/0 (socket says 172.21.15.81:38726) 2023-10-06T03:23:57.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.728+0000 7fa30cd9a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa308153e60 0x7fa3080b23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:57.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.728+0000 7fa30dd9c700 1 -- 172.21.15.81:0/4103806373 learned_addr learned my addr 172.21.15.81:0/4103806373 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:57.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.728+0000 7fa30dd9c700 1 -- 172.21.15.81:0/4103806373 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa308153e60 msgr2=0x7fa3080b23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:57.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.728+0000 7fa30dd9c700 1 --2- 172.21.15.81:0/4103806373 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa308153e60 0x7fa3080b23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.728+0000 7fa30dd9c700 1 -- 172.21.15.81:0/4103806373 >> v2:172.21.15.83:3300/0 conn(0x7fa308153a90 msgr2=0x7fa30815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:57.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.728+0000 7fa30dd9c700 1 --2- 172.21.15.81:0/4103806373 >> v2:172.21.15.83:3300/0 conn(0x7fa308153a90 0x7fa30815a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.728+0000 7fa30dd9c700 1 -- 172.21.15.81:0/4103806373 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa30806dc70 con 0x7fa3080675e0 2023-10-06T03:23:57.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.729+0000 7fa30dd9c700 1 --2- 172.21.15.81:0/4103806373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3080675e0 0x7fa3080cb860 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa30806d940 tx=0x7fa300009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3780c0b1edd385af server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:57.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.729+0000 7fa2fffff700 1 -- 172.21.15.81:0/4103806373 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30000e070 con 0x7fa3080675e0 2023-10-06T03:23:57.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.729+0000 7fa2fffff700 1 -- 172.21.15.81:0/4103806373 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa30000b970 con 0x7fa3080675e0 2023-10-06T03:23:57.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.729+0000 7fa2fffff700 1 -- 172.21.15.81:0/4103806373 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3000092e0 con 0x7fa3080675e0 2023-10-06T03:23:57.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.730+0000 7fa30f7ff700 1 -- 172.21.15.81:0/4103806373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3080675e0 msgr2=0x7fa3080cb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:57.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.730+0000 7fa30f7ff700 1 --2- 172.21.15.81:0/4103806373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3080675e0 0x7fa3080cb860 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa30806d940 tx=0x7fa300009840 comp rx=0 tx=0).stop 2023-10-06T03:23:57.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.730+0000 7fa30f7ff700 1 -- 172.21.15.81:0/4103806373 shutdown_connections 2023-10-06T03:23:57.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.730+0000 7fa30f7ff700 1 --2- 172.21.15.81:0/4103806373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3080675e0 0x7fa3080cb860 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.730+0000 7fa30f7ff700 1 --2- 172.21.15.81:0/4103806373 >> v2:172.21.15.83:3300/0 conn(0x7fa308153a90 0x7fa30815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.730+0000 7fa30f7ff700 1 --2- 172.21.15.81:0/4103806373 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa308153e60 0x7fa3080b23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.730+0000 7fa30f7ff700 1 -- 172.21.15.81:0/4103806373 >> 172.21.15.81:0/4103806373 conn(0x7fa3080cd3c0 msgr2=0x7fa3080b1860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:57.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.730+0000 7fa30f7ff700 1 -- 172.21.15.81:0/4103806373 shutdown_connections 2023-10-06T03:23:57.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.730+0000 7fa30f7ff700 1 -- 172.21.15.81:0/4103806373 wait complete. 2023-10-06T03:23:57.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.731+0000 7fa30f7ff700 1 Processor -- start 2023-10-06T03:23:57.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.731+0000 7fa30f7ff700 1 -- start start 2023-10-06T03:23:57.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.732+0000 7fa30f7ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa3080675e0 0x7fa30813e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:57.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.732+0000 7fa30f7ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa308153a90 0x7fa30815c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:57.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.732+0000 7fa30f7ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa308153e60 0x7fa3081528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:57.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.732+0000 7fa30f7ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3080c5ae0 con 0x7fa308153e60 2023-10-06T03:23:57.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.732+0000 7fa30f7ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3080c5dc0 con 0x7fa308153a90 2023-10-06T03:23:57.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.732+0000 7fa30f7ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa30815ce20 con 0x7fa3080675e0 2023-10-06T03:23:57.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.732+0000 7fa30dd9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa308153e60 0x7fa3081528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:57.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.732+0000 7fa30dd9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa308153e60 0x7fa3081528c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38740/0 (socket says 172.21.15.81:38740) 2023-10-06T03:23:57.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.732+0000 7fa30dd9c700 1 -- 172.21.15.81:0/826861020 learned_addr learned my addr 172.21.15.81:0/826861020 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:57.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.733+0000 7fa30d59b700 1 --2- 172.21.15.81:0/826861020 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa3080675e0 0x7fa30813e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:57.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.733+0000 7fa30cd9a700 1 --2- 172.21.15.81:0/826861020 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa308153a90 0x7fa30815c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:57.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.733+0000 7fa30dd9c700 1 -- 172.21.15.81:0/826861020 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa3080675e0 msgr2=0x7fa30813e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:57.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.733+0000 7fa30dd9c700 1 --2- 172.21.15.81:0/826861020 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa3080675e0 0x7fa30813e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.733+0000 7fa30dd9c700 1 -- 172.21.15.81:0/826861020 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa308153a90 msgr2=0x7fa30815c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:57.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.733+0000 7fa30dd9c700 1 --2- 172.21.15.81:0/826861020 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa308153a90 0x7fa30815c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.733+0000 7fa30dd9c700 1 -- 172.21.15.81:0/826861020 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa300009ae0 con 0x7fa308153e60 2023-10-06T03:23:57.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.733+0000 7fa30dd9c700 1 --2- 172.21.15.81:0/826861020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa308153e60 0x7fa3081528c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa3080694f0 tx=0x7fa300018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:57.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.733+0000 7fa2fd7fa700 1 -- 172.21.15.81:0/826861020 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa300008b80 con 0x7fa308153e60 2023-10-06T03:23:57.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.733+0000 7fa2fd7fa700 1 -- 172.21.15.81:0/826861020 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa300008ce0 con 0x7fa308153e60 2023-10-06T03:23:57.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.733+0000 7fa2fd7fa700 1 -- 172.21.15.81:0/826861020 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3000256b0 con 0x7fa308153e60 2023-10-06T03:23:57.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.733+0000 7fa30f7ff700 1 -- 172.21.15.81:0/826861020 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa30815d100 con 0x7fa308153e60 2023-10-06T03:23:57.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.733+0000 7fa30f7ff700 1 -- 172.21.15.81:0/826861020 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa30813e850 con 0x7fa308153e60 2023-10-06T03:23:57.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.734+0000 7fa30f7ff700 1 -- 172.21.15.81:0/826861020 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3080c5f70 con 0x7fa308153e60 2023-10-06T03:23:57.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.735+0000 7fa2fd7fa700 1 -- 172.21.15.81:0/826861020 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa300003040 con 0x7fa308153e60 2023-10-06T03:23:57.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.736+0000 7fa2fd7fa700 1 --2- 172.21.15.81:0/826861020 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa2ec066f30 0x7fa2ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:57.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.736+0000 7fa2fd7fa700 1 -- 172.21.15.81:0/826861020 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa300086520 con 0x7fa308153e60 2023-10-06T03:23:57.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.736+0000 7fa30d59b700 1 --2- 172.21.15.81:0/826861020 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa2ec066f30 0x7fa2ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:57.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.737+0000 7fa30d59b700 1 --2- 172.21.15.81:0/826861020 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa2ec066f30 0x7fa2ec0693e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa3080c8ae0 tx=0x7fa304008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:57.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.740+0000 7fa2fd7fa700 1 -- 172.21.15.81:0/826861020 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa3080c5f70 con 0x7fa308153e60 2023-10-06T03:23:57.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.927+0000 7fa30f7ff700 1 -- 172.21.15.81:0/826861020 --> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa3080c5f30 con 0x7fa2ec066f30 2023-10-06T03:23:57.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.940+0000 7fa2fd7fa700 1 -- 172.21.15.81:0/826861020 <== mgr.4100 v2:172.21.15.81:6832/85286 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367560 (secure 0 0 0) 0x7fa3080c5f30 con 0x7fa2ec066f30 2023-10-06T03:23:57.946 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:23:57.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.944+0000 7fa30f7ff700 1 -- 172.21.15.81:0/826861020 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa2ec066f30 msgr2=0x7fa2ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:57.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.944+0000 7fa30f7ff700 1 --2- 172.21.15.81:0/826861020 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa2ec066f30 0x7fa2ec0693e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa3080c8ae0 tx=0x7fa304008040 comp rx=0 tx=0).stop 2023-10-06T03:23:57.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.944+0000 7fa30f7ff700 1 -- 172.21.15.81:0/826861020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa308153e60 msgr2=0x7fa3081528c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:57.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.944+0000 7fa30f7ff700 1 --2- 172.21.15.81:0/826861020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa308153e60 0x7fa3081528c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa3080694f0 tx=0x7fa300018000 comp rx=0 tx=0).stop 2023-10-06T03:23:57.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.944+0000 7fa30f7ff700 1 -- 172.21.15.81:0/826861020 shutdown_connections 2023-10-06T03:23:57.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.944+0000 7fa30f7ff700 1 --2- 172.21.15.81:0/826861020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa308153e60 0x7fa3081528c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.944+0000 7fa30f7ff700 1 --2- 172.21.15.81:0/826861020 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa2ec066f30 0x7fa2ec0693e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.944+0000 7fa30f7ff700 1 --2- 172.21.15.81:0/826861020 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa3080675e0 0x7fa30813e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.944+0000 7fa30f7ff700 1 --2- 172.21.15.81:0/826861020 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa308153a90 0x7fa30815c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:57.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.944+0000 7fa30f7ff700 1 -- 172.21.15.81:0/826861020 >> 172.21.15.81:0/826861020 conn(0x7fa3080cd3c0 msgr2=0x7fa3080b1760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:57.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.945+0000 7fa30f7ff700 1 -- 172.21.15.81:0/826861020 shutdown_connections 2023-10-06T03:23:57.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:57.945+0000 7fa30f7ff700 1 -- 172.21.15.81:0/826861020 wait complete. 2023-10-06T03:23:57.951 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-06T03:23:57.964 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2023-10-06T03:23:57.557406+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593127,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":205,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381508,"kb_used_data":3204,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593212,"statfs":{"total":773094113280,"available":770655449088,"internally_reserved":0,"allocated":3280896,"data_stored":2020405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":453,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.911923"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.934944+0000","last_change":"2023-10-06T03:23:40.657927+0000","last_active":"2023-10-06T03:23:44.934944+0000","last_peered":"2023-10-06T03:23:44.934944+0000","last_clean":"2023-10-06T03:23:44.934944+0000","last_became_active":"2023-10-06T03:23:40.657628+0000","last_became_peered":"2023-10-06T03:23:40.657628+0000","last_unstale":"2023-10-06T03:23:44.934944+0000","last_undegraded":"2023-10-06T03:23:44.934944+0000","last_fullsized":"2023-10-06T03:23:44.934944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:53.566006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936939+0000","last_change":"2023-10-06T03:23:40.669392+0000","last_active":"2023-10-06T03:23:44.936939+0000","last_peered":"2023-10-06T03:23:44.936939+0000","last_clean":"2023-10-06T03:23:44.936939+0000","last_became_active":"2023-10-06T03:23:40.669068+0000","last_became_peered":"2023-10-06T03:23:40.669068+0000","last_unstale":"2023-10-06T03:23:44.936939+0000","last_undegraded":"2023-10-06T03:23:44.936939+0000","last_fullsized":"2023-10-06T03:23:44.936939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:15.293618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937675+0000","last_change":"2023-10-06T03:23:40.672182+0000","last_active":"2023-10-06T03:23:44.937675+0000","last_peered":"2023-10-06T03:23:44.937675+0000","last_clean":"2023-10-06T03:23:44.937675+0000","last_became_active":"2023-10-06T03:23:40.671082+0000","last_became_peered":"2023-10-06T03:23:40.671082+0000","last_unstale":"2023-10-06T03:23:44.937675+0000","last_undegraded":"2023-10-06T03:23:44.937675+0000","last_fullsized":"2023-10-06T03:23:44.937675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:37:07.602543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.944602+0000","last_change":"2023-10-06T03:23:40.669872+0000","last_active":"2023-10-06T03:23:44.944602+0000","last_peered":"2023-10-06T03:23:44.944602+0000","last_clean":"2023-10-06T03:23:44.944602+0000","last_became_active":"2023-10-06T03:23:40.669607+0000","last_became_peered":"2023-10-06T03:23:40.669607+0000","last_unstale":"2023-10-06T03:23:44.944602+0000","last_undegraded":"2023-10-06T03:23:44.944602+0000","last_fullsized":"2023-10-06T03:23:44.944602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:45.363103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.947565+0000","last_change":"2023-10-06T03:23:40.673713+0000","last_active":"2023-10-06T03:23:44.947565+0000","last_peered":"2023-10-06T03:23:44.947565+0000","last_clean":"2023-10-06T03:23:44.947565+0000","last_became_active":"2023-10-06T03:23:40.673350+0000","last_became_peered":"2023-10-06T03:23:40.673350+0000","last_unstale":"2023-10-06T03:23:44.947565+0000","last_undegraded":"2023-10-06T03:23:44.947565+0000","last_fullsized":"2023-10-06T03:23:44.947565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:54:33.855202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936531+0000","last_change":"2023-10-06T03:23:40.672923+0000","last_active":"2023-10-06T03:23:44.936531+0000","last_peered":"2023-10-06T03:23:44.936531+0000","last_clean":"2023-10-06T03:23:44.936531+0000","last_became_active":"2023-10-06T03:23:40.672651+0000","last_became_peered":"2023-10-06T03:23:40.672651+0000","last_unstale":"2023-10-06T03:23:44.936531+0000","last_undegraded":"2023-10-06T03:23:44.936531+0000","last_fullsized":"2023-10-06T03:23:44.936531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:30:38.801700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937090+0000","last_change":"2023-10-06T03:23:40.670079+0000","last_active":"2023-10-06T03:23:44.937090+0000","last_peered":"2023-10-06T03:23:44.937090+0000","last_clean":"2023-10-06T03:23:44.937090+0000","last_became_active":"2023-10-06T03:23:40.669460+0000","last_became_peered":"2023-10-06T03:23:40.669460+0000","last_unstale":"2023-10-06T03:23:44.937090+0000","last_undegraded":"2023-10-06T03:23:44.937090+0000","last_fullsized":"2023-10-06T03:23:44.937090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:21.489097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.934267+0000","last_change":"2023-10-06T03:23:40.670214+0000","last_active":"2023-10-06T03:23:44.934267+0000","last_peered":"2023-10-06T03:23:44.934267+0000","last_clean":"2023-10-06T03:23:44.934267+0000","last_became_active":"2023-10-06T03:23:40.669794+0000","last_became_peered":"2023-10-06T03:23:40.669794+0000","last_unstale":"2023-10-06T03:23:44.934267+0000","last_undegraded":"2023-10-06T03:23:44.934267+0000","last_fullsized":"2023-10-06T03:23:44.934267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:51:39.105798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.947704+0000","last_change":"2023-10-06T03:23:40.673814+0000","last_active":"2023-10-06T03:23:44.947704+0000","last_peered":"2023-10-06T03:23:44.947704+0000","last_clean":"2023-10-06T03:23:44.947704+0000","last_became_active":"2023-10-06T03:23:40.673518+0000","last_became_peered":"2023-10-06T03:23:40.673518+0000","last_unstale":"2023-10-06T03:23:44.947704+0000","last_undegraded":"2023-10-06T03:23:44.947704+0000","last_fullsized":"2023-10-06T03:23:44.947704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:36:33.973063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937252+0000","last_change":"2023-10-06T03:23:40.674286+0000","last_active":"2023-10-06T03:23:44.937252+0000","last_peered":"2023-10-06T03:23:44.937252+0000","last_clean":"2023-10-06T03:23:44.937252+0000","last_became_active":"2023-10-06T03:23:40.673972+0000","last_became_peered":"2023-10-06T03:23:40.673972+0000","last_unstale":"2023-10-06T03:23:44.937252+0000","last_undegraded":"2023-10-06T03:23:44.937252+0000","last_fullsized":"2023-10-06T03:23:44.937252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:35.462631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937591+0000","last_change":"2023-10-06T03:23:40.672377+0000","last_active":"2023-10-06T03:23:44.937591+0000","last_peered":"2023-10-06T03:23:44.937591+0000","last_clean":"2023-10-06T03:23:44.937591+0000","last_became_active":"2023-10-06T03:23:40.671914+0000","last_became_peered":"2023-10-06T03:23:40.671914+0000","last_unstale":"2023-10-06T03:23:44.937591+0000","last_undegraded":"2023-10-06T03:23:44.937591+0000","last_fullsized":"2023-10-06T03:23:44.937591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:49.615169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.934679+0000","last_change":"2023-10-06T03:23:40.664677+0000","last_active":"2023-10-06T03:23:44.934679+0000","last_peered":"2023-10-06T03:23:44.934679+0000","last_clean":"2023-10-06T03:23:44.934679+0000","last_became_active":"2023-10-06T03:23:40.664274+0000","last_became_peered":"2023-10-06T03:23:40.664274+0000","last_unstale":"2023-10-06T03:23:44.934679+0000","last_undegraded":"2023-10-06T03:23:44.934679+0000","last_fullsized":"2023-10-06T03:23:44.934679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:46:25.920290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936715+0000","last_change":"2023-10-06T03:23:40.661431+0000","last_active":"2023-10-06T03:23:44.936715+0000","last_peered":"2023-10-06T03:23:44.936715+0000","last_clean":"2023-10-06T03:23:44.936715+0000","last_became_active":"2023-10-06T03:23:40.661152+0000","last_became_peered":"2023-10-06T03:23:40.661152+0000","last_unstale":"2023-10-06T03:23:44.936715+0000","last_undegraded":"2023-10-06T03:23:44.936715+0000","last_fullsized":"2023-10-06T03:23:44.936715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:35.968610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.934879+0000","last_change":"2023-10-06T03:23:40.654344+0000","last_active":"2023-10-06T03:23:44.934879+0000","last_peered":"2023-10-06T03:23:44.934879+0000","last_clean":"2023-10-06T03:23:44.934879+0000","last_became_active":"2023-10-06T03:23:40.654053+0000","last_became_peered":"2023-10-06T03:23:40.654053+0000","last_unstale":"2023-10-06T03:23:44.934879+0000","last_undegraded":"2023-10-06T03:23:44.934879+0000","last_fullsized":"2023-10-06T03:23:44.934879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:04:49.664462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936826+0000","last_change":"2023-10-06T03:23:40.669778+0000","last_active":"2023-10-06T03:23:44.936826+0000","last_peered":"2023-10-06T03:23:44.936826+0000","last_clean":"2023-10-06T03:23:44.936826+0000","last_became_active":"2023-10-06T03:23:40.669080+0000","last_became_peered":"2023-10-06T03:23:40.669080+0000","last_unstale":"2023-10-06T03:23:44.936826+0000","last_undegraded":"2023-10-06T03:23:44.936826+0000","last_fullsized":"2023-10-06T03:23:44.936826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:51:39.105798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937246+0000","last_change":"2023-10-06T03:23:40.675925+0000","last_active":"2023-10-06T03:23:44.937246+0000","last_peered":"2023-10-06T03:23:44.937246+0000","last_clean":"2023-10-06T03:23:44.937246+0000","last_became_active":"2023-10-06T03:23:40.673050+0000","last_became_peered":"2023-10-06T03:23:40.673050+0000","last_unstale":"2023-10-06T03:23:44.937246+0000","last_undegraded":"2023-10-06T03:23:44.937246+0000","last_fullsized":"2023-10-06T03:23:44.937246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:38:27.078009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.947782+0000","last_change":"2023-10-06T03:23:40.670497+0000","last_active":"2023-10-06T03:23:44.947782+0000","last_peered":"2023-10-06T03:23:44.947782+0000","last_clean":"2023-10-06T03:23:44.947782+0000","last_became_active":"2023-10-06T03:23:40.670254+0000","last_became_peered":"2023-10-06T03:23:40.670254+0000","last_unstale":"2023-10-06T03:23:44.947782+0000","last_undegraded":"2023-10-06T03:23:44.947782+0000","last_fullsized":"2023-10-06T03:23:44.947782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:18.546154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937896+0000","last_change":"2023-10-06T03:23:40.664385+0000","last_active":"2023-10-06T03:23:44.937896+0000","last_peered":"2023-10-06T03:23:44.937896+0000","last_clean":"2023-10-06T03:23:44.937896+0000","last_became_active":"2023-10-06T03:23:40.664019+0000","last_became_peered":"2023-10-06T03:23:40.664019+0000","last_unstale":"2023-10-06T03:23:44.937896+0000","last_undegraded":"2023-10-06T03:23:44.937896+0000","last_fullsized":"2023-10-06T03:23:44.937896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:18.834001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.935061+0000","last_change":"2023-10-06T03:23:40.664719+0000","last_active":"2023-10-06T03:23:44.935061+0000","last_peered":"2023-10-06T03:23:44.935061+0000","last_clean":"2023-10-06T03:23:44.935061+0000","last_became_active":"2023-10-06T03:23:40.664292+0000","last_became_peered":"2023-10-06T03:23:40.664292+0000","last_unstale":"2023-10-06T03:23:44.935061+0000","last_undegraded":"2023-10-06T03:23:44.935061+0000","last_fullsized":"2023-10-06T03:23:44.935061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:25:22.431703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937565+0000","last_change":"2023-10-06T03:23:40.676968+0000","last_active":"2023-10-06T03:23:44.937565+0000","last_peered":"2023-10-06T03:23:44.937565+0000","last_clean":"2023-10-06T03:23:44.937565+0000","last_became_active":"2023-10-06T03:23:40.671490+0000","last_became_peered":"2023-10-06T03:23:40.671490+0000","last_unstale":"2023-10-06T03:23:44.937565+0000","last_undegraded":"2023-10-06T03:23:44.937565+0000","last_fullsized":"2023-10-06T03:23:44.937565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:57.849203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936664+0000","last_change":"2023-10-06T03:23:40.664089+0000","last_active":"2023-10-06T03:23:44.936664+0000","last_peered":"2023-10-06T03:23:44.936664+0000","last_clean":"2023-10-06T03:23:44.936664+0000","last_became_active":"2023-10-06T03:23:40.662392+0000","last_became_peered":"2023-10-06T03:23:40.662392+0000","last_unstale":"2023-10-06T03:23:44.936664+0000","last_undegraded":"2023-10-06T03:23:44.936664+0000","last_fullsized":"2023-10-06T03:23:44.936664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:35.462631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.945221+0000","last_change":"2023-10-06T03:23:40.673025+0000","last_active":"2023-10-06T03:23:44.945221+0000","last_peered":"2023-10-06T03:23:44.945221+0000","last_clean":"2023-10-06T03:23:44.945221+0000","last_became_active":"2023-10-06T03:23:40.672797+0000","last_became_peered":"2023-10-06T03:23:40.672797+0000","last_unstale":"2023-10-06T03:23:44.945221+0000","last_undegraded":"2023-10-06T03:23:44.945221+0000","last_fullsized":"2023-10-06T03:23:44.945221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:21.489097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.930431+0000","last_change":"2023-10-06T03:23:40.670561+0000","last_active":"2023-10-06T03:23:44.930431+0000","last_peered":"2023-10-06T03:23:44.930431+0000","last_clean":"2023-10-06T03:23:44.930431+0000","last_became_active":"2023-10-06T03:23:40.670272+0000","last_became_peered":"2023-10-06T03:23:40.670272+0000","last_unstale":"2023-10-06T03:23:44.930431+0000","last_undegraded":"2023-10-06T03:23:44.930431+0000","last_fullsized":"2023-10-06T03:23:44.930431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:18.834001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936341+0000","last_change":"2023-10-06T03:23:40.662281+0000","last_active":"2023-10-06T03:23:44.936341+0000","last_peered":"2023-10-06T03:23:44.936341+0000","last_clean":"2023-10-06T03:23:44.936341+0000","last_became_active":"2023-10-06T03:23:40.661686+0000","last_became_peered":"2023-10-06T03:23:40.661686+0000","last_unstale":"2023-10-06T03:23:44.936341+0000","last_undegraded":"2023-10-06T03:23:44.936341+0000","last_fullsized":"2023-10-06T03:23:44.936341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:15.293618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.938818+0000","last_change":"2023-10-06T03:23:40.668204+0000","last_active":"2023-10-06T03:23:44.938818+0000","last_peered":"2023-10-06T03:23:44.938818+0000","last_clean":"2023-10-06T03:23:44.938818+0000","last_became_active":"2023-10-06T03:23:40.665998+0000","last_became_peered":"2023-10-06T03:23:40.665998+0000","last_unstale":"2023-10-06T03:23:44.938818+0000","last_undegraded":"2023-10-06T03:23:44.938818+0000","last_fullsized":"2023-10-06T03:23:44.938818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:15.293618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936984+0000","last_change":"2023-10-06T03:23:40.654367+0000","last_active":"2023-10-06T03:23:44.936984+0000","last_peered":"2023-10-06T03:23:44.936984+0000","last_clean":"2023-10-06T03:23:44.936984+0000","last_became_active":"2023-10-06T03:23:40.654082+0000","last_became_peered":"2023-10-06T03:23:40.654082+0000","last_unstale":"2023-10-06T03:23:44.936984+0000","last_undegraded":"2023-10-06T03:23:44.936984+0000","last_fullsized":"2023-10-06T03:23:44.936984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:56.483789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.938900+0000","last_change":"2023-10-06T03:23:40.662226+0000","last_active":"2023-10-06T03:23:44.938900+0000","last_peered":"2023-10-06T03:23:44.938900+0000","last_clean":"2023-10-06T03:23:44.938900+0000","last_became_active":"2023-10-06T03:23:40.662025+0000","last_became_peered":"2023-10-06T03:23:40.662025+0000","last_unstale":"2023-10-06T03:23:44.938900+0000","last_undegraded":"2023-10-06T03:23:44.938900+0000","last_fullsized":"2023-10-06T03:23:44.938900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:37.167322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.955136+0000","last_change":"2023-10-06T03:23:44.949281+0000","last_active":"2023-10-06T03:23:44.955136+0000","last_peered":"2023-10-06T03:23:44.955136+0000","last_clean":"2023-10-06T03:23:44.955136+0000","last_became_active":"2023-10-06T03:23:44.948885+0000","last_became_peered":"2023-10-06T03:23:44.948885+0000","last_unstale":"2023-10-06T03:23:44.955136+0000","last_undegraded":"2023-10-06T03:23:44.955136+0000","last_fullsized":"2023-10-06T03:23:44.955136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:31:16.317335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936350+0000","last_change":"2023-10-06T03:23:39.919181+0000","last_active":"2023-10-06T03:23:44.936350+0000","last_peered":"2023-10-06T03:23:44.936350+0000","last_clean":"2023-10-06T03:23:44.936350+0000","last_became_active":"2023-10-06T03:23:39.918331+0000","last_became_peered":"2023-10-06T03:23:39.918331+0000","last_unstale":"2023-10-06T03:23:44.936350+0000","last_undegraded":"2023-10-06T03:23:44.936350+0000","last_fullsized":"2023-10-06T03:23:44.936350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:46:24.911513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.931056+0000","last_change":"2023-10-06T03:23:40.666693+0000","last_active":"2023-10-06T03:23:44.931056+0000","last_peered":"2023-10-06T03:23:44.931056+0000","last_clean":"2023-10-06T03:23:44.931056+0000","last_became_active":"2023-10-06T03:23:40.666435+0000","last_became_peered":"2023-10-06T03:23:40.666435+0000","last_unstale":"2023-10-06T03:23:44.931056+0000","last_undegraded":"2023-10-06T03:23:44.931056+0000","last_fullsized":"2023-10-06T03:23:44.931056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:35.462631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.962151+0000","last_change":"2023-10-06T03:23:44.958592+0000","last_active":"2023-10-06T03:23:44.962151+0000","last_peered":"2023-10-06T03:23:44.962151+0000","last_clean":"2023-10-06T03:23:44.962151+0000","last_became_active":"2023-10-06T03:23:44.957907+0000","last_became_peered":"2023-10-06T03:23:44.957907+0000","last_unstale":"2023-10-06T03:23:44.962151+0000","last_undegraded":"2023-10-06T03:23:44.962151+0000","last_fullsized":"2023-10-06T03:23:44.962151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:22.863565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.938027+0000","last_change":"2023-10-06T03:23:39.927167+0000","last_active":"2023-10-06T03:23:44.938027+0000","last_peered":"2023-10-06T03:23:44.938027+0000","last_clean":"2023-10-06T03:23:44.938027+0000","last_became_active":"2023-10-06T03:23:39.926796+0000","last_became_peered":"2023-10-06T03:23:39.926796+0000","last_unstale":"2023-10-06T03:23:44.938027+0000","last_undegraded":"2023-10-06T03:23:44.938027+0000","last_fullsized":"2023-10-06T03:23:44.938027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:10:12.819926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.948077+0000","last_change":"2023-10-06T03:23:40.676555+0000","last_active":"2023-10-06T03:23:44.948077+0000","last_peered":"2023-10-06T03:23:44.948077+0000","last_clean":"2023-10-06T03:23:44.948077+0000","last_became_active":"2023-10-06T03:23:40.676292+0000","last_became_peered":"2023-10-06T03:23:40.676292+0000","last_unstale":"2023-10-06T03:23:44.948077+0000","last_undegraded":"2023-10-06T03:23:44.948077+0000","last_fullsized":"2023-10-06T03:23:44.948077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:15.293618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.966214+0000","last_change":"2023-10-06T03:23:44.963581+0000","last_active":"2023-10-06T03:23:44.966214+0000","last_peered":"2023-10-06T03:23:44.966214+0000","last_clean":"2023-10-06T03:23:44.966214+0000","last_became_active":"2023-10-06T03:23:44.963132+0000","last_became_peered":"2023-10-06T03:23:44.963132+0000","last_unstale":"2023-10-06T03:23:44.966214+0000","last_undegraded":"2023-10-06T03:23:44.966214+0000","last_fullsized":"2023-10-06T03:23:44.966214+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:39.997230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.930690+0000","last_change":"2023-10-06T03:23:39.931987+0000","last_active":"2023-10-06T03:23:44.930690+0000","last_peered":"2023-10-06T03:23:44.930690+0000","last_clean":"2023-10-06T03:23:44.930690+0000","last_became_active":"2023-10-06T03:23:39.931330+0000","last_became_peered":"2023-10-06T03:23:39.931330+0000","last_unstale":"2023-10-06T03:23:44.930690+0000","last_undegraded":"2023-10-06T03:23:44.930690+0000","last_fullsized":"2023-10-06T03:23:44.930690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:41.245899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.947767+0000","last_change":"2023-10-06T03:23:40.666106+0000","last_active":"2023-10-06T03:23:44.947767+0000","last_peered":"2023-10-06T03:23:44.947767+0000","last_clean":"2023-10-06T03:23:44.947767+0000","last_became_active":"2023-10-06T03:23:40.665767+0000","last_became_peered":"2023-10-06T03:23:40.665767+0000","last_unstale":"2023-10-06T03:23:44.947767+0000","last_undegraded":"2023-10-06T03:23:44.947767+0000","last_fullsized":"2023-10-06T03:23:44.947767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:35.738270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.959918+0000","last_change":"2023-10-06T03:23:44.957763+0000","last_active":"2023-10-06T03:23:44.959918+0000","last_peered":"2023-10-06T03:23:44.959918+0000","last_clean":"2023-10-06T03:23:44.959918+0000","last_became_active":"2023-10-06T03:23:44.957461+0000","last_became_peered":"2023-10-06T03:23:44.957461+0000","last_unstale":"2023-10-06T03:23:44.959918+0000","last_undegraded":"2023-10-06T03:23:44.959918+0000","last_fullsized":"2023-10-06T03:23:44.959918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:27:46.202488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.947861+0000","last_change":"2023-10-06T03:23:39.926868+0000","last_active":"2023-10-06T03:23:44.947861+0000","last_peered":"2023-10-06T03:23:44.947861+0000","last_clean":"2023-10-06T03:23:44.947861+0000","last_became_active":"2023-10-06T03:23:39.926602+0000","last_became_peered":"2023-10-06T03:23:39.926602+0000","last_unstale":"2023-10-06T03:23:44.947861+0000","last_undegraded":"2023-10-06T03:23:44.947861+0000","last_fullsized":"2023-10-06T03:23:44.947861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:34.959833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.930596+0000","last_change":"2023-10-06T03:23:40.666666+0000","last_active":"2023-10-06T03:23:44.930596+0000","last_peered":"2023-10-06T03:23:44.930596+0000","last_clean":"2023-10-06T03:23:44.930596+0000","last_became_active":"2023-10-06T03:23:40.666333+0000","last_became_peered":"2023-10-06T03:23:40.666333+0000","last_unstale":"2023-10-06T03:23:44.930596+0000","last_undegraded":"2023-10-06T03:23:44.930596+0000","last_fullsized":"2023-10-06T03:23:44.930596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:21.489097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.963680+0000","last_change":"2023-10-06T03:23:44.956770+0000","last_active":"2023-10-06T03:23:44.963680+0000","last_peered":"2023-10-06T03:23:44.963680+0000","last_clean":"2023-10-06T03:23:44.963680+0000","last_became_active":"2023-10-06T03:23:44.956335+0000","last_became_peered":"2023-10-06T03:23:44.956335+0000","last_unstale":"2023-10-06T03:23:44.963680+0000","last_undegraded":"2023-10-06T03:23:44.963680+0000","last_fullsized":"2023-10-06T03:23:44.963680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:26.358389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937057+0000","last_change":"2023-10-06T03:23:39.918613+0000","last_active":"2023-10-06T03:23:44.937057+0000","last_peered":"2023-10-06T03:23:44.937057+0000","last_clean":"2023-10-06T03:23:44.937057+0000","last_became_active":"2023-10-06T03:23:39.918224+0000","last_became_peered":"2023-10-06T03:23:39.918224+0000","last_unstale":"2023-10-06T03:23:44.937057+0000","last_undegraded":"2023-10-06T03:23:44.937057+0000","last_fullsized":"2023-10-06T03:23:44.937057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:10:12.819926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.930293+0000","last_change":"2023-10-06T03:23:40.665896+0000","last_active":"2023-10-06T03:23:44.930293+0000","last_peered":"2023-10-06T03:23:44.930293+0000","last_clean":"2023-10-06T03:23:44.930293+0000","last_became_active":"2023-10-06T03:23:40.665625+0000","last_became_peered":"2023-10-06T03:23:40.665625+0000","last_unstale":"2023-10-06T03:23:44.930293+0000","last_undegraded":"2023-10-06T03:23:44.930293+0000","last_fullsized":"2023-10-06T03:23:44.930293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:00.382000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.959626+0000","last_change":"2023-10-06T03:23:44.950950+0000","last_active":"2023-10-06T03:23:44.959626+0000","last_peered":"2023-10-06T03:23:44.959626+0000","last_clean":"2023-10-06T03:23:44.959626+0000","last_became_active":"2023-10-06T03:23:44.950383+0000","last_became_peered":"2023-10-06T03:23:44.950383+0000","last_unstale":"2023-10-06T03:23:44.959626+0000","last_undegraded":"2023-10-06T03:23:44.959626+0000","last_fullsized":"2023-10-06T03:23:44.959626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:41.590979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936358+0000","last_change":"2023-10-06T03:23:39.928175+0000","last_active":"2023-10-06T03:23:44.936358+0000","last_peered":"2023-10-06T03:23:44.936358+0000","last_clean":"2023-10-06T03:23:44.936358+0000","last_became_active":"2023-10-06T03:23:39.927870+0000","last_became_peered":"2023-10-06T03:23:39.927870+0000","last_unstale":"2023-10-06T03:23:44.936358+0000","last_undegraded":"2023-10-06T03:23:44.936358+0000","last_fullsized":"2023-10-06T03:23:44.936358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:15:53.608164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.938038+0000","last_change":"2023-10-06T03:23:40.668044+0000","last_active":"2023-10-06T03:23:44.938038+0000","last_peered":"2023-10-06T03:23:44.938038+0000","last_clean":"2023-10-06T03:23:44.938038+0000","last_became_active":"2023-10-06T03:23:40.667677+0000","last_became_peered":"2023-10-06T03:23:40.667677+0000","last_unstale":"2023-10-06T03:23:44.938038+0000","last_undegraded":"2023-10-06T03:23:44.938038+0000","last_fullsized":"2023-10-06T03:23:44.938038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:37.167322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.962261+0000","last_change":"2023-10-06T03:23:44.957225+0000","last_active":"2023-10-06T03:23:44.962261+0000","last_peered":"2023-10-06T03:23:44.962261+0000","last_clean":"2023-10-06T03:23:44.962261+0000","last_became_active":"2023-10-06T03:23:44.956809+0000","last_became_peered":"2023-10-06T03:23:44.956809+0000","last_unstale":"2023-10-06T03:23:44.962261+0000","last_undegraded":"2023-10-06T03:23:44.962261+0000","last_fullsized":"2023-10-06T03:23:44.962261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:46:57.334758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"24'7","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:23:46.431143+0000","last_change":"2023-10-06T03:23:39.926096+0000","last_active":"2023-10-06T03:23:46.431143+0000","last_peered":"2023-10-06T03:23:46.431143+0000","last_clean":"2023-10-06T03:23:46.431143+0000","last_became_active":"2023-10-06T03:23:39.925763+0000","last_became_peered":"2023-10-06T03:23:39.925763+0000","last_unstale":"2023-10-06T03:23:46.431143+0000","last_undegraded":"2023-10-06T03:23:46.431143+0000","last_fullsized":"2023-10-06T03:23:46.431143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:25:21.422926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1989,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936727+0000","last_change":"2023-10-06T03:23:40.668353+0000","last_active":"2023-10-06T03:23:44.936727+0000","last_peered":"2023-10-06T03:23:44.936727+0000","last_clean":"2023-10-06T03:23:44.936727+0000","last_became_active":"2023-10-06T03:23:40.668068+0000","last_became_peered":"2023-10-06T03:23:40.668068+0000","last_unstale":"2023-10-06T03:23:44.936727+0000","last_undegraded":"2023-10-06T03:23:44.936727+0000","last_fullsized":"2023-10-06T03:23:44.936727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:07:52.772047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.955742+0000","last_change":"2023-10-06T03:23:44.954499+0000","last_active":"2023-10-06T03:23:44.955742+0000","last_peered":"2023-10-06T03:23:44.955742+0000","last_clean":"2023-10-06T03:23:44.955742+0000","last_became_active":"2023-10-06T03:23:44.954033+0000","last_became_peered":"2023-10-06T03:23:44.954033+0000","last_unstale":"2023-10-06T03:23:44.955742+0000","last_undegraded":"2023-10-06T03:23:44.955742+0000","last_fullsized":"2023-10-06T03:23:44.955742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:39.997230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936587+0000","last_change":"2023-10-06T03:23:39.929796+0000","last_active":"2023-10-06T03:23:44.936587+0000","last_peered":"2023-10-06T03:23:44.936587+0000","last_clean":"2023-10-06T03:23:44.936587+0000","last_became_active":"2023-10-06T03:23:39.929503+0000","last_became_peered":"2023-10-06T03:23:39.929503+0000","last_unstale":"2023-10-06T03:23:44.936587+0000","last_undegraded":"2023-10-06T03:23:44.936587+0000","last_fullsized":"2023-10-06T03:23:44.936587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:44.354326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.931035+0000","last_change":"2023-10-06T03:23:40.670640+0000","last_active":"2023-10-06T03:23:44.931035+0000","last_peered":"2023-10-06T03:23:44.931035+0000","last_clean":"2023-10-06T03:23:44.931035+0000","last_became_active":"2023-10-06T03:23:40.670295+0000","last_became_peered":"2023-10-06T03:23:40.670295+0000","last_unstale":"2023-10-06T03:23:44.931035+0000","last_undegraded":"2023-10-06T03:23:44.931035+0000","last_fullsized":"2023-10-06T03:23:44.931035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:18.546154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.959802+0000","last_change":"2023-10-06T03:23:44.952973+0000","last_active":"2023-10-06T03:23:44.959802+0000","last_peered":"2023-10-06T03:23:44.959802+0000","last_clean":"2023-10-06T03:23:44.959802+0000","last_became_active":"2023-10-06T03:23:44.952573+0000","last_became_peered":"2023-10-06T03:23:44.952573+0000","last_unstale":"2023-10-06T03:23:44.959802+0000","last_undegraded":"2023-10-06T03:23:44.959802+0000","last_fullsized":"2023-10-06T03:23:44.959802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:47:31.959148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.946424+0000","last_change":"2023-10-06T03:23:39.920586+0000","last_active":"2023-10-06T03:23:44.946424+0000","last_peered":"2023-10-06T03:23:44.946424+0000","last_clean":"2023-10-06T03:23:44.946424+0000","last_became_active":"2023-10-06T03:23:39.920273+0000","last_became_peered":"2023-10-06T03:23:39.920273+0000","last_unstale":"2023-10-06T03:23:44.946424+0000","last_undegraded":"2023-10-06T03:23:44.946424+0000","last_fullsized":"2023-10-06T03:23:44.946424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:25:21.422926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.938789+0000","last_change":"2023-10-06T03:23:40.660488+0000","last_active":"2023-10-06T03:23:44.938789+0000","last_peered":"2023-10-06T03:23:44.938789+0000","last_clean":"2023-10-06T03:23:44.938789+0000","last_became_active":"2023-10-06T03:23:40.660218+0000","last_became_peered":"2023-10-06T03:23:40.660218+0000","last_unstale":"2023-10-06T03:23:44.938789+0000","last_undegraded":"2023-10-06T03:23:44.938789+0000","last_fullsized":"2023-10-06T03:23:44.938789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:29:10.177304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.959965+0000","last_change":"2023-10-06T03:23:44.957434+0000","last_active":"2023-10-06T03:23:44.959965+0000","last_peered":"2023-10-06T03:23:44.959965+0000","last_clean":"2023-10-06T03:23:44.959965+0000","last_became_active":"2023-10-06T03:23:44.957081+0000","last_became_peered":"2023-10-06T03:23:44.957081+0000","last_unstale":"2023-10-06T03:23:44.959965+0000","last_undegraded":"2023-10-06T03:23:44.959965+0000","last_fullsized":"2023-10-06T03:23:44.959965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:23.189419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936994+0000","last_change":"2023-10-06T03:23:39.929775+0000","last_active":"2023-10-06T03:23:44.936994+0000","last_peered":"2023-10-06T03:23:44.936994+0000","last_clean":"2023-10-06T03:23:44.936994+0000","last_became_active":"2023-10-06T03:23:39.929442+0000","last_became_peered":"2023-10-06T03:23:39.929442+0000","last_unstale":"2023-10-06T03:23:44.936994+0000","last_undegraded":"2023-10-06T03:23:44.936994+0000","last_fullsized":"2023-10-06T03:23:44.936994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:13:39.307938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.949506+0000","last_change":"2023-10-06T03:23:40.667709+0000","last_active":"2023-10-06T03:23:44.949506+0000","last_peered":"2023-10-06T03:23:44.949506+0000","last_clean":"2023-10-06T03:23:44.949506+0000","last_became_active":"2023-10-06T03:23:40.667393+0000","last_became_peered":"2023-10-06T03:23:40.667393+0000","last_unstale":"2023-10-06T03:23:44.949506+0000","last_undegraded":"2023-10-06T03:23:44.949506+0000","last_fullsized":"2023-10-06T03:23:44.949506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:00.382000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.964649+0000","last_change":"2023-10-06T03:23:44.961540+0000","last_active":"2023-10-06T03:23:44.964649+0000","last_peered":"2023-10-06T03:23:44.964649+0000","last_clean":"2023-10-06T03:23:44.964649+0000","last_became_active":"2023-10-06T03:23:44.961152+0000","last_became_peered":"2023-10-06T03:23:44.961152+0000","last_unstale":"2023-10-06T03:23:44.964649+0000","last_undegraded":"2023-10-06T03:23:44.964649+0000","last_fullsized":"2023-10-06T03:23:44.964649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:48.424006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.944147+0000","last_change":"2023-10-06T03:23:39.930656+0000","last_active":"2023-10-06T03:23:44.944147+0000","last_peered":"2023-10-06T03:23:44.944147+0000","last_clean":"2023-10-06T03:23:44.944147+0000","last_became_active":"2023-10-06T03:23:39.930340+0000","last_became_peered":"2023-10-06T03:23:39.930340+0000","last_unstale":"2023-10-06T03:23:44.944147+0000","last_undegraded":"2023-10-06T03:23:44.944147+0000","last_fullsized":"2023-10-06T03:23:44.944147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:10:12.819926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.931492+0000","last_change":"2023-10-06T03:23:40.666356+0000","last_active":"2023-10-06T03:23:44.931492+0000","last_peered":"2023-10-06T03:23:44.931492+0000","last_clean":"2023-10-06T03:23:44.931492+0000","last_became_active":"2023-10-06T03:23:40.666092+0000","last_became_peered":"2023-10-06T03:23:40.666092+0000","last_unstale":"2023-10-06T03:23:44.931492+0000","last_undegraded":"2023-10-06T03:23:44.931492+0000","last_fullsized":"2023-10-06T03:23:44.931492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:15.293618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.969201+0000","last_change":"2023-10-06T03:23:44.965794+0000","last_active":"2023-10-06T03:23:44.969201+0000","last_peered":"2023-10-06T03:23:44.969201+0000","last_clean":"2023-10-06T03:23:44.969201+0000","last_became_active":"2023-10-06T03:23:44.959858+0000","last_became_peered":"2023-10-06T03:23:44.959858+0000","last_unstale":"2023-10-06T03:23:44.969201+0000","last_undegraded":"2023-10-06T03:23:44.969201+0000","last_fullsized":"2023-10-06T03:23:44.969201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:53.182371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.944656+0000","last_change":"2023-10-06T03:23:39.927449+0000","last_active":"2023-10-06T03:23:44.944656+0000","last_peered":"2023-10-06T03:23:44.944656+0000","last_clean":"2023-10-06T03:23:44.944656+0000","last_became_active":"2023-10-06T03:23:39.927150+0000","last_became_peered":"2023-10-06T03:23:39.927150+0000","last_unstale":"2023-10-06T03:23:44.944656+0000","last_undegraded":"2023-10-06T03:23:44.944656+0000","last_fullsized":"2023-10-06T03:23:44.944656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:34.729493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.934229+0000","last_change":"2023-10-06T03:23:40.660603+0000","last_active":"2023-10-06T03:23:44.934229+0000","last_peered":"2023-10-06T03:23:44.934229+0000","last_clean":"2023-10-06T03:23:44.934229+0000","last_became_active":"2023-10-06T03:23:40.660310+0000","last_became_peered":"2023-10-06T03:23:40.660310+0000","last_unstale":"2023-10-06T03:23:44.934229+0000","last_undegraded":"2023-10-06T03:23:44.934229+0000","last_fullsized":"2023-10-06T03:23:44.934229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:21.489097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.965034+0000","last_change":"2023-10-06T03:23:44.958953+0000","last_active":"2023-10-06T03:23:44.965034+0000","last_peered":"2023-10-06T03:23:44.965034+0000","last_clean":"2023-10-06T03:23:44.965034+0000","last_became_active":"2023-10-06T03:23:44.958414+0000","last_became_peered":"2023-10-06T03:23:44.958414+0000","last_unstale":"2023-10-06T03:23:44.965034+0000","last_undegraded":"2023-10-06T03:23:44.965034+0000","last_fullsized":"2023-10-06T03:23:44.965034+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:22.575718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936667+0000","last_change":"2023-10-06T03:23:39.924645+0000","last_active":"2023-10-06T03:23:44.936667+0000","last_peered":"2023-10-06T03:23:44.936667+0000","last_clean":"2023-10-06T03:23:44.936667+0000","last_became_active":"2023-10-06T03:23:39.924375+0000","last_became_peered":"2023-10-06T03:23:39.924375+0000","last_unstale":"2023-10-06T03:23:44.936667+0000","last_undegraded":"2023-10-06T03:23:44.936667+0000","last_fullsized":"2023-10-06T03:23:44.936667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:21.428737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936388+0000","last_change":"2023-10-06T03:23:40.671688+0000","last_active":"2023-10-06T03:23:44.936388+0000","last_peered":"2023-10-06T03:23:44.936388+0000","last_clean":"2023-10-06T03:23:44.936388+0000","last_became_active":"2023-10-06T03:23:40.671408+0000","last_became_peered":"2023-10-06T03:23:40.671408+0000","last_unstale":"2023-10-06T03:23:44.936388+0000","last_undegraded":"2023-10-06T03:23:44.936388+0000","last_fullsized":"2023-10-06T03:23:44.936388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:43:56.448825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.959633+0000","last_change":"2023-10-06T03:23:44.955142+0000","last_active":"2023-10-06T03:23:44.959633+0000","last_peered":"2023-10-06T03:23:44.959633+0000","last_clean":"2023-10-06T03:23:44.959633+0000","last_became_active":"2023-10-06T03:23:44.954726+0000","last_became_peered":"2023-10-06T03:23:44.954726+0000","last_unstale":"2023-10-06T03:23:44.959633+0000","last_undegraded":"2023-10-06T03:23:44.959633+0000","last_fullsized":"2023-10-06T03:23:44.959633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:55:01.878766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936253+0000","last_change":"2023-10-06T03:23:39.917247+0000","last_active":"2023-10-06T03:23:44.936253+0000","last_peered":"2023-10-06T03:23:44.936253+0000","last_clean":"2023-10-06T03:23:44.936253+0000","last_became_active":"2023-10-06T03:23:39.916954+0000","last_became_peered":"2023-10-06T03:23:39.916954+0000","last_unstale":"2023-10-06T03:23:44.936253+0000","last_undegraded":"2023-10-06T03:23:44.936253+0000","last_fullsized":"2023-10-06T03:23:44.936253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:05.109047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.944090+0000","last_change":"2023-10-06T03:23:40.671497+0000","last_active":"2023-10-06T03:23:44.944090+0000","last_peered":"2023-10-06T03:23:44.944090+0000","last_clean":"2023-10-06T03:23:44.944090+0000","last_became_active":"2023-10-06T03:23:40.671220+0000","last_became_peered":"2023-10-06T03:23:40.671220+0000","last_unstale":"2023-10-06T03:23:44.944090+0000","last_undegraded":"2023-10-06T03:23:44.944090+0000","last_fullsized":"2023-10-06T03:23:44.944090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:13:40.316715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.953035+0000","last_change":"2023-10-06T03:23:44.950490+0000","last_active":"2023-10-06T03:23:44.953035+0000","last_peered":"2023-10-06T03:23:44.953035+0000","last_clean":"2023-10-06T03:23:44.953035+0000","last_became_active":"2023-10-06T03:23:44.949773+0000","last_became_peered":"2023-10-06T03:23:44.949773+0000","last_unstale":"2023-10-06T03:23:44.953035+0000","last_undegraded":"2023-10-06T03:23:44.953035+0000","last_fullsized":"2023-10-06T03:23:44.953035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:27:46.202488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.934555+0000","last_change":"2023-10-06T03:23:39.927421+0000","last_active":"2023-10-06T03:23:44.934555+0000","last_peered":"2023-10-06T03:23:44.934555+0000","last_clean":"2023-10-06T03:23:44.934555+0000","last_became_active":"2023-10-06T03:23:39.927038+0000","last_became_peered":"2023-10-06T03:23:39.927038+0000","last_unstale":"2023-10-06T03:23:44.934555+0000","last_undegraded":"2023-10-06T03:23:44.934555+0000","last_fullsized":"2023-10-06T03:23:44.934555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:41.245899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.947302+0000","last_change":"2023-10-06T03:23:40.668861+0000","last_active":"2023-10-06T03:23:44.947302+0000","last_peered":"2023-10-06T03:23:44.947302+0000","last_clean":"2023-10-06T03:23:44.947302+0000","last_became_active":"2023-10-06T03:23:40.668596+0000","last_became_peered":"2023-10-06T03:23:40.668596+0000","last_unstale":"2023-10-06T03:23:44.947302+0000","last_undegraded":"2023-10-06T03:23:44.947302+0000","last_fullsized":"2023-10-06T03:23:44.947302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:51:39.105798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.959600+0000","last_change":"2023-10-06T03:23:44.956193+0000","last_active":"2023-10-06T03:23:44.959600+0000","last_peered":"2023-10-06T03:23:44.959600+0000","last_clean":"2023-10-06T03:23:44.959600+0000","last_became_active":"2023-10-06T03:23:44.955814+0000","last_became_peered":"2023-10-06T03:23:44.955814+0000","last_unstale":"2023-10-06T03:23:44.959600+0000","last_undegraded":"2023-10-06T03:23:44.959600+0000","last_fullsized":"2023-10-06T03:23:44.959600+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:22.863565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.930753+0000","last_change":"2023-10-06T03:23:39.927251+0000","last_active":"2023-10-06T03:23:44.930753+0000","last_peered":"2023-10-06T03:23:44.930753+0000","last_clean":"2023-10-06T03:23:44.930753+0000","last_became_active":"2023-10-06T03:23:39.926999+0000","last_became_peered":"2023-10-06T03:23:39.926999+0000","last_unstale":"2023-10-06T03:23:44.930753+0000","last_undegraded":"2023-10-06T03:23:44.930753+0000","last_fullsized":"2023-10-06T03:23:44.930753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:10:12.819926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937381+0000","last_change":"2023-10-06T03:23:40.666463+0000","last_active":"2023-10-06T03:23:44.937381+0000","last_peered":"2023-10-06T03:23:44.937381+0000","last_clean":"2023-10-06T03:23:44.937381+0000","last_became_active":"2023-10-06T03:23:40.666227+0000","last_became_peered":"2023-10-06T03:23:40.666227+0000","last_unstale":"2023-10-06T03:23:44.937381+0000","last_undegraded":"2023-10-06T03:23:44.937381+0000","last_fullsized":"2023-10-06T03:23:44.937381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:51:39.105798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.962121+0000","last_change":"2023-10-06T03:23:44.955034+0000","last_active":"2023-10-06T03:23:44.962121+0000","last_peered":"2023-10-06T03:23:44.962121+0000","last_clean":"2023-10-06T03:23:44.962121+0000","last_became_active":"2023-10-06T03:23:44.954644+0000","last_became_peered":"2023-10-06T03:23:44.954644+0000","last_unstale":"2023-10-06T03:23:44.962121+0000","last_undegraded":"2023-10-06T03:23:44.962121+0000","last_fullsized":"2023-10-06T03:23:44.962121+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:48:22.544086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.944177+0000","last_change":"2023-10-06T03:23:39.924561+0000","last_active":"2023-10-06T03:23:44.944177+0000","last_peered":"2023-10-06T03:23:44.944177+0000","last_clean":"2023-10-06T03:23:44.944177+0000","last_became_active":"2023-10-06T03:23:39.924258+0000","last_became_peered":"2023-10-06T03:23:39.924258+0000","last_unstale":"2023-10-06T03:23:44.944177+0000","last_undegraded":"2023-10-06T03:23:44.944177+0000","last_fullsized":"2023-10-06T03:23:44.944177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:25:21.422926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937352+0000","last_change":"2023-10-06T03:23:40.664384+0000","last_active":"2023-10-06T03:23:44.937352+0000","last_peered":"2023-10-06T03:23:44.937352+0000","last_clean":"2023-10-06T03:23:44.937352+0000","last_became_active":"2023-10-06T03:23:40.664072+0000","last_became_peered":"2023-10-06T03:23:40.664072+0000","last_unstale":"2023-10-06T03:23:44.937352+0000","last_undegraded":"2023-10-06T03:23:44.937352+0000","last_fullsized":"2023-10-06T03:23:44.937352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:00.382000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.962692+0000","last_change":"2023-10-06T03:23:44.956737+0000","last_active":"2023-10-06T03:23:44.962692+0000","last_peered":"2023-10-06T03:23:44.962692+0000","last_clean":"2023-10-06T03:23:44.962692+0000","last_became_active":"2023-10-06T03:23:44.956371+0000","last_became_peered":"2023-10-06T03:23:44.956371+0000","last_unstale":"2023-10-06T03:23:44.962692+0000","last_undegraded":"2023-10-06T03:23:44.962692+0000","last_fullsized":"2023-10-06T03:23:44.962692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:11.304312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936209+0000","last_change":"2023-10-06T03:23:39.918323+0000","last_active":"2023-10-06T03:23:44.936209+0000","last_peered":"2023-10-06T03:23:44.936209+0000","last_clean":"2023-10-06T03:23:44.936209+0000","last_became_active":"2023-10-06T03:23:39.916159+0000","last_became_peered":"2023-10-06T03:23:39.916159+0000","last_unstale":"2023-10-06T03:23:44.936209+0000","last_undegraded":"2023-10-06T03:23:44.936209+0000","last_fullsized":"2023-10-06T03:23:44.936209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:34.959833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937989+0000","last_change":"2023-10-06T03:23:40.663057+0000","last_active":"2023-10-06T03:23:44.937989+0000","last_peered":"2023-10-06T03:23:44.937989+0000","last_clean":"2023-10-06T03:23:44.937989+0000","last_became_active":"2023-10-06T03:23:40.662793+0000","last_became_peered":"2023-10-06T03:23:40.662793+0000","last_unstale":"2023-10-06T03:23:44.937989+0000","last_undegraded":"2023-10-06T03:23:44.937989+0000","last_fullsized":"2023-10-06T03:23:44.937989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:29:24.713990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.954896+0000","last_change":"2023-10-06T03:23:44.951565+0000","last_active":"2023-10-06T03:23:44.954896+0000","last_peered":"2023-10-06T03:23:44.954896+0000","last_clean":"2023-10-06T03:23:44.954896+0000","last_became_active":"2023-10-06T03:23:44.951124+0000","last_became_peered":"2023-10-06T03:23:44.951124+0000","last_unstale":"2023-10-06T03:23:44.954896+0000","last_undegraded":"2023-10-06T03:23:44.954896+0000","last_fullsized":"2023-10-06T03:23:44.954896+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:40:21.613547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.930481+0000","last_change":"2023-10-06T03:23:39.927594+0000","last_active":"2023-10-06T03:23:44.930481+0000","last_peered":"2023-10-06T03:23:44.930481+0000","last_clean":"2023-10-06T03:23:44.930481+0000","last_became_active":"2023-10-06T03:23:39.926962+0000","last_became_peered":"2023-10-06T03:23:39.926962+0000","last_unstale":"2023-10-06T03:23:44.930481+0000","last_undegraded":"2023-10-06T03:23:44.930481+0000","last_fullsized":"2023-10-06T03:23:44.930481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:46:24.911513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.939034+0000","last_change":"2023-10-06T03:23:40.658994+0000","last_active":"2023-10-06T03:23:44.939034+0000","last_peered":"2023-10-06T03:23:44.939034+0000","last_clean":"2023-10-06T03:23:44.939034+0000","last_became_active":"2023-10-06T03:23:40.658600+0000","last_became_peered":"2023-10-06T03:23:40.658600+0000","last_unstale":"2023-10-06T03:23:44.939034+0000","last_undegraded":"2023-10-06T03:23:44.939034+0000","last_fullsized":"2023-10-06T03:23:44.939034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:21.489097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.962887+0000","last_change":"2023-10-06T03:23:44.961313+0000","last_active":"2023-10-06T03:23:44.962887+0000","last_peered":"2023-10-06T03:23:44.962887+0000","last_clean":"2023-10-06T03:23:44.962887+0000","last_became_active":"2023-10-06T03:23:44.960885+0000","last_became_peered":"2023-10-06T03:23:44.960885+0000","last_unstale":"2023-10-06T03:23:44.962887+0000","last_undegraded":"2023-10-06T03:23:44.962887+0000","last_fullsized":"2023-10-06T03:23:44.962887+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:26:37.645345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.931270+0000","last_change":"2023-10-06T03:23:39.926444+0000","last_active":"2023-10-06T03:23:44.931270+0000","last_peered":"2023-10-06T03:23:44.931270+0000","last_clean":"2023-10-06T03:23:44.931270+0000","last_became_active":"2023-10-06T03:23:39.925823+0000","last_became_peered":"2023-10-06T03:23:39.925823+0000","last_unstale":"2023-10-06T03:23:44.931270+0000","last_undegraded":"2023-10-06T03:23:44.931270+0000","last_fullsized":"2023-10-06T03:23:44.931270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:34.959833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937506+0000","last_change":"2023-10-06T03:23:35.397971+0000","last_active":"2023-10-06T03:23:44.937506+0000","last_peered":"2023-10-06T03:23:44.937506+0000","last_clean":"2023-10-06T03:23:44.937506+0000","last_became_active":"2023-10-06T03:23:35.397649+0000","last_became_peered":"2023-10-06T03:23:35.397649+0000","last_unstale":"2023-10-06T03:23:44.937506+0000","last_undegraded":"2023-10-06T03:23:44.937506+0000","last_fullsized":"2023-10-06T03:23:44.937506+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:11.974461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.930368+0000","last_change":"2023-10-06T03:23:40.669097+0000","last_active":"2023-10-06T03:23:44.930368+0000","last_peered":"2023-10-06T03:23:44.930368+0000","last_clean":"2023-10-06T03:23:44.930368+0000","last_became_active":"2023-10-06T03:23:40.668871+0000","last_became_peered":"2023-10-06T03:23:40.668871+0000","last_unstale":"2023-10-06T03:23:44.930368+0000","last_undegraded":"2023-10-06T03:23:44.930368+0000","last_fullsized":"2023-10-06T03:23:44.930368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:49.615169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.959612+0000","last_change":"2023-10-06T03:23:44.951296+0000","last_active":"2023-10-06T03:23:44.959612+0000","last_peered":"2023-10-06T03:23:44.959612+0000","last_clean":"2023-10-06T03:23:44.959612+0000","last_became_active":"2023-10-06T03:23:44.950936+0000","last_became_peered":"2023-10-06T03:23:44.950936+0000","last_unstale":"2023-10-06T03:23:44.959612+0000","last_undegraded":"2023-10-06T03:23:44.959612+0000","last_fullsized":"2023-10-06T03:23:44.959612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:45:45.700670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.930926+0000","last_change":"2023-10-06T03:23:34.866196+0000","last_active":"2023-10-06T03:23:44.930926+0000","last_peered":"2023-10-06T03:23:44.930926+0000","last_clean":"2023-10-06T03:23:44.930926+0000","last_became_active":"2023-10-06T03:23:34.865914+0000","last_became_peered":"2023-10-06T03:23:34.865914+0000","last_unstale":"2023-10-06T03:23:44.930926+0000","last_undegraded":"2023-10-06T03:23:44.930926+0000","last_fullsized":"2023-10-06T03:23:44.930926+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:11.974461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:45.052691+0000","last_change":"2023-10-06T03:23:39.927514+0000","last_active":"2023-10-06T03:23:45.052691+0000","last_peered":"2023-10-06T03:23:45.052691+0000","last_clean":"2023-10-06T03:23:45.052691+0000","last_became_active":"2023-10-06T03:23:39.927274+0000","last_became_peered":"2023-10-06T03:23:39.927274+0000","last_unstale":"2023-10-06T03:23:45.052691+0000","last_undegraded":"2023-10-06T03:23:45.052691+0000","last_fullsized":"2023-10-06T03:23:45.052691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:41.245899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936299+0000","last_change":"2023-10-06T03:23:40.662222+0000","last_active":"2023-10-06T03:23:44.936299+0000","last_peered":"2023-10-06T03:23:44.936299+0000","last_clean":"2023-10-06T03:23:44.936299+0000","last_became_active":"2023-10-06T03:23:40.661970+0000","last_became_peered":"2023-10-06T03:23:40.661970+0000","last_unstale":"2023-10-06T03:23:44.936299+0000","last_undegraded":"2023-10-06T03:23:44.936299+0000","last_fullsized":"2023-10-06T03:23:44.936299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:54:33.855202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.955860+0000","last_change":"2023-10-06T03:23:44.954326+0000","last_active":"2023-10-06T03:23:44.955860+0000","last_peered":"2023-10-06T03:23:44.955860+0000","last_clean":"2023-10-06T03:23:44.955860+0000","last_became_active":"2023-10-06T03:23:44.953952+0000","last_became_peered":"2023-10-06T03:23:44.953952+0000","last_unstale":"2023-10-06T03:23:44.955860+0000","last_undegraded":"2023-10-06T03:23:44.955860+0000","last_fullsized":"2023-10-06T03:23:44.955860+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:38:22.970164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.934805+0000","last_change":"2023-10-06T03:23:34.874380+0000","last_active":"2023-10-06T03:23:44.934805+0000","last_peered":"2023-10-06T03:23:44.934805+0000","last_clean":"2023-10-06T03:23:44.934805+0000","last_became_active":"2023-10-06T03:23:34.873972+0000","last_became_peered":"2023-10-06T03:23:34.873972+0000","last_unstale":"2023-10-06T03:23:44.934805+0000","last_undegraded":"2023-10-06T03:23:44.934805+0000","last_fullsized":"2023-10-06T03:23:44.934805+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:30.204999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":167,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936436+0000","last_change":"2023-10-06T03:23:34.864626+0000","last_active":"2023-10-06T03:23:44.936436+0000","last_peered":"2023-10-06T03:23:44.936436+0000","last_clean":"2023-10-06T03:23:44.936436+0000","last_became_active":"2023-10-06T03:23:34.863539+0000","last_became_peered":"2023-10-06T03:23:34.863539+0000","last_unstale":"2023-10-06T03:23:44.936436+0000","last_undegraded":"2023-10-06T03:23:44.936436+0000","last_fullsized":"2023-10-06T03:23:44.936436+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:11.750836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.944554+0000","last_change":"2023-10-06T03:23:39.930157+0000","last_active":"2023-10-06T03:23:44.944554+0000","last_peered":"2023-10-06T03:23:44.944554+0000","last_clean":"2023-10-06T03:23:44.944554+0000","last_became_active":"2023-10-06T03:23:39.929906+0000","last_became_peered":"2023-10-06T03:23:39.929906+0000","last_unstale":"2023-10-06T03:23:44.944554+0000","last_undegraded":"2023-10-06T03:23:44.944554+0000","last_fullsized":"2023-10-06T03:23:44.944554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:52.557228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.949418+0000","last_change":"2023-10-06T03:23:40.668183+0000","last_active":"2023-10-06T03:23:44.949418+0000","last_peered":"2023-10-06T03:23:44.949418+0000","last_clean":"2023-10-06T03:23:44.949418+0000","last_became_active":"2023-10-06T03:23:40.667934+0000","last_became_peered":"2023-10-06T03:23:40.667934+0000","last_unstale":"2023-10-06T03:23:44.949418+0000","last_undegraded":"2023-10-06T03:23:44.949418+0000","last_fullsized":"2023-10-06T03:23:44.949418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:35.462631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.969737+0000","last_change":"2023-10-06T03:23:44.961492+0000","last_active":"2023-10-06T03:23:44.969737+0000","last_peered":"2023-10-06T03:23:44.969737+0000","last_clean":"2023-10-06T03:23:44.969737+0000","last_became_active":"2023-10-06T03:23:44.961050+0000","last_became_peered":"2023-10-06T03:23:44.961050+0000","last_unstale":"2023-10-06T03:23:44.969737+0000","last_undegraded":"2023-10-06T03:23:44.969737+0000","last_fullsized":"2023-10-06T03:23:44.969737+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:39.492194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.938294+0000","last_change":"2023-10-06T03:23:34.864399+0000","last_active":"2023-10-06T03:23:44.938294+0000","last_peered":"2023-10-06T03:23:44.938294+0000","last_clean":"2023-10-06T03:23:44.938294+0000","last_became_active":"2023-10-06T03:23:34.863991+0000","last_became_peered":"2023-10-06T03:23:34.863991+0000","last_unstale":"2023-10-06T03:23:44.938294+0000","last_undegraded":"2023-10-06T03:23:44.938294+0000","last_fullsized":"2023-10-06T03:23:44.938294+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:56:32.358597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.935729+0000","last_change":"2023-10-06T03:23:39.925094+0000","last_active":"2023-10-06T03:23:44.935729+0000","last_peered":"2023-10-06T03:23:44.935729+0000","last_clean":"2023-10-06T03:23:44.935729+0000","last_became_active":"2023-10-06T03:23:39.923918+0000","last_became_peered":"2023-10-06T03:23:39.923918+0000","last_unstale":"2023-10-06T03:23:44.935729+0000","last_undegraded":"2023-10-06T03:23:44.935729+0000","last_fullsized":"2023-10-06T03:23:44.935729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:25:21.422926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.938945+0000","last_change":"2023-10-06T03:23:40.663620+0000","last_active":"2023-10-06T03:23:44.938945+0000","last_peered":"2023-10-06T03:23:44.938945+0000","last_clean":"2023-10-06T03:23:44.938945+0000","last_became_active":"2023-10-06T03:23:40.663339+0000","last_became_peered":"2023-10-06T03:23:40.663339+0000","last_unstale":"2023-10-06T03:23:44.938945+0000","last_undegraded":"2023-10-06T03:23:44.938945+0000","last_fullsized":"2023-10-06T03:23:44.938945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:51:39.105798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.970567+0000","last_change":"2023-10-06T03:23:44.969165+0000","last_active":"2023-10-06T03:23:44.970567+0000","last_peered":"2023-10-06T03:23:44.970567+0000","last_clean":"2023-10-06T03:23:44.970567+0000","last_became_active":"2023-10-06T03:23:44.966357+0000","last_became_peered":"2023-10-06T03:23:44.966357+0000","last_unstale":"2023-10-06T03:23:44.970567+0000","last_undegraded":"2023-10-06T03:23:44.970567+0000","last_fullsized":"2023-10-06T03:23:44.970567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:56:31.830855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936245+0000","last_change":"2023-10-06T03:23:34.865125+0000","last_active":"2023-10-06T03:23:44.936245+0000","last_peered":"2023-10-06T03:23:44.936245+0000","last_clean":"2023-10-06T03:23:44.936245+0000","last_became_active":"2023-10-06T03:23:34.864752+0000","last_became_peered":"2023-10-06T03:23:34.864752+0000","last_unstale":"2023-10-06T03:23:44.936245+0000","last_undegraded":"2023-10-06T03:23:44.936245+0000","last_fullsized":"2023-10-06T03:23:44.936245+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:00.374963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.930358+0000","last_change":"2023-10-06T03:23:39.922954+0000","last_active":"2023-10-06T03:23:44.930358+0000","last_peered":"2023-10-06T03:23:44.930358+0000","last_clean":"2023-10-06T03:23:44.930358+0000","last_became_active":"2023-10-06T03:23:39.922405+0000","last_became_peered":"2023-10-06T03:23:39.922405+0000","last_unstale":"2023-10-06T03:23:44.930358+0000","last_undegraded":"2023-10-06T03:23:44.930358+0000","last_fullsized":"2023-10-06T03:23:44.930358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:52.557228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.944559+0000","last_change":"2023-10-06T03:23:40.672406+0000","last_active":"2023-10-06T03:23:44.944559+0000","last_peered":"2023-10-06T03:23:44.944559+0000","last_clean":"2023-10-06T03:23:44.944559+0000","last_became_active":"2023-10-06T03:23:40.672113+0000","last_became_peered":"2023-10-06T03:23:40.672113+0000","last_unstale":"2023-10-06T03:23:44.944559+0000","last_undegraded":"2023-10-06T03:23:44.944559+0000","last_fullsized":"2023-10-06T03:23:44.944559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:58.012559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.966608+0000","last_change":"2023-10-06T03:23:44.957635+0000","last_active":"2023-10-06T03:23:44.966608+0000","last_peered":"2023-10-06T03:23:44.966608+0000","last_clean":"2023-10-06T03:23:44.966608+0000","last_became_active":"2023-10-06T03:23:44.957238+0000","last_became_peered":"2023-10-06T03:23:44.957238+0000","last_unstale":"2023-10-06T03:23:44.966608+0000","last_undegraded":"2023-10-06T03:23:44.966608+0000","last_fullsized":"2023-10-06T03:23:44.966608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:53.182371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.934131+0000","last_change":"2023-10-06T03:23:34.864329+0000","last_active":"2023-10-06T03:23:44.934131+0000","last_peered":"2023-10-06T03:23:44.934131+0000","last_clean":"2023-10-06T03:23:44.934131+0000","last_became_active":"2023-10-06T03:23:34.863953+0000","last_became_peered":"2023-10-06T03:23:34.863953+0000","last_unstale":"2023-10-06T03:23:44.934131+0000","last_undegraded":"2023-10-06T03:23:44.934131+0000","last_fullsized":"2023-10-06T03:23:44.934131+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:30.204999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936822+0000","last_change":"2023-10-06T03:23:39.930279+0000","last_active":"2023-10-06T03:23:44.936822+0000","last_peered":"2023-10-06T03:23:44.936822+0000","last_clean":"2023-10-06T03:23:44.936822+0000","last_became_active":"2023-10-06T03:23:39.929992+0000","last_became_peered":"2023-10-06T03:23:39.929992+0000","last_unstale":"2023-10-06T03:23:44.936822+0000","last_undegraded":"2023-10-06T03:23:44.936822+0000","last_fullsized":"2023-10-06T03:23:44.936822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:10:12.819926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936204+0000","last_change":"2023-10-06T03:23:40.662851+0000","last_active":"2023-10-06T03:23:44.936204+0000","last_peered":"2023-10-06T03:23:44.936204+0000","last_clean":"2023-10-06T03:23:44.936204+0000","last_became_active":"2023-10-06T03:23:40.662555+0000","last_became_peered":"2023-10-06T03:23:40.662555+0000","last_unstale":"2023-10-06T03:23:44.936204+0000","last_undegraded":"2023-10-06T03:23:44.936204+0000","last_fullsized":"2023-10-06T03:23:44.936204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:29:10.177304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.958925+0000","last_change":"2023-10-06T03:23:44.955457+0000","last_active":"2023-10-06T03:23:44.958925+0000","last_peered":"2023-10-06T03:23:44.958925+0000","last_clean":"2023-10-06T03:23:44.958925+0000","last_became_active":"2023-10-06T03:23:44.954842+0000","last_became_peered":"2023-10-06T03:23:44.954842+0000","last_unstale":"2023-10-06T03:23:44.958925+0000","last_undegraded":"2023-10-06T03:23:44.958925+0000","last_fullsized":"2023-10-06T03:23:44.958925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:00.478388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.944665+0000","last_change":"2023-10-06T03:23:34.873939+0000","last_active":"2023-10-06T03:23:44.944665+0000","last_peered":"2023-10-06T03:23:44.944665+0000","last_clean":"2023-10-06T03:23:44.944665+0000","last_became_active":"2023-10-06T03:23:34.873623+0000","last_became_peered":"2023-10-06T03:23:34.873623+0000","last_unstale":"2023-10-06T03:23:44.944665+0000","last_undegraded":"2023-10-06T03:23:44.944665+0000","last_fullsized":"2023-10-06T03:23:44.944665+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:30.204999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936368+0000","last_change":"2023-10-06T03:23:39.923260+0000","last_active":"2023-10-06T03:23:44.936368+0000","last_peered":"2023-10-06T03:23:44.936368+0000","last_clean":"2023-10-06T03:23:44.936368+0000","last_became_active":"2023-10-06T03:23:39.922927+0000","last_became_peered":"2023-10-06T03:23:39.922927+0000","last_unstale":"2023-10-06T03:23:44.936368+0000","last_undegraded":"2023-10-06T03:23:44.936368+0000","last_fullsized":"2023-10-06T03:23:44.936368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:34.959833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.947472+0000","last_change":"2023-10-06T03:23:40.669315+0000","last_active":"2023-10-06T03:23:44.947472+0000","last_peered":"2023-10-06T03:23:44.947472+0000","last_clean":"2023-10-06T03:23:44.947472+0000","last_became_active":"2023-10-06T03:23:40.669061+0000","last_became_peered":"2023-10-06T03:23:40.669061+0000","last_unstale":"2023-10-06T03:23:44.947472+0000","last_undegraded":"2023-10-06T03:23:44.947472+0000","last_fullsized":"2023-10-06T03:23:44.947472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:56.483789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.966208+0000","last_change":"2023-10-06T03:23:44.962703+0000","last_active":"2023-10-06T03:23:44.966208+0000","last_peered":"2023-10-06T03:23:44.966208+0000","last_clean":"2023-10-06T03:23:44.966208+0000","last_became_active":"2023-10-06T03:23:44.957582+0000","last_became_peered":"2023-10-06T03:23:44.957582+0000","last_unstale":"2023-10-06T03:23:44.966208+0000","last_undegraded":"2023-10-06T03:23:44.966208+0000","last_fullsized":"2023-10-06T03:23:44.966208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:56:31.830855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.947663+0000","last_change":"2023-10-06T03:23:34.872453+0000","last_active":"2023-10-06T03:23:44.947663+0000","last_peered":"2023-10-06T03:23:44.947663+0000","last_clean":"2023-10-06T03:23:44.947663+0000","last_became_active":"2023-10-06T03:23:34.872139+0000","last_became_peered":"2023-10-06T03:23:34.872139+0000","last_unstale":"2023-10-06T03:23:44.947663+0000","last_undegraded":"2023-10-06T03:23:44.947663+0000","last_fullsized":"2023-10-06T03:23:44.947663+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:25:46.214290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.938700+0000","last_change":"2023-10-06T03:23:39.927321+0000","last_active":"2023-10-06T03:23:44.938700+0000","last_peered":"2023-10-06T03:23:44.938700+0000","last_clean":"2023-10-06T03:23:44.938700+0000","last_became_active":"2023-10-06T03:23:39.927057+0000","last_became_peered":"2023-10-06T03:23:39.927057+0000","last_unstale":"2023-10-06T03:23:44.938700+0000","last_undegraded":"2023-10-06T03:23:44.938700+0000","last_fullsized":"2023-10-06T03:23:44.938700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:52.557228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937835+0000","last_change":"2023-10-06T03:23:40.662143+0000","last_active":"2023-10-06T03:23:44.937835+0000","last_peered":"2023-10-06T03:23:44.937835+0000","last_clean":"2023-10-06T03:23:44.937835+0000","last_became_active":"2023-10-06T03:23:40.661885+0000","last_became_peered":"2023-10-06T03:23:40.661885+0000","last_unstale":"2023-10-06T03:23:44.937835+0000","last_undegraded":"2023-10-06T03:23:44.937835+0000","last_fullsized":"2023-10-06T03:23:44.937835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:04:49.664462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.954580+0000","last_change":"2023-10-06T03:23:44.952490+0000","last_active":"2023-10-06T03:23:44.954580+0000","last_peered":"2023-10-06T03:23:44.954580+0000","last_clean":"2023-10-06T03:23:44.954580+0000","last_became_active":"2023-10-06T03:23:44.951755+0000","last_became_peered":"2023-10-06T03:23:44.951755+0000","last_unstale":"2023-10-06T03:23:44.954580+0000","last_undegraded":"2023-10-06T03:23:44.954580+0000","last_fullsized":"2023-10-06T03:23:44.954580+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:37:11.632106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.947387+0000","last_change":"2023-10-06T03:23:39.927188+0000","last_active":"2023-10-06T03:23:44.947387+0000","last_peered":"2023-10-06T03:23:44.947387+0000","last_clean":"2023-10-06T03:23:44.947387+0000","last_became_active":"2023-10-06T03:23:39.926830+0000","last_became_peered":"2023-10-06T03:23:39.926830+0000","last_unstale":"2023-10-06T03:23:44.947387+0000","last_undegraded":"2023-10-06T03:23:44.947387+0000","last_fullsized":"2023-10-06T03:23:44.947387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:36.047828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.934779+0000","last_change":"2023-10-06T03:23:40.671601+0000","last_active":"2023-10-06T03:23:44.934779+0000","last_peered":"2023-10-06T03:23:44.934779+0000","last_clean":"2023-10-06T03:23:44.934779+0000","last_became_active":"2023-10-06T03:23:40.671312+0000","last_became_peered":"2023-10-06T03:23:40.671312+0000","last_unstale":"2023-10-06T03:23:44.934779+0000","last_undegraded":"2023-10-06T03:23:44.934779+0000","last_fullsized":"2023-10-06T03:23:44.934779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:42.254676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.966019+0000","last_change":"2023-10-06T03:23:44.964087+0000","last_active":"2023-10-06T03:23:44.966019+0000","last_peered":"2023-10-06T03:23:44.966019+0000","last_clean":"2023-10-06T03:23:44.966019+0000","last_became_active":"2023-10-06T03:23:44.963323+0000","last_became_peered":"2023-10-06T03:23:44.963323+0000","last_unstale":"2023-10-06T03:23:44.966019+0000","last_undegraded":"2023-10-06T03:23:44.966019+0000","last_fullsized":"2023-10-06T03:23:44.966019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:37:11.632106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.934389+0000","last_change":"2023-10-06T03:23:39.921245+0000","last_active":"2023-10-06T03:23:44.934389+0000","last_peered":"2023-10-06T03:23:44.934389+0000","last_clean":"2023-10-06T03:23:44.934389+0000","last_became_active":"2023-10-06T03:23:39.920740+0000","last_became_peered":"2023-10-06T03:23:39.920740+0000","last_unstale":"2023-10-06T03:23:44.934389+0000","last_undegraded":"2023-10-06T03:23:44.934389+0000","last_fullsized":"2023-10-06T03:23:44.934389+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:46:24.911513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936975+0000","last_change":"2023-10-06T03:23:40.665175+0000","last_active":"2023-10-06T03:23:44.936975+0000","last_peered":"2023-10-06T03:23:44.936975+0000","last_clean":"2023-10-06T03:23:44.936975+0000","last_became_active":"2023-10-06T03:23:40.664926+0000","last_became_peered":"2023-10-06T03:23:40.664926+0000","last_unstale":"2023-10-06T03:23:44.936975+0000","last_undegraded":"2023-10-06T03:23:44.936975+0000","last_fullsized":"2023-10-06T03:23:44.936975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:21.489097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.964364+0000","last_change":"2023-10-06T03:23:44.958192+0000","last_active":"2023-10-06T03:23:44.964364+0000","last_peered":"2023-10-06T03:23:44.964364+0000","last_clean":"2023-10-06T03:23:44.964364+0000","last_became_active":"2023-10-06T03:23:44.957757+0000","last_became_peered":"2023-10-06T03:23:44.957757+0000","last_unstale":"2023-10-06T03:23:44.964364+0000","last_undegraded":"2023-10-06T03:23:44.964364+0000","last_fullsized":"2023-10-06T03:23:44.964364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:32.743988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.938605+0000","last_change":"2023-10-06T03:23:39.923600+0000","last_active":"2023-10-06T03:23:44.938605+0000","last_peered":"2023-10-06T03:23:44.938605+0000","last_clean":"2023-10-06T03:23:44.938605+0000","last_became_active":"2023-10-06T03:23:39.923304+0000","last_became_peered":"2023-10-06T03:23:39.923304+0000","last_unstale":"2023-10-06T03:23:44.938605+0000","last_undegraded":"2023-10-06T03:23:44.938605+0000","last_fullsized":"2023-10-06T03:23:44.938605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:34.959833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936185+0000","last_change":"2023-10-06T03:23:40.665909+0000","last_active":"2023-10-06T03:23:44.936185+0000","last_peered":"2023-10-06T03:23:44.936185+0000","last_clean":"2023-10-06T03:23:44.936185+0000","last_became_active":"2023-10-06T03:23:40.665618+0000","last_became_peered":"2023-10-06T03:23:40.665618+0000","last_unstale":"2023-10-06T03:23:44.936185+0000","last_undegraded":"2023-10-06T03:23:44.936185+0000","last_fullsized":"2023-10-06T03:23:44.936185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:15.293618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.964221+0000","last_change":"2023-10-06T03:23:44.962232+0000","last_active":"2023-10-06T03:23:44.964221+0000","last_peered":"2023-10-06T03:23:44.964221+0000","last_clean":"2023-10-06T03:23:44.964221+0000","last_became_active":"2023-10-06T03:23:44.961871+0000","last_became_peered":"2023-10-06T03:23:44.961871+0000","last_unstale":"2023-10-06T03:23:44.964221+0000","last_undegraded":"2023-10-06T03:23:44.964221+0000","last_fullsized":"2023-10-06T03:23:44.964221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:17.153983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.931188+0000","last_change":"2023-10-06T03:23:39.922068+0000","last_active":"2023-10-06T03:23:44.931188+0000","last_peered":"2023-10-06T03:23:44.931188+0000","last_clean":"2023-10-06T03:23:44.931188+0000","last_became_active":"2023-10-06T03:23:39.921763+0000","last_became_peered":"2023-10-06T03:23:39.921763+0000","last_unstale":"2023-10-06T03:23:44.931188+0000","last_undegraded":"2023-10-06T03:23:44.931188+0000","last_fullsized":"2023-10-06T03:23:44.931188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:36.047828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.930511+0000","last_change":"2023-10-06T03:23:40.664327+0000","last_active":"2023-10-06T03:23:44.930511+0000","last_peered":"2023-10-06T03:23:44.930511+0000","last_clean":"2023-10-06T03:23:44.930511+0000","last_became_active":"2023-10-06T03:23:40.664073+0000","last_became_peered":"2023-10-06T03:23:40.664073+0000","last_unstale":"2023-10-06T03:23:44.930511+0000","last_undegraded":"2023-10-06T03:23:44.930511+0000","last_fullsized":"2023-10-06T03:23:44.930511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:36:33.973063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.962224+0000","last_change":"2023-10-06T03:23:44.956207+0000","last_active":"2023-10-06T03:23:44.962224+0000","last_peered":"2023-10-06T03:23:44.962224+0000","last_clean":"2023-10-06T03:23:44.962224+0000","last_became_active":"2023-10-06T03:23:44.955806+0000","last_became_peered":"2023-10-06T03:23:44.955806+0000","last_unstale":"2023-10-06T03:23:44.962224+0000","last_undegraded":"2023-10-06T03:23:44.962224+0000","last_fullsized":"2023-10-06T03:23:44.962224+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:26.358389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.947996+0000","last_change":"2023-10-06T03:23:39.923144+0000","last_active":"2023-10-06T03:23:44.947996+0000","last_peered":"2023-10-06T03:23:44.947996+0000","last_clean":"2023-10-06T03:23:44.947996+0000","last_became_active":"2023-10-06T03:23:39.922061+0000","last_became_peered":"2023-10-06T03:23:39.922061+0000","last_unstale":"2023-10-06T03:23:44.947996+0000","last_undegraded":"2023-10-06T03:23:44.947996+0000","last_fullsized":"2023-10-06T03:23:44.947996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:46:24.911513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937147+0000","last_change":"2023-10-06T03:23:40.676711+0000","last_active":"2023-10-06T03:23:44.937147+0000","last_peered":"2023-10-06T03:23:44.937147+0000","last_clean":"2023-10-06T03:23:44.937147+0000","last_became_active":"2023-10-06T03:23:40.671550+0000","last_became_peered":"2023-10-06T03:23:40.671550+0000","last_unstale":"2023-10-06T03:23:44.937147+0000","last_undegraded":"2023-10-06T03:23:44.937147+0000","last_fullsized":"2023-10-06T03:23:44.937147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:27:42.172925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.944242+0000","last_change":"2023-10-06T03:23:40.661484+0000","last_active":"2023-10-06T03:23:44.944242+0000","last_peered":"2023-10-06T03:23:44.944242+0000","last_clean":"2023-10-06T03:23:44.944242+0000","last_became_active":"2023-10-06T03:23:40.661161+0000","last_became_peered":"2023-10-06T03:23:40.661161+0000","last_unstale":"2023-10-06T03:23:44.944242+0000","last_undegraded":"2023-10-06T03:23:44.944242+0000","last_fullsized":"2023-10-06T03:23:44.944242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:22.437514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.930421+0000","last_change":"2023-10-06T03:23:40.667283+0000","last_active":"2023-10-06T03:23:44.930421+0000","last_peered":"2023-10-06T03:23:44.930421+0000","last_clean":"2023-10-06T03:23:44.930421+0000","last_became_active":"2023-10-06T03:23:40.667036+0000","last_became_peered":"2023-10-06T03:23:40.667036+0000","last_unstale":"2023-10-06T03:23:44.930421+0000","last_undegraded":"2023-10-06T03:23:44.930421+0000","last_fullsized":"2023-10-06T03:23:44.930421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:54:33.855202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936441+0000","last_change":"2023-10-06T03:23:40.672592+0000","last_active":"2023-10-06T03:23:44.936441+0000","last_peered":"2023-10-06T03:23:44.936441+0000","last_clean":"2023-10-06T03:23:44.936441+0000","last_became_active":"2023-10-06T03:23:40.668259+0000","last_became_peered":"2023-10-06T03:23:40.668259+0000","last_unstale":"2023-10-06T03:23:44.936441+0000","last_undegraded":"2023-10-06T03:23:44.936441+0000","last_fullsized":"2023-10-06T03:23:44.936441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:42:53.927175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.930385+0000","last_change":"2023-10-06T03:23:40.668141+0000","last_active":"2023-10-06T03:23:44.930385+0000","last_peered":"2023-10-06T03:23:44.930385+0000","last_clean":"2023-10-06T03:23:44.930385+0000","last_became_active":"2023-10-06T03:23:40.667709+0000","last_became_peered":"2023-10-06T03:23:40.667709+0000","last_unstale":"2023-10-06T03:23:44.930385+0000","last_undegraded":"2023-10-06T03:23:44.930385+0000","last_fullsized":"2023-10-06T03:23:44.930385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:43:56.448825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936286+0000","last_change":"2023-10-06T03:23:40.662860+0000","last_active":"2023-10-06T03:23:44.936286+0000","last_peered":"2023-10-06T03:23:44.936286+0000","last_clean":"2023-10-06T03:23:44.936286+0000","last_became_active":"2023-10-06T03:23:40.662635+0000","last_became_peered":"2023-10-06T03:23:40.662635+0000","last_unstale":"2023-10-06T03:23:44.936286+0000","last_undegraded":"2023-10-06T03:23:44.936286+0000","last_fullsized":"2023-10-06T03:23:44.936286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:58.012559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2759,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":40,"ondisk_log_size":40,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298144,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073696,"statfs":{"total":96636764160,"available":96331464704,"internally_reserved":0,"allocated":876544,"data_stored":697011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297532,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074308,"statfs":{"total":96636764160,"available":96332091392,"internally_reserved":0,"allocated":249856,"data_stored":103085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0940000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298116,"kb_used_data":828,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073724,"statfs":{"total":96636764160,"available":96331493376,"internally_reserved":0,"allocated":847872,"data_stored":694806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297540,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074300,"statfs":{"total":96636764160,"available":96332083200,"internally_reserved":0,"allocated":258048,"data_stored":104992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":253952,"data_stored":104438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297540,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074300,"statfs":{"total":96636764160,"available":96332083200,"internally_reserved":0,"allocated":258048,"data_stored":104528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297556,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074284,"statfs":{"total":96636764160,"available":96332066816,"internally_reserved":0,"allocated":274432,"data_stored":106483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297544,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074296,"statfs":{"total":96636764160,"available":96332079104,"internally_reserved":0,"allocated":262144,"data_stored":105062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:23:57.974 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:23:58.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.180+0000 7f27559ff700 1 Processor -- start 2023-10-06T03:23:58.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.181+0000 7f27559ff700 1 -- start start 2023-10-06T03:23:58.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.182+0000 7f27559ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2750067cf0 0x7f27500b0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:58.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.182+0000 7f27559ff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f275006e770 con 0x7f2750159480 2023-10-06T03:23:58.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.182+0000 7f27559ff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f275006c0d0 con 0x7f275015a860 2023-10-06T03:23:58.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.182+0000 7f27559ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f275015e1a0 con 0x7f2750067cf0 2023-10-06T03:23:58.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.182+0000 7f274effd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2750159480 0x7f275006b9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52912/0 (socket says 172.21.15.81:52912) 2023-10-06T03:23:58.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.182+0000 7f274effd700 1 -- 172.21.15.81:0/11160681 learned_addr learned my addr 172.21.15.81:0/11160681 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:23:58.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.182+0000 7f274f7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2750067cf0 0x7f27500b0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:58.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.183+0000 7f274e7fc700 1 -- 172.21.15.81:0/11160681 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 429159297 0 0) 0x7f275006e770 con 0x7f2750159480 2023-10-06T03:23:58.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.183+0000 7f274e7fc700 1 -- 172.21.15.81:0/11160681 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f273c003570 con 0x7f2750159480 2023-10-06T03:23:58.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.183+0000 7f274f7fe700 1 -- 172.21.15.81:0/11160681 >> v1:172.21.15.83:6789/0 conn(0x7f275015a860 legacy=0x7f27500675e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:58.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.183+0000 7f274f7fe700 1 -- 172.21.15.81:0/11160681 >> v1:172.21.15.81:6789/0 conn(0x7f2750159480 legacy=0x7f275006b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:58.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.183+0000 7f274f7fe700 1 -- 172.21.15.81:0/11160681 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f275015d900 con 0x7f2750067cf0 2023-10-06T03:23:58.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.183+0000 7f274f7fe700 1 --2- 172.21.15.81:0/11160681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2750067cf0 0x7f27500b0b20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2748009e60 tx=0x7f2748009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20e6181bc0d9af7e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:58.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.183+0000 7f274e7fc700 1 -- 172.21.15.81:0/11160681 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274800e070 con 0x7f2750067cf0 2023-10-06T03:23:58.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.183+0000 7f274e7fc700 1 -- 172.21.15.81:0/11160681 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f274800bb60 con 0x7f2750067cf0 2023-10-06T03:23:58.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.183+0000 7f274e7fc700 1 -- 172.21.15.81:0/11160681 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2748012430 con 0x7f2750067cf0 2023-10-06T03:23:58.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.184+0000 7f27559ff700 1 -- 172.21.15.81:0/11160681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2750067cf0 msgr2=0x7f27500b0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:58.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.184+0000 7f27559ff700 1 --2- 172.21.15.81:0/11160681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2750067cf0 0x7f27500b0b20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2748009e60 tx=0x7f2748009780 comp rx=0 tx=0).stop 2023-10-06T03:23:58.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.184+0000 7f27559ff700 1 -- 172.21.15.81:0/11160681 shutdown_connections 2023-10-06T03:23:58.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.184+0000 7f27559ff700 1 --2- 172.21.15.81:0/11160681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2750067cf0 0x7f27500b0b20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:58.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.184+0000 7f27559ff700 1 -- 172.21.15.81:0/11160681 >> 172.21.15.81:0/11160681 conn(0x7f27500cdbe0 msgr2=0x7f27500aeb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:58.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.184+0000 7f27559ff700 1 -- 172.21.15.81:0/11160681 shutdown_connections 2023-10-06T03:23:58.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.184+0000 7f27559ff700 1 -- 172.21.15.81:0/11160681 wait complete. 2023-10-06T03:23:58.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.185+0000 7f27559ff700 1 Processor -- start 2023-10-06T03:23:58.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.186+0000 7f27559ff700 1 -- start start 2023-10-06T03:23:58.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.186+0000 7f27559ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2750067cf0 0x7f27500a9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:58.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.186+0000 7f27559ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2750159480 0x7f2750146c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:58.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.186+0000 7f27559ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f275015a860 0x7f27500abd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:58.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.186+0000 7f27559ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2750155fa0 con 0x7f2750067cf0 2023-10-06T03:23:58.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.186+0000 7f27559ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27501522b0 con 0x7f2750159480 2023-10-06T03:23:58.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.186+0000 7f27559ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f275016a620 con 0x7f275015a860 2023-10-06T03:23:58.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.187+0000 7f274effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2750067cf0 0x7f27500a9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:58.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.187+0000 7f274effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2750067cf0 0x7f27500a9840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38758/0 (socket says 172.21.15.81:38758) 2023-10-06T03:23:58.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.187+0000 7f274effd700 1 -- 172.21.15.81:0/3186631971 learned_addr learned my addr 172.21.15.81:0/3186631971 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:58.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.187+0000 7f274effd700 1 -- 172.21.15.81:0/3186631971 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f275015a860 msgr2=0x7f27500abd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:58.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.187+0000 7f274effd700 1 --2- 172.21.15.81:0/3186631971 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f275015a860 0x7f27500abd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:58.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.187+0000 7f274effd700 1 -- 172.21.15.81:0/3186631971 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2750159480 msgr2=0x7f2750146c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:58.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.187+0000 7f2747fff700 1 --2- 172.21.15.81:0/3186631971 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2750159480 0x7f2750146c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:58.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.187+0000 7f274effd700 1 --2- 172.21.15.81:0/3186631971 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2750159480 0x7f2750146c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:58.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.187+0000 7f274effd700 1 -- 172.21.15.81:0/3186631971 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2748009a20 con 0x7f2750067cf0 2023-10-06T03:23:58.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.187+0000 7f2747fff700 1 --2- 172.21.15.81:0/3186631971 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2750159480 0x7f2750146c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:23:58.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.187+0000 7f274effd700 1 --2- 172.21.15.81:0/3186631971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2750067cf0 0x7f27500a9840 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f274000c7c0 tx=0x7f2740007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:58.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.188+0000 7f2746ffd700 1 -- 172.21.15.81:0/3186631971 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2740005b30 con 0x7f2750067cf0 2023-10-06T03:23:58.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.188+0000 7f2746ffd700 1 -- 172.21.15.81:0/3186631971 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2740005c90 con 0x7f2750067cf0 2023-10-06T03:23:58.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.188+0000 7f27559ff700 1 -- 172.21.15.81:0/3186631971 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f275016a900 con 0x7f2750067cf0 2023-10-06T03:23:58.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.188+0000 7f2746ffd700 1 -- 172.21.15.81:0/3186631971 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2740007340 con 0x7f2750067cf0 2023-10-06T03:23:58.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.188+0000 7f27559ff700 1 -- 172.21.15.81:0/3186631971 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2750155c30 con 0x7f2750067cf0 2023-10-06T03:23:58.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.189+0000 7f27559ff700 1 -- 172.21.15.81:0/3186631971 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f275004c3c0 con 0x7f2750067cf0 2023-10-06T03:23:58.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.190+0000 7f2746ffd700 1 -- 172.21.15.81:0/3186631971 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f274001b400 con 0x7f2750067cf0 2023-10-06T03:23:58.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.190+0000 7f2746ffd700 1 --2- 172.21.15.81:0/3186631971 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2730066f30 0x7f27300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:58.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.190+0000 7f2746ffd700 1 -- 172.21.15.81:0/3186631971 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f2740084500 con 0x7f2750067cf0 2023-10-06T03:23:58.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.191+0000 7f2747fff700 1 --2- 172.21.15.81:0/3186631971 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2730066f30 0x7f27300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:58.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.191+0000 7f2747fff700 1 --2- 172.21.15.81:0/3186631971 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2730066f30 0x7f27300693e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f27500cd030 tx=0x7f2738009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:58.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.194+0000 7f2746ffd700 1 -- 172.21.15.81:0/3186631971 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2740051300 con 0x7f2750067cf0 2023-10-06T03:23:58.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.381+0000 7f27559ff700 1 -- 172.21.15.81:0/3186631971 --> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f275015dbe0 con 0x7f2730066f30 2023-10-06T03:23:58.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.391+0000 7f2746ffd700 1 -- 172.21.15.81:0/3186631971 <== mgr.4100 v2:172.21.15.81:6832/85286 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367560 (secure 0 0 0) 0x7f275015dbe0 con 0x7f2730066f30 2023-10-06T03:23:58.398 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:23:58.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.396+0000 7f27559ff700 1 -- 172.21.15.81:0/3186631971 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2730066f30 msgr2=0x7f27300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:58.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.396+0000 7f27559ff700 1 --2- 172.21.15.81:0/3186631971 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2730066f30 0x7f27300693e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f27500cd030 tx=0x7f2738009040 comp rx=0 tx=0).stop 2023-10-06T03:23:58.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.396+0000 7f27559ff700 1 -- 172.21.15.81:0/3186631971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2750067cf0 msgr2=0x7f27500a9840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:58.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.396+0000 7f27559ff700 1 --2- 172.21.15.81:0/3186631971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2750067cf0 0x7f27500a9840 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f274000c7c0 tx=0x7f2740007e00 comp rx=0 tx=0).stop 2023-10-06T03:23:58.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.396+0000 7f27559ff700 1 -- 172.21.15.81:0/3186631971 shutdown_connections 2023-10-06T03:23:58.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.396+0000 7f27559ff700 1 --2- 172.21.15.81:0/3186631971 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2730066f30 0x7f27300693e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:58.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.396+0000 7f27559ff700 1 --2- 172.21.15.81:0/3186631971 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f275015a860 0x7f27500abd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:58.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.396+0000 7f27559ff700 1 --2- 172.21.15.81:0/3186631971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2750067cf0 0x7f27500a9840 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:58.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.396+0000 7f27559ff700 1 --2- 172.21.15.81:0/3186631971 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2750159480 0x7f2750146c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:58.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.396+0000 7f27559ff700 1 -- 172.21.15.81:0/3186631971 >> 172.21.15.81:0/3186631971 conn(0x7f27500cdbe0 msgr2=0x7f2750152930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:58.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.396+0000 7f27559ff700 1 -- 172.21.15.81:0/3186631971 shutdown_connections 2023-10-06T03:23:58.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.396+0000 7f27559ff700 1 -- 172.21.15.81:0/3186631971 wait complete. 2023-10-06T03:23:58.402 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-06T03:23:58.415 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2023-10-06T03:23:57.557406+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593127,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":205,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381508,"kb_used_data":3204,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593212,"statfs":{"total":773094113280,"available":770655449088,"internally_reserved":0,"allocated":3280896,"data_stored":2020405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":453,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.911923"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.934944+0000","last_change":"2023-10-06T03:23:40.657927+0000","last_active":"2023-10-06T03:23:44.934944+0000","last_peered":"2023-10-06T03:23:44.934944+0000","last_clean":"2023-10-06T03:23:44.934944+0000","last_became_active":"2023-10-06T03:23:40.657628+0000","last_became_peered":"2023-10-06T03:23:40.657628+0000","last_unstale":"2023-10-06T03:23:44.934944+0000","last_undegraded":"2023-10-06T03:23:44.934944+0000","last_fullsized":"2023-10-06T03:23:44.934944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:53.566006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936939+0000","last_change":"2023-10-06T03:23:40.669392+0000","last_active":"2023-10-06T03:23:44.936939+0000","last_peered":"2023-10-06T03:23:44.936939+0000","last_clean":"2023-10-06T03:23:44.936939+0000","last_became_active":"2023-10-06T03:23:40.669068+0000","last_became_peered":"2023-10-06T03:23:40.669068+0000","last_unstale":"2023-10-06T03:23:44.936939+0000","last_undegraded":"2023-10-06T03:23:44.936939+0000","last_fullsized":"2023-10-06T03:23:44.936939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:15.293618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937675+0000","last_change":"2023-10-06T03:23:40.672182+0000","last_active":"2023-10-06T03:23:44.937675+0000","last_peered":"2023-10-06T03:23:44.937675+0000","last_clean":"2023-10-06T03:23:44.937675+0000","last_became_active":"2023-10-06T03:23:40.671082+0000","last_became_peered":"2023-10-06T03:23:40.671082+0000","last_unstale":"2023-10-06T03:23:44.937675+0000","last_undegraded":"2023-10-06T03:23:44.937675+0000","last_fullsized":"2023-10-06T03:23:44.937675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:37:07.602543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.944602+0000","last_change":"2023-10-06T03:23:40.669872+0000","last_active":"2023-10-06T03:23:44.944602+0000","last_peered":"2023-10-06T03:23:44.944602+0000","last_clean":"2023-10-06T03:23:44.944602+0000","last_became_active":"2023-10-06T03:23:40.669607+0000","last_became_peered":"2023-10-06T03:23:40.669607+0000","last_unstale":"2023-10-06T03:23:44.944602+0000","last_undegraded":"2023-10-06T03:23:44.944602+0000","last_fullsized":"2023-10-06T03:23:44.944602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:45.363103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.947565+0000","last_change":"2023-10-06T03:23:40.673713+0000","last_active":"2023-10-06T03:23:44.947565+0000","last_peered":"2023-10-06T03:23:44.947565+0000","last_clean":"2023-10-06T03:23:44.947565+0000","last_became_active":"2023-10-06T03:23:40.673350+0000","last_became_peered":"2023-10-06T03:23:40.673350+0000","last_unstale":"2023-10-06T03:23:44.947565+0000","last_undegraded":"2023-10-06T03:23:44.947565+0000","last_fullsized":"2023-10-06T03:23:44.947565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:54:33.855202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936531+0000","last_change":"2023-10-06T03:23:40.672923+0000","last_active":"2023-10-06T03:23:44.936531+0000","last_peered":"2023-10-06T03:23:44.936531+0000","last_clean":"2023-10-06T03:23:44.936531+0000","last_became_active":"2023-10-06T03:23:40.672651+0000","last_became_peered":"2023-10-06T03:23:40.672651+0000","last_unstale":"2023-10-06T03:23:44.936531+0000","last_undegraded":"2023-10-06T03:23:44.936531+0000","last_fullsized":"2023-10-06T03:23:44.936531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:30:38.801700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937090+0000","last_change":"2023-10-06T03:23:40.670079+0000","last_active":"2023-10-06T03:23:44.937090+0000","last_peered":"2023-10-06T03:23:44.937090+0000","last_clean":"2023-10-06T03:23:44.937090+0000","last_became_active":"2023-10-06T03:23:40.669460+0000","last_became_peered":"2023-10-06T03:23:40.669460+0000","last_unstale":"2023-10-06T03:23:44.937090+0000","last_undegraded":"2023-10-06T03:23:44.937090+0000","last_fullsized":"2023-10-06T03:23:44.937090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:21.489097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.934267+0000","last_change":"2023-10-06T03:23:40.670214+0000","last_active":"2023-10-06T03:23:44.934267+0000","last_peered":"2023-10-06T03:23:44.934267+0000","last_clean":"2023-10-06T03:23:44.934267+0000","last_became_active":"2023-10-06T03:23:40.669794+0000","last_became_peered":"2023-10-06T03:23:40.669794+0000","last_unstale":"2023-10-06T03:23:44.934267+0000","last_undegraded":"2023-10-06T03:23:44.934267+0000","last_fullsized":"2023-10-06T03:23:44.934267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:51:39.105798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.947704+0000","last_change":"2023-10-06T03:23:40.673814+0000","last_active":"2023-10-06T03:23:44.947704+0000","last_peered":"2023-10-06T03:23:44.947704+0000","last_clean":"2023-10-06T03:23:44.947704+0000","last_became_active":"2023-10-06T03:23:40.673518+0000","last_became_peered":"2023-10-06T03:23:40.673518+0000","last_unstale":"2023-10-06T03:23:44.947704+0000","last_undegraded":"2023-10-06T03:23:44.947704+0000","last_fullsized":"2023-10-06T03:23:44.947704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:36:33.973063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937252+0000","last_change":"2023-10-06T03:23:40.674286+0000","last_active":"2023-10-06T03:23:44.937252+0000","last_peered":"2023-10-06T03:23:44.937252+0000","last_clean":"2023-10-06T03:23:44.937252+0000","last_became_active":"2023-10-06T03:23:40.673972+0000","last_became_peered":"2023-10-06T03:23:40.673972+0000","last_unstale":"2023-10-06T03:23:44.937252+0000","last_undegraded":"2023-10-06T03:23:44.937252+0000","last_fullsized":"2023-10-06T03:23:44.937252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:35.462631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937591+0000","last_change":"2023-10-06T03:23:40.672377+0000","last_active":"2023-10-06T03:23:44.937591+0000","last_peered":"2023-10-06T03:23:44.937591+0000","last_clean":"2023-10-06T03:23:44.937591+0000","last_became_active":"2023-10-06T03:23:40.671914+0000","last_became_peered":"2023-10-06T03:23:40.671914+0000","last_unstale":"2023-10-06T03:23:44.937591+0000","last_undegraded":"2023-10-06T03:23:44.937591+0000","last_fullsized":"2023-10-06T03:23:44.937591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:49.615169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.934679+0000","last_change":"2023-10-06T03:23:40.664677+0000","last_active":"2023-10-06T03:23:44.934679+0000","last_peered":"2023-10-06T03:23:44.934679+0000","last_clean":"2023-10-06T03:23:44.934679+0000","last_became_active":"2023-10-06T03:23:40.664274+0000","last_became_peered":"2023-10-06T03:23:40.664274+0000","last_unstale":"2023-10-06T03:23:44.934679+0000","last_undegraded":"2023-10-06T03:23:44.934679+0000","last_fullsized":"2023-10-06T03:23:44.934679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:46:25.920290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936715+0000","last_change":"2023-10-06T03:23:40.661431+0000","last_active":"2023-10-06T03:23:44.936715+0000","last_peered":"2023-10-06T03:23:44.936715+0000","last_clean":"2023-10-06T03:23:44.936715+0000","last_became_active":"2023-10-06T03:23:40.661152+0000","last_became_peered":"2023-10-06T03:23:40.661152+0000","last_unstale":"2023-10-06T03:23:44.936715+0000","last_undegraded":"2023-10-06T03:23:44.936715+0000","last_fullsized":"2023-10-06T03:23:44.936715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:35.968610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.934879+0000","last_change":"2023-10-06T03:23:40.654344+0000","last_active":"2023-10-06T03:23:44.934879+0000","last_peered":"2023-10-06T03:23:44.934879+0000","last_clean":"2023-10-06T03:23:44.934879+0000","last_became_active":"2023-10-06T03:23:40.654053+0000","last_became_peered":"2023-10-06T03:23:40.654053+0000","last_unstale":"2023-10-06T03:23:44.934879+0000","last_undegraded":"2023-10-06T03:23:44.934879+0000","last_fullsized":"2023-10-06T03:23:44.934879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:04:49.664462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936826+0000","last_change":"2023-10-06T03:23:40.669778+0000","last_active":"2023-10-06T03:23:44.936826+0000","last_peered":"2023-10-06T03:23:44.936826+0000","last_clean":"2023-10-06T03:23:44.936826+0000","last_became_active":"2023-10-06T03:23:40.669080+0000","last_became_peered":"2023-10-06T03:23:40.669080+0000","last_unstale":"2023-10-06T03:23:44.936826+0000","last_undegraded":"2023-10-06T03:23:44.936826+0000","last_fullsized":"2023-10-06T03:23:44.936826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:51:39.105798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937246+0000","last_change":"2023-10-06T03:23:40.675925+0000","last_active":"2023-10-06T03:23:44.937246+0000","last_peered":"2023-10-06T03:23:44.937246+0000","last_clean":"2023-10-06T03:23:44.937246+0000","last_became_active":"2023-10-06T03:23:40.673050+0000","last_became_peered":"2023-10-06T03:23:40.673050+0000","last_unstale":"2023-10-06T03:23:44.937246+0000","last_undegraded":"2023-10-06T03:23:44.937246+0000","last_fullsized":"2023-10-06T03:23:44.937246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:38:27.078009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.947782+0000","last_change":"2023-10-06T03:23:40.670497+0000","last_active":"2023-10-06T03:23:44.947782+0000","last_peered":"2023-10-06T03:23:44.947782+0000","last_clean":"2023-10-06T03:23:44.947782+0000","last_became_active":"2023-10-06T03:23:40.670254+0000","last_became_peered":"2023-10-06T03:23:40.670254+0000","last_unstale":"2023-10-06T03:23:44.947782+0000","last_undegraded":"2023-10-06T03:23:44.947782+0000","last_fullsized":"2023-10-06T03:23:44.947782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:18.546154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937896+0000","last_change":"2023-10-06T03:23:40.664385+0000","last_active":"2023-10-06T03:23:44.937896+0000","last_peered":"2023-10-06T03:23:44.937896+0000","last_clean":"2023-10-06T03:23:44.937896+0000","last_became_active":"2023-10-06T03:23:40.664019+0000","last_became_peered":"2023-10-06T03:23:40.664019+0000","last_unstale":"2023-10-06T03:23:44.937896+0000","last_undegraded":"2023-10-06T03:23:44.937896+0000","last_fullsized":"2023-10-06T03:23:44.937896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:18.834001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.935061+0000","last_change":"2023-10-06T03:23:40.664719+0000","last_active":"2023-10-06T03:23:44.935061+0000","last_peered":"2023-10-06T03:23:44.935061+0000","last_clean":"2023-10-06T03:23:44.935061+0000","last_became_active":"2023-10-06T03:23:40.664292+0000","last_became_peered":"2023-10-06T03:23:40.664292+0000","last_unstale":"2023-10-06T03:23:44.935061+0000","last_undegraded":"2023-10-06T03:23:44.935061+0000","last_fullsized":"2023-10-06T03:23:44.935061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:25:22.431703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937565+0000","last_change":"2023-10-06T03:23:40.676968+0000","last_active":"2023-10-06T03:23:44.937565+0000","last_peered":"2023-10-06T03:23:44.937565+0000","last_clean":"2023-10-06T03:23:44.937565+0000","last_became_active":"2023-10-06T03:23:40.671490+0000","last_became_peered":"2023-10-06T03:23:40.671490+0000","last_unstale":"2023-10-06T03:23:44.937565+0000","last_undegraded":"2023-10-06T03:23:44.937565+0000","last_fullsized":"2023-10-06T03:23:44.937565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:57.849203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936664+0000","last_change":"2023-10-06T03:23:40.664089+0000","last_active":"2023-10-06T03:23:44.936664+0000","last_peered":"2023-10-06T03:23:44.936664+0000","last_clean":"2023-10-06T03:23:44.936664+0000","last_became_active":"2023-10-06T03:23:40.662392+0000","last_became_peered":"2023-10-06T03:23:40.662392+0000","last_unstale":"2023-10-06T03:23:44.936664+0000","last_undegraded":"2023-10-06T03:23:44.936664+0000","last_fullsized":"2023-10-06T03:23:44.936664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:35.462631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.945221+0000","last_change":"2023-10-06T03:23:40.673025+0000","last_active":"2023-10-06T03:23:44.945221+0000","last_peered":"2023-10-06T03:23:44.945221+0000","last_clean":"2023-10-06T03:23:44.945221+0000","last_became_active":"2023-10-06T03:23:40.672797+0000","last_became_peered":"2023-10-06T03:23:40.672797+0000","last_unstale":"2023-10-06T03:23:44.945221+0000","last_undegraded":"2023-10-06T03:23:44.945221+0000","last_fullsized":"2023-10-06T03:23:44.945221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:21.489097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.930431+0000","last_change":"2023-10-06T03:23:40.670561+0000","last_active":"2023-10-06T03:23:44.930431+0000","last_peered":"2023-10-06T03:23:44.930431+0000","last_clean":"2023-10-06T03:23:44.930431+0000","last_became_active":"2023-10-06T03:23:40.670272+0000","last_became_peered":"2023-10-06T03:23:40.670272+0000","last_unstale":"2023-10-06T03:23:44.930431+0000","last_undegraded":"2023-10-06T03:23:44.930431+0000","last_fullsized":"2023-10-06T03:23:44.930431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:18.834001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936341+0000","last_change":"2023-10-06T03:23:40.662281+0000","last_active":"2023-10-06T03:23:44.936341+0000","last_peered":"2023-10-06T03:23:44.936341+0000","last_clean":"2023-10-06T03:23:44.936341+0000","last_became_active":"2023-10-06T03:23:40.661686+0000","last_became_peered":"2023-10-06T03:23:40.661686+0000","last_unstale":"2023-10-06T03:23:44.936341+0000","last_undegraded":"2023-10-06T03:23:44.936341+0000","last_fullsized":"2023-10-06T03:23:44.936341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:15.293618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.938818+0000","last_change":"2023-10-06T03:23:40.668204+0000","last_active":"2023-10-06T03:23:44.938818+0000","last_peered":"2023-10-06T03:23:44.938818+0000","last_clean":"2023-10-06T03:23:44.938818+0000","last_became_active":"2023-10-06T03:23:40.665998+0000","last_became_peered":"2023-10-06T03:23:40.665998+0000","last_unstale":"2023-10-06T03:23:44.938818+0000","last_undegraded":"2023-10-06T03:23:44.938818+0000","last_fullsized":"2023-10-06T03:23:44.938818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:15.293618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936984+0000","last_change":"2023-10-06T03:23:40.654367+0000","last_active":"2023-10-06T03:23:44.936984+0000","last_peered":"2023-10-06T03:23:44.936984+0000","last_clean":"2023-10-06T03:23:44.936984+0000","last_became_active":"2023-10-06T03:23:40.654082+0000","last_became_peered":"2023-10-06T03:23:40.654082+0000","last_unstale":"2023-10-06T03:23:44.936984+0000","last_undegraded":"2023-10-06T03:23:44.936984+0000","last_fullsized":"2023-10-06T03:23:44.936984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:56.483789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.938900+0000","last_change":"2023-10-06T03:23:40.662226+0000","last_active":"2023-10-06T03:23:44.938900+0000","last_peered":"2023-10-06T03:23:44.938900+0000","last_clean":"2023-10-06T03:23:44.938900+0000","last_became_active":"2023-10-06T03:23:40.662025+0000","last_became_peered":"2023-10-06T03:23:40.662025+0000","last_unstale":"2023-10-06T03:23:44.938900+0000","last_undegraded":"2023-10-06T03:23:44.938900+0000","last_fullsized":"2023-10-06T03:23:44.938900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:37.167322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.955136+0000","last_change":"2023-10-06T03:23:44.949281+0000","last_active":"2023-10-06T03:23:44.955136+0000","last_peered":"2023-10-06T03:23:44.955136+0000","last_clean":"2023-10-06T03:23:44.955136+0000","last_became_active":"2023-10-06T03:23:44.948885+0000","last_became_peered":"2023-10-06T03:23:44.948885+0000","last_unstale":"2023-10-06T03:23:44.955136+0000","last_undegraded":"2023-10-06T03:23:44.955136+0000","last_fullsized":"2023-10-06T03:23:44.955136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:31:16.317335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936350+0000","last_change":"2023-10-06T03:23:39.919181+0000","last_active":"2023-10-06T03:23:44.936350+0000","last_peered":"2023-10-06T03:23:44.936350+0000","last_clean":"2023-10-06T03:23:44.936350+0000","last_became_active":"2023-10-06T03:23:39.918331+0000","last_became_peered":"2023-10-06T03:23:39.918331+0000","last_unstale":"2023-10-06T03:23:44.936350+0000","last_undegraded":"2023-10-06T03:23:44.936350+0000","last_fullsized":"2023-10-06T03:23:44.936350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:46:24.911513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.931056+0000","last_change":"2023-10-06T03:23:40.666693+0000","last_active":"2023-10-06T03:23:44.931056+0000","last_peered":"2023-10-06T03:23:44.931056+0000","last_clean":"2023-10-06T03:23:44.931056+0000","last_became_active":"2023-10-06T03:23:40.666435+0000","last_became_peered":"2023-10-06T03:23:40.666435+0000","last_unstale":"2023-10-06T03:23:44.931056+0000","last_undegraded":"2023-10-06T03:23:44.931056+0000","last_fullsized":"2023-10-06T03:23:44.931056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:35.462631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.962151+0000","last_change":"2023-10-06T03:23:44.958592+0000","last_active":"2023-10-06T03:23:44.962151+0000","last_peered":"2023-10-06T03:23:44.962151+0000","last_clean":"2023-10-06T03:23:44.962151+0000","last_became_active":"2023-10-06T03:23:44.957907+0000","last_became_peered":"2023-10-06T03:23:44.957907+0000","last_unstale":"2023-10-06T03:23:44.962151+0000","last_undegraded":"2023-10-06T03:23:44.962151+0000","last_fullsized":"2023-10-06T03:23:44.962151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:22.863565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.938027+0000","last_change":"2023-10-06T03:23:39.927167+0000","last_active":"2023-10-06T03:23:44.938027+0000","last_peered":"2023-10-06T03:23:44.938027+0000","last_clean":"2023-10-06T03:23:44.938027+0000","last_became_active":"2023-10-06T03:23:39.926796+0000","last_became_peered":"2023-10-06T03:23:39.926796+0000","last_unstale":"2023-10-06T03:23:44.938027+0000","last_undegraded":"2023-10-06T03:23:44.938027+0000","last_fullsized":"2023-10-06T03:23:44.938027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:10:12.819926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.948077+0000","last_change":"2023-10-06T03:23:40.676555+0000","last_active":"2023-10-06T03:23:44.948077+0000","last_peered":"2023-10-06T03:23:44.948077+0000","last_clean":"2023-10-06T03:23:44.948077+0000","last_became_active":"2023-10-06T03:23:40.676292+0000","last_became_peered":"2023-10-06T03:23:40.676292+0000","last_unstale":"2023-10-06T03:23:44.948077+0000","last_undegraded":"2023-10-06T03:23:44.948077+0000","last_fullsized":"2023-10-06T03:23:44.948077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:15.293618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.966214+0000","last_change":"2023-10-06T03:23:44.963581+0000","last_active":"2023-10-06T03:23:44.966214+0000","last_peered":"2023-10-06T03:23:44.966214+0000","last_clean":"2023-10-06T03:23:44.966214+0000","last_became_active":"2023-10-06T03:23:44.963132+0000","last_became_peered":"2023-10-06T03:23:44.963132+0000","last_unstale":"2023-10-06T03:23:44.966214+0000","last_undegraded":"2023-10-06T03:23:44.966214+0000","last_fullsized":"2023-10-06T03:23:44.966214+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:39.997230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.930690+0000","last_change":"2023-10-06T03:23:39.931987+0000","last_active":"2023-10-06T03:23:44.930690+0000","last_peered":"2023-10-06T03:23:44.930690+0000","last_clean":"2023-10-06T03:23:44.930690+0000","last_became_active":"2023-10-06T03:23:39.931330+0000","last_became_peered":"2023-10-06T03:23:39.931330+0000","last_unstale":"2023-10-06T03:23:44.930690+0000","last_undegraded":"2023-10-06T03:23:44.930690+0000","last_fullsized":"2023-10-06T03:23:44.930690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:41.245899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.947767+0000","last_change":"2023-10-06T03:23:40.666106+0000","last_active":"2023-10-06T03:23:44.947767+0000","last_peered":"2023-10-06T03:23:44.947767+0000","last_clean":"2023-10-06T03:23:44.947767+0000","last_became_active":"2023-10-06T03:23:40.665767+0000","last_became_peered":"2023-10-06T03:23:40.665767+0000","last_unstale":"2023-10-06T03:23:44.947767+0000","last_undegraded":"2023-10-06T03:23:44.947767+0000","last_fullsized":"2023-10-06T03:23:44.947767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:35.738270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.959918+0000","last_change":"2023-10-06T03:23:44.957763+0000","last_active":"2023-10-06T03:23:44.959918+0000","last_peered":"2023-10-06T03:23:44.959918+0000","last_clean":"2023-10-06T03:23:44.959918+0000","last_became_active":"2023-10-06T03:23:44.957461+0000","last_became_peered":"2023-10-06T03:23:44.957461+0000","last_unstale":"2023-10-06T03:23:44.959918+0000","last_undegraded":"2023-10-06T03:23:44.959918+0000","last_fullsized":"2023-10-06T03:23:44.959918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:27:46.202488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.947861+0000","last_change":"2023-10-06T03:23:39.926868+0000","last_active":"2023-10-06T03:23:44.947861+0000","last_peered":"2023-10-06T03:23:44.947861+0000","last_clean":"2023-10-06T03:23:44.947861+0000","last_became_active":"2023-10-06T03:23:39.926602+0000","last_became_peered":"2023-10-06T03:23:39.926602+0000","last_unstale":"2023-10-06T03:23:44.947861+0000","last_undegraded":"2023-10-06T03:23:44.947861+0000","last_fullsized":"2023-10-06T03:23:44.947861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:34.959833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.930596+0000","last_change":"2023-10-06T03:23:40.666666+0000","last_active":"2023-10-06T03:23:44.930596+0000","last_peered":"2023-10-06T03:23:44.930596+0000","last_clean":"2023-10-06T03:23:44.930596+0000","last_became_active":"2023-10-06T03:23:40.666333+0000","last_became_peered":"2023-10-06T03:23:40.666333+0000","last_unstale":"2023-10-06T03:23:44.930596+0000","last_undegraded":"2023-10-06T03:23:44.930596+0000","last_fullsized":"2023-10-06T03:23:44.930596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:21.489097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.963680+0000","last_change":"2023-10-06T03:23:44.956770+0000","last_active":"2023-10-06T03:23:44.963680+0000","last_peered":"2023-10-06T03:23:44.963680+0000","last_clean":"2023-10-06T03:23:44.963680+0000","last_became_active":"2023-10-06T03:23:44.956335+0000","last_became_peered":"2023-10-06T03:23:44.956335+0000","last_unstale":"2023-10-06T03:23:44.963680+0000","last_undegraded":"2023-10-06T03:23:44.963680+0000","last_fullsized":"2023-10-06T03:23:44.963680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:26.358389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937057+0000","last_change":"2023-10-06T03:23:39.918613+0000","last_active":"2023-10-06T03:23:44.937057+0000","last_peered":"2023-10-06T03:23:44.937057+0000","last_clean":"2023-10-06T03:23:44.937057+0000","last_became_active":"2023-10-06T03:23:39.918224+0000","last_became_peered":"2023-10-06T03:23:39.918224+0000","last_unstale":"2023-10-06T03:23:44.937057+0000","last_undegraded":"2023-10-06T03:23:44.937057+0000","last_fullsized":"2023-10-06T03:23:44.937057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:10:12.819926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.930293+0000","last_change":"2023-10-06T03:23:40.665896+0000","last_active":"2023-10-06T03:23:44.930293+0000","last_peered":"2023-10-06T03:23:44.930293+0000","last_clean":"2023-10-06T03:23:44.930293+0000","last_became_active":"2023-10-06T03:23:40.665625+0000","last_became_peered":"2023-10-06T03:23:40.665625+0000","last_unstale":"2023-10-06T03:23:44.930293+0000","last_undegraded":"2023-10-06T03:23:44.930293+0000","last_fullsized":"2023-10-06T03:23:44.930293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:00.382000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.959626+0000","last_change":"2023-10-06T03:23:44.950950+0000","last_active":"2023-10-06T03:23:44.959626+0000","last_peered":"2023-10-06T03:23:44.959626+0000","last_clean":"2023-10-06T03:23:44.959626+0000","last_became_active":"2023-10-06T03:23:44.950383+0000","last_became_peered":"2023-10-06T03:23:44.950383+0000","last_unstale":"2023-10-06T03:23:44.959626+0000","last_undegraded":"2023-10-06T03:23:44.959626+0000","last_fullsized":"2023-10-06T03:23:44.959626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:41.590979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936358+0000","last_change":"2023-10-06T03:23:39.928175+0000","last_active":"2023-10-06T03:23:44.936358+0000","last_peered":"2023-10-06T03:23:44.936358+0000","last_clean":"2023-10-06T03:23:44.936358+0000","last_became_active":"2023-10-06T03:23:39.927870+0000","last_became_peered":"2023-10-06T03:23:39.927870+0000","last_unstale":"2023-10-06T03:23:44.936358+0000","last_undegraded":"2023-10-06T03:23:44.936358+0000","last_fullsized":"2023-10-06T03:23:44.936358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:15:53.608164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.938038+0000","last_change":"2023-10-06T03:23:40.668044+0000","last_active":"2023-10-06T03:23:44.938038+0000","last_peered":"2023-10-06T03:23:44.938038+0000","last_clean":"2023-10-06T03:23:44.938038+0000","last_became_active":"2023-10-06T03:23:40.667677+0000","last_became_peered":"2023-10-06T03:23:40.667677+0000","last_unstale":"2023-10-06T03:23:44.938038+0000","last_undegraded":"2023-10-06T03:23:44.938038+0000","last_fullsized":"2023-10-06T03:23:44.938038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:37.167322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.962261+0000","last_change":"2023-10-06T03:23:44.957225+0000","last_active":"2023-10-06T03:23:44.962261+0000","last_peered":"2023-10-06T03:23:44.962261+0000","last_clean":"2023-10-06T03:23:44.962261+0000","last_became_active":"2023-10-06T03:23:44.956809+0000","last_became_peered":"2023-10-06T03:23:44.956809+0000","last_unstale":"2023-10-06T03:23:44.962261+0000","last_undegraded":"2023-10-06T03:23:44.962261+0000","last_fullsized":"2023-10-06T03:23:44.962261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:46:57.334758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"24'7","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:23:46.431143+0000","last_change":"2023-10-06T03:23:39.926096+0000","last_active":"2023-10-06T03:23:46.431143+0000","last_peered":"2023-10-06T03:23:46.431143+0000","last_clean":"2023-10-06T03:23:46.431143+0000","last_became_active":"2023-10-06T03:23:39.925763+0000","last_became_peered":"2023-10-06T03:23:39.925763+0000","last_unstale":"2023-10-06T03:23:46.431143+0000","last_undegraded":"2023-10-06T03:23:46.431143+0000","last_fullsized":"2023-10-06T03:23:46.431143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:25:21.422926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1989,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936727+0000","last_change":"2023-10-06T03:23:40.668353+0000","last_active":"2023-10-06T03:23:44.936727+0000","last_peered":"2023-10-06T03:23:44.936727+0000","last_clean":"2023-10-06T03:23:44.936727+0000","last_became_active":"2023-10-06T03:23:40.668068+0000","last_became_peered":"2023-10-06T03:23:40.668068+0000","last_unstale":"2023-10-06T03:23:44.936727+0000","last_undegraded":"2023-10-06T03:23:44.936727+0000","last_fullsized":"2023-10-06T03:23:44.936727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:07:52.772047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.955742+0000","last_change":"2023-10-06T03:23:44.954499+0000","last_active":"2023-10-06T03:23:44.955742+0000","last_peered":"2023-10-06T03:23:44.955742+0000","last_clean":"2023-10-06T03:23:44.955742+0000","last_became_active":"2023-10-06T03:23:44.954033+0000","last_became_peered":"2023-10-06T03:23:44.954033+0000","last_unstale":"2023-10-06T03:23:44.955742+0000","last_undegraded":"2023-10-06T03:23:44.955742+0000","last_fullsized":"2023-10-06T03:23:44.955742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:39.997230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936587+0000","last_change":"2023-10-06T03:23:39.929796+0000","last_active":"2023-10-06T03:23:44.936587+0000","last_peered":"2023-10-06T03:23:44.936587+0000","last_clean":"2023-10-06T03:23:44.936587+0000","last_became_active":"2023-10-06T03:23:39.929503+0000","last_became_peered":"2023-10-06T03:23:39.929503+0000","last_unstale":"2023-10-06T03:23:44.936587+0000","last_undegraded":"2023-10-06T03:23:44.936587+0000","last_fullsized":"2023-10-06T03:23:44.936587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:44.354326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.931035+0000","last_change":"2023-10-06T03:23:40.670640+0000","last_active":"2023-10-06T03:23:44.931035+0000","last_peered":"2023-10-06T03:23:44.931035+0000","last_clean":"2023-10-06T03:23:44.931035+0000","last_became_active":"2023-10-06T03:23:40.670295+0000","last_became_peered":"2023-10-06T03:23:40.670295+0000","last_unstale":"2023-10-06T03:23:44.931035+0000","last_undegraded":"2023-10-06T03:23:44.931035+0000","last_fullsized":"2023-10-06T03:23:44.931035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:18.546154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.959802+0000","last_change":"2023-10-06T03:23:44.952973+0000","last_active":"2023-10-06T03:23:44.959802+0000","last_peered":"2023-10-06T03:23:44.959802+0000","last_clean":"2023-10-06T03:23:44.959802+0000","last_became_active":"2023-10-06T03:23:44.952573+0000","last_became_peered":"2023-10-06T03:23:44.952573+0000","last_unstale":"2023-10-06T03:23:44.959802+0000","last_undegraded":"2023-10-06T03:23:44.959802+0000","last_fullsized":"2023-10-06T03:23:44.959802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:47:31.959148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.946424+0000","last_change":"2023-10-06T03:23:39.920586+0000","last_active":"2023-10-06T03:23:44.946424+0000","last_peered":"2023-10-06T03:23:44.946424+0000","last_clean":"2023-10-06T03:23:44.946424+0000","last_became_active":"2023-10-06T03:23:39.920273+0000","last_became_peered":"2023-10-06T03:23:39.920273+0000","last_unstale":"2023-10-06T03:23:44.946424+0000","last_undegraded":"2023-10-06T03:23:44.946424+0000","last_fullsized":"2023-10-06T03:23:44.946424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:25:21.422926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.938789+0000","last_change":"2023-10-06T03:23:40.660488+0000","last_active":"2023-10-06T03:23:44.938789+0000","last_peered":"2023-10-06T03:23:44.938789+0000","last_clean":"2023-10-06T03:23:44.938789+0000","last_became_active":"2023-10-06T03:23:40.660218+0000","last_became_peered":"2023-10-06T03:23:40.660218+0000","last_unstale":"2023-10-06T03:23:44.938789+0000","last_undegraded":"2023-10-06T03:23:44.938789+0000","last_fullsized":"2023-10-06T03:23:44.938789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:29:10.177304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.959965+0000","last_change":"2023-10-06T03:23:44.957434+0000","last_active":"2023-10-06T03:23:44.959965+0000","last_peered":"2023-10-06T03:23:44.959965+0000","last_clean":"2023-10-06T03:23:44.959965+0000","last_became_active":"2023-10-06T03:23:44.957081+0000","last_became_peered":"2023-10-06T03:23:44.957081+0000","last_unstale":"2023-10-06T03:23:44.959965+0000","last_undegraded":"2023-10-06T03:23:44.959965+0000","last_fullsized":"2023-10-06T03:23:44.959965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:23.189419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936994+0000","last_change":"2023-10-06T03:23:39.929775+0000","last_active":"2023-10-06T03:23:44.936994+0000","last_peered":"2023-10-06T03:23:44.936994+0000","last_clean":"2023-10-06T03:23:44.936994+0000","last_became_active":"2023-10-06T03:23:39.929442+0000","last_became_peered":"2023-10-06T03:23:39.929442+0000","last_unstale":"2023-10-06T03:23:44.936994+0000","last_undegraded":"2023-10-06T03:23:44.936994+0000","last_fullsized":"2023-10-06T03:23:44.936994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:13:39.307938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.949506+0000","last_change":"2023-10-06T03:23:40.667709+0000","last_active":"2023-10-06T03:23:44.949506+0000","last_peered":"2023-10-06T03:23:44.949506+0000","last_clean":"2023-10-06T03:23:44.949506+0000","last_became_active":"2023-10-06T03:23:40.667393+0000","last_became_peered":"2023-10-06T03:23:40.667393+0000","last_unstale":"2023-10-06T03:23:44.949506+0000","last_undegraded":"2023-10-06T03:23:44.949506+0000","last_fullsized":"2023-10-06T03:23:44.949506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:00.382000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.964649+0000","last_change":"2023-10-06T03:23:44.961540+0000","last_active":"2023-10-06T03:23:44.964649+0000","last_peered":"2023-10-06T03:23:44.964649+0000","last_clean":"2023-10-06T03:23:44.964649+0000","last_became_active":"2023-10-06T03:23:44.961152+0000","last_became_peered":"2023-10-06T03:23:44.961152+0000","last_unstale":"2023-10-06T03:23:44.964649+0000","last_undegraded":"2023-10-06T03:23:44.964649+0000","last_fullsized":"2023-10-06T03:23:44.964649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:48.424006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.944147+0000","last_change":"2023-10-06T03:23:39.930656+0000","last_active":"2023-10-06T03:23:44.944147+0000","last_peered":"2023-10-06T03:23:44.944147+0000","last_clean":"2023-10-06T03:23:44.944147+0000","last_became_active":"2023-10-06T03:23:39.930340+0000","last_became_peered":"2023-10-06T03:23:39.930340+0000","last_unstale":"2023-10-06T03:23:44.944147+0000","last_undegraded":"2023-10-06T03:23:44.944147+0000","last_fullsized":"2023-10-06T03:23:44.944147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:10:12.819926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.931492+0000","last_change":"2023-10-06T03:23:40.666356+0000","last_active":"2023-10-06T03:23:44.931492+0000","last_peered":"2023-10-06T03:23:44.931492+0000","last_clean":"2023-10-06T03:23:44.931492+0000","last_became_active":"2023-10-06T03:23:40.666092+0000","last_became_peered":"2023-10-06T03:23:40.666092+0000","last_unstale":"2023-10-06T03:23:44.931492+0000","last_undegraded":"2023-10-06T03:23:44.931492+0000","last_fullsized":"2023-10-06T03:23:44.931492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:15.293618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.969201+0000","last_change":"2023-10-06T03:23:44.965794+0000","last_active":"2023-10-06T03:23:44.969201+0000","last_peered":"2023-10-06T03:23:44.969201+0000","last_clean":"2023-10-06T03:23:44.969201+0000","last_became_active":"2023-10-06T03:23:44.959858+0000","last_became_peered":"2023-10-06T03:23:44.959858+0000","last_unstale":"2023-10-06T03:23:44.969201+0000","last_undegraded":"2023-10-06T03:23:44.969201+0000","last_fullsized":"2023-10-06T03:23:44.969201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:53.182371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.944656+0000","last_change":"2023-10-06T03:23:39.927449+0000","last_active":"2023-10-06T03:23:44.944656+0000","last_peered":"2023-10-06T03:23:44.944656+0000","last_clean":"2023-10-06T03:23:44.944656+0000","last_became_active":"2023-10-06T03:23:39.927150+0000","last_became_peered":"2023-10-06T03:23:39.927150+0000","last_unstale":"2023-10-06T03:23:44.944656+0000","last_undegraded":"2023-10-06T03:23:44.944656+0000","last_fullsized":"2023-10-06T03:23:44.944656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:34.729493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.934229+0000","last_change":"2023-10-06T03:23:40.660603+0000","last_active":"2023-10-06T03:23:44.934229+0000","last_peered":"2023-10-06T03:23:44.934229+0000","last_clean":"2023-10-06T03:23:44.934229+0000","last_became_active":"2023-10-06T03:23:40.660310+0000","last_became_peered":"2023-10-06T03:23:40.660310+0000","last_unstale":"2023-10-06T03:23:44.934229+0000","last_undegraded":"2023-10-06T03:23:44.934229+0000","last_fullsized":"2023-10-06T03:23:44.934229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:21.489097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.965034+0000","last_change":"2023-10-06T03:23:44.958953+0000","last_active":"2023-10-06T03:23:44.965034+0000","last_peered":"2023-10-06T03:23:44.965034+0000","last_clean":"2023-10-06T03:23:44.965034+0000","last_became_active":"2023-10-06T03:23:44.958414+0000","last_became_peered":"2023-10-06T03:23:44.958414+0000","last_unstale":"2023-10-06T03:23:44.965034+0000","last_undegraded":"2023-10-06T03:23:44.965034+0000","last_fullsized":"2023-10-06T03:23:44.965034+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:22.575718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936667+0000","last_change":"2023-10-06T03:23:39.924645+0000","last_active":"2023-10-06T03:23:44.936667+0000","last_peered":"2023-10-06T03:23:44.936667+0000","last_clean":"2023-10-06T03:23:44.936667+0000","last_became_active":"2023-10-06T03:23:39.924375+0000","last_became_peered":"2023-10-06T03:23:39.924375+0000","last_unstale":"2023-10-06T03:23:44.936667+0000","last_undegraded":"2023-10-06T03:23:44.936667+0000","last_fullsized":"2023-10-06T03:23:44.936667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:21.428737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936388+0000","last_change":"2023-10-06T03:23:40.671688+0000","last_active":"2023-10-06T03:23:44.936388+0000","last_peered":"2023-10-06T03:23:44.936388+0000","last_clean":"2023-10-06T03:23:44.936388+0000","last_became_active":"2023-10-06T03:23:40.671408+0000","last_became_peered":"2023-10-06T03:23:40.671408+0000","last_unstale":"2023-10-06T03:23:44.936388+0000","last_undegraded":"2023-10-06T03:23:44.936388+0000","last_fullsized":"2023-10-06T03:23:44.936388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:43:56.448825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.959633+0000","last_change":"2023-10-06T03:23:44.955142+0000","last_active":"2023-10-06T03:23:44.959633+0000","last_peered":"2023-10-06T03:23:44.959633+0000","last_clean":"2023-10-06T03:23:44.959633+0000","last_became_active":"2023-10-06T03:23:44.954726+0000","last_became_peered":"2023-10-06T03:23:44.954726+0000","last_unstale":"2023-10-06T03:23:44.959633+0000","last_undegraded":"2023-10-06T03:23:44.959633+0000","last_fullsized":"2023-10-06T03:23:44.959633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:55:01.878766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936253+0000","last_change":"2023-10-06T03:23:39.917247+0000","last_active":"2023-10-06T03:23:44.936253+0000","last_peered":"2023-10-06T03:23:44.936253+0000","last_clean":"2023-10-06T03:23:44.936253+0000","last_became_active":"2023-10-06T03:23:39.916954+0000","last_became_peered":"2023-10-06T03:23:39.916954+0000","last_unstale":"2023-10-06T03:23:44.936253+0000","last_undegraded":"2023-10-06T03:23:44.936253+0000","last_fullsized":"2023-10-06T03:23:44.936253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:05.109047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.944090+0000","last_change":"2023-10-06T03:23:40.671497+0000","last_active":"2023-10-06T03:23:44.944090+0000","last_peered":"2023-10-06T03:23:44.944090+0000","last_clean":"2023-10-06T03:23:44.944090+0000","last_became_active":"2023-10-06T03:23:40.671220+0000","last_became_peered":"2023-10-06T03:23:40.671220+0000","last_unstale":"2023-10-06T03:23:44.944090+0000","last_undegraded":"2023-10-06T03:23:44.944090+0000","last_fullsized":"2023-10-06T03:23:44.944090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:13:40.316715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.953035+0000","last_change":"2023-10-06T03:23:44.950490+0000","last_active":"2023-10-06T03:23:44.953035+0000","last_peered":"2023-10-06T03:23:44.953035+0000","last_clean":"2023-10-06T03:23:44.953035+0000","last_became_active":"2023-10-06T03:23:44.949773+0000","last_became_peered":"2023-10-06T03:23:44.949773+0000","last_unstale":"2023-10-06T03:23:44.953035+0000","last_undegraded":"2023-10-06T03:23:44.953035+0000","last_fullsized":"2023-10-06T03:23:44.953035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:27:46.202488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.934555+0000","last_change":"2023-10-06T03:23:39.927421+0000","last_active":"2023-10-06T03:23:44.934555+0000","last_peered":"2023-10-06T03:23:44.934555+0000","last_clean":"2023-10-06T03:23:44.934555+0000","last_became_active":"2023-10-06T03:23:39.927038+0000","last_became_peered":"2023-10-06T03:23:39.927038+0000","last_unstale":"2023-10-06T03:23:44.934555+0000","last_undegraded":"2023-10-06T03:23:44.934555+0000","last_fullsized":"2023-10-06T03:23:44.934555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:41.245899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.947302+0000","last_change":"2023-10-06T03:23:40.668861+0000","last_active":"2023-10-06T03:23:44.947302+0000","last_peered":"2023-10-06T03:23:44.947302+0000","last_clean":"2023-10-06T03:23:44.947302+0000","last_became_active":"2023-10-06T03:23:40.668596+0000","last_became_peered":"2023-10-06T03:23:40.668596+0000","last_unstale":"2023-10-06T03:23:44.947302+0000","last_undegraded":"2023-10-06T03:23:44.947302+0000","last_fullsized":"2023-10-06T03:23:44.947302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:51:39.105798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.959600+0000","last_change":"2023-10-06T03:23:44.956193+0000","last_active":"2023-10-06T03:23:44.959600+0000","last_peered":"2023-10-06T03:23:44.959600+0000","last_clean":"2023-10-06T03:23:44.959600+0000","last_became_active":"2023-10-06T03:23:44.955814+0000","last_became_peered":"2023-10-06T03:23:44.955814+0000","last_unstale":"2023-10-06T03:23:44.959600+0000","last_undegraded":"2023-10-06T03:23:44.959600+0000","last_fullsized":"2023-10-06T03:23:44.959600+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:22.863565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.930753+0000","last_change":"2023-10-06T03:23:39.927251+0000","last_active":"2023-10-06T03:23:44.930753+0000","last_peered":"2023-10-06T03:23:44.930753+0000","last_clean":"2023-10-06T03:23:44.930753+0000","last_became_active":"2023-10-06T03:23:39.926999+0000","last_became_peered":"2023-10-06T03:23:39.926999+0000","last_unstale":"2023-10-06T03:23:44.930753+0000","last_undegraded":"2023-10-06T03:23:44.930753+0000","last_fullsized":"2023-10-06T03:23:44.930753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:10:12.819926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937381+0000","last_change":"2023-10-06T03:23:40.666463+0000","last_active":"2023-10-06T03:23:44.937381+0000","last_peered":"2023-10-06T03:23:44.937381+0000","last_clean":"2023-10-06T03:23:44.937381+0000","last_became_active":"2023-10-06T03:23:40.666227+0000","last_became_peered":"2023-10-06T03:23:40.666227+0000","last_unstale":"2023-10-06T03:23:44.937381+0000","last_undegraded":"2023-10-06T03:23:44.937381+0000","last_fullsized":"2023-10-06T03:23:44.937381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:51:39.105798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.962121+0000","last_change":"2023-10-06T03:23:44.955034+0000","last_active":"2023-10-06T03:23:44.962121+0000","last_peered":"2023-10-06T03:23:44.962121+0000","last_clean":"2023-10-06T03:23:44.962121+0000","last_became_active":"2023-10-06T03:23:44.954644+0000","last_became_peered":"2023-10-06T03:23:44.954644+0000","last_unstale":"2023-10-06T03:23:44.962121+0000","last_undegraded":"2023-10-06T03:23:44.962121+0000","last_fullsized":"2023-10-06T03:23:44.962121+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:48:22.544086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.944177+0000","last_change":"2023-10-06T03:23:39.924561+0000","last_active":"2023-10-06T03:23:44.944177+0000","last_peered":"2023-10-06T03:23:44.944177+0000","last_clean":"2023-10-06T03:23:44.944177+0000","last_became_active":"2023-10-06T03:23:39.924258+0000","last_became_peered":"2023-10-06T03:23:39.924258+0000","last_unstale":"2023-10-06T03:23:44.944177+0000","last_undegraded":"2023-10-06T03:23:44.944177+0000","last_fullsized":"2023-10-06T03:23:44.944177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:25:21.422926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937352+0000","last_change":"2023-10-06T03:23:40.664384+0000","last_active":"2023-10-06T03:23:44.937352+0000","last_peered":"2023-10-06T03:23:44.937352+0000","last_clean":"2023-10-06T03:23:44.937352+0000","last_became_active":"2023-10-06T03:23:40.664072+0000","last_became_peered":"2023-10-06T03:23:40.664072+0000","last_unstale":"2023-10-06T03:23:44.937352+0000","last_undegraded":"2023-10-06T03:23:44.937352+0000","last_fullsized":"2023-10-06T03:23:44.937352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:00.382000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.962692+0000","last_change":"2023-10-06T03:23:44.956737+0000","last_active":"2023-10-06T03:23:44.962692+0000","last_peered":"2023-10-06T03:23:44.962692+0000","last_clean":"2023-10-06T03:23:44.962692+0000","last_became_active":"2023-10-06T03:23:44.956371+0000","last_became_peered":"2023-10-06T03:23:44.956371+0000","last_unstale":"2023-10-06T03:23:44.962692+0000","last_undegraded":"2023-10-06T03:23:44.962692+0000","last_fullsized":"2023-10-06T03:23:44.962692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:11.304312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936209+0000","last_change":"2023-10-06T03:23:39.918323+0000","last_active":"2023-10-06T03:23:44.936209+0000","last_peered":"2023-10-06T03:23:44.936209+0000","last_clean":"2023-10-06T03:23:44.936209+0000","last_became_active":"2023-10-06T03:23:39.916159+0000","last_became_peered":"2023-10-06T03:23:39.916159+0000","last_unstale":"2023-10-06T03:23:44.936209+0000","last_undegraded":"2023-10-06T03:23:44.936209+0000","last_fullsized":"2023-10-06T03:23:44.936209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:34.959833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937989+0000","last_change":"2023-10-06T03:23:40.663057+0000","last_active":"2023-10-06T03:23:44.937989+0000","last_peered":"2023-10-06T03:23:44.937989+0000","last_clean":"2023-10-06T03:23:44.937989+0000","last_became_active":"2023-10-06T03:23:40.662793+0000","last_became_peered":"2023-10-06T03:23:40.662793+0000","last_unstale":"2023-10-06T03:23:44.937989+0000","last_undegraded":"2023-10-06T03:23:44.937989+0000","last_fullsized":"2023-10-06T03:23:44.937989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:29:24.713990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.954896+0000","last_change":"2023-10-06T03:23:44.951565+0000","last_active":"2023-10-06T03:23:44.954896+0000","last_peered":"2023-10-06T03:23:44.954896+0000","last_clean":"2023-10-06T03:23:44.954896+0000","last_became_active":"2023-10-06T03:23:44.951124+0000","last_became_peered":"2023-10-06T03:23:44.951124+0000","last_unstale":"2023-10-06T03:23:44.954896+0000","last_undegraded":"2023-10-06T03:23:44.954896+0000","last_fullsized":"2023-10-06T03:23:44.954896+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:40:21.613547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.930481+0000","last_change":"2023-10-06T03:23:39.927594+0000","last_active":"2023-10-06T03:23:44.930481+0000","last_peered":"2023-10-06T03:23:44.930481+0000","last_clean":"2023-10-06T03:23:44.930481+0000","last_became_active":"2023-10-06T03:23:39.926962+0000","last_became_peered":"2023-10-06T03:23:39.926962+0000","last_unstale":"2023-10-06T03:23:44.930481+0000","last_undegraded":"2023-10-06T03:23:44.930481+0000","last_fullsized":"2023-10-06T03:23:44.930481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:46:24.911513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.939034+0000","last_change":"2023-10-06T03:23:40.658994+0000","last_active":"2023-10-06T03:23:44.939034+0000","last_peered":"2023-10-06T03:23:44.939034+0000","last_clean":"2023-10-06T03:23:44.939034+0000","last_became_active":"2023-10-06T03:23:40.658600+0000","last_became_peered":"2023-10-06T03:23:40.658600+0000","last_unstale":"2023-10-06T03:23:44.939034+0000","last_undegraded":"2023-10-06T03:23:44.939034+0000","last_fullsized":"2023-10-06T03:23:44.939034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:21.489097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.962887+0000","last_change":"2023-10-06T03:23:44.961313+0000","last_active":"2023-10-06T03:23:44.962887+0000","last_peered":"2023-10-06T03:23:44.962887+0000","last_clean":"2023-10-06T03:23:44.962887+0000","last_became_active":"2023-10-06T03:23:44.960885+0000","last_became_peered":"2023-10-06T03:23:44.960885+0000","last_unstale":"2023-10-06T03:23:44.962887+0000","last_undegraded":"2023-10-06T03:23:44.962887+0000","last_fullsized":"2023-10-06T03:23:44.962887+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:26:37.645345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.931270+0000","last_change":"2023-10-06T03:23:39.926444+0000","last_active":"2023-10-06T03:23:44.931270+0000","last_peered":"2023-10-06T03:23:44.931270+0000","last_clean":"2023-10-06T03:23:44.931270+0000","last_became_active":"2023-10-06T03:23:39.925823+0000","last_became_peered":"2023-10-06T03:23:39.925823+0000","last_unstale":"2023-10-06T03:23:44.931270+0000","last_undegraded":"2023-10-06T03:23:44.931270+0000","last_fullsized":"2023-10-06T03:23:44.931270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:34.959833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937506+0000","last_change":"2023-10-06T03:23:35.397971+0000","last_active":"2023-10-06T03:23:44.937506+0000","last_peered":"2023-10-06T03:23:44.937506+0000","last_clean":"2023-10-06T03:23:44.937506+0000","last_became_active":"2023-10-06T03:23:35.397649+0000","last_became_peered":"2023-10-06T03:23:35.397649+0000","last_unstale":"2023-10-06T03:23:44.937506+0000","last_undegraded":"2023-10-06T03:23:44.937506+0000","last_fullsized":"2023-10-06T03:23:44.937506+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:11.974461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.930368+0000","last_change":"2023-10-06T03:23:40.669097+0000","last_active":"2023-10-06T03:23:44.930368+0000","last_peered":"2023-10-06T03:23:44.930368+0000","last_clean":"2023-10-06T03:23:44.930368+0000","last_became_active":"2023-10-06T03:23:40.668871+0000","last_became_peered":"2023-10-06T03:23:40.668871+0000","last_unstale":"2023-10-06T03:23:44.930368+0000","last_undegraded":"2023-10-06T03:23:44.930368+0000","last_fullsized":"2023-10-06T03:23:44.930368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:49.615169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.959612+0000","last_change":"2023-10-06T03:23:44.951296+0000","last_active":"2023-10-06T03:23:44.959612+0000","last_peered":"2023-10-06T03:23:44.959612+0000","last_clean":"2023-10-06T03:23:44.959612+0000","last_became_active":"2023-10-06T03:23:44.950936+0000","last_became_peered":"2023-10-06T03:23:44.950936+0000","last_unstale":"2023-10-06T03:23:44.959612+0000","last_undegraded":"2023-10-06T03:23:44.959612+0000","last_fullsized":"2023-10-06T03:23:44.959612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:45:45.700670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.930926+0000","last_change":"2023-10-06T03:23:34.866196+0000","last_active":"2023-10-06T03:23:44.930926+0000","last_peered":"2023-10-06T03:23:44.930926+0000","last_clean":"2023-10-06T03:23:44.930926+0000","last_became_active":"2023-10-06T03:23:34.865914+0000","last_became_peered":"2023-10-06T03:23:34.865914+0000","last_unstale":"2023-10-06T03:23:44.930926+0000","last_undegraded":"2023-10-06T03:23:44.930926+0000","last_fullsized":"2023-10-06T03:23:44.930926+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:11.974461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:45.052691+0000","last_change":"2023-10-06T03:23:39.927514+0000","last_active":"2023-10-06T03:23:45.052691+0000","last_peered":"2023-10-06T03:23:45.052691+0000","last_clean":"2023-10-06T03:23:45.052691+0000","last_became_active":"2023-10-06T03:23:39.927274+0000","last_became_peered":"2023-10-06T03:23:39.927274+0000","last_unstale":"2023-10-06T03:23:45.052691+0000","last_undegraded":"2023-10-06T03:23:45.052691+0000","last_fullsized":"2023-10-06T03:23:45.052691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:41.245899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936299+0000","last_change":"2023-10-06T03:23:40.662222+0000","last_active":"2023-10-06T03:23:44.936299+0000","last_peered":"2023-10-06T03:23:44.936299+0000","last_clean":"2023-10-06T03:23:44.936299+0000","last_became_active":"2023-10-06T03:23:40.661970+0000","last_became_peered":"2023-10-06T03:23:40.661970+0000","last_unstale":"2023-10-06T03:23:44.936299+0000","last_undegraded":"2023-10-06T03:23:44.936299+0000","last_fullsized":"2023-10-06T03:23:44.936299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:54:33.855202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.955860+0000","last_change":"2023-10-06T03:23:44.954326+0000","last_active":"2023-10-06T03:23:44.955860+0000","last_peered":"2023-10-06T03:23:44.955860+0000","last_clean":"2023-10-06T03:23:44.955860+0000","last_became_active":"2023-10-06T03:23:44.953952+0000","last_became_peered":"2023-10-06T03:23:44.953952+0000","last_unstale":"2023-10-06T03:23:44.955860+0000","last_undegraded":"2023-10-06T03:23:44.955860+0000","last_fullsized":"2023-10-06T03:23:44.955860+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:38:22.970164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.934805+0000","last_change":"2023-10-06T03:23:34.874380+0000","last_active":"2023-10-06T03:23:44.934805+0000","last_peered":"2023-10-06T03:23:44.934805+0000","last_clean":"2023-10-06T03:23:44.934805+0000","last_became_active":"2023-10-06T03:23:34.873972+0000","last_became_peered":"2023-10-06T03:23:34.873972+0000","last_unstale":"2023-10-06T03:23:44.934805+0000","last_undegraded":"2023-10-06T03:23:44.934805+0000","last_fullsized":"2023-10-06T03:23:44.934805+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:30.204999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":167,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936436+0000","last_change":"2023-10-06T03:23:34.864626+0000","last_active":"2023-10-06T03:23:44.936436+0000","last_peered":"2023-10-06T03:23:44.936436+0000","last_clean":"2023-10-06T03:23:44.936436+0000","last_became_active":"2023-10-06T03:23:34.863539+0000","last_became_peered":"2023-10-06T03:23:34.863539+0000","last_unstale":"2023-10-06T03:23:44.936436+0000","last_undegraded":"2023-10-06T03:23:44.936436+0000","last_fullsized":"2023-10-06T03:23:44.936436+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:11.750836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.944554+0000","last_change":"2023-10-06T03:23:39.930157+0000","last_active":"2023-10-06T03:23:44.944554+0000","last_peered":"2023-10-06T03:23:44.944554+0000","last_clean":"2023-10-06T03:23:44.944554+0000","last_became_active":"2023-10-06T03:23:39.929906+0000","last_became_peered":"2023-10-06T03:23:39.929906+0000","last_unstale":"2023-10-06T03:23:44.944554+0000","last_undegraded":"2023-10-06T03:23:44.944554+0000","last_fullsized":"2023-10-06T03:23:44.944554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:52.557228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.949418+0000","last_change":"2023-10-06T03:23:40.668183+0000","last_active":"2023-10-06T03:23:44.949418+0000","last_peered":"2023-10-06T03:23:44.949418+0000","last_clean":"2023-10-06T03:23:44.949418+0000","last_became_active":"2023-10-06T03:23:40.667934+0000","last_became_peered":"2023-10-06T03:23:40.667934+0000","last_unstale":"2023-10-06T03:23:44.949418+0000","last_undegraded":"2023-10-06T03:23:44.949418+0000","last_fullsized":"2023-10-06T03:23:44.949418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:35.462631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.969737+0000","last_change":"2023-10-06T03:23:44.961492+0000","last_active":"2023-10-06T03:23:44.969737+0000","last_peered":"2023-10-06T03:23:44.969737+0000","last_clean":"2023-10-06T03:23:44.969737+0000","last_became_active":"2023-10-06T03:23:44.961050+0000","last_became_peered":"2023-10-06T03:23:44.961050+0000","last_unstale":"2023-10-06T03:23:44.969737+0000","last_undegraded":"2023-10-06T03:23:44.969737+0000","last_fullsized":"2023-10-06T03:23:44.969737+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:39.492194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.938294+0000","last_change":"2023-10-06T03:23:34.864399+0000","last_active":"2023-10-06T03:23:44.938294+0000","last_peered":"2023-10-06T03:23:44.938294+0000","last_clean":"2023-10-06T03:23:44.938294+0000","last_became_active":"2023-10-06T03:23:34.863991+0000","last_became_peered":"2023-10-06T03:23:34.863991+0000","last_unstale":"2023-10-06T03:23:44.938294+0000","last_undegraded":"2023-10-06T03:23:44.938294+0000","last_fullsized":"2023-10-06T03:23:44.938294+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:56:32.358597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.935729+0000","last_change":"2023-10-06T03:23:39.925094+0000","last_active":"2023-10-06T03:23:44.935729+0000","last_peered":"2023-10-06T03:23:44.935729+0000","last_clean":"2023-10-06T03:23:44.935729+0000","last_became_active":"2023-10-06T03:23:39.923918+0000","last_became_peered":"2023-10-06T03:23:39.923918+0000","last_unstale":"2023-10-06T03:23:44.935729+0000","last_undegraded":"2023-10-06T03:23:44.935729+0000","last_fullsized":"2023-10-06T03:23:44.935729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:25:21.422926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.938945+0000","last_change":"2023-10-06T03:23:40.663620+0000","last_active":"2023-10-06T03:23:44.938945+0000","last_peered":"2023-10-06T03:23:44.938945+0000","last_clean":"2023-10-06T03:23:44.938945+0000","last_became_active":"2023-10-06T03:23:40.663339+0000","last_became_peered":"2023-10-06T03:23:40.663339+0000","last_unstale":"2023-10-06T03:23:44.938945+0000","last_undegraded":"2023-10-06T03:23:44.938945+0000","last_fullsized":"2023-10-06T03:23:44.938945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:51:39.105798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.970567+0000","last_change":"2023-10-06T03:23:44.969165+0000","last_active":"2023-10-06T03:23:44.970567+0000","last_peered":"2023-10-06T03:23:44.970567+0000","last_clean":"2023-10-06T03:23:44.970567+0000","last_became_active":"2023-10-06T03:23:44.966357+0000","last_became_peered":"2023-10-06T03:23:44.966357+0000","last_unstale":"2023-10-06T03:23:44.970567+0000","last_undegraded":"2023-10-06T03:23:44.970567+0000","last_fullsized":"2023-10-06T03:23:44.970567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:56:31.830855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936245+0000","last_change":"2023-10-06T03:23:34.865125+0000","last_active":"2023-10-06T03:23:44.936245+0000","last_peered":"2023-10-06T03:23:44.936245+0000","last_clean":"2023-10-06T03:23:44.936245+0000","last_became_active":"2023-10-06T03:23:34.864752+0000","last_became_peered":"2023-10-06T03:23:34.864752+0000","last_unstale":"2023-10-06T03:23:44.936245+0000","last_undegraded":"2023-10-06T03:23:44.936245+0000","last_fullsized":"2023-10-06T03:23:44.936245+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:00.374963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.930358+0000","last_change":"2023-10-06T03:23:39.922954+0000","last_active":"2023-10-06T03:23:44.930358+0000","last_peered":"2023-10-06T03:23:44.930358+0000","last_clean":"2023-10-06T03:23:44.930358+0000","last_became_active":"2023-10-06T03:23:39.922405+0000","last_became_peered":"2023-10-06T03:23:39.922405+0000","last_unstale":"2023-10-06T03:23:44.930358+0000","last_undegraded":"2023-10-06T03:23:44.930358+0000","last_fullsized":"2023-10-06T03:23:44.930358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:52.557228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.944559+0000","last_change":"2023-10-06T03:23:40.672406+0000","last_active":"2023-10-06T03:23:44.944559+0000","last_peered":"2023-10-06T03:23:44.944559+0000","last_clean":"2023-10-06T03:23:44.944559+0000","last_became_active":"2023-10-06T03:23:40.672113+0000","last_became_peered":"2023-10-06T03:23:40.672113+0000","last_unstale":"2023-10-06T03:23:44.944559+0000","last_undegraded":"2023-10-06T03:23:44.944559+0000","last_fullsized":"2023-10-06T03:23:44.944559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:58.012559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.966608+0000","last_change":"2023-10-06T03:23:44.957635+0000","last_active":"2023-10-06T03:23:44.966608+0000","last_peered":"2023-10-06T03:23:44.966608+0000","last_clean":"2023-10-06T03:23:44.966608+0000","last_became_active":"2023-10-06T03:23:44.957238+0000","last_became_peered":"2023-10-06T03:23:44.957238+0000","last_unstale":"2023-10-06T03:23:44.966608+0000","last_undegraded":"2023-10-06T03:23:44.966608+0000","last_fullsized":"2023-10-06T03:23:44.966608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:53.182371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.934131+0000","last_change":"2023-10-06T03:23:34.864329+0000","last_active":"2023-10-06T03:23:44.934131+0000","last_peered":"2023-10-06T03:23:44.934131+0000","last_clean":"2023-10-06T03:23:44.934131+0000","last_became_active":"2023-10-06T03:23:34.863953+0000","last_became_peered":"2023-10-06T03:23:34.863953+0000","last_unstale":"2023-10-06T03:23:44.934131+0000","last_undegraded":"2023-10-06T03:23:44.934131+0000","last_fullsized":"2023-10-06T03:23:44.934131+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:30.204999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936822+0000","last_change":"2023-10-06T03:23:39.930279+0000","last_active":"2023-10-06T03:23:44.936822+0000","last_peered":"2023-10-06T03:23:44.936822+0000","last_clean":"2023-10-06T03:23:44.936822+0000","last_became_active":"2023-10-06T03:23:39.929992+0000","last_became_peered":"2023-10-06T03:23:39.929992+0000","last_unstale":"2023-10-06T03:23:44.936822+0000","last_undegraded":"2023-10-06T03:23:44.936822+0000","last_fullsized":"2023-10-06T03:23:44.936822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:10:12.819926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936204+0000","last_change":"2023-10-06T03:23:40.662851+0000","last_active":"2023-10-06T03:23:44.936204+0000","last_peered":"2023-10-06T03:23:44.936204+0000","last_clean":"2023-10-06T03:23:44.936204+0000","last_became_active":"2023-10-06T03:23:40.662555+0000","last_became_peered":"2023-10-06T03:23:40.662555+0000","last_unstale":"2023-10-06T03:23:44.936204+0000","last_undegraded":"2023-10-06T03:23:44.936204+0000","last_fullsized":"2023-10-06T03:23:44.936204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:29:10.177304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.958925+0000","last_change":"2023-10-06T03:23:44.955457+0000","last_active":"2023-10-06T03:23:44.958925+0000","last_peered":"2023-10-06T03:23:44.958925+0000","last_clean":"2023-10-06T03:23:44.958925+0000","last_became_active":"2023-10-06T03:23:44.954842+0000","last_became_peered":"2023-10-06T03:23:44.954842+0000","last_unstale":"2023-10-06T03:23:44.958925+0000","last_undegraded":"2023-10-06T03:23:44.958925+0000","last_fullsized":"2023-10-06T03:23:44.958925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:00.478388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.944665+0000","last_change":"2023-10-06T03:23:34.873939+0000","last_active":"2023-10-06T03:23:44.944665+0000","last_peered":"2023-10-06T03:23:44.944665+0000","last_clean":"2023-10-06T03:23:44.944665+0000","last_became_active":"2023-10-06T03:23:34.873623+0000","last_became_peered":"2023-10-06T03:23:34.873623+0000","last_unstale":"2023-10-06T03:23:44.944665+0000","last_undegraded":"2023-10-06T03:23:44.944665+0000","last_fullsized":"2023-10-06T03:23:44.944665+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:30.204999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936368+0000","last_change":"2023-10-06T03:23:39.923260+0000","last_active":"2023-10-06T03:23:44.936368+0000","last_peered":"2023-10-06T03:23:44.936368+0000","last_clean":"2023-10-06T03:23:44.936368+0000","last_became_active":"2023-10-06T03:23:39.922927+0000","last_became_peered":"2023-10-06T03:23:39.922927+0000","last_unstale":"2023-10-06T03:23:44.936368+0000","last_undegraded":"2023-10-06T03:23:44.936368+0000","last_fullsized":"2023-10-06T03:23:44.936368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:34.959833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.947472+0000","last_change":"2023-10-06T03:23:40.669315+0000","last_active":"2023-10-06T03:23:44.947472+0000","last_peered":"2023-10-06T03:23:44.947472+0000","last_clean":"2023-10-06T03:23:44.947472+0000","last_became_active":"2023-10-06T03:23:40.669061+0000","last_became_peered":"2023-10-06T03:23:40.669061+0000","last_unstale":"2023-10-06T03:23:44.947472+0000","last_undegraded":"2023-10-06T03:23:44.947472+0000","last_fullsized":"2023-10-06T03:23:44.947472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:56.483789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.966208+0000","last_change":"2023-10-06T03:23:44.962703+0000","last_active":"2023-10-06T03:23:44.966208+0000","last_peered":"2023-10-06T03:23:44.966208+0000","last_clean":"2023-10-06T03:23:44.966208+0000","last_became_active":"2023-10-06T03:23:44.957582+0000","last_became_peered":"2023-10-06T03:23:44.957582+0000","last_unstale":"2023-10-06T03:23:44.966208+0000","last_undegraded":"2023-10-06T03:23:44.966208+0000","last_fullsized":"2023-10-06T03:23:44.966208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:56:31.830855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.947663+0000","last_change":"2023-10-06T03:23:34.872453+0000","last_active":"2023-10-06T03:23:44.947663+0000","last_peered":"2023-10-06T03:23:44.947663+0000","last_clean":"2023-10-06T03:23:44.947663+0000","last_became_active":"2023-10-06T03:23:34.872139+0000","last_became_peered":"2023-10-06T03:23:34.872139+0000","last_unstale":"2023-10-06T03:23:44.947663+0000","last_undegraded":"2023-10-06T03:23:44.947663+0000","last_fullsized":"2023-10-06T03:23:44.947663+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:25:46.214290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.938700+0000","last_change":"2023-10-06T03:23:39.927321+0000","last_active":"2023-10-06T03:23:44.938700+0000","last_peered":"2023-10-06T03:23:44.938700+0000","last_clean":"2023-10-06T03:23:44.938700+0000","last_became_active":"2023-10-06T03:23:39.927057+0000","last_became_peered":"2023-10-06T03:23:39.927057+0000","last_unstale":"2023-10-06T03:23:44.938700+0000","last_undegraded":"2023-10-06T03:23:44.938700+0000","last_fullsized":"2023-10-06T03:23:44.938700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:52.557228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937835+0000","last_change":"2023-10-06T03:23:40.662143+0000","last_active":"2023-10-06T03:23:44.937835+0000","last_peered":"2023-10-06T03:23:44.937835+0000","last_clean":"2023-10-06T03:23:44.937835+0000","last_became_active":"2023-10-06T03:23:40.661885+0000","last_became_peered":"2023-10-06T03:23:40.661885+0000","last_unstale":"2023-10-06T03:23:44.937835+0000","last_undegraded":"2023-10-06T03:23:44.937835+0000","last_fullsized":"2023-10-06T03:23:44.937835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:04:49.664462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.954580+0000","last_change":"2023-10-06T03:23:44.952490+0000","last_active":"2023-10-06T03:23:44.954580+0000","last_peered":"2023-10-06T03:23:44.954580+0000","last_clean":"2023-10-06T03:23:44.954580+0000","last_became_active":"2023-10-06T03:23:44.951755+0000","last_became_peered":"2023-10-06T03:23:44.951755+0000","last_unstale":"2023-10-06T03:23:44.954580+0000","last_undegraded":"2023-10-06T03:23:44.954580+0000","last_fullsized":"2023-10-06T03:23:44.954580+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:37:11.632106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.947387+0000","last_change":"2023-10-06T03:23:39.927188+0000","last_active":"2023-10-06T03:23:44.947387+0000","last_peered":"2023-10-06T03:23:44.947387+0000","last_clean":"2023-10-06T03:23:44.947387+0000","last_became_active":"2023-10-06T03:23:39.926830+0000","last_became_peered":"2023-10-06T03:23:39.926830+0000","last_unstale":"2023-10-06T03:23:44.947387+0000","last_undegraded":"2023-10-06T03:23:44.947387+0000","last_fullsized":"2023-10-06T03:23:44.947387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:36.047828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.934779+0000","last_change":"2023-10-06T03:23:40.671601+0000","last_active":"2023-10-06T03:23:44.934779+0000","last_peered":"2023-10-06T03:23:44.934779+0000","last_clean":"2023-10-06T03:23:44.934779+0000","last_became_active":"2023-10-06T03:23:40.671312+0000","last_became_peered":"2023-10-06T03:23:40.671312+0000","last_unstale":"2023-10-06T03:23:44.934779+0000","last_undegraded":"2023-10-06T03:23:44.934779+0000","last_fullsized":"2023-10-06T03:23:44.934779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:42.254676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.966019+0000","last_change":"2023-10-06T03:23:44.964087+0000","last_active":"2023-10-06T03:23:44.966019+0000","last_peered":"2023-10-06T03:23:44.966019+0000","last_clean":"2023-10-06T03:23:44.966019+0000","last_became_active":"2023-10-06T03:23:44.963323+0000","last_became_peered":"2023-10-06T03:23:44.963323+0000","last_unstale":"2023-10-06T03:23:44.966019+0000","last_undegraded":"2023-10-06T03:23:44.966019+0000","last_fullsized":"2023-10-06T03:23:44.966019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:37:11.632106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.934389+0000","last_change":"2023-10-06T03:23:39.921245+0000","last_active":"2023-10-06T03:23:44.934389+0000","last_peered":"2023-10-06T03:23:44.934389+0000","last_clean":"2023-10-06T03:23:44.934389+0000","last_became_active":"2023-10-06T03:23:39.920740+0000","last_became_peered":"2023-10-06T03:23:39.920740+0000","last_unstale":"2023-10-06T03:23:44.934389+0000","last_undegraded":"2023-10-06T03:23:44.934389+0000","last_fullsized":"2023-10-06T03:23:44.934389+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:46:24.911513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936975+0000","last_change":"2023-10-06T03:23:40.665175+0000","last_active":"2023-10-06T03:23:44.936975+0000","last_peered":"2023-10-06T03:23:44.936975+0000","last_clean":"2023-10-06T03:23:44.936975+0000","last_became_active":"2023-10-06T03:23:40.664926+0000","last_became_peered":"2023-10-06T03:23:40.664926+0000","last_unstale":"2023-10-06T03:23:44.936975+0000","last_undegraded":"2023-10-06T03:23:44.936975+0000","last_fullsized":"2023-10-06T03:23:44.936975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:21.489097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.964364+0000","last_change":"2023-10-06T03:23:44.958192+0000","last_active":"2023-10-06T03:23:44.964364+0000","last_peered":"2023-10-06T03:23:44.964364+0000","last_clean":"2023-10-06T03:23:44.964364+0000","last_became_active":"2023-10-06T03:23:44.957757+0000","last_became_peered":"2023-10-06T03:23:44.957757+0000","last_unstale":"2023-10-06T03:23:44.964364+0000","last_undegraded":"2023-10-06T03:23:44.964364+0000","last_fullsized":"2023-10-06T03:23:44.964364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:32.743988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.938605+0000","last_change":"2023-10-06T03:23:39.923600+0000","last_active":"2023-10-06T03:23:44.938605+0000","last_peered":"2023-10-06T03:23:44.938605+0000","last_clean":"2023-10-06T03:23:44.938605+0000","last_became_active":"2023-10-06T03:23:39.923304+0000","last_became_peered":"2023-10-06T03:23:39.923304+0000","last_unstale":"2023-10-06T03:23:44.938605+0000","last_undegraded":"2023-10-06T03:23:44.938605+0000","last_fullsized":"2023-10-06T03:23:44.938605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:34.959833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936185+0000","last_change":"2023-10-06T03:23:40.665909+0000","last_active":"2023-10-06T03:23:44.936185+0000","last_peered":"2023-10-06T03:23:44.936185+0000","last_clean":"2023-10-06T03:23:44.936185+0000","last_became_active":"2023-10-06T03:23:40.665618+0000","last_became_peered":"2023-10-06T03:23:40.665618+0000","last_unstale":"2023-10-06T03:23:44.936185+0000","last_undegraded":"2023-10-06T03:23:44.936185+0000","last_fullsized":"2023-10-06T03:23:44.936185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:15.293618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.964221+0000","last_change":"2023-10-06T03:23:44.962232+0000","last_active":"2023-10-06T03:23:44.964221+0000","last_peered":"2023-10-06T03:23:44.964221+0000","last_clean":"2023-10-06T03:23:44.964221+0000","last_became_active":"2023-10-06T03:23:44.961871+0000","last_became_peered":"2023-10-06T03:23:44.961871+0000","last_unstale":"2023-10-06T03:23:44.964221+0000","last_undegraded":"2023-10-06T03:23:44.964221+0000","last_fullsized":"2023-10-06T03:23:44.964221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:17.153983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.931188+0000","last_change":"2023-10-06T03:23:39.922068+0000","last_active":"2023-10-06T03:23:44.931188+0000","last_peered":"2023-10-06T03:23:44.931188+0000","last_clean":"2023-10-06T03:23:44.931188+0000","last_became_active":"2023-10-06T03:23:39.921763+0000","last_became_peered":"2023-10-06T03:23:39.921763+0000","last_unstale":"2023-10-06T03:23:44.931188+0000","last_undegraded":"2023-10-06T03:23:44.931188+0000","last_fullsized":"2023-10-06T03:23:44.931188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:36.047828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.930511+0000","last_change":"2023-10-06T03:23:40.664327+0000","last_active":"2023-10-06T03:23:44.930511+0000","last_peered":"2023-10-06T03:23:44.930511+0000","last_clean":"2023-10-06T03:23:44.930511+0000","last_became_active":"2023-10-06T03:23:40.664073+0000","last_became_peered":"2023-10-06T03:23:40.664073+0000","last_unstale":"2023-10-06T03:23:44.930511+0000","last_undegraded":"2023-10-06T03:23:44.930511+0000","last_fullsized":"2023-10-06T03:23:44.930511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:36:33.973063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.962224+0000","last_change":"2023-10-06T03:23:44.956207+0000","last_active":"2023-10-06T03:23:44.962224+0000","last_peered":"2023-10-06T03:23:44.962224+0000","last_clean":"2023-10-06T03:23:44.962224+0000","last_became_active":"2023-10-06T03:23:44.955806+0000","last_became_peered":"2023-10-06T03:23:44.955806+0000","last_unstale":"2023-10-06T03:23:44.962224+0000","last_undegraded":"2023-10-06T03:23:44.962224+0000","last_fullsized":"2023-10-06T03:23:44.962224+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:26.358389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.947996+0000","last_change":"2023-10-06T03:23:39.923144+0000","last_active":"2023-10-06T03:23:44.947996+0000","last_peered":"2023-10-06T03:23:44.947996+0000","last_clean":"2023-10-06T03:23:44.947996+0000","last_became_active":"2023-10-06T03:23:39.922061+0000","last_became_peered":"2023-10-06T03:23:39.922061+0000","last_unstale":"2023-10-06T03:23:44.947996+0000","last_undegraded":"2023-10-06T03:23:44.947996+0000","last_fullsized":"2023-10-06T03:23:44.947996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:46:24.911513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937147+0000","last_change":"2023-10-06T03:23:40.676711+0000","last_active":"2023-10-06T03:23:44.937147+0000","last_peered":"2023-10-06T03:23:44.937147+0000","last_clean":"2023-10-06T03:23:44.937147+0000","last_became_active":"2023-10-06T03:23:40.671550+0000","last_became_peered":"2023-10-06T03:23:40.671550+0000","last_unstale":"2023-10-06T03:23:44.937147+0000","last_undegraded":"2023-10-06T03:23:44.937147+0000","last_fullsized":"2023-10-06T03:23:44.937147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:27:42.172925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.944242+0000","last_change":"2023-10-06T03:23:40.661484+0000","last_active":"2023-10-06T03:23:44.944242+0000","last_peered":"2023-10-06T03:23:44.944242+0000","last_clean":"2023-10-06T03:23:44.944242+0000","last_became_active":"2023-10-06T03:23:40.661161+0000","last_became_peered":"2023-10-06T03:23:40.661161+0000","last_unstale":"2023-10-06T03:23:44.944242+0000","last_undegraded":"2023-10-06T03:23:44.944242+0000","last_fullsized":"2023-10-06T03:23:44.944242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:22.437514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.930421+0000","last_change":"2023-10-06T03:23:40.667283+0000","last_active":"2023-10-06T03:23:44.930421+0000","last_peered":"2023-10-06T03:23:44.930421+0000","last_clean":"2023-10-06T03:23:44.930421+0000","last_became_active":"2023-10-06T03:23:40.667036+0000","last_became_peered":"2023-10-06T03:23:40.667036+0000","last_unstale":"2023-10-06T03:23:44.930421+0000","last_undegraded":"2023-10-06T03:23:44.930421+0000","last_fullsized":"2023-10-06T03:23:44.930421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:54:33.855202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936441+0000","last_change":"2023-10-06T03:23:40.672592+0000","last_active":"2023-10-06T03:23:44.936441+0000","last_peered":"2023-10-06T03:23:44.936441+0000","last_clean":"2023-10-06T03:23:44.936441+0000","last_became_active":"2023-10-06T03:23:40.668259+0000","last_became_peered":"2023-10-06T03:23:40.668259+0000","last_unstale":"2023-10-06T03:23:44.936441+0000","last_undegraded":"2023-10-06T03:23:44.936441+0000","last_fullsized":"2023-10-06T03:23:44.936441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:42:53.927175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.930385+0000","last_change":"2023-10-06T03:23:40.668141+0000","last_active":"2023-10-06T03:23:44.930385+0000","last_peered":"2023-10-06T03:23:44.930385+0000","last_clean":"2023-10-06T03:23:44.930385+0000","last_became_active":"2023-10-06T03:23:40.667709+0000","last_became_peered":"2023-10-06T03:23:40.667709+0000","last_unstale":"2023-10-06T03:23:44.930385+0000","last_undegraded":"2023-10-06T03:23:44.930385+0000","last_fullsized":"2023-10-06T03:23:44.930385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:43:56.448825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936286+0000","last_change":"2023-10-06T03:23:40.662860+0000","last_active":"2023-10-06T03:23:44.936286+0000","last_peered":"2023-10-06T03:23:44.936286+0000","last_clean":"2023-10-06T03:23:44.936286+0000","last_became_active":"2023-10-06T03:23:40.662635+0000","last_became_peered":"2023-10-06T03:23:40.662635+0000","last_unstale":"2023-10-06T03:23:44.936286+0000","last_undegraded":"2023-10-06T03:23:44.936286+0000","last_fullsized":"2023-10-06T03:23:44.936286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:58.012559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2759,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":40,"ondisk_log_size":40,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298144,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073696,"statfs":{"total":96636764160,"available":96331464704,"internally_reserved":0,"allocated":876544,"data_stored":697011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297532,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074308,"statfs":{"total":96636764160,"available":96332091392,"internally_reserved":0,"allocated":249856,"data_stored":103085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0940000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298116,"kb_used_data":828,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073724,"statfs":{"total":96636764160,"available":96331493376,"internally_reserved":0,"allocated":847872,"data_stored":694806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297540,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074300,"statfs":{"total":96636764160,"available":96332083200,"internally_reserved":0,"allocated":258048,"data_stored":104992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":253952,"data_stored":104438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297540,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074300,"statfs":{"total":96636764160,"available":96332083200,"internally_reserved":0,"allocated":258048,"data_stored":104528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297556,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074284,"statfs":{"total":96636764160,"available":96332066816,"internally_reserved":0,"allocated":274432,"data_stored":106483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297544,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074296,"statfs":{"total":96636764160,"available":96332079104,"internally_reserved":0,"allocated":262144,"data_stored":105062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:23:58.422 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T03:23:58.423 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-06T03:23:58.423 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-06T03:23:58.423 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-06T03:23:58.423 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-06T03:23:58.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.635+0000 7f7b2fbff700 1 Processor -- start 2023-10-06T03:23:58.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.635+0000 7f7b2fbff700 1 -- start start 2023-10-06T03:23:58.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.637+0000 7f7b2fbff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7b28155bc0 0x7f7b28156c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:58.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.637+0000 7f7b2fbff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b280c9c60 con 0x7f7b28069ee0 2023-10-06T03:23:58.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.637+0000 7f7b2fbff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b2806dc60 con 0x7f7b281557f0 2023-10-06T03:23:58.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.637+0000 7f7b2fbff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b2806df20 con 0x7f7b28155bc0 2023-10-06T03:23:58.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.637+0000 7f7b2d19a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7b28155bc0 0x7f7b28156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:58.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.637+0000 7f7b2e19c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7b28069ee0 0x7f7b2806e370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52924/0 (socket says 172.21.15.81:52924) 2023-10-06T03:23:58.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.637+0000 7f7b2e19c700 1 -- 172.21.15.81:0/3119757209 learned_addr learned my addr 172.21.15.81:0/3119757209 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:23:58.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.637+0000 7f7b2c999700 1 -- 172.21.15.81:0/3119757209 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1390208779 0 0) 0x7f7b280c9c60 con 0x7f7b28069ee0 2023-10-06T03:23:58.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.637+0000 7f7b2c999700 1 -- 172.21.15.81:0/3119757209 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b14003570 con 0x7f7b28069ee0 2023-10-06T03:23:58.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.637+0000 7f7b2c999700 1 -- 172.21.15.81:0/3119757209 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 709652356 0 0) 0x7f7b2806dc60 con 0x7f7b281557f0 2023-10-06T03:23:58.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.637+0000 7f7b2d19a700 1 -- 172.21.15.81:0/3119757209 >> v1:172.21.15.83:6789/0 conn(0x7f7b281557f0 legacy=0x7f7b280c6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:58.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.637+0000 7f7b2d19a700 1 -- 172.21.15.81:0/3119757209 >> v1:172.21.15.81:6789/0 conn(0x7f7b28069ee0 legacy=0x7f7b2806e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:58.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.637+0000 7f7b2d19a700 1 -- 172.21.15.81:0/3119757209 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b280c74e0 con 0x7f7b28155bc0 2023-10-06T03:23:58.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.638+0000 7f7b2d19a700 1 --2- 172.21.15.81:0/3119757209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b28155bc0 0x7f7b28156c90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7b180098e0 tx=0x7f7b180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbd27d6c410973f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:58.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.638+0000 7f7b2c999700 1 -- 172.21.15.81:0/3119757209 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1800b640 con 0x7f7b28155bc0 2023-10-06T03:23:58.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.638+0000 7f7b2c999700 1 -- 172.21.15.81:0/3119757209 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b1800b7a0 con 0x7f7b28155bc0 2023-10-06T03:23:58.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.638+0000 7f7b2c999700 1 -- 172.21.15.81:0/3119757209 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1800bb40 con 0x7f7b28155bc0 2023-10-06T03:23:58.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.638+0000 7f7b2fbff700 1 -- 172.21.15.81:0/3119757209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b28155bc0 msgr2=0x7f7b28156c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:58.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.638+0000 7f7b2fbff700 1 --2- 172.21.15.81:0/3119757209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b28155bc0 0x7f7b28156c90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7b180098e0 tx=0x7f7b180091a0 comp rx=0 tx=0).stop 2023-10-06T03:23:58.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.639+0000 7f7b2fbff700 1 -- 172.21.15.81:0/3119757209 shutdown_connections 2023-10-06T03:23:58.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.639+0000 7f7b2fbff700 1 --2- 172.21.15.81:0/3119757209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b28155bc0 0x7f7b28156c90 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:58.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.639+0000 7f7b2fbff700 1 -- 172.21.15.81:0/3119757209 >> 172.21.15.81:0/3119757209 conn(0x7f7b280cc090 msgr2=0x7f7b280cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:58.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.639+0000 7f7b2fbff700 1 -- 172.21.15.81:0/3119757209 shutdown_connections 2023-10-06T03:23:58.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.639+0000 7f7b2fbff700 1 -- 172.21.15.81:0/3119757209 wait complete. 2023-10-06T03:23:58.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.640+0000 7f7b2fbff700 1 Processor -- start 2023-10-06T03:23:58.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.640+0000 7f7b2fbff700 1 -- start start 2023-10-06T03:23:58.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.641+0000 7f7b2fbff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b28069ee0 0x7f7b28148250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:58.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.641+0000 7f7b2fbff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b281557f0 0x7f7b2814ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:58.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.641+0000 7f7b2fbff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b28155bc0 0x7f7b280c5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:58.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.641+0000 7f7b2fbff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2806f640 con 0x7f7b281557f0 2023-10-06T03:23:58.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.641+0000 7f7b2fbff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2806ee70 con 0x7f7b28155bc0 2023-10-06T03:23:58.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.641+0000 7f7b2fbff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b28157a30 con 0x7f7b28069ee0 2023-10-06T03:23:58.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.641+0000 7f7b2d19a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b281557f0 0x7f7b2814ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:58.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.641+0000 7f7b2d19a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b281557f0 0x7f7b2814ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38764/0 (socket says 172.21.15.81:38764) 2023-10-06T03:23:58.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.641+0000 7f7b2d19a700 1 -- 172.21.15.81:0/3838595593 learned_addr learned my addr 172.21.15.81:0/3838595593 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:58.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.642+0000 7f7b2e19c700 1 --2- 172.21.15.81:0/3838595593 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b28155bc0 0x7f7b280c5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:58.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.642+0000 7f7b2d99b700 1 --2- 172.21.15.81:0/3838595593 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b28069ee0 0x7f7b28148250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:58.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.642+0000 7f7b2d19a700 1 -- 172.21.15.81:0/3838595593 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b28069ee0 msgr2=0x7f7b28148250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:58.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.642+0000 7f7b2d19a700 1 --2- 172.21.15.81:0/3838595593 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b28069ee0 0x7f7b28148250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:58.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.642+0000 7f7b2d19a700 1 -- 172.21.15.81:0/3838595593 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b28155bc0 msgr2=0x7f7b280c5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:58.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.642+0000 7f7b2d19a700 1 --2- 172.21.15.81:0/3838595593 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b28155bc0 0x7f7b280c5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:58.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.642+0000 7f7b2d19a700 1 -- 172.21.15.81:0/3838595593 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b18009420 con 0x7f7b281557f0 2023-10-06T03:23:58.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.642+0000 7f7b2d99b700 1 --2- 172.21.15.81:0/3838595593 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b28069ee0 0x7f7b28148250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:23:58.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.642+0000 7f7b2d19a700 1 --2- 172.21.15.81:0/3838595593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b281557f0 0x7f7b2814ba80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7b180093f0 tx=0x7f7b18017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:58.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.642+0000 7f7b1dffb700 1 -- 172.21.15.81:0/3838595593 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b18020070 con 0x7f7b281557f0 2023-10-06T03:23:58.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.642+0000 7f7b1dffb700 1 -- 172.21.15.81:0/3838595593 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b18000c90 con 0x7f7b281557f0 2023-10-06T03:23:58.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.642+0000 7f7b2fbff700 1 -- 172.21.15.81:0/3838595593 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b28148f40 con 0x7f7b281557f0 2023-10-06T03:23:58.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.642+0000 7f7b1dffb700 1 -- 172.21.15.81:0/3838595593 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b18026420 con 0x7f7b281557f0 2023-10-06T03:23:58.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.643+0000 7f7b2fbff700 1 -- 172.21.15.81:0/3838595593 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b2806f360 con 0x7f7b281557f0 2023-10-06T03:23:58.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.644+0000 7f7b2fbff700 1 -- 172.21.15.81:0/3838595593 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b2804c3c0 con 0x7f7b281557f0 2023-10-06T03:23:58.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.644+0000 7f7b1dffb700 1 -- 172.21.15.81:0/3838595593 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7b18024070 con 0x7f7b281557f0 2023-10-06T03:23:58.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.645+0000 7f7b1dffb700 1 --2- 172.21.15.81:0/3838595593 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7b0c066f30 0x7f7b0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:58.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.645+0000 7f7b1dffb700 1 -- 172.21.15.81:0/3838595593 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f7b18085ef0 con 0x7f7b281557f0 2023-10-06T03:23:58.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.645+0000 7f7b2d99b700 1 --2- 172.21.15.81:0/3838595593 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7b0c066f30 0x7f7b0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:58.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.646+0000 7f7b2d99b700 1 --2- 172.21.15.81:0/3838595593 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7b0c066f30 0x7f7b0c0693e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7b28164980 tx=0x7f7b24009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:58.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.649+0000 7f7b1dffb700 1 -- 172.21.15.81:0/3838595593 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7b18052c70 con 0x7f7b281557f0 2023-10-06T03:23:58.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.896+0000 7f7b2fbff700 1 -- 172.21.15.81:0/3838595593 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f7b28157b70 con 0x7f7b281557f0 2023-10-06T03:23:58.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.899+0000 7f7b1dffb700 1 -- 172.21.15.81:0/3838595593 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+163698 (secure 0 0 0) 0x7f7b1802b090 con 0x7f7b281557f0 2023-10-06T03:23:58.903 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:23:58.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.903+0000 7f7b2fbff700 1 -- 172.21.15.81:0/3838595593 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7b0c066f30 msgr2=0x7f7b0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:58.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.903+0000 7f7b2fbff700 1 --2- 172.21.15.81:0/3838595593 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7b0c066f30 0x7f7b0c0693e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7b28164980 tx=0x7f7b24009040 comp rx=0 tx=0).stop 2023-10-06T03:23:58.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.903+0000 7f7b2fbff700 1 -- 172.21.15.81:0/3838595593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b281557f0 msgr2=0x7f7b2814ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:58.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.903+0000 7f7b2fbff700 1 --2- 172.21.15.81:0/3838595593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b281557f0 0x7f7b2814ba80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7b180093f0 tx=0x7f7b18017000 comp rx=0 tx=0).stop 2023-10-06T03:23:58.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.903+0000 7f7b2fbff700 1 -- 172.21.15.81:0/3838595593 shutdown_connections 2023-10-06T03:23:58.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.903+0000 7f7b2fbff700 1 --2- 172.21.15.81:0/3838595593 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b28155bc0 0x7f7b280c5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:58.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.903+0000 7f7b2fbff700 1 --2- 172.21.15.81:0/3838595593 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7b0c066f30 0x7f7b0c0693e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:58.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.903+0000 7f7b2fbff700 1 --2- 172.21.15.81:0/3838595593 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b28069ee0 0x7f7b28148250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:58.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.903+0000 7f7b2fbff700 1 --2- 172.21.15.81:0/3838595593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b281557f0 0x7f7b2814ba80 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:58.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.903+0000 7f7b2fbff700 1 -- 172.21.15.81:0/3838595593 >> 172.21.15.81:0/3838595593 conn(0x7f7b280cc090 msgr2=0x7f7b280c1180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:58.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.903+0000 7f7b2fbff700 1 -- 172.21.15.81:0/3838595593 shutdown_connections 2023-10-06T03:23:58.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:58.903+0000 7f7b2fbff700 1 -- 172.21.15.81:0/3838595593 wait complete. 2023-10-06T03:23:58.922 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":5,"active_gid":4100,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":85286},{"type":"v1","addr":"172.21.15.81:6833","nonce":85286}]},"active_addr":"172.21.15.81:6833/85286","active_change":"2023-10-06T03:23:27.541293+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4106,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":2765303407}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":2920531758}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":2079786857}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":765028321}]}]} 2023-10-06T03:23:58.926 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-06T03:23:58.926 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-06T03:23:58.926 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:23:59.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.105+0000 7f69eeb9d700 1 Processor -- start 2023-10-06T03:23:59.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.105+0000 7f69eeb9d700 1 -- start start 2023-10-06T03:23:59.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.106+0000 7f69eeb9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f69e80b2430 0x7f69e815ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:59.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.106+0000 7f69eeb9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f69e815ca90 0x7f69e815b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:59.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.106+0000 7f69eeb9d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69e8150970 con 0x7f69e815a4b0 2023-10-06T03:23:59.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.106+0000 7f69eeb9d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69e815c600 con 0x7f69e80b2430 2023-10-06T03:23:59.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.106+0000 7f69eeb9d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e815b9f0 con 0x7f69e815ca90 2023-10-06T03:23:59.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.106+0000 7f69ed39a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f69e80b2430 0x7f69e815ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:59.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.106+0000 7f69ed39a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f69e80b2430 0x7f69e815ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38778/0 (socket says 172.21.15.81:38778) 2023-10-06T03:23:59.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.106+0000 7f69ed39a700 1 -- 172.21.15.81:0/2005222008 learned_addr learned my addr 172.21.15.81:0/2005222008 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:59.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.107+0000 7f69ee39c700 1 --2- 172.21.15.81:0/2005222008 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f69e815ca90 0x7f69e815b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:59.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.107+0000 7f69ed39a700 1 -- 172.21.15.81:0/2005222008 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f69e815ca90 msgr2=0x7f69e815b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:23:59.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.107+0000 7f69ed39a700 1 --2- 172.21.15.81:0/2005222008 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f69e815ca90 0x7f69e815b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:59.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.107+0000 7f69ed39a700 1 -- 172.21.15.81:0/2005222008 >> v1:172.21.15.83:6789/0 conn(0x7f69e815a4b0 legacy=0x7f69e80b1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:59.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.107+0000 7f69ed39a700 1 -- 172.21.15.81:0/2005222008 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e815bcd0 con 0x7f69e80b2430 2023-10-06T03:23:59.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.107+0000 7f69ee39c700 1 --2- 172.21.15.81:0/2005222008 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f69e815ca90 0x7f69e815b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:23:59.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.107+0000 7f69ed39a700 1 --2- 172.21.15.81:0/2005222008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69e80b2430 0x7f69e815ac70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f69d80099b0 tx=0x7f69d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a40a5ed0b986cf39 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:59.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.107+0000 7f69ecb99700 1 -- 172.21.15.81:0/2005222008 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d800b860 con 0x7f69e80b2430 2023-10-06T03:23:59.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.107+0000 7f69ecb99700 1 -- 172.21.15.81:0/2005222008 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d800b9c0 con 0x7f69e80b2430 2023-10-06T03:23:59.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.107+0000 7f69ecb99700 1 -- 172.21.15.81:0/2005222008 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d800bd60 con 0x7f69e80b2430 2023-10-06T03:23:59.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.108+0000 7f69eeb9d700 1 -- 172.21.15.81:0/2005222008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69e80b2430 msgr2=0x7f69e815ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:59.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.108+0000 7f69eeb9d700 1 --2- 172.21.15.81:0/2005222008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69e80b2430 0x7f69e815ac70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f69d80099b0 tx=0x7f69d8009250 comp rx=0 tx=0).stop 2023-10-06T03:23:59.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.108+0000 7f69eeb9d700 1 -- 172.21.15.81:0/2005222008 shutdown_connections 2023-10-06T03:23:59.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.108+0000 7f69eeb9d700 1 --2- 172.21.15.81:0/2005222008 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f69e815ca90 0x7f69e815b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:59.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.108+0000 7f69eeb9d700 1 --2- 172.21.15.81:0/2005222008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69e80b2430 0x7f69e815ac70 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:59.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.108+0000 7f69eeb9d700 1 -- 172.21.15.81:0/2005222008 >> 172.21.15.81:0/2005222008 conn(0x7f69e806ed10 msgr2=0x7f69e806f110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:59.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.108+0000 7f69eeb9d700 1 -- 172.21.15.81:0/2005222008 shutdown_connections 2023-10-06T03:23:59.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.108+0000 7f69eeb9d700 1 -- 172.21.15.81:0/2005222008 wait complete. 2023-10-06T03:23:59.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.109+0000 7f69eeb9d700 1 Processor -- start 2023-10-06T03:23:59.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.110+0000 7f69eeb9d700 1 -- start start 2023-10-06T03:23:59.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.110+0000 7f69eeb9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f69e80b2430 0x7f69e81531c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:59.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.110+0000 7f69eeb9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69e815a4b0 0x7f69e8155640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:59.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.110+0000 7f69eeb9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69e815ca90 0x7f69e8155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:59.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.110+0000 7f69eeb9d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e816a120 con 0x7f69e815ca90 2023-10-06T03:23:59.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.110+0000 7f69eeb9d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e8156200 con 0x7f69e815a4b0 2023-10-06T03:23:59.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.110+0000 7f69eeb9d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e81564e0 con 0x7f69e80b2430 2023-10-06T03:23:59.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.111+0000 7f69ee39c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69e815ca90 0x7f69e8155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:59.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.111+0000 7f69ee39c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69e815ca90 0x7f69e8155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38794/0 (socket says 172.21.15.81:38794) 2023-10-06T03:23:59.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.111+0000 7f69ee39c700 1 -- 172.21.15.81:0/200428224 learned_addr learned my addr 172.21.15.81:0/200428224 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:59.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.111+0000 7f69ed39a700 1 --2- 172.21.15.81:0/200428224 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69e815a4b0 0x7f69e8155640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:59.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.111+0000 7f69edb9b700 1 --2- 172.21.15.81:0/200428224 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f69e80b2430 0x7f69e81531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:59.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.111+0000 7f69ee39c700 1 -- 172.21.15.81:0/200428224 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f69e80b2430 msgr2=0x7f69e81531c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:59.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.111+0000 7f69ee39c700 1 --2- 172.21.15.81:0/200428224 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f69e80b2430 0x7f69e81531c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:59.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.111+0000 7f69ee39c700 1 -- 172.21.15.81:0/200428224 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69e815a4b0 msgr2=0x7f69e8155640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:59.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.111+0000 7f69ee39c700 1 --2- 172.21.15.81:0/200428224 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69e815a4b0 0x7f69e8155640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:59.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.111+0000 7f69ee39c700 1 -- 172.21.15.81:0/200428224 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d80094f0 con 0x7f69e815ca90 2023-10-06T03:23:59.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.111+0000 7f69edb9b700 1 --2- 172.21.15.81:0/200428224 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f69e80b2430 0x7f69e81531c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:23:59.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.111+0000 7f69ee39c700 1 --2- 172.21.15.81:0/200428224 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69e815ca90 0x7f69e8155b80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f69e0009fc0 tx=0x7f69e00099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:59.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.112+0000 7f69ddffb700 1 -- 172.21.15.81:0/200428224 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e000dc90 con 0x7f69e815ca90 2023-10-06T03:23:59.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.112+0000 7f69ddffb700 1 -- 172.21.15.81:0/200428224 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e000f040 con 0x7f69e815ca90 2023-10-06T03:23:59.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.112+0000 7f69eeb9d700 1 -- 172.21.15.81:0/200428224 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69e81567c0 con 0x7f69e815ca90 2023-10-06T03:23:59.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.112+0000 7f69ddffb700 1 -- 172.21.15.81:0/200428224 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e0015690 con 0x7f69e815ca90 2023-10-06T03:23:59.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.112+0000 7f69eeb9d700 1 -- 172.21.15.81:0/200428224 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69e8156d80 con 0x7f69e815ca90 2023-10-06T03:23:59.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.113+0000 7f69eeb9d700 1 -- 172.21.15.81:0/200428224 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69e80b3b20 con 0x7f69e815ca90 2023-10-06T03:23:59.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.114+0000 7f69ddffb700 1 -- 172.21.15.81:0/200428224 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f69e001e3b0 con 0x7f69e815ca90 2023-10-06T03:23:59.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.114+0000 7f69ddffb700 1 --2- 172.21.15.81:0/200428224 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f69cc066f30 0x7f69cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:59.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.114+0000 7f69ddffb700 1 -- 172.21.15.81:0/200428224 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f69e0084ee0 con 0x7f69e815ca90 2023-10-06T03:23:59.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.115+0000 7f69edb9b700 1 --2- 172.21.15.81:0/200428224 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f69cc066f30 0x7f69cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:59.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.115+0000 7f69edb9b700 1 --2- 172.21.15.81:0/200428224 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f69cc066f30 0x7f69cc0693e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f69e4007fd0 tx=0x7f69e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:59.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.119+0000 7f69ddffb700 1 -- 172.21.15.81:0/200428224 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f69e0051c60 con 0x7f69e815ca90 2023-10-06T03:23:59.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.318+0000 7f69eeb9d700 1 -- 172.21.15.81:0/200428224 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f69e815bfb0 con 0x7f69e815ca90 2023-10-06T03:23:59.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.319+0000 7f69ddffb700 1 -- 172.21.15.81:0/200428224 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18659 (secure 0 0 0) 0x7f69e001a090 con 0x7f69e815ca90 2023-10-06T03:23:59.321 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:23:59.321 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"fsid":"1807b5d7-9be8-43ad-aaf8-99a4273430b3","created":"2023-10-06T03:23:20.805306+0000","modified":"2023-10-06T03:23:45.419616+0000","last_up_change":"2023-10-06T03:23:32.735796+0000","last_in_change":"2023-10-06T03:23:24.109024+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:33.198850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:33.606744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:23:38.742266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:23:39.347944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:23:42.959054+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"14fb667d-a677-4978-a477-80027f889d36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":85563},{"type":"v1","addr":"172.21.15.81:6818","nonce":85563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":85563},{"type":"v1","addr":"172.21.15.81:6822","nonce":85563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":85563},{"type":"v1","addr":"172.21.15.81:6830","nonce":85563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":85563},{"type":"v1","addr":"172.21.15.81:6826","nonce":85563}]},"public_addr":"172.21.15.81:6818/85563","cluster_addr":"172.21.15.81:6822/85563","heartbeat_back_addr":"172.21.15.81:6830/85563","heartbeat_front_addr":"172.21.15.81:6826/85563","state":["exists","up"]},{"osd":1,"uuid":"974d8a86-1829-4176-89ce-18e6038857f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":85561},{"type":"v1","addr":"172.21.15.81:6801","nonce":85561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":85561},{"type":"v1","addr":"172.21.15.81:6803","nonce":85561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":85561},{"type":"v1","addr":"172.21.15.81:6807","nonce":85561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":85561},{"type":"v1","addr":"172.21.15.81:6805","nonce":85561}]},"public_addr":"172.21.15.81:6801/85561","cluster_addr":"172.21.15.81:6803/85561","heartbeat_back_addr":"172.21.15.81:6807/85561","heartbeat_front_addr":"172.21.15.81:6805/85561","state":["exists","up"]},{"osd":2,"uuid":"ffbfe056-46bc-46e0-bf49-4d8f8650e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":85564},{"type":"v1","addr":"172.21.15.81:6809","nonce":85564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":85564},{"type":"v1","addr":"172.21.15.81:6811","nonce":85564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":85564},{"type":"v1","addr":"172.21.15.81:6815","nonce":85564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":85564},{"type":"v1","addr":"172.21.15.81:6813","nonce":85564}]},"public_addr":"172.21.15.81:6809/85564","cluster_addr":"172.21.15.81:6811/85564","heartbeat_back_addr":"172.21.15.81:6815/85564","heartbeat_front_addr":"172.21.15.81:6813/85564","state":["exists","up"]},{"osd":3,"uuid":"ef9a8314-3d37-4ea1-858a-e704d5695002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":85562},{"type":"v1","addr":"172.21.15.81:6819","nonce":85562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":85562},{"type":"v1","addr":"172.21.15.81:6823","nonce":85562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":85562},{"type":"v1","addr":"172.21.15.81:6831","nonce":85562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":85562},{"type":"v1","addr":"172.21.15.81:6827","nonce":85562}]},"public_addr":"172.21.15.81:6819/85562","cluster_addr":"172.21.15.81:6823/85562","heartbeat_back_addr":"172.21.15.81:6831/85562","heartbeat_front_addr":"172.21.15.81:6827/85562","state":["exists","up"]},{"osd":4,"uuid":"d83506a0-2c96-4bcb-a9fa-05e43dc329df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":85785},{"type":"v1","addr":"172.21.15.83:6801","nonce":85785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":85785},{"type":"v1","addr":"172.21.15.83:6803","nonce":85785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":85785},{"type":"v1","addr":"172.21.15.83:6807","nonce":85785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":85785},{"type":"v1","addr":"172.21.15.83:6805","nonce":85785}]},"public_addr":"172.21.15.83:6801/85785","cluster_addr":"172.21.15.83:6803/85785","heartbeat_back_addr":"172.21.15.83:6807/85785","heartbeat_front_addr":"172.21.15.83:6805/85785","state":["exists","up"]},{"osd":5,"uuid":"10687c63-a3d5-472f-acc0-4f61847b6e0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":85818},{"type":"v1","addr":"172.21.15.83:6825","nonce":85818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":85818},{"type":"v1","addr":"172.21.15.83:6827","nonce":85818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":85818},{"type":"v1","addr":"172.21.15.83:6831","nonce":85818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":85818},{"type":"v1","addr":"172.21.15.83:6829","nonce":85818}]},"public_addr":"172.21.15.83:6825/85818","cluster_addr":"172.21.15.83:6827/85818","heartbeat_back_addr":"172.21.15.83:6831/85818","heartbeat_front_addr":"172.21.15.83:6829/85818","state":["exists","up"]},{"osd":6,"uuid":"2e9daf76-5607-4a29-9a58-6e270700d223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":85787},{"type":"v1","addr":"172.21.15.83:6811","nonce":85787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":85787},{"type":"v1","addr":"172.21.15.83:6815","nonce":85787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":85787},{"type":"v1","addr":"172.21.15.83:6823","nonce":85787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6817","nonce":85787},{"type":"v1","addr":"172.21.15.83:6819","nonce":85787}]},"public_addr":"172.21.15.83:6811/85787","cluster_addr":"172.21.15.83:6815/85787","heartbeat_back_addr":"172.21.15.83:6823/85787","heartbeat_front_addr":"172.21.15.83:6819/85787","state":["exists","up"]},{"osd":7,"uuid":"5019e1ff-233a-4a5a-91ca-8afccb7ab6e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":85786},{"type":"v1","addr":"172.21.15.83:6810","nonce":85786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":85786},{"type":"v1","addr":"172.21.15.83:6814","nonce":85786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":85786},{"type":"v1","addr":"172.21.15.83:6822","nonce":85786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":85786},{"type":"v1","addr":"172.21.15.83:6818","nonce":85786}]},"public_addr":"172.21.15.83:6810/85786","cluster_addr":"172.21.15.83:6814/85786","heartbeat_back_addr":"172.21.15.83:6822/85786","heartbeat_front_addr":"172.21.15.83:6818/85786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.393431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.360031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.407428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.391613+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.403211+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.438142+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.496181+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.472323+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:23:59.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.321+0000 7f69eeb9d700 1 -- 172.21.15.81:0/200428224 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f69cc066f30 msgr2=0x7f69cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:59.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.321+0000 7f69eeb9d700 1 --2- 172.21.15.81:0/200428224 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f69cc066f30 0x7f69cc0693e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f69e4007fd0 tx=0x7f69e4009040 comp rx=0 tx=0).stop 2023-10-06T03:23:59.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.321+0000 7f69eeb9d700 1 -- 172.21.15.81:0/200428224 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69e815ca90 msgr2=0x7f69e8155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:59.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.321+0000 7f69eeb9d700 1 --2- 172.21.15.81:0/200428224 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69e815ca90 0x7f69e8155b80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f69e0009fc0 tx=0x7f69e00099b0 comp rx=0 tx=0).stop 2023-10-06T03:23:59.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.321+0000 7f69eeb9d700 1 -- 172.21.15.81:0/200428224 shutdown_connections 2023-10-06T03:23:59.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.321+0000 7f69eeb9d700 1 --2- 172.21.15.81:0/200428224 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69e815ca90 0x7f69e8155b80 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:59.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.321+0000 7f69eeb9d700 1 --2- 172.21.15.81:0/200428224 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f69cc066f30 0x7f69cc0693e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:59.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.321+0000 7f69eeb9d700 1 --2- 172.21.15.81:0/200428224 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f69e80b2430 0x7f69e81531c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:59.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.321+0000 7f69eeb9d700 1 --2- 172.21.15.81:0/200428224 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69e815a4b0 0x7f69e8155640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:59.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.321+0000 7f69eeb9d700 1 -- 172.21.15.81:0/200428224 >> 172.21.15.81:0/200428224 conn(0x7f69e806ed10 msgr2=0x7f69e80d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:59.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.321+0000 7f69eeb9d700 1 -- 172.21.15.81:0/200428224 shutdown_connections 2023-10-06T03:23:59.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.321+0000 7f69eeb9d700 1 -- 172.21.15.81:0/200428224 wait complete. 2023-10-06T03:23:59.342 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-06T03:23:59.342 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:23:59.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.520+0000 7facd7dff700 1 Processor -- start 2023-10-06T03:23:59.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.520+0000 7facd7dff700 1 -- start start 2023-10-06T03:23:59.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.521+0000 7facd7dff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7facd01557f0 0x7facd0156c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:59.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.522+0000 7facd7dff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facd00c9c60 con 0x7facd0155bc0 2023-10-06T03:23:59.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.522+0000 7facd7dff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facd006dc60 con 0x7facd0069ee0 2023-10-06T03:23:59.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.522+0000 7facd7dff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facd006df20 con 0x7facd01557f0 2023-10-06T03:23:59.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.522+0000 7facd5b9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7facd01557f0 0x7facd0156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:59.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.522+0000 7facd539a700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7facd0155bc0 0x7facd00c6cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52932/0 (socket says 172.21.15.81:52932) 2023-10-06T03:23:59.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.522+0000 7facd539a700 1 -- 172.21.15.81:0/2205330588 learned_addr learned my addr 172.21.15.81:0/2205330588 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:23:59.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.522+0000 7facd5b9b700 1 -- 172.21.15.81:0/2205330588 >> v1:172.21.15.83:6789/0 conn(0x7facd0069ee0 legacy=0x7facd006e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:59.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.522+0000 7facd5b9b700 1 -- 172.21.15.81:0/2205330588 >> v1:172.21.15.81:6789/0 conn(0x7facd0155bc0 legacy=0x7facd00c6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:59.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.522+0000 7facd5b9b700 1 -- 172.21.15.81:0/2205330588 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd00c74e0 con 0x7facd01557f0 2023-10-06T03:23:59.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.522+0000 7facd4b99700 1 -- 172.21.15.81:0/2205330588 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 543642352 0 0) 0x7facd00c9c60 con 0x7facd0155bc0 2023-10-06T03:23:59.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.523+0000 7facd5b9b700 1 --2- 172.21.15.81:0/2205330588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facd01557f0 0x7facd0156c90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7faccc00bb90 tx=0x7faccc00b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee17a190ea85ad46 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:59.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.523+0000 7facd4b99700 1 -- 172.21.15.81:0/2205330588 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faccc00dba0 con 0x7facd01557f0 2023-10-06T03:23:59.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.523+0000 7facd4b99700 1 -- 172.21.15.81:0/2205330588 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faccc00dd00 con 0x7facd01557f0 2023-10-06T03:23:59.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.523+0000 7facd4b99700 1 -- 172.21.15.81:0/2205330588 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faccc0196b0 con 0x7facd01557f0 2023-10-06T03:23:59.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.523+0000 7facd7dff700 1 -- 172.21.15.81:0/2205330588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facd01557f0 msgr2=0x7facd0156c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:59.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.523+0000 7facd7dff700 1 --2- 172.21.15.81:0/2205330588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facd01557f0 0x7facd0156c90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7faccc00bb90 tx=0x7faccc00b430 comp rx=0 tx=0).stop 2023-10-06T03:23:59.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.523+0000 7facd7dff700 1 -- 172.21.15.81:0/2205330588 shutdown_connections 2023-10-06T03:23:59.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.523+0000 7facd7dff700 1 --2- 172.21.15.81:0/2205330588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facd01557f0 0x7facd0156c90 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:59.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.523+0000 7facd7dff700 1 -- 172.21.15.81:0/2205330588 >> 172.21.15.81:0/2205330588 conn(0x7facd00cc090 msgr2=0x7facd00cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:59.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.523+0000 7facd7dff700 1 -- 172.21.15.81:0/2205330588 shutdown_connections 2023-10-06T03:23:59.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.523+0000 7facd7dff700 1 -- 172.21.15.81:0/2205330588 wait complete. 2023-10-06T03:23:59.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.525+0000 7facd7dff700 1 Processor -- start 2023-10-06T03:23:59.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.525+0000 7facd7dff700 1 -- start start 2023-10-06T03:23:59.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.526+0000 7facd7dff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facd0069ee0 0x7facd0146a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:59.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.526+0000 7facd7dff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facd01557f0 0x7facd00b0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:59.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.526+0000 7facd7dff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7facd0155bc0 0x7facd00b14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:59.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.526+0000 7facd7dff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd00c5120 con 0x7facd01557f0 2023-10-06T03:23:59.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.526+0000 7facd7dff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd015cf90 con 0x7facd0069ee0 2023-10-06T03:23:59.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.526+0000 7facd7dff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facd015d270 con 0x7facd0155bc0 2023-10-06T03:23:59.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.526+0000 7facd539a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facd01557f0 0x7facd00b0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:59.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.526+0000 7facd539a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facd01557f0 0x7facd00b0f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38816/0 (socket says 172.21.15.81:38816) 2023-10-06T03:23:59.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.526+0000 7facd539a700 1 -- 172.21.15.81:0/4254361472 learned_addr learned my addr 172.21.15.81:0/4254361472 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:23:59.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.526+0000 7facd5b9b700 1 --2- 172.21.15.81:0/4254361472 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facd0069ee0 0x7facd0146a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:59.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.526+0000 7facd639c700 1 --2- 172.21.15.81:0/4254361472 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7facd0155bc0 0x7facd00b14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:59.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.527+0000 7facd539a700 1 -- 172.21.15.81:0/4254361472 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7facd0155bc0 msgr2=0x7facd00b14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:59.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.527+0000 7facd539a700 1 --2- 172.21.15.81:0/4254361472 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7facd0155bc0 0x7facd00b14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:59.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.527+0000 7facd539a700 1 -- 172.21.15.81:0/4254361472 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facd0069ee0 msgr2=0x7facd0146a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:59.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.527+0000 7facd539a700 1 --2- 172.21.15.81:0/4254361472 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facd0069ee0 0x7facd0146a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:59.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.527+0000 7facd539a700 1 -- 172.21.15.81:0/4254361472 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faccc00b6d0 con 0x7facd01557f0 2023-10-06T03:23:59.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.527+0000 7facd539a700 1 --2- 172.21.15.81:0/4254361472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facd01557f0 0x7facd00b0f80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7facc000c810 tx=0x7facc0007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:59.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.527+0000 7facc5ffb700 1 -- 172.21.15.81:0/4254361472 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc0005c00 con 0x7facd01557f0 2023-10-06T03:23:59.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.527+0000 7facc5ffb700 1 -- 172.21.15.81:0/4254361472 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc0005d60 con 0x7facd01557f0 2023-10-06T03:23:59.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.527+0000 7facd7dff700 1 -- 172.21.15.81:0/4254361472 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facd00c4ad0 con 0x7facd01557f0 2023-10-06T03:23:59.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.527+0000 7facc5ffb700 1 -- 172.21.15.81:0/4254361472 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc0007320 con 0x7facd01557f0 2023-10-06T03:23:59.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.527+0000 7facd7dff700 1 -- 172.21.15.81:0/4254361472 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facd0146f70 con 0x7facd01557f0 2023-10-06T03:23:59.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.528+0000 7facd7dff700 1 -- 172.21.15.81:0/4254361472 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facd004c3c0 con 0x7facd01557f0 2023-10-06T03:23:59.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.529+0000 7facc5ffb700 1 -- 172.21.15.81:0/4254361472 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7facc001b3b0 con 0x7facd01557f0 2023-10-06T03:23:59.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.530+0000 7facc5ffb700 1 --2- 172.21.15.81:0/4254361472 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7facb4066f30 0x7facb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:23:59.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.530+0000 7facc5ffb700 1 -- 172.21.15.81:0/4254361472 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7facc0083f50 con 0x7facd01557f0 2023-10-06T03:23:59.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.530+0000 7facd5b9b700 1 --2- 172.21.15.81:0/4254361472 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7facb4066f30 0x7facb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:23:59.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.531+0000 7facd5b9b700 1 --2- 172.21.15.81:0/4254361472 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7facb4066f30 0x7facb40693e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7faccc00b6a0 tx=0x7faccc01b000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:23:59.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.534+0000 7facc5ffb700 1 -- 172.21.15.81:0/4254361472 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7facc0050cd0 con 0x7facd01557f0 2023-10-06T03:23:59.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.732+0000 7facd7dff700 1 -- 172.21.15.81:0/4254361472 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7facd00c5260 con 0x7facd01557f0 2023-10-06T03:23:59.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.733+0000 7facc5ffb700 1 -- 172.21.15.81:0/4254361472 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18659 (secure 0 0 0) 0x7facc0017020 con 0x7facd01557f0 2023-10-06T03:23:59.736 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:23:59.736 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"fsid":"1807b5d7-9be8-43ad-aaf8-99a4273430b3","created":"2023-10-06T03:23:20.805306+0000","modified":"2023-10-06T03:23:45.419616+0000","last_up_change":"2023-10-06T03:23:32.735796+0000","last_in_change":"2023-10-06T03:23:24.109024+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:33.198850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:33.606744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:23:38.742266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:23:39.347944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:23:42.959054+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"14fb667d-a677-4978-a477-80027f889d36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":85563},{"type":"v1","addr":"172.21.15.81:6818","nonce":85563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":85563},{"type":"v1","addr":"172.21.15.81:6822","nonce":85563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":85563},{"type":"v1","addr":"172.21.15.81:6830","nonce":85563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":85563},{"type":"v1","addr":"172.21.15.81:6826","nonce":85563}]},"public_addr":"172.21.15.81:6818/85563","cluster_addr":"172.21.15.81:6822/85563","heartbeat_back_addr":"172.21.15.81:6830/85563","heartbeat_front_addr":"172.21.15.81:6826/85563","state":["exists","up"]},{"osd":1,"uuid":"974d8a86-1829-4176-89ce-18e6038857f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":85561},{"type":"v1","addr":"172.21.15.81:6801","nonce":85561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":85561},{"type":"v1","addr":"172.21.15.81:6803","nonce":85561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":85561},{"type":"v1","addr":"172.21.15.81:6807","nonce":85561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":85561},{"type":"v1","addr":"172.21.15.81:6805","nonce":85561}]},"public_addr":"172.21.15.81:6801/85561","cluster_addr":"172.21.15.81:6803/85561","heartbeat_back_addr":"172.21.15.81:6807/85561","heartbeat_front_addr":"172.21.15.81:6805/85561","state":["exists","up"]},{"osd":2,"uuid":"ffbfe056-46bc-46e0-bf49-4d8f8650e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":85564},{"type":"v1","addr":"172.21.15.81:6809","nonce":85564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":85564},{"type":"v1","addr":"172.21.15.81:6811","nonce":85564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":85564},{"type":"v1","addr":"172.21.15.81:6815","nonce":85564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":85564},{"type":"v1","addr":"172.21.15.81:6813","nonce":85564}]},"public_addr":"172.21.15.81:6809/85564","cluster_addr":"172.21.15.81:6811/85564","heartbeat_back_addr":"172.21.15.81:6815/85564","heartbeat_front_addr":"172.21.15.81:6813/85564","state":["exists","up"]},{"osd":3,"uuid":"ef9a8314-3d37-4ea1-858a-e704d5695002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":85562},{"type":"v1","addr":"172.21.15.81:6819","nonce":85562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":85562},{"type":"v1","addr":"172.21.15.81:6823","nonce":85562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":85562},{"type":"v1","addr":"172.21.15.81:6831","nonce":85562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":85562},{"type":"v1","addr":"172.21.15.81:6827","nonce":85562}]},"public_addr":"172.21.15.81:6819/85562","cluster_addr":"172.21.15.81:6823/85562","heartbeat_back_addr":"172.21.15.81:6831/85562","heartbeat_front_addr":"172.21.15.81:6827/85562","state":["exists","up"]},{"osd":4,"uuid":"d83506a0-2c96-4bcb-a9fa-05e43dc329df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":85785},{"type":"v1","addr":"172.21.15.83:6801","nonce":85785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":85785},{"type":"v1","addr":"172.21.15.83:6803","nonce":85785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":85785},{"type":"v1","addr":"172.21.15.83:6807","nonce":85785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":85785},{"type":"v1","addr":"172.21.15.83:6805","nonce":85785}]},"public_addr":"172.21.15.83:6801/85785","cluster_addr":"172.21.15.83:6803/85785","heartbeat_back_addr":"172.21.15.83:6807/85785","heartbeat_front_addr":"172.21.15.83:6805/85785","state":["exists","up"]},{"osd":5,"uuid":"10687c63-a3d5-472f-acc0-4f61847b6e0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":85818},{"type":"v1","addr":"172.21.15.83:6825","nonce":85818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":85818},{"type":"v1","addr":"172.21.15.83:6827","nonce":85818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":85818},{"type":"v1","addr":"172.21.15.83:6831","nonce":85818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":85818},{"type":"v1","addr":"172.21.15.83:6829","nonce":85818}]},"public_addr":"172.21.15.83:6825/85818","cluster_addr":"172.21.15.83:6827/85818","heartbeat_back_addr":"172.21.15.83:6831/85818","heartbeat_front_addr":"172.21.15.83:6829/85818","state":["exists","up"]},{"osd":6,"uuid":"2e9daf76-5607-4a29-9a58-6e270700d223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":85787},{"type":"v1","addr":"172.21.15.83:6811","nonce":85787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":85787},{"type":"v1","addr":"172.21.15.83:6815","nonce":85787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":85787},{"type":"v1","addr":"172.21.15.83:6823","nonce":85787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6817","nonce":85787},{"type":"v1","addr":"172.21.15.83:6819","nonce":85787}]},"public_addr":"172.21.15.83:6811/85787","cluster_addr":"172.21.15.83:6815/85787","heartbeat_back_addr":"172.21.15.83:6823/85787","heartbeat_front_addr":"172.21.15.83:6819/85787","state":["exists","up"]},{"osd":7,"uuid":"5019e1ff-233a-4a5a-91ca-8afccb7ab6e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":85786},{"type":"v1","addr":"172.21.15.83:6810","nonce":85786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":85786},{"type":"v1","addr":"172.21.15.83:6814","nonce":85786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":85786},{"type":"v1","addr":"172.21.15.83:6822","nonce":85786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":85786},{"type":"v1","addr":"172.21.15.83:6818","nonce":85786}]},"public_addr":"172.21.15.83:6810/85786","cluster_addr":"172.21.15.83:6814/85786","heartbeat_back_addr":"172.21.15.83:6822/85786","heartbeat_front_addr":"172.21.15.83:6818/85786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.393431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.360031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.407428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.391613+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.403211+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.438142+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.496181+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.472323+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:23:59.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.736+0000 7facd7dff700 1 -- 172.21.15.81:0/4254361472 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7facb4066f30 msgr2=0x7facb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:59.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.736+0000 7facd7dff700 1 --2- 172.21.15.81:0/4254361472 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7facb4066f30 0x7facb40693e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7faccc00b6a0 tx=0x7faccc01b000 comp rx=0 tx=0).stop 2023-10-06T03:23:59.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.736+0000 7facd7dff700 1 -- 172.21.15.81:0/4254361472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facd01557f0 msgr2=0x7facd00b0f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:23:59.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.736+0000 7facd7dff700 1 --2- 172.21.15.81:0/4254361472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facd01557f0 0x7facd00b0f80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7facc000c810 tx=0x7facc0007d90 comp rx=0 tx=0).stop 2023-10-06T03:23:59.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.736+0000 7facd7dff700 1 -- 172.21.15.81:0/4254361472 shutdown_connections 2023-10-06T03:23:59.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.736+0000 7facd7dff700 1 --2- 172.21.15.81:0/4254361472 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7facb4066f30 0x7facb40693e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:59.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.736+0000 7facd7dff700 1 --2- 172.21.15.81:0/4254361472 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7facd0155bc0 0x7facd00b14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:59.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.736+0000 7facd7dff700 1 --2- 172.21.15.81:0/4254361472 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facd0069ee0 0x7facd0146a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:59.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.736+0000 7facd7dff700 1 --2- 172.21.15.81:0/4254361472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facd01557f0 0x7facd00b0f80 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:23:59.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.736+0000 7facd7dff700 1 -- 172.21.15.81:0/4254361472 >> 172.21.15.81:0/4254361472 conn(0x7facd00cc090 msgr2=0x7facd00c9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:23:59.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.736+0000 7facd7dff700 1 -- 172.21.15.81:0/4254361472 shutdown_connections 2023-10-06T03:23:59.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:23:59.736+0000 7facd7dff700 1 -- 172.21.15.81:0/4254361472 wait complete. 2023-10-06T03:23:59.757 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-06T03:23:59.757 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-06T03:23:59.758 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-06T03:23:59.758 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-06T03:23:59.758 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-06T03:23:59.759 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-06T03:23:59.759 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-06T03:23:59.760 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-06T03:24:00.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.084+0000 7f276f59e700 1 Processor -- start 2023-10-06T03:24:00.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.084+0000 7f276f59e700 1 -- start start 2023-10-06T03:24:00.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.086+0000 7f276f59e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f27680504d0 0x7f27680e17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.086+0000 7f276f59e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2768050940 0x7f27680e1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.086+0000 7f276f59e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f276804fe50 con 0x7f2768035330 2023-10-06T03:24:00.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.086+0000 7f276f59e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2768035700 con 0x7f27680504d0 2023-10-06T03:24:00.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.086+0000 7f276f59e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2768006620 con 0x7f2768050940 2023-10-06T03:24:00.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.087+0000 7f276dd9b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f27680504d0 0x7f27680e17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.087+0000 7f276ed9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2768050940 0x7f27680e1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.087+0000 7f276ed9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2768050940 0x7f27680e1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:51318/0 (socket says 172.21.15.81:51318) 2023-10-06T03:24:00.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.087+0000 7f276ed9d700 1 -- 172.21.15.81:0/3948962480 learned_addr learned my addr 172.21.15.81:0/3948962480 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:00.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.088+0000 7f276ed9d700 1 -- 172.21.15.81:0/3948962480 >> v2:172.21.15.83:3300/0 conn(0x7f27680504d0 msgr2=0x7f27680e17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:00.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.088+0000 7f276ed9d700 1 --2- 172.21.15.81:0/3948962480 >> v2:172.21.15.83:3300/0 conn(0x7f27680504d0 0x7f27680e17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.088+0000 7f276ed9d700 1 -- 172.21.15.81:0/3948962480 >> v1:172.21.15.83:6789/0 conn(0x7f2768035330 legacy=0x7f2768005f10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T03:24:00.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.088+0000 7f276ed9d700 1 -- 172.21.15.81:0/3948962480 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27680e2270 con 0x7f2768050940 2023-10-06T03:24:00.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.088+0000 7f276ed9d700 1 --2- 172.21.15.81:0/3948962480 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2768050940 0x7f27680e1d30 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2770076470 tx=0x7f2770066bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2618aad2a28bc2b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.088+0000 7f276d59a700 1 -- 172.21.15.81:0/3948962480 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277004c3c0 con 0x7f2768050940 2023-10-06T03:24:00.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.089+0000 7f276d59a700 1 -- 172.21.15.81:0/3948962480 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27700647b0 con 0x7f2768050940 2023-10-06T03:24:00.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.089+0000 7f276d59a700 1 -- 172.21.15.81:0/3948962480 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2770068760 con 0x7f2768050940 2023-10-06T03:24:00.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.090+0000 7f276f59e700 1 -- 172.21.15.81:0/3948962480 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2768050940 msgr2=0x7f27680e1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.090+0000 7f276f59e700 1 --2- 172.21.15.81:0/3948962480 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2768050940 0x7f27680e1d30 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2770076470 tx=0x7f2770066bb0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.090+0000 7f276f59e700 1 -- 172.21.15.81:0/3948962480 shutdown_connections 2023-10-06T03:24:00.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.090+0000 7f276f59e700 1 --2- 172.21.15.81:0/3948962480 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2768050940 0x7f27680e1d30 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.090+0000 7f276f59e700 1 --2- 172.21.15.81:0/3948962480 >> v2:172.21.15.83:3300/0 conn(0x7f27680504d0 0x7f27680e17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.090+0000 7f276f59e700 1 -- 172.21.15.81:0/3948962480 >> 172.21.15.81:0/3948962480 conn(0x7f2768054d40 msgr2=0x7f2768055140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:00.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.091+0000 7f276f59e700 1 -- 172.21.15.81:0/3948962480 shutdown_connections 2023-10-06T03:24:00.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.091+0000 7f9f523ff700 1 Processor -- start 2023-10-06T03:24:00.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.092+0000 7f9f523ff700 1 -- start start 2023-10-06T03:24:00.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.091+0000 7f276f59e700 1 -- 172.21.15.81:0/3948962480 wait complete. 2023-10-06T03:24:00.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.094+0000 7f276f59e700 1 Processor -- start 2023-10-06T03:24:00.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.094+0000 7f276f59e700 1 -- start start 2023-10-06T03:24:00.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.094+0000 7f9f523ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9f440dc630 0x7f9f440542c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.094+0000 7f9f523ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9f440e65a0 0x7f9f44057840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.095+0000 7f0e24fff700 1 Processor -- start 2023-10-06T03:24:00.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.095+0000 7f0e24fff700 1 -- start start 2023-10-06T03:24:00.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.094+0000 7f9f523ff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f440070c0 con 0x7f9f44054800 2023-10-06T03:24:00.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.094+0000 7f9f523ff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f440073a0 con 0x7f9f440e65a0 2023-10-06T03:24:00.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.094+0000 7f9f523ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f44007680 con 0x7f9f440dc630 2023-10-06T03:24:00.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.095+0000 7f9f5099c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9f440e65a0 0x7f9f44057840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.095+0000 7f9f5099c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9f440e65a0 0x7f9f44057840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:50684/0 (socket says 172.21.15.81:50684) 2023-10-06T03:24:00.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.095+0000 7f9f5099c700 1 -- 172.21.15.81:0/3702135699 learned_addr learned my addr 172.21.15.81:0/3702135699 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:00.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.095+0000 7f9f5099c700 1 -- 172.21.15.81:0/3702135699 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9f440dc630 msgr2=0x7f9f440542c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T03:24:00.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.095+0000 7f9f5099c700 1 --2- 172.21.15.81:0/3702135699 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9f440dc630 0x7f9f440542c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.095+0000 7f9f5099c700 1 -- 172.21.15.81:0/3702135699 >> v1:172.21.15.81:6789/0 conn(0x7f9f44054800 legacy=0x7f9f440e5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.095+0000 7f9f5099c700 1 -- 172.21.15.81:0/3702135699 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f44007960 con 0x7f9f440e65a0 2023-10-06T03:24:00.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.096+0000 7f9f5099c700 1 --2- 172.21.15.81:0/3702135699 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f440e65a0 0x7f9f44057840 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c076470 tx=0x7f9f4c066bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d621c07b2b69f4b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.096+0000 7fa6c2d9d700 1 Processor -- start 2023-10-06T03:24:00.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.096+0000 7fa6c2d9d700 1 -- start start 2023-10-06T03:24:00.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.097+0000 7f9f4affd700 1 -- 172.21.15.81:0/3702135699 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c04c3c0 con 0x7f9f440e65a0 2023-10-06T03:24:00.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.097+0000 7f9f4affd700 1 -- 172.21.15.81:0/3702135699 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f4c0647b0 con 0x7f9f440e65a0 2023-10-06T03:24:00.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.097+0000 7f0e24fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0e200cb9f0 0x7f0e200cac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.097+0000 7f0e24fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e20167980 0x7f0e20087260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.097+0000 7f0e24fff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f0e200c6fc0 0x7f0e200877a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.097+0000 7f0e24fff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e20069e40 con 0x7f0e200cb9f0 2023-10-06T03:24:00.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.097+0000 7f0e24fff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e200697f0 con 0x7f0e200c6fc0 2023-10-06T03:24:00.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.097+0000 7f0e24fff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e20069ad0 con 0x7f0e20167980 2023-10-06T03:24:00.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.097+0000 7f0e1dd9b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e20167980 0x7f0e20087260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.098+0000 7f0e1dd9b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e20167980 0x7f0e20087260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:51326/0 (socket says 172.21.15.81:51326) 2023-10-06T03:24:00.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.098+0000 7f0e1dd9b700 1 -- 172.21.15.81:0/3559639079 learned_addr learned my addr 172.21.15.81:0/3559639079 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:00.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.098+0000 7f0e1ed9d700 1 --2- 172.21.15.81:0/3559639079 >> v2:172.21.15.83:3300/0 conn(0x7f0e200c6fc0 0x7f0e200877a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.098+0000 7f9f523ff700 1 -- 172.21.15.81:0/3702135699 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f440e65a0 msgr2=0x7f9f44057840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.098+0000 7f9f523ff700 1 --2- 172.21.15.81:0/3702135699 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f440e65a0 0x7f9f44057840 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c076470 tx=0x7f9f4c066bb0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.098+0000 7f9f523ff700 1 -- 172.21.15.81:0/3702135699 shutdown_connections 2023-10-06T03:24:00.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.098+0000 7f9f523ff700 1 --2- 172.21.15.81:0/3702135699 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9f440dc630 0x7f9f440542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.098+0000 7f9f523ff700 1 --2- 172.21.15.81:0/3702135699 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f440e65a0 0x7f9f44057840 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.098+0000 7f9f523ff700 1 -- 172.21.15.81:0/3702135699 >> 172.21.15.81:0/3702135699 conn(0x7f9f44055bd0 msgr2=0x7f9f44055fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:00.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.099+0000 7f276f59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2768035330 0x7f276804df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.099+0000 7f276f59e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f27680504d0 0x7f276804e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.099+0000 7f0e1dd9b700 1 -- 172.21.15.81:0/3559639079 >> v2:172.21.15.83:3300/0 conn(0x7f0e200c6fc0 msgr2=0x7f0e200877a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:00.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.099+0000 7f0e1dd9b700 1 --2- 172.21.15.81:0/3559639079 >> v2:172.21.15.83:3300/0 conn(0x7f0e200c6fc0 0x7f0e200877a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.099+0000 7f0e1dd9b700 1 -- 172.21.15.81:0/3559639079 >> v2:172.21.15.81:3300/0 conn(0x7f0e200cb9f0 msgr2=0x7f0e200cac70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T03:24:00.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.099+0000 7f77e4bff700 1 Processor -- start 2023-10-06T03:24:00.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.098+0000 7fa6c2d9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa6b404fe30 0x7fa6b4050200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.099+0000 7fa6c2d9d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa6b40e9550 0x7fa6b40e99d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.099+0000 7fa6c2d9d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6b4053cd0 con 0x7fa6b4033970 2023-10-06T03:24:00.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.099+0000 7fa6c2d9d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6b4053fb0 con 0x7fa6b40e9550 2023-10-06T03:24:00.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.099+0000 7fa6c2d9d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b4054290 con 0x7fa6b404fe30 2023-10-06T03:24:00.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.099+0000 7f276f59e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2768050940 0x7f27680be530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.099+0000 7f276f59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27680bb560 con 0x7f2768035330 2023-10-06T03:24:00.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.099+0000 7f276f59e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27680bb800 con 0x7f2768050940 2023-10-06T03:24:00.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.099+0000 7f276f59e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27680bbae0 con 0x7f27680504d0 2023-10-06T03:24:00.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.099+0000 7f0e1e59c700 1 --2- 172.21.15.81:0/3559639079 >> v2:172.21.15.81:3300/0 conn(0x7f0e200cb9f0 0x7f0e200cac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.099+0000 7f77e4bff700 1 -- start start 2023-10-06T03:24:00.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.100+0000 7f276ed9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2768050940 0x7f27680be530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.100+0000 7f0e1dd9b700 1 --2- 172.21.15.81:0/3559639079 >> v2:172.21.15.81:3300/0 conn(0x7f0e200cb9f0 0x7f0e200cac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.099+0000 7f9f523ff700 1 -- 172.21.15.81:0/3702135699 shutdown_connections 2023-10-06T03:24:00.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.099+0000 7fa6c1d9b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa6b404fe30 0x7fa6b4050200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.099+0000 7fa6c1d9b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa6b404fe30 0x7fa6b4050200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:51332/0 (socket says 172.21.15.81:51332) 2023-10-06T03:24:00.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.099+0000 7fa6c1d9b700 1 -- 172.21.15.81:0/2932784398 learned_addr learned my addr 172.21.15.81:0/2932784398 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:00.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.099+0000 7fa6c259c700 1 --2- 172.21.15.81:0/2932784398 >> v2:172.21.15.83:3300/0 conn(0x7fa6b40e9550 0x7fa6b40e99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.100+0000 7fa6c1d9b700 1 -- 172.21.15.81:0/2932784398 >> v2:172.21.15.83:3300/0 conn(0x7fa6b40e9550 msgr2=0x7fa6b40e99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:00.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.100+0000 7fa6c1d9b700 1 --2- 172.21.15.81:0/2932784398 >> v2:172.21.15.83:3300/0 conn(0x7fa6b40e9550 0x7fa6b40e99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.100+0000 7fa6c1d9b700 1 -- 172.21.15.81:0/2932784398 >> v1:172.21.15.83:6789/0 conn(0x7fa6b4033970 legacy=0x7fa6b4033dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.100+0000 7fa6c1d9b700 1 -- 172.21.15.81:0/2932784398 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b4054570 con 0x7fa6b404fe30 2023-10-06T03:24:00.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.100+0000 7f276e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2768035330 0x7f276804df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.100+0000 7f276ed9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2768050940 0x7f27680be530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:50714/0 (socket says 172.21.15.81:50714) 2023-10-06T03:24:00.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.100+0000 7f276ed9d700 1 -- 172.21.15.81:0/983596788 learned_addr learned my addr 172.21.15.81:0/983596788 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:00.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.100+0000 7f276dd9b700 1 --2- 172.21.15.81:0/983596788 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f27680504d0 0x7f276804e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.100+0000 7fa6c1d9b700 1 --2- 172.21.15.81:0/2932784398 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa6b404fe30 0x7fa6b4050200 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc02b6c0 tx=0x7fa6bc067320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25cef253d3d53c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.100+0000 7f9f523ff700 1 -- 172.21.15.81:0/3702135699 wait complete. 2023-10-06T03:24:00.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.100+0000 7f0e1dd9b700 1 -- 172.21.15.81:0/3559639079 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e200cb1b0 con 0x7f0e20167980 2023-10-06T03:24:00.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.100+0000 7f0e1e59c700 1 --2- 172.21.15.81:0/3559639079 >> v2:172.21.15.81:3300/0 conn(0x7f0e200cb9f0 0x7f0e200cac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:00.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.101+0000 7f0e1ed9d700 1 --2- 172.21.15.81:0/3559639079 >> v2:172.21.15.83:3300/0 conn(0x7f0e200c6fc0 0x7f0e200877a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:24:00.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.101+0000 7f77e4bff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f77e0068bc0 0x7f77e00ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.101+0000 7f77e4bff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f77e00cfbc0 0x7f77e00cd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.101+0000 7f77e4bff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77e00ce720 con 0x7f77e01595b0 2023-10-06T03:24:00.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.101+0000 7f77e4bff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77e00cd840 con 0x7f77e00cfbc0 2023-10-06T03:24:00.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.101+0000 7f77e4bff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77e00af730 con 0x7f77e0068bc0 2023-10-06T03:24:00.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.101+0000 7f276e59c700 1 -- 172.21.15.81:0/983596788 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f27680504d0 msgr2=0x7f276804e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.101+0000 7f276e59c700 1 --2- 172.21.15.81:0/983596788 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f27680504d0 0x7f276804e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.101+0000 7f276e59c700 1 -- 172.21.15.81:0/983596788 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2768050940 msgr2=0x7f27680be530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.101+0000 7f276e59c700 1 --2- 172.21.15.81:0/983596788 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2768050940 0x7f27680be530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.101+0000 7f276e59c700 1 -- 172.21.15.81:0/983596788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27680bbdc0 con 0x7f2768035330 2023-10-06T03:24:00.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.102+0000 7f77ded9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f77e00cfbc0 0x7f77e00cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.102+0000 7f77ded9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f77e00cfbc0 0x7f77e00cd300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56140/0 (socket says 172.21.15.81:56140) 2023-10-06T03:24:00.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.102+0000 7f77ded9d700 1 -- 172.21.15.81:0/1104141968 learned_addr learned my addr 172.21.15.81:0/1104141968 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:00.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.101+0000 7fa6c0d99700 1 -- 172.21.15.81:0/2932784398 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc04c3c0 con 0x7fa6b404fe30 2023-10-06T03:24:00.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.102+0000 7fa6c0d99700 1 -- 172.21.15.81:0/2932784398 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6bc063230 con 0x7fa6b404fe30 2023-10-06T03:24:00.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.102+0000 7f276e59c700 1 --2- 172.21.15.81:0/983596788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2768035330 0x7f276804df40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f276000b5b0 tx=0x7f27600090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.102+0000 7f275e7fc700 1 -- 172.21.15.81:0/983596788 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276000f510 con 0x7f2768035330 2023-10-06T03:24:00.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.103+0000 7f276f59e700 1 -- 172.21.15.81:0/983596788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27680bc0a0 con 0x7f2768035330 2023-10-06T03:24:00.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.103+0000 7fa6c2d9d700 1 -- 172.21.15.81:0/2932784398 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa6b404fe30 msgr2=0x7fa6b4050200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.103+0000 7fa6c2d9d700 1 --2- 172.21.15.81:0/2932784398 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa6b404fe30 0x7fa6b4050200 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc02b6c0 tx=0x7fa6bc067320 comp rx=0 tx=0).stop 2023-10-06T03:24:00.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.103+0000 7f276f59e700 1 -- 172.21.15.81:0/983596788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27680becb0 con 0x7f2768035330 2023-10-06T03:24:00.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.103+0000 7f77ded9d700 1 -- 172.21.15.81:0/1104141968 >> v2:172.21.15.83:3300/0 conn(0x7f77e0068bc0 msgr2=0x7f77e00ccdc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T03:24:00.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.103+0000 7f77ded9d700 1 --2- 172.21.15.81:0/1104141968 >> v2:172.21.15.83:3300/0 conn(0x7f77e0068bc0 0x7f77e00ccdc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.103+0000 7f77ded9d700 1 -- 172.21.15.81:0/1104141968 >> v1:172.21.15.81:6789/0 conn(0x7f77e01595b0 legacy=0x7f77e00af020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.103+0000 7fa6c2d9d700 1 -- 172.21.15.81:0/2932784398 shutdown_connections 2023-10-06T03:24:00.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.103+0000 7f77ded9d700 1 -- 172.21.15.81:0/1104141968 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e00ce110 con 0x7f77e00cfbc0 2023-10-06T03:24:00.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.103+0000 7fa6c2d9d700 1 --2- 172.21.15.81:0/2932784398 >> v2:172.21.15.83:3300/0 conn(0x7fa6b40e9550 0x7fa6b40e99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.103+0000 7fa6c2d9d700 1 --2- 172.21.15.81:0/2932784398 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa6b404fe30 0x7fa6b4050200 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.103+0000 7fa6c2d9d700 1 -- 172.21.15.81:0/2932784398 >> 172.21.15.81:0/2932784398 conn(0x7fa6b4051690 msgr2=0x7fa6b4051a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:00.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.104+0000 7fa6c2d9d700 1 -- 172.21.15.81:0/2932784398 shutdown_connections 2023-10-06T03:24:00.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.104+0000 7f77ded9d700 1 --2- 172.21.15.81:0/1104141968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77e00cfbc0 0x7f77e00cd300 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f77e00b0030 tx=0x7f77d8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e62a3a542415f29 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.103+0000 7f275e7fc700 1 -- 172.21.15.81:0/983596788 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f276000f670 con 0x7f2768035330 2023-10-06T03:24:00.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.104+0000 7f275e7fc700 1 -- 172.21.15.81:0/983596788 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276000f510 con 0x7f2768035330 2023-10-06T03:24:00.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.104+0000 7f77dd59a700 1 -- 172.21.15.81:0/1104141968 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d800e070 con 0x7f77e00cfbc0 2023-10-06T03:24:00.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.105+0000 7f77dd59a700 1 -- 172.21.15.81:0/1104141968 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d800b950 con 0x7f77e00cfbc0 2023-10-06T03:24:00.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.105+0000 7f77dd59a700 1 -- 172.21.15.81:0/1104141968 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d80092e0 con 0x7f77e00cfbc0 2023-10-06T03:24:00.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.106+0000 7f0e1dd9b700 1 --2- 172.21.15.81:0/3559639079 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e20167980 0x7f0e20087260 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0e200b2090 tx=0x7f0e18009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f8849dffb33aece server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.106+0000 7f276f59e700 1 -- 172.21.15.81:0/983596788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2754000fd0 con 0x7f2768035330 2023-10-06T03:24:00.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.104+0000 7fa6c2d9d700 1 -- 172.21.15.81:0/2932784398 wait complete. 2023-10-06T03:24:00.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.103+0000 7f9f523ff700 1 Processor -- start 2023-10-06T03:24:00.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.106+0000 7f9f523ff700 1 -- start start 2023-10-06T03:24:00.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.106+0000 7fa6c2d9d700 1 Processor -- start 2023-10-06T03:24:00.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.108+0000 7f9f523ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f44054800 0x7f9f44052c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.107+0000 7fa6c2d9d700 1 -- start start 2023-10-06T03:24:00.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.108+0000 7f9f523ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9f440dc630 0x7f9f440d5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.108+0000 7f9f523ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f44050210 0x7f9f44050bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.108+0000 7f9f4bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f44054800 0x7f9f44052c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.108+0000 7f9f523ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f440d6270 con 0x7f9f44054800 2023-10-06T03:24:00.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.108+0000 7f9f523ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f440e4750 con 0x7f9f44050210 2023-10-06T03:24:00.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.108+0000 7f9f4bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f44054800 0x7f9f44052c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56156/0 (socket says 172.21.15.81:56156) 2023-10-06T03:24:00.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.108+0000 7f9f523ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f440e4a30 con 0x7f9f440dc630 2023-10-06T03:24:00.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.108+0000 7f9f4bfff700 1 -- 172.21.15.81:0/2831563967 learned_addr learned my addr 172.21.15.81:0/2831563967 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:00.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.109+0000 7f9f5099c700 1 --2- 172.21.15.81:0/2831563967 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f44050210 0x7f9f44050bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.109+0000 7f9f4b7fe700 1 --2- 172.21.15.81:0/2831563967 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9f440dc630 0x7f9f440d5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.108+0000 7f275e7fc700 1 -- 172.21.15.81:0/983596788 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f276000f7e0 con 0x7f2768035330 2023-10-06T03:24:00.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.107+0000 7f77e4bff700 1 -- 172.21.15.81:0/1104141968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77e00cfbc0 msgr2=0x7f77e00cd300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.107+0000 7f77e4bff700 1 --2- 172.21.15.81:0/1104141968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77e00cfbc0 0x7f77e00cd300 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f77e00b0030 tx=0x7f77d8009840 comp rx=0 tx=0).stop 2023-10-06T03:24:00.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.109+0000 7f275e7fc700 1 --2- 172.21.15.81:0/983596788 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2750066ff0 0x7f27500694a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.109+0000 7fa6c2d9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6b4033970 0x7fa6b40e2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.109+0000 7fa6c2d9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa6b404fe30 0x7fa6b404b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.110+0000 7f275e7fc700 1 -- 172.21.15.81:0/983596788 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f2760083470 con 0x7f2768035330 2023-10-06T03:24:00.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.109+0000 7fa6c2d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6b40e9550 0x7fa6b404b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.109+0000 7f9f5099c700 1 -- 172.21.15.81:0/2831563967 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9f440dc630 msgr2=0x7f9f440d5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.109+0000 7f9f5099c700 1 --2- 172.21.15.81:0/2831563967 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9f440dc630 0x7f9f440d5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.109+0000 7f9f5099c700 1 -- 172.21.15.81:0/2831563967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f44054800 msgr2=0x7f9f44052c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.109+0000 7f9f5099c700 1 --2- 172.21.15.81:0/2831563967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f44054800 0x7f9f44052c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.109+0000 7f9f5099c700 1 -- 172.21.15.81:0/2831563967 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f440e4d10 con 0x7f9f44050210 2023-10-06T03:24:00.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.109+0000 7f9f4b7fe700 1 --2- 172.21.15.81:0/2831563967 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9f440dc630 0x7f9f440d5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:00.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.110+0000 7f9f5099c700 1 --2- 172.21.15.81:0/2831563967 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f44050210 0x7f9f44050bc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c076520 tx=0x7f9f4c06e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.109+0000 7fa6c2d9d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b40e31c0 con 0x7fa6b40e9550 2023-10-06T03:24:00.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.110+0000 7f0e1d59a700 1 -- 172.21.15.81:0/3559639079 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1800e070 con 0x7f0e20167980 2023-10-06T03:24:00.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.110+0000 7f77e4bff700 1 -- 172.21.15.81:0/1104141968 shutdown_connections 2023-10-06T03:24:00.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.110+0000 7f77e4bff700 1 --2- 172.21.15.81:0/1104141968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77e00cfbc0 0x7f77e00cd300 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.110+0000 7f77e4bff700 1 --2- 172.21.15.81:0/1104141968 >> v2:172.21.15.83:3300/0 conn(0x7f77e0068bc0 0x7f77e00ccdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.110+0000 7f77e4bff700 1 -- 172.21.15.81:0/1104141968 >> 172.21.15.81:0/1104141968 conn(0x7f77e006f7e0 msgr2=0x7f77e00682b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:00.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.110+0000 7f275e7fc700 1 --2- 172.21.15.81:0/983596788 >> [v2:172.21.15.81:6816/85563,v1:172.21.15.81:6818/85563] conn(0x7f2750070bc0 0x7f2750072ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.110+0000 7f275e7fc700 1 -- 172.21.15.81:0/983596788 --> [v2:172.21.15.81:6816/85563,v1:172.21.15.81:6818/85563] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f27500736c0 con 0x7f2750070bc0 2023-10-06T03:24:00.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.110+0000 7f275e7fc700 1 -- 172.21.15.81:0/983596788 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f276000f510 con 0x7f2768035330 2023-10-06T03:24:00.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.109+0000 7fa6c2d9d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b40ff8a0 con 0x7fa6b4033970 2023-10-06T03:24:00.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.109+0000 7fa6c2d9d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b40ffb80 con 0x7fa6b404fe30 2023-10-06T03:24:00.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.110+0000 7fa6c259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6b40e9550 0x7fa6b404b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.110+0000 7fa6c259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6b40e9550 0x7fa6b404b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56158/0 (socket says 172.21.15.81:56158) 2023-10-06T03:24:00.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.110+0000 7fa6c259c700 1 -- 172.21.15.81:0/957186360 learned_addr learned my addr 172.21.15.81:0/957186360 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:00.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.110+0000 7f0e1d59a700 1 -- 172.21.15.81:0/3559639079 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e1800bab0 con 0x7f0e20167980 2023-10-06T03:24:00.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.110+0000 7f77e4bff700 1 -- 172.21.15.81:0/1104141968 shutdown_connections 2023-10-06T03:24:00.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.111+0000 7fa6c259c700 1 -- 172.21.15.81:0/957186360 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa6b404fe30 msgr2=0x7fa6b404b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.111+0000 7fa6c259c700 1 --2- 172.21.15.81:0/957186360 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa6b404fe30 0x7fa6b404b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.111+0000 7f276ed9d700 1 --2- 172.21.15.81:0/983596788 >> [v2:172.21.15.81:6816/85563,v1:172.21.15.81:6818/85563] conn(0x7f2750070bc0 0x7f2750072ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.111+0000 7fa6c259c700 1 -- 172.21.15.81:0/957186360 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6b4033970 msgr2=0x7fa6b40e2c80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T03:24:00.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.111+0000 7fa6c259c700 1 --2- 172.21.15.81:0/957186360 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6b4033970 0x7fa6b40e2c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.111+0000 7fa6c259c700 1 -- 172.21.15.81:0/957186360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6bc04c9a0 con 0x7fa6b40e9550 2023-10-06T03:24:00.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.110+0000 7f77e4bff700 1 -- 172.21.15.81:0/1104141968 wait complete. 2023-10-06T03:24:00.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.111+0000 7fa6c259c700 1 --2- 172.21.15.81:0/957186360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6b40e9550 0x7fa6b404b5e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac00e8d0 tx=0x7fa6ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.111+0000 7f0e24fff700 1 -- 172.21.15.81:0/3559639079 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e20167980 msgr2=0x7f0e20087260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.111+0000 7f0e24fff700 1 --2- 172.21.15.81:0/3559639079 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e20167980 0x7f0e20087260 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0e200b2090 tx=0x7f0e18009840 comp rx=0 tx=0).stop 2023-10-06T03:24:00.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.112+0000 7f9f37fff700 1 -- 172.21.15.81:0/2831563967 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c068d30 con 0x7f9f44050210 2023-10-06T03:24:00.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.112+0000 7f9f523ff700 1 -- 172.21.15.81:0/2831563967 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f440e4ff0 con 0x7f9f44050210 2023-10-06T03:24:00.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.112+0000 7f9f523ff700 1 -- 172.21.15.81:0/2831563967 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f440dc180 con 0x7f9f44050210 2023-10-06T03:24:00.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.112+0000 7f9f37fff700 1 -- 172.21.15.81:0/2831563967 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f4c068e90 con 0x7f9f44050210 2023-10-06T03:24:00.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.112+0000 7f9f37fff700 1 -- 172.21.15.81:0/2831563967 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c099610 con 0x7f9f44050210 2023-10-06T03:24:00.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.112+0000 7f276ed9d700 1 --2- 172.21.15.81:0/983596788 >> [v2:172.21.15.81:6816/85563,v1:172.21.15.81:6818/85563] conn(0x7f2750070bc0 0x7f2750072ff0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.112+0000 7f276dd9b700 1 --2- 172.21.15.81:0/983596788 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2750066ff0 0x7f27500694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.113+0000 7f276dd9b700 1 --2- 172.21.15.81:0/983596788 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2750066ff0 0x7f27500694a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f27680c2310 tx=0x7f2764008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.113+0000 7f0e24fff700 1 -- 172.21.15.81:0/3559639079 shutdown_connections 2023-10-06T03:24:00.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.113+0000 7f0e24fff700 1 --2- 172.21.15.81:0/3559639079 >> v2:172.21.15.83:3300/0 conn(0x7f0e200c6fc0 0x7f0e200877a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.113+0000 7f0e24fff700 1 --2- 172.21.15.81:0/3559639079 >> v2:172.21.15.81:3300/0 conn(0x7f0e200cb9f0 0x7f0e200cac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.113+0000 7f0e24fff700 1 --2- 172.21.15.81:0/3559639079 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e20167980 0x7f0e20087260 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.113+0000 7f0e24fff700 1 -- 172.21.15.81:0/3559639079 >> 172.21.15.81:0/3559639079 conn(0x7f0e200cc090 msgr2=0x7f0e200cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:00.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.113+0000 7f77e4bff700 1 Processor -- start 2023-10-06T03:24:00.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.113+0000 7f77e4bff700 1 -- start start 2023-10-06T03:24:00.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.112+0000 7fa6b1ffb700 1 -- 172.21.15.81:0/957186360 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ac00ee70 con 0x7fa6b40e9550 2023-10-06T03:24:00.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.112+0000 7fa6b1ffb700 1 -- 172.21.15.81:0/957186360 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6ac00c850 con 0x7fa6b40e9550 2023-10-06T03:24:00.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.112+0000 7fa6b1ffb700 1 -- 172.21.15.81:0/957186360 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ac00cc10 con 0x7fa6b40e9550 2023-10-06T03:24:00.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.112+0000 7fa6c2d9d700 1 -- 172.21.15.81:0/957186360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6b40ffe60 con 0x7fa6b40e9550 2023-10-06T03:24:00.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.113+0000 7fa6c2d9d700 1 -- 172.21.15.81:0/957186360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6b40ff570 con 0x7fa6b40e9550 2023-10-06T03:24:00.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.114+0000 7f275e7fc700 1 -- 172.21.15.81:0/983596788 <== osd.0 v2:172.21.15.81:6816/85563 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f27500736c0 con 0x7f2750070bc0 2023-10-06T03:24:00.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.114+0000 7f77e4bff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77e0068bc0 0x7f77e00c7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.114+0000 7f77e4bff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77e00cfbc0 0x7f77e015b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.114+0000 7fa6c2d9d700 1 -- 172.21.15.81:0/957186360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa6b40052b0 con 0x7fa6b40e9550 2023-10-06T03:24:00.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.115+0000 7f77de59c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77e0068bc0 0x7f77e00c7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.115+0000 7f77de59c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77e0068bc0 0x7f77e00c7f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:51352/0 (socket says 172.21.15.81:51352) 2023-10-06T03:24:00.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.115+0000 7f9f37fff700 1 -- 172.21.15.81:0/2831563967 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9f4c097040 con 0x7f9f44050210 2023-10-06T03:24:00.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.115+0000 7f9f523ff700 1 -- 172.21.15.81:0/2831563967 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9f44055fa0 con 0x7f9f44050210 2023-10-06T03:24:00.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.116+0000 7f0e24fff700 1 -- 172.21.15.81:0/3559639079 shutdown_connections 2023-10-06T03:24:00.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.115+0000 7f77e4bff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77e01595b0 0x7f77e00b3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.115+0000 7f77ddd9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77e00cfbc0 0x7f77e015b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.115+0000 7f77ddd9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77e00cfbc0 0x7f77e015b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:50756/0 (socket says 172.21.15.81:50756) 2023-10-06T03:24:00.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.115+0000 7f77ded9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77e01595b0 0x7f77e00b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.115+0000 7f77de59c700 1 -- 172.21.15.81:0/2031661562 learned_addr learned my addr 172.21.15.81:0/2031661562 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:00.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.116+0000 7f77e4bff700 1 -- 172.21.15.81:0/2031661562 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e00c8860 con 0x7f77e01595b0 2023-10-06T03:24:00.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.116+0000 7f77e4bff700 1 -- 172.21.15.81:0/2031661562 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e015bbb0 con 0x7f77e00cfbc0 2023-10-06T03:24:00.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.116+0000 7f77e4bff700 1 -- 172.21.15.81:0/2031661562 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e015be90 con 0x7f77e0068bc0 2023-10-06T03:24:00.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.117+0000 7f9f37fff700 1 --2- 172.21.15.81:0/2831563967 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f9f30067080 0x7f9f30069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.117+0000 7f9f37fff700 1 -- 172.21.15.81:0/2831563967 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f9f4c103d30 con 0x7f9f44050210 2023-10-06T03:24:00.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.118+0000 7f9f37fff700 1 --2- 172.21.15.81:0/2831563967 >> [v2:172.21.15.81:6808/85564,v1:172.21.15.81:6809/85564] conn(0x7f9f30070d50 0x7f9f30073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.118+0000 7f9f37fff700 1 -- 172.21.15.81:0/2831563967 --> [v2:172.21.15.81:6808/85564,v1:172.21.15.81:6809/85564] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9f30073850 con 0x7f9f30070d50 2023-10-06T03:24:00.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.118+0000 7f9f37fff700 1 -- 172.21.15.81:0/2831563967 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f4c109240 con 0x7f9f44050210 2023-10-06T03:24:00.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.116+0000 7f0e24fff700 1 -- 172.21.15.81:0/3559639079 wait complete. 2023-10-06T03:24:00.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.118+0000 7f0e24fff700 1 Processor -- start 2023-10-06T03:24:00.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.118+0000 7f9f4bfff700 1 --2- 172.21.15.81:0/2831563967 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f9f30067080 0x7f9f30069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.118+0000 7f9f4b7fe700 1 --2- 172.21.15.81:0/2831563967 >> [v2:172.21.15.81:6808/85564,v1:172.21.15.81:6809/85564] conn(0x7f9f30070d50 0x7f9f30073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.118+0000 7f0e24fff700 1 -- start start 2023-10-06T03:24:00.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.116+0000 7fa6b1ffb700 1 -- 172.21.15.81:0/957186360 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa6ac013470 con 0x7fa6b40e9550 2023-10-06T03:24:00.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.117+0000 7fa6b1ffb700 1 --2- 172.21.15.81:0/957186360 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa6a0067000 0x7fa6a00694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.119+0000 7fa6c1d9b700 1 --2- 172.21.15.81:0/957186360 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa6a0067000 0x7fa6a00694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.119+0000 7f9f4b7fe700 1 --2- 172.21.15.81:0/2831563967 >> [v2:172.21.15.81:6808/85564,v1:172.21.15.81:6809/85564] conn(0x7f9f30070d50 0x7f9f30073180 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.119+0000 7f9f4bfff700 1 --2- 172.21.15.81:0/2831563967 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f9f30067080 0x7f9f30069530 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9f40009b60 tx=0x7f9f400090f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.119+0000 7fa6b1ffb700 1 -- 172.21.15.81:0/957186360 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa6ac055d20 con 0x7fa6b40e9550 2023-10-06T03:24:00.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.120+0000 7f0e24fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e200c6fc0 0x7f0e200c3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.121+0000 7f0e24fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e200cb9f0 0x7f0e2006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.121+0000 7f0e1e59c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e200c6fc0 0x7f0e200c3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.121+0000 7f0e1e59c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e200c6fc0 0x7f0e200c3140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:51368/0 (socket says 172.21.15.81:51368) 2023-10-06T03:24:00.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.121+0000 7f0e1e59c700 1 -- 172.21.15.81:0/3976595335 learned_addr learned my addr 172.21.15.81:0/3976595335 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:00.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.121+0000 7f0e24fff700 1 --2- 172.21.15.81:0/3976595335 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e20167980 0x7f0e200acac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.121+0000 7f0e1dd9b700 1 --2- 172.21.15.81:0/3976595335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e200cb9f0 0x7f0e2006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.121+0000 7f9f37fff700 1 -- 172.21.15.81:0/2831563967 <== osd.2 v2:172.21.15.81:6808/85564 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f9f30073850 con 0x7f9f30070d50 2023-10-06T03:24:00.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.117+0000 7f77ddd9b700 1 -- 172.21.15.81:0/2031661562 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77e0068bc0 msgr2=0x7f77e00c7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.117+0000 7f77ddd9b700 1 --2- 172.21.15.81:0/2031661562 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77e0068bc0 0x7f77e00c7f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.117+0000 7f77ddd9b700 1 -- 172.21.15.81:0/2031661562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77e01595b0 msgr2=0x7f77e00b3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.117+0000 7f77ddd9b700 1 --2- 172.21.15.81:0/2031661562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77e01595b0 0x7f77e00b3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.117+0000 7f77ddd9b700 1 -- 172.21.15.81:0/2031661562 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d8009ae0 con 0x7f77e00cfbc0 2023-10-06T03:24:00.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.117+0000 7f77ded9d700 1 --2- 172.21.15.81:0/2031661562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77e01595b0 0x7f77e00b3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:00.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.117+0000 7f77ddd9b700 1 --2- 172.21.15.81:0/2031661562 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77e00cfbc0 0x7f77e015b330 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f77d400b5b0 tx=0x7f77d40090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.118+0000 7f77ce7fc700 1 -- 172.21.15.81:0/2031661562 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d400f510 con 0x7f77e00cfbc0 2023-10-06T03:24:00.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.118+0000 7f77ce7fc700 1 -- 172.21.15.81:0/2031661562 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d400f670 con 0x7f77e00cfbc0 2023-10-06T03:24:00.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.118+0000 7f77ce7fc700 1 -- 172.21.15.81:0/2031661562 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d400fa30 con 0x7f77e00cfbc0 2023-10-06T03:24:00.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.120+0000 7f77e4bff700 1 -- 172.21.15.81:0/2031661562 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77e015c170 con 0x7f77e00cfbc0 2023-10-06T03:24:00.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.120+0000 7f77e4bff700 1 -- 172.21.15.81:0/2031661562 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77e015b870 con 0x7f77e00cfbc0 2023-10-06T03:24:00.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.120+0000 7fa6b1ffb700 1 --2- 172.21.15.81:0/957186360 >> [v2:172.21.15.83:6800/85785,v1:172.21.15.83:6801/85785] conn(0x7fa6a0071920 0x7fa6a0073db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.120+0000 7fa6b1ffb700 1 -- 172.21.15.81:0/957186360 --> [v2:172.21.15.83:6800/85785,v1:172.21.15.83:6801/85785] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa6a0074480 con 0x7fa6a0071920 2023-10-06T03:24:00.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.120+0000 7fa6b1ffb700 1 -- 172.21.15.81:0/957186360 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa6ac0553f0 con 0x7fa6b40e9550 2023-10-06T03:24:00.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.120+0000 7fa6c159a700 1 --2- 172.21.15.81:0/957186360 >> [v2:172.21.15.83:6800/85785,v1:172.21.15.83:6801/85785] conn(0x7fa6a0071920 0x7fa6a0073db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.120+0000 7fa6c1d9b700 1 --2- 172.21.15.81:0/957186360 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa6a0067000 0x7fa6a00694b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa6b40543d0 tx=0x7fa6bc06b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.121+0000 7f0e24fff700 1 -- 172.21.15.81:0/3976595335 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e200b12a0 con 0x7f0e200cb9f0 2023-10-06T03:24:00.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.121+0000 7fa6c159a700 1 --2- 172.21.15.81:0/957186360 >> [v2:172.21.15.83:6800/85785,v1:172.21.15.83:6801/85785] conn(0x7fa6a0071920 0x7fa6a0073db0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.122+0000 7f0e1ed9d700 1 --2- 172.21.15.81:0/3976595335 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e20167980 0x7f0e200acac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.122+0000 7f77bffff700 1 -- 172.21.15.81:0/2031661562 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f77e004c3c0 con 0x7f77e00cfbc0 2023-10-06T03:24:00.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.122+0000 7f0e24fff700 1 -- 172.21.15.81:0/3976595335 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e200ac0b0 con 0x7f0e20167980 2023-10-06T03:24:00.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.122+0000 7f0e24fff700 1 -- 172.21.15.81:0/3976595335 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e200b14b0 con 0x7f0e200c6fc0 2023-10-06T03:24:00.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.122+0000 7f0e1dd9b700 1 -- 172.21.15.81:0/3976595335 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e200c6fc0 msgr2=0x7f0e200c3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.122+0000 7f0e1dd9b700 1 --2- 172.21.15.81:0/3976595335 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e200c6fc0 0x7f0e200c3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.123+0000 7f0e1dd9b700 1 -- 172.21.15.81:0/3976595335 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e20167980 msgr2=0x7f0e200acac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.123+0000 7f0e1dd9b700 1 --2- 172.21.15.81:0/3976595335 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e20167980 0x7f0e200acac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.123+0000 7f0e1dd9b700 1 -- 172.21.15.81:0/3976595335 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e10009420 con 0x7f0e200cb9f0 2023-10-06T03:24:00.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.123+0000 7f0e1dd9b700 1 --2- 172.21.15.81:0/3976595335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e200cb9f0 0x7f0e2006de50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0e18015000 tx=0x7f0e18018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.123+0000 7fa6b1ffb700 1 -- 172.21.15.81:0/957186360 <== osd.4 v2:172.21.15.83:6800/85785 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fa6a0074480 con 0x7fa6a0071920 2023-10-06T03:24:00.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.123+0000 7f0e0e7fc700 1 -- 172.21.15.81:0/3976595335 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e18007c50 con 0x7f0e200cb9f0 2023-10-06T03:24:00.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.124+0000 7f77ce7fc700 1 -- 172.21.15.81:0/2031661562 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f77d401a400 con 0x7f77e00cfbc0 2023-10-06T03:24:00.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.124+0000 7f0e24fff700 1 -- 172.21.15.81:0/3976595335 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e18009ae0 con 0x7f0e200cb9f0 2023-10-06T03:24:00.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.124+0000 7f0e0e7fc700 1 -- 172.21.15.81:0/3976595335 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e18007db0 con 0x7f0e200cb9f0 2023-10-06T03:24:00.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.123+0000 7f81161ff700 1 Processor -- start 2023-10-06T03:24:00.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.124+0000 7f81161ff700 1 -- start start 2023-10-06T03:24:00.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.125+0000 7f77ce7fc700 1 --2- 172.21.15.81:0/2031661562 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f77c0067080 0x7f77c0069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.125+0000 7f77ce7fc700 1 -- 172.21.15.81:0/2031661562 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f77d4084480 con 0x7f77e00cfbc0 2023-10-06T03:24:00.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.126+0000 7f77ce7fc700 1 --2- 172.21.15.81:0/2031661562 >> [v2:172.21.15.81:6817/85562,v1:172.21.15.81:6819/85562] conn(0x7f77c0070d50 0x7f77c0073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.126+0000 7f81161ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f811006d880 0x7f811006ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.126+0000 7f81161ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f811006f060 0x7f811006f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.126+0000 7f81161ff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f811006fa00 con 0x7f811006b520 2023-10-06T03:24:00.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.126+0000 7f81161ff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f811006de10 con 0x7f811006f060 2023-10-06T03:24:00.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.126+0000 7f81161ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f811006e0f0 con 0x7f811006d880 2023-10-06T03:24:00.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.126+0000 7f810ffff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f811006f060 0x7f811006f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.127+0000 7f810ffff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f811006f060 0x7f811006f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:50764/0 (socket says 172.21.15.81:50764) 2023-10-06T03:24:00.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.127+0000 7f810ffff700 1 -- 172.21.15.81:0/1191628766 learned_addr learned my addr 172.21.15.81:0/1191628766 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:00.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.127+0000 7f77ce7fc700 1 -- 172.21.15.81:0/2031661562 --> [v2:172.21.15.81:6817/85562,v1:172.21.15.81:6819/85562] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f77c0073850 con 0x7f77c0070d50 2023-10-06T03:24:00.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.127+0000 7f77ce7fc700 1 -- 172.21.15.81:0/2031661562 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77d40869c0 con 0x7f77e00cfbc0 2023-10-06T03:24:00.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.125+0000 7f0e24fff700 1 -- 172.21.15.81:0/3976595335 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e200ac5a0 con 0x7f0e200cb9f0 2023-10-06T03:24:00.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.127+0000 7f0e24fff700 1 -- 172.21.15.81:0/3976595335 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0e200b16d0 con 0x7f0e200cb9f0 2023-10-06T03:24:00.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.128+0000 7f0e0e7fc700 1 -- 172.21.15.81:0/3976595335 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1801d670 con 0x7f0e200cb9f0 2023-10-06T03:24:00.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.128+0000 7f77ded9d700 1 --2- 172.21.15.81:0/2031661562 >> [v2:172.21.15.81:6817/85562,v1:172.21.15.81:6819/85562] conn(0x7f77c0070d50 0x7f77c0073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.128+0000 7f77de59c700 1 --2- 172.21.15.81:0/2031661562 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f77c0067080 0x7f77c0069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.128+0000 7f810ffff700 1 -- 172.21.15.81:0/1191628766 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f811006d880 msgr2=0x7f811006ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:00.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.128+0000 7f810ffff700 1 --2- 172.21.15.81:0/1191628766 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f811006d880 0x7f811006ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.128+0000 7f810ffff700 1 -- 172.21.15.81:0/1191628766 >> v1:172.21.15.81:6789/0 conn(0x7f811006b520 legacy=0x7f8110156600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.128+0000 7f810ffff700 1 -- 172.21.15.81:0/1191628766 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f811006e3d0 con 0x7f811006f060 2023-10-06T03:24:00.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.128+0000 7f810ffff700 1 --2- 172.21.15.81:0/1191628766 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f811006f060 0x7f811006f4c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8108009f20 tx=0x7f8108009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3791b76aa0fb4095 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.129+0000 7f77ded9d700 1 --2- 172.21.15.81:0/2031661562 >> [v2:172.21.15.81:6817/85562,v1:172.21.15.81:6819/85562] conn(0x7f77c0070d50 0x7f77c0073180 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.129+0000 7f77de59c700 1 --2- 172.21.15.81:0/2031661562 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f77c0067080 0x7f77c0069530 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f77d00039a0 tx=0x7f77d0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.129+0000 7f810e7fc700 1 -- 172.21.15.81:0/1191628766 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810800e070 con 0x7f811006f060 2023-10-06T03:24:00.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.129+0000 7f810e7fc700 1 -- 172.21.15.81:0/1191628766 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f810800b980 con 0x7f811006f060 2023-10-06T03:24:00.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.129+0000 7f810e7fc700 1 -- 172.21.15.81:0/1191628766 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81080092e0 con 0x7f811006f060 2023-10-06T03:24:00.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.130+0000 7f77ce7fc700 1 -- 172.21.15.81:0/2031661562 <== osd.3 v2:172.21.15.81:6817/85562 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f77c0073850 con 0x7f77c0070d50 2023-10-06T03:24:00.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.130+0000 7f0e0e7fc700 1 -- 172.21.15.81:0/3976595335 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0e1801daa0 con 0x7f0e200cb9f0 2023-10-06T03:24:00.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.131+0000 7f81161ff700 1 -- 172.21.15.81:0/1191628766 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f811006f060 msgr2=0x7f811006f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.131+0000 7f81161ff700 1 --2- 172.21.15.81:0/1191628766 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f811006f060 0x7f811006f4c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8108009f20 tx=0x7f8108009840 comp rx=0 tx=0).stop 2023-10-06T03:24:00.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.132+0000 7f0e0e7fc700 1 --2- 172.21.15.81:0/3976595335 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0e00067000 0x7f0e000694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.132+0000 7f81161ff700 1 -- 172.21.15.81:0/1191628766 shutdown_connections 2023-10-06T03:24:00.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.132+0000 7f81161ff700 1 --2- 172.21.15.81:0/1191628766 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f811006f060 0x7f811006f4c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.132+0000 7f81161ff700 1 --2- 172.21.15.81:0/1191628766 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f811006d880 0x7f811006ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.132+0000 7f81161ff700 1 -- 172.21.15.81:0/1191628766 >> 172.21.15.81:0/1191628766 conn(0x7f81100cc090 msgr2=0x7f81100cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:00.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.132+0000 7f0e1e59c700 1 --2- 172.21.15.81:0/3976595335 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0e00067000 0x7f0e000694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.133+0000 7f7faa1ff700 1 Processor -- start 2023-10-06T03:24:00.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.133+0000 7f7faa1ff700 1 -- start start 2023-10-06T03:24:00.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.133+0000 7f0e0e7fc700 1 -- 172.21.15.81:0/3976595335 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f0e18085910 con 0x7f0e200cb9f0 2023-10-06T03:24:00.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.133+0000 7f0e1e59c700 1 --2- 172.21.15.81:0/3976595335 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0e00067000 0x7f0e000694b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0e201614e0 tx=0x7f0e14008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.134+0000 7f0e0e7fc700 1 --2- 172.21.15.81:0/3976595335 >> [v2:172.21.15.81:6800/85561,v1:172.21.15.81:6801/85561] conn(0x7f0e00070cd0 0x7f0e00073100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.134+0000 7f0e0e7fc700 1 -- 172.21.15.81:0/3976595335 --> [v2:172.21.15.81:6800/85561,v1:172.21.15.81:6801/85561] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0e000737d0 con 0x7f0e00070cd0 2023-10-06T03:24:00.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.134+0000 7f0e0e7fc700 1 -- 172.21.15.81:0/3976595335 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e18085b50 con 0x7f0e200cb9f0 2023-10-06T03:24:00.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.132+0000 7f81161ff700 1 -- 172.21.15.81:0/1191628766 shutdown_connections 2023-10-06T03:24:00.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.132+0000 7f81161ff700 1 -- 172.21.15.81:0/1191628766 wait complete. 2023-10-06T03:24:00.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.134+0000 7f0e1ed9d700 1 --2- 172.21.15.81:0/3976595335 >> [v2:172.21.15.81:6800/85561,v1:172.21.15.81:6801/85561] conn(0x7f0e00070cd0 0x7f0e00073100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.134+0000 7f81161ff700 1 Processor -- start 2023-10-06T03:24:00.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.135+0000 7f81161ff700 1 -- start start 2023-10-06T03:24:00.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.135+0000 7f0e1ed9d700 1 --2- 172.21.15.81:0/3976595335 >> [v2:172.21.15.81:6800/85561,v1:172.21.15.81:6801/85561] conn(0x7f0e00070cd0 0x7f0e00073100 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.136+0000 7f7faa1ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7fa40af560 0x7f7fa40cf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.137+0000 7f0e0e7fc700 1 -- 172.21.15.81:0/3976595335 <== osd.1 v2:172.21.15.81:6800/85561 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f0e000737d0 con 0x7f0e00070cd0 2023-10-06T03:24:00.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.136+0000 7f7fa37fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7fa40af560 0x7f7fa40cf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.136+0000 7f7fa37fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7fa40af560 0x7f7fa40cf2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:50770/0 (socket says 172.21.15.81:50770) 2023-10-06T03:24:00.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.136+0000 7f81161ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f811006b520 0x7f81100b1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.136+0000 7f81161ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f811006d880 0x7f81101761c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.136+0000 7f81161ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f811006f060 0x7f8110176700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.136+0000 7f81161ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81100c4c30 con 0x7f811006b520 2023-10-06T03:24:00.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.136+0000 7f81161ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8110170680 con 0x7f811006d880 2023-10-06T03:24:00.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.136+0000 7f81161ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8110177ae0 con 0x7f811006f060 2023-10-06T03:24:00.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.137+0000 7f7fa37fe700 1 -- 172.21.15.81:0/2791659099 learned_addr learned my addr 172.21.15.81:0/2791659099 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:00.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.137+0000 7f7faa1ff700 1 -- 172.21.15.81:0/2791659099 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fa40b0760 con 0x7f7fa40af930 2023-10-06T03:24:00.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.137+0000 7f7faa1ff700 1 -- 172.21.15.81:0/2791659099 --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fa40cfd50 con 0x7f7fa40cd440 2023-10-06T03:24:00.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.137+0000 7f7faa1ff700 1 -- 172.21.15.81:0/2791659099 --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fa40cbd20 con 0x7f7fa40af560 2023-10-06T03:24:00.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.138+0000 7f810ffff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f811006f060 0x7f8110176700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.138+0000 7f810effd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f811006d880 0x7f81101761c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.138+0000 7f810effd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f811006d880 0x7f81101761c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:50780/0 (socket says 172.21.15.81:50780) 2023-10-06T03:24:00.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.138+0000 7f810effd700 1 -- 172.21.15.81:0/341641490 learned_addr learned my addr 172.21.15.81:0/341641490 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:00.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.138+0000 7f7fa37fe700 1 -- 172.21.15.81:0/2791659099 >> v1:172.21.15.83:6789/0 conn(0x7f7fa40cd440 legacy=0x7f7fa40b0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.139+0000 7f7fa37fe700 1 -- 172.21.15.81:0/2791659099 >> v1:172.21.15.81:6789/0 conn(0x7f7fa40af930 legacy=0x7f7fa40ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.139+0000 7f7fa37fe700 1 -- 172.21.15.81:0/2791659099 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa40d0030 con 0x7f7fa40af560 2023-10-06T03:24:00.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.139+0000 7f810effd700 1 -- 172.21.15.81:0/341641490 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f811006f060 msgr2=0x7f8110176700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.139+0000 7f810effd700 1 --2- 172.21.15.81:0/341641490 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f811006f060 0x7f8110176700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.139+0000 7f810effd700 1 -- 172.21.15.81:0/341641490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f811006b520 msgr2=0x7f81100b1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.139+0000 7f810effd700 1 --2- 172.21.15.81:0/341641490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f811006b520 0x7f81100b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.139+0000 7f810effd700 1 -- 172.21.15.81:0/341641490 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8108009ae0 con 0x7f811006d880 2023-10-06T03:24:00.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.139+0000 7f7fa37fe700 1 --2- 172.21.15.81:0/2791659099 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7fa40af560 0x7f7fa40cf2b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c0099b0 tx=0x7f7f8c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82e2cc1be403643f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.140+0000 7fe94639d700 1 Processor -- start 2023-10-06T03:24:00.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.139+0000 7f810effd700 1 --2- 172.21.15.81:0/341641490 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f811006d880 0x7f81101761c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f810400b810 tx=0x7f8104009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.140+0000 7f80f77fe700 1 -- 172.21.15.81:0/341641490 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810400f5f0 con 0x7f811006d880 2023-10-06T03:24:00.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.140+0000 7f80f77fe700 1 -- 172.21.15.81:0/341641490 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f810400f750 con 0x7f811006d880 2023-10-06T03:24:00.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.140+0000 7f80f77fe700 1 -- 172.21.15.81:0/341641490 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810400f5f0 con 0x7f811006d880 2023-10-06T03:24:00.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.140+0000 7f81161ff700 1 -- 172.21.15.81:0/341641490 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81100c4950 con 0x7f811006d880 2023-10-06T03:24:00.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.140+0000 7f81161ff700 1 -- 172.21.15.81:0/341641490 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8110177770 con 0x7f811006d880 2023-10-06T03:24:00.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.141+0000 7f7fa2ffd700 1 -- 172.21.15.81:0/2791659099 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c00b860 con 0x7f7fa40af560 2023-10-06T03:24:00.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.141+0000 7f7fa2ffd700 1 -- 172.21.15.81:0/2791659099 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f8c00b9c0 con 0x7f7fa40af560 2023-10-06T03:24:00.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.141+0000 7f7fa2ffd700 1 -- 172.21.15.81:0/2791659099 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c00bd40 con 0x7f7fa40af560 2023-10-06T03:24:00.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.143+0000 7f7faa1ff700 1 -- 172.21.15.81:0/2791659099 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7fa40af560 msgr2=0x7f7fa40cf2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.143+0000 7f7faa1ff700 1 --2- 172.21.15.81:0/2791659099 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7fa40af560 0x7f7fa40cf2b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c0099b0 tx=0x7f7f8c009250 comp rx=0 tx=0).stop 2023-10-06T03:24:00.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.140+0000 7fe94639d700 1 -- start start 2023-10-06T03:24:00.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.143+0000 7fe94639d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe9400cb7f0 0x7fe9400af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.143+0000 7f7faa1ff700 1 -- 172.21.15.81:0/2791659099 shutdown_connections 2023-10-06T03:24:00.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.143+0000 7f7faa1ff700 1 --2- 172.21.15.81:0/2791659099 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7fa40af560 0x7f7fa40cf2b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.143+0000 7f7faa1ff700 1 -- 172.21.15.81:0/2791659099 >> 172.21.15.81:0/2791659099 conn(0x7f7fa406ed10 msgr2=0x7f7fa406f110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:00.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.143+0000 7fe94639d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe94006dca0 con 0x7fe9400a6700 2023-10-06T03:24:00.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.143+0000 7fe94639d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9400ac980 con 0x7fe9400cb420 2023-10-06T03:24:00.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.143+0000 7fe94639d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe94006d370 con 0x7fe9400cb7f0 2023-10-06T03:24:00.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.143+0000 7fe94539b700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fe9400cb420 0x7fe9400ac160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:40058/0 (socket says 172.21.15.81:40058) 2023-10-06T03:24:00.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.143+0000 7fe94539b700 1 -- 172.21.15.81:0/604566933 learned_addr learned my addr 172.21.15.81:0/604566933 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:24:00.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.143+0000 7fe944b9a700 1 --2- 172.21.15.81:0/604566933 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe9400cb7f0 0x7fe9400af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.144+0000 7fe933fff700 1 -- 172.21.15.81:0/604566933 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 963298630 0 0) 0x7fe9400ac980 con 0x7fe9400cb420 2023-10-06T03:24:00.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.144+0000 7f7faa1ff700 1 -- 172.21.15.81:0/2791659099 shutdown_connections 2023-10-06T03:24:00.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.144+0000 7f7faa1ff700 1 -- 172.21.15.81:0/2791659099 wait complete. 2023-10-06T03:24:00.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.144+0000 7fe933fff700 1 -- 172.21.15.81:0/604566933 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe92c003570 con 0x7fe9400cb420 2023-10-06T03:24:00.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.145+0000 7fe944b9a700 1 -- 172.21.15.81:0/604566933 >> v1:172.21.15.83:6789/0 conn(0x7fe9400cb420 legacy=0x7fe9400ac160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.145+0000 7fe944b9a700 1 -- 172.21.15.81:0/604566933 >> v1:172.21.15.81:6789/0 conn(0x7fe9400a6700 legacy=0x7fe9400acea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:00.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.145+0000 7fe944b9a700 1 -- 172.21.15.81:0/604566933 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe94006d650 con 0x7fe9400cb7f0 2023-10-06T03:24:00.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.144+0000 7f80f77fe700 1 -- 172.21.15.81:0/341641490 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f810400fad0 con 0x7f811006d880 2023-10-06T03:24:00.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.144+0000 7f81161ff700 1 -- 172.21.15.81:0/341641490 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f811004c3c0 con 0x7f811006d880 2023-10-06T03:24:00.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.145+0000 7f80f77fe700 1 --2- 172.21.15.81:0/341641490 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f80fc066f90 0x7f80fc069440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.145+0000 7f80f77fe700 1 -- 172.21.15.81:0/341641490 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f81040845a0 con 0x7f811006d880 2023-10-06T03:24:00.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.145+0000 7f80f77fe700 1 --2- 172.21.15.81:0/341641490 >> [v2:172.21.15.83:6808/85786,v1:172.21.15.83:6810/85786] conn(0x7f80fc070b60 0x7f80fc072f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.145+0000 7f80f77fe700 1 -- 172.21.15.81:0/341641490 --> [v2:172.21.15.83:6808/85786,v1:172.21.15.83:6810/85786] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f80fc073660 con 0x7f80fc070b60 2023-10-06T03:24:00.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.146+0000 7f810f7fe700 1 --2- 172.21.15.81:0/341641490 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f80fc066f90 0x7f80fc069440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.147+0000 7f810f7fe700 1 --2- 172.21.15.81:0/341641490 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f80fc066f90 0x7f80fc069440 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f81100c2dc0 tx=0x7f8100007aa0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.147+0000 7f7faa1ff700 1 Processor -- start 2023-10-06T03:24:00.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.147+0000 7f810ffff700 1 --2- 172.21.15.81:0/341641490 >> [v2:172.21.15.83:6808/85786,v1:172.21.15.83:6810/85786] conn(0x7f80fc070b60 0x7f80fc072f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.147+0000 7f7faa1ff700 1 -- start start 2023-10-06T03:24:00.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.148+0000 7f80f77fe700 1 -- 172.21.15.81:0/341641490 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8104051320 con 0x7f811006d880 2023-10-06T03:24:00.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.148+0000 7fe944b9a700 1 --2- 172.21.15.81:0/604566933 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe9400cb7f0 0x7fe9400af2e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe938009e90 tx=0x7fe938009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8cc2ccf6df340054 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.148+0000 7f810ffff700 1 --2- 172.21.15.81:0/341641490 >> [v2:172.21.15.83:6808/85786,v1:172.21.15.83:6810/85786] conn(0x7f80fc070b60 0x7f80fc072f90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.149+0000 7fe933fff700 1 -- 172.21.15.81:0/604566933 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93800e070 con 0x7fe9400cb7f0 2023-10-06T03:24:00.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.149+0000 7fe933fff700 1 -- 172.21.15.81:0/604566933 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe93800bbb0 con 0x7fe9400cb7f0 2023-10-06T03:24:00.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.149+0000 7fe933fff700 1 -- 172.21.15.81:0/604566933 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe938012430 con 0x7fe9400cb7f0 2023-10-06T03:24:00.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.149+0000 7f7faa1ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7fa40af560 0x7f7fa416cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.149+0000 7f7faa1ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fa40af930 0x7f7fa4156d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.149+0000 7f7faa1ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7fa40cd440 0x7f7fa41584c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.149+0000 7f7faa1ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa4169580 con 0x7f7fa40af930 2023-10-06T03:24:00.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.149+0000 7fe94639d700 1 -- 172.21.15.81:0/604566933 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe9400cb7f0 msgr2=0x7fe9400af2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.149+0000 7fe94639d700 1 --2- 172.21.15.81:0/604566933 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe9400cb7f0 0x7fe9400af2e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe938009e90 tx=0x7fe938009780 comp rx=0 tx=0).stop 2023-10-06T03:24:00.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.149+0000 7f80f77fe700 1 -- 172.21.15.81:0/341641490 <== osd.7 v2:172.21.15.83:6808/85786 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f80fc073660 con 0x7f80fc070b60 2023-10-06T03:24:00.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.149+0000 7f7faa1ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa40c79c0 con 0x7f7fa40af560 2023-10-06T03:24:00.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.149+0000 7f7faa1ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa416d160 con 0x7f7fa40cd440 2023-10-06T03:24:00.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.150+0000 7f7fa37fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7fa40af560 0x7f7fa416cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.150+0000 7f7fa3fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7fa40cd440 0x7f7fa41584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.150+0000 7f7fa37fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7fa40af560 0x7f7fa416cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:50790/0 (socket says 172.21.15.81:50790) 2023-10-06T03:24:00.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.150+0000 7f7fa37fe700 1 -- 172.21.15.81:0/1437426576 learned_addr learned my addr 172.21.15.81:0/1437426576 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:00.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.150+0000 7f7f9affd700 1 --2- 172.21.15.81:0/1437426576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fa40af930 0x7f7fa4156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.150+0000 7fe94639d700 1 -- 172.21.15.81:0/604566933 shutdown_connections 2023-10-06T03:24:00.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.150+0000 7fe94639d700 1 --2- 172.21.15.81:0/604566933 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe9400cb7f0 0x7fe9400af2e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.150+0000 7fe94639d700 1 -- 172.21.15.81:0/604566933 >> 172.21.15.81:0/604566933 conn(0x7fe9400cbef0 msgr2=0x7fe9400cc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:00.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.150+0000 7f7fa3fff700 1 -- 172.21.15.81:0/1437426576 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7fa40af560 msgr2=0x7f7fa416cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.150+0000 7f7fa3fff700 1 --2- 172.21.15.81:0/1437426576 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7fa40af560 0x7f7fa416cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.150+0000 7f7fa3fff700 1 -- 172.21.15.81:0/1437426576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fa40af930 msgr2=0x7f7fa4156d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.150+0000 7f7fa3fff700 1 --2- 172.21.15.81:0/1437426576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fa40af930 0x7f7fa4156d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.150+0000 7f7fa3fff700 1 -- 172.21.15.81:0/1437426576 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f8c0094f0 con 0x7f7fa40cd440 2023-10-06T03:24:00.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.151+0000 7f7fa3fff700 1 --2- 172.21.15.81:0/1437426576 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7fa40cd440 0x7f7fa41584c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7fa40cd860 tx=0x7f7f9c001690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.150+0000 7fe94639d700 1 -- 172.21.15.81:0/604566933 shutdown_connections 2023-10-06T03:24:00.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.152+0000 7f276f59e700 1 -- 172.21.15.81:0/983596788 --> [v2:172.21.15.81:6816/85563,v1:172.21.15.81:6818/85563] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2754002d30 con 0x7f2750070bc0 2023-10-06T03:24:00.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.150+0000 7fe94639d700 1 -- 172.21.15.81:0/604566933 wait complete. 2023-10-06T03:24:00.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.152+0000 7f275e7fc700 1 -- 172.21.15.81:0/983596788 <== osd.0 v2:172.21.15.81:6816/85563 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2754002d30 con 0x7f2750070bc0 2023-10-06T03:24:00.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.153+0000 7fe94639d700 1 Processor -- start 2023-10-06T03:24:00.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.153+0000 7fe94639d700 1 -- start start 2023-10-06T03:24:00.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.153+0000 7f7f9bfff700 1 -- 172.21.15.81:0/1437426576 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c012630 con 0x7f7fa40cd440 2023-10-06T03:24:00.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.153+0000 7f7f9bfff700 1 -- 172.21.15.81:0/1437426576 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f9c012790 con 0x7f7fa40cd440 2023-10-06T03:24:00.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.153+0000 7f7f9bfff700 1 -- 172.21.15.81:0/1437426576 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c012b50 con 0x7f7fa40cd440 2023-10-06T03:24:00.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.154+0000 7f7faa1ff700 1 -- 172.21.15.81:0/1437426576 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fa416d440 con 0x7f7fa40cd440 2023-10-06T03:24:00.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.155+0000 7f7faa1ff700 1 -- 172.21.15.81:0/1437426576 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fa416da00 con 0x7f7fa40cd440 2023-10-06T03:24:00.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.155+0000 7f276f59e700 1 -- 172.21.15.81:0/983596788 >> [v2:172.21.15.81:6816/85563,v1:172.21.15.81:6818/85563] conn(0x7f2750070bc0 msgr2=0x7f2750072ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.155+0000 7f276f59e700 1 --2- 172.21.15.81:0/983596788 >> [v2:172.21.15.81:6816/85563,v1:172.21.15.81:6818/85563] conn(0x7f2750070bc0 0x7f2750072ff0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.155+0000 7fe94639d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9400a6700 0x7fe94015e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.155+0000 7f9f523ff700 1 -- 172.21.15.81:0/2831563967 --> [v2:172.21.15.81:6808/85564,v1:172.21.15.81:6809/85564] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9f44055fa0 con 0x7f9f30070d50 2023-10-06T03:24:00.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.155+0000 7fe94639d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9400cb420 0x7fe94014b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.155+0000 7f276f59e700 1 -- 172.21.15.81:0/983596788 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2750066ff0 msgr2=0x7f27500694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.155+0000 7f276f59e700 1 --2- 172.21.15.81:0/983596788 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2750066ff0 0x7f27500694a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f27680c2310 tx=0x7f2764008040 comp rx=0 tx=0).stop 2023-10-06T03:24:00.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.155+0000 7f276f59e700 1 -- 172.21.15.81:0/983596788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2768035330 msgr2=0x7f276804df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.155+0000 7f276f59e700 1 --2- 172.21.15.81:0/983596788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2768035330 0x7f276804df40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f276000b5b0 tx=0x7f27600090f0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.156+0000 7f276ed9d700 1 -- 172.21.15.81:0/983596788 reap_dead start 2023-10-06T03:24:00.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.156+0000 7f276f59e700 1 -- 172.21.15.81:0/983596788 shutdown_connections 2023-10-06T03:24:00.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.156+0000 7f276f59e700 1 -- 172.21.15.81:0/983596788 >> 172.21.15.81:0/983596788 conn(0x7f2768054d40 msgr2=0x7f2768051680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:00.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.155+0000 7fe94539b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9400a6700 0x7fe94015e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.156+0000 7fe94539b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9400a6700 0x7fe94015e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56186/0 (socket says 172.21.15.81:56186) 2023-10-06T03:24:00.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.156+0000 7fe94639d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe9400cb7f0 0x7fe940171640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.156+0000 7fe94639d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9400ab130 con 0x7fe9400a6700 2023-10-06T03:24:00.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.156+0000 7fe94639d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9400a74c0 con 0x7fe9400cb420 2023-10-06T03:24:00.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.156+0000 7fe94639d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9401721e0 con 0x7fe9400cb7f0 2023-10-06T03:24:00.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.156+0000 7f276f59e700 1 -- 172.21.15.81:0/983596788 shutdown_connections 2023-10-06T03:24:00.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.156+0000 7f276f59e700 1 -- 172.21.15.81:0/983596788 wait complete. 2023-10-06T03:24:00.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.156+0000 7f9f37fff700 1 -- 172.21.15.81:0/2831563967 <== osd.2 v2:172.21.15.81:6808/85564 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9f44055fa0 con 0x7f9f30070d50 2023-10-06T03:24:00.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.156+0000 7fe94539b700 1 -- 172.21.15.81:0/1855099968 learned_addr learned my addr 172.21.15.81:0/1855099968 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:00.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.157+0000 7fe944b9a700 1 --2- 172.21.15.81:0/1855099968 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9400cb420 0x7fe94014b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.157+0000 7fe945b9c700 1 --2- 172.21.15.81:0/1855099968 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe9400cb7f0 0x7fe940171640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.158+0000 7f9f523ff700 1 -- 172.21.15.81:0/2831563967 >> [v2:172.21.15.81:6808/85564,v1:172.21.15.81:6809/85564] conn(0x7f9f30070d50 msgr2=0x7f9f30073180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.158+0000 7f9f523ff700 1 --2- 172.21.15.81:0/2831563967 >> [v2:172.21.15.81:6808/85564,v1:172.21.15.81:6809/85564] conn(0x7f9f30070d50 0x7f9f30073180 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.157+0000 7fe94539b700 1 -- 172.21.15.81:0/1855099968 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe9400cb7f0 msgr2=0x7fe940171640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.157+0000 7fe94539b700 1 --2- 172.21.15.81:0/1855099968 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe9400cb7f0 0x7fe940171640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.157+0000 7fe94539b700 1 -- 172.21.15.81:0/1855099968 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9400cb420 msgr2=0x7fe94014b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.157+0000 7fe94539b700 1 --2- 172.21.15.81:0/1855099968 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9400cb420 0x7fe94014b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.157+0000 7fe94539b700 1 -- 172.21.15.81:0/1855099968 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe938009a20 con 0x7fe9400a6700 2023-10-06T03:24:00.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.158+0000 7f7f9bfff700 1 -- 172.21.15.81:0/1437426576 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7f9c01a3a0 con 0x7f7fa40cd440 2023-10-06T03:24:00.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.158+0000 7f9f523ff700 1 -- 172.21.15.81:0/2831563967 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f9f30067080 msgr2=0x7f9f30069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.158+0000 7f9f523ff700 1 --2- 172.21.15.81:0/2831563967 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f9f30067080 0x7f9f30069530 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9f40009b60 tx=0x7f9f400090f0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.158+0000 7f9f523ff700 1 -- 172.21.15.81:0/2831563967 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f44050210 msgr2=0x7f9f44050bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.158+0000 7f9f523ff700 1 --2- 172.21.15.81:0/2831563967 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f44050210 0x7f9f44050bc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c076520 tx=0x7f9f4c06e000 comp rx=0 tx=0).stop 2023-10-06T03:24:00.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.158+0000 7f9f5099c700 1 -- 172.21.15.81:0/2831563967 reap_dead start 2023-10-06T03:24:00.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.158+0000 7f9f523ff700 1 -- 172.21.15.81:0/2831563967 shutdown_connections 2023-10-06T03:24:00.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.158+0000 7f9f523ff700 1 -- 172.21.15.81:0/2831563967 >> 172.21.15.81:0/2831563967 conn(0x7f9f44055bd0 msgr2=0x7f9f4404f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:00.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.158+0000 7fe94539b700 1 --2- 172.21.15.81:0/1855099968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9400a6700 0x7fe94015e090 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe93400c810 tx=0x7fe934007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.159+0000 7fe9317fa700 1 -- 172.21.15.81:0/1855099968 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe934005c00 con 0x7fe9400a6700 2023-10-06T03:24:00.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.159+0000 7fe94639d700 1 -- 172.21.15.81:0/1855099968 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9400a6e70 con 0x7fe9400a6700 2023-10-06T03:24:00.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.159+0000 7f7faa1ff700 1 -- 172.21.15.81:0/1437426576 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7fa404c3c0 con 0x7f7fa40cd440 2023-10-06T03:24:00.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.160+0000 7f7f9bfff700 1 --2- 172.21.15.81:0/1437426576 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7f84067080 0x7f7f84069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.160+0000 7f7f9bfff700 1 -- 172.21.15.81:0/1437426576 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f7f9c084af0 con 0x7f7fa40cd440 2023-10-06T03:24:00.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.161+0000 7f7f9bfff700 1 --2- 172.21.15.81:0/1437426576 >> [v2:172.21.15.83:6824/85818,v1:172.21.15.83:6825/85818] conn(0x7f7f84070cd0 0x7f7f84073100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.161+0000 7f7f9bfff700 1 -- 172.21.15.81:0/1437426576 --> [v2:172.21.15.83:6824/85818,v1:172.21.15.83:6825/85818] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7f840737d0 con 0x7f7f84070cd0 2023-10-06T03:24:00.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.161+0000 7f7f9bfff700 1 -- 172.21.15.81:0/1437426576 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f9c0518f0 con 0x7f7fa40cd440 2023-10-06T03:24:00.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.161+0000 7f7fa37fe700 1 --2- 172.21.15.81:0/1437426576 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7f84067080 0x7f7f84069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.162+0000 7f9f523ff700 1 -- 172.21.15.81:0/2831563967 shutdown_connections 2023-10-06T03:24:00.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.162+0000 7f9f523ff700 1 -- 172.21.15.81:0/2831563967 wait complete. 2023-10-06T03:24:00.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.162+0000 7f7fa37fe700 1 --2- 172.21.15.81:0/1437426576 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7f84067080 0x7f7f84069530 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c006e80 tx=0x7f7f8c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.163+0000 7f7f9affd700 1 --2- 172.21.15.81:0/1437426576 >> [v2:172.21.15.83:6824/85818,v1:172.21.15.83:6825/85818] conn(0x7f7f84070cd0 0x7f7f84073100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.163+0000 7fe94639d700 1 -- 172.21.15.81:0/1855099968 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe94014b640 con 0x7fe9400a6700 2023-10-06T03:24:00.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.163+0000 7fe9317fa700 1 -- 172.21.15.81:0/1855099968 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe934005d60 con 0x7fe9400a6700 2023-10-06T03:24:00.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.163+0000 7fa6c2d9d700 1 -- 172.21.15.81:0/957186360 --> [v2:172.21.15.83:6800/85785,v1:172.21.15.83:6801/85785] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa6b4049a60 con 0x7fa6a0071920 2023-10-06T03:24:00.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.164+0000 7fe9317fa700 1 -- 172.21.15.81:0/1855099968 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe934007320 con 0x7fe9400a6700 2023-10-06T03:24:00.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.164+0000 7fe94639d700 1 -- 172.21.15.81:0/1855099968 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe920000fd0 con 0x7fe9400a6700 2023-10-06T03:24:00.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.164+0000 7fe9317fa700 1 -- 172.21.15.81:0/1855099968 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe93401b3b0 con 0x7fe9400a6700 2023-10-06T03:24:00.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.165+0000 7fa6b1ffb700 1 -- 172.21.15.81:0/957186360 <== osd.4 v2:172.21.15.83:6800/85785 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa6b4049a60 con 0x7fa6a0071920 2023-10-06T03:24:00.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.165+0000 7f7f9affd700 1 --2- 172.21.15.81:0/1437426576 >> [v2:172.21.15.83:6824/85818,v1:172.21.15.83:6825/85818] conn(0x7f7f84070cd0 0x7f7f84073100 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.166+0000 7fa6c2d9d700 1 -- 172.21.15.81:0/957186360 >> [v2:172.21.15.83:6800/85785,v1:172.21.15.83:6801/85785] conn(0x7fa6a0071920 msgr2=0x7fa6a0073db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.166+0000 7fa6c2d9d700 1 --2- 172.21.15.81:0/957186360 >> [v2:172.21.15.83:6800/85785,v1:172.21.15.83:6801/85785] conn(0x7fa6a0071920 0x7fa6a0073db0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.166+0000 7fe9317fa700 1 --2- 172.21.15.81:0/1855099968 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fe924067100 0x7fe9240695b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.166+0000 7fa6c2d9d700 1 -- 172.21.15.81:0/957186360 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa6a0067000 msgr2=0x7fa6a00694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.166+0000 7fa6c2d9d700 1 --2- 172.21.15.81:0/957186360 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa6a0067000 0x7fa6a00694b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa6b40543d0 tx=0x7fa6bc06b070 comp rx=0 tx=0).stop 2023-10-06T03:24:00.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.166+0000 7fa6c2d9d700 1 -- 172.21.15.81:0/957186360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6b40e9550 msgr2=0x7fa6b404b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.167+0000 7fa6c2d9d700 1 --2- 172.21.15.81:0/957186360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6b40e9550 0x7fa6b404b5e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac00e8d0 tx=0x7fa6ac0091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.167+0000 7fa6c259c700 1 -- 172.21.15.81:0/957186360 reap_dead start 2023-10-06T03:24:00.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.166+0000 7f7f9bfff700 1 -- 172.21.15.81:0/1437426576 <== osd.5 v2:172.21.15.83:6824/85818 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f7f840737d0 con 0x7f7f84070cd0 2023-10-06T03:24:00.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.166+0000 7fe944b9a700 1 --2- 172.21.15.81:0/1855099968 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fe924067100 0x7fe9240695b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.167+0000 7fa6c2d9d700 1 -- 172.21.15.81:0/957186360 shutdown_connections 2023-10-06T03:24:00.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.167+0000 7fa6c2d9d700 1 -- 172.21.15.81:0/957186360 >> 172.21.15.81:0/957186360 conn(0x7fa6b4051690 msgr2=0x7fa6b40e33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:00.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.167+0000 7fe9317fa700 1 -- 172.21.15.81:0/1855099968 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fe934083c00 con 0x7fe9400a6700 2023-10-06T03:24:00.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.168+0000 7fe9317fa700 1 --2- 172.21.15.81:0/1855099968 >> [v2:172.21.15.83:6809/85787,v1:172.21.15.83:6811/85787] conn(0x7fe924070dd0 0x7fe924073200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.168+0000 7fa6c2d9d700 1 -- 172.21.15.81:0/957186360 shutdown_connections 2023-10-06T03:24:00.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.168+0000 7fa6c2d9d700 1 -- 172.21.15.81:0/957186360 wait complete. 2023-10-06T03:24:00.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.168+0000 7fe9317fa700 1 -- 172.21.15.81:0/1855099968 --> [v2:172.21.15.83:6809/85787,v1:172.21.15.83:6811/85787] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe9240738d0 con 0x7fe924070dd0 2023-10-06T03:24:00.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.168+0000 7fe9317fa700 1 -- 172.21.15.81:0/1855099968 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe934083e80 con 0x7fe9400a6700 2023-10-06T03:24:00.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.168+0000 7fe945b9c700 1 --2- 172.21.15.81:0/1855099968 >> [v2:172.21.15.83:6809/85787,v1:172.21.15.83:6811/85787] conn(0x7fe924070dd0 0x7fe924073200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.169+0000 7fe944b9a700 1 --2- 172.21.15.81:0/1855099968 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fe924067100 0x7fe9240695b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe9400cbc00 tx=0x7fe938018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.169+0000 7f0e24fff700 1 -- 172.21.15.81:0/3976595335 --> [v2:172.21.15.81:6800/85561,v1:172.21.15.81:6801/85561] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0e20065720 con 0x7f0e00070cd0 2023-10-06T03:24:00.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.169+0000 7fe945b9c700 1 --2- 172.21.15.81:0/1855099968 >> [v2:172.21.15.83:6809/85787,v1:172.21.15.83:6811/85787] conn(0x7fe924070dd0 0x7fe924073200 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.170+0000 7f0e0e7fc700 1 -- 172.21.15.81:0/3976595335 <== osd.1 v2:172.21.15.81:6800/85561 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0e20065720 con 0x7f0e00070cd0 2023-10-06T03:24:00.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.170+0000 7f77bffff700 1 -- 172.21.15.81:0/2031661562 --> [v2:172.21.15.81:6817/85562,v1:172.21.15.81:6819/85562] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f77e00ccf70 con 0x7f77c0070d50 2023-10-06T03:24:00.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.170+0000 7fe9317fa700 1 -- 172.21.15.81:0/1855099968 <== osd.6 v2:172.21.15.83:6809/85787 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fe9240738d0 con 0x7fe924070dd0 2023-10-06T03:24:00.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.171+0000 7f77ce7fc700 1 -- 172.21.15.81:0/2031661562 <== osd.3 v2:172.21.15.81:6817/85562 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f77e00ccf70 con 0x7f77c0070d50 2023-10-06T03:24:00.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.171+0000 7f0e24fff700 1 -- 172.21.15.81:0/3976595335 >> [v2:172.21.15.81:6800/85561,v1:172.21.15.81:6801/85561] conn(0x7f0e00070cd0 msgr2=0x7f0e00073100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.171+0000 7f0e24fff700 1 --2- 172.21.15.81:0/3976595335 >> [v2:172.21.15.81:6800/85561,v1:172.21.15.81:6801/85561] conn(0x7f0e00070cd0 0x7f0e00073100 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.171+0000 7f0e24fff700 1 -- 172.21.15.81:0/3976595335 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0e00067000 msgr2=0x7f0e000694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.171+0000 7f0e24fff700 1 --2- 172.21.15.81:0/3976595335 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0e00067000 0x7f0e000694b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0e201614e0 tx=0x7f0e14008040 comp rx=0 tx=0).stop 2023-10-06T03:24:00.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.171+0000 7f0e24fff700 1 -- 172.21.15.81:0/3976595335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e200cb9f0 msgr2=0x7f0e2006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.171+0000 7f0e24fff700 1 --2- 172.21.15.81:0/3976595335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e200cb9f0 0x7f0e2006de50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0e18015000 tx=0x7f0e18018000 comp rx=0 tx=0).stop 2023-10-06T03:24:00.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.171+0000 7f0e1ed9d700 1 -- 172.21.15.81:0/3976595335 reap_dead start 2023-10-06T03:24:00.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.172+0000 7f0e24fff700 1 -- 172.21.15.81:0/3976595335 shutdown_connections 2023-10-06T03:24:00.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.172+0000 7f0e24fff700 1 -- 172.21.15.81:0/3976595335 >> 172.21.15.81:0/3976595335 conn(0x7f0e200cc090 msgr2=0x7f0e200c1330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:00.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.172+0000 7f0e24fff700 1 -- 172.21.15.81:0/3976595335 shutdown_connections 2023-10-06T03:24:00.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.172+0000 7f0e24fff700 1 -- 172.21.15.81:0/3976595335 wait complete. 2023-10-06T03:24:00.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.173+0000 7f77bffff700 1 -- 172.21.15.81:0/2031661562 >> [v2:172.21.15.81:6817/85562,v1:172.21.15.81:6819/85562] conn(0x7f77c0070d50 msgr2=0x7f77c0073180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.173+0000 7f77bffff700 1 --2- 172.21.15.81:0/2031661562 >> [v2:172.21.15.81:6817/85562,v1:172.21.15.81:6819/85562] conn(0x7f77c0070d50 0x7f77c0073180 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.174+0000 7f77bffff700 1 -- 172.21.15.81:0/2031661562 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f77c0067080 msgr2=0x7f77c0069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.174+0000 7f77bffff700 1 --2- 172.21.15.81:0/2031661562 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f77c0067080 0x7f77c0069530 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f77d00039a0 tx=0x7f77d0009040 comp rx=0 tx=0).stop 2023-10-06T03:24:00.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.174+0000 7f77bffff700 1 -- 172.21.15.81:0/2031661562 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77e00cfbc0 msgr2=0x7f77e015b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.174+0000 7f77bffff700 1 --2- 172.21.15.81:0/2031661562 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77e00cfbc0 0x7f77e015b330 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f77d400b5b0 tx=0x7f77d40090f0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.175+0000 7f77ded9d700 1 -- 172.21.15.81:0/2031661562 reap_dead start 2023-10-06T03:24:00.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.175+0000 7f77bffff700 1 -- 172.21.15.81:0/2031661562 shutdown_connections 2023-10-06T03:24:00.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.175+0000 7f77bffff700 1 -- 172.21.15.81:0/2031661562 >> 172.21.15.81:0/2031661562 conn(0x7f77e006f7e0 msgr2=0x7f77e01557b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:00.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.178+0000 7f77bffff700 1 -- 172.21.15.81:0/2031661562 shutdown_connections 2023-10-06T03:24:00.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.178+0000 7f77bffff700 1 -- 172.21.15.81:0/2031661562 wait complete. 2023-10-06T03:24:00.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.183+0000 7f81161ff700 1 -- 172.21.15.81:0/341641490 --> [v2:172.21.15.83:6808/85786,v1:172.21.15.83:6810/85786] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8110065720 con 0x7f80fc070b60 2023-10-06T03:24:00.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.186+0000 7f80f77fe700 1 -- 172.21.15.81:0/341641490 <== osd.7 v2:172.21.15.83:6808/85786 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8110065720 con 0x7f80fc070b60 2023-10-06T03:24:00.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.189+0000 7f81161ff700 1 -- 172.21.15.81:0/341641490 >> [v2:172.21.15.83:6808/85786,v1:172.21.15.83:6810/85786] conn(0x7f80fc070b60 msgr2=0x7f80fc072f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.189+0000 7f81161ff700 1 --2- 172.21.15.81:0/341641490 >> [v2:172.21.15.83:6808/85786,v1:172.21.15.83:6810/85786] conn(0x7f80fc070b60 0x7f80fc072f90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.208 INFO:teuthology.orchestra.run.smithi081.stdout:55834574856 2023-10-06T03:24:00.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.189+0000 7f81161ff700 1 -- 172.21.15.81:0/341641490 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f80fc066f90 msgr2=0x7f80fc069440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.189+0000 7f81161ff700 1 --2- 172.21.15.81:0/341641490 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f80fc066f90 0x7f80fc069440 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f81100c2dc0 tx=0x7f8100007aa0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.189+0000 7f81161ff700 1 -- 172.21.15.81:0/341641490 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f811006d880 msgr2=0x7f81101761c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.189+0000 7f81161ff700 1 --2- 172.21.15.81:0/341641490 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f811006d880 0x7f81101761c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f810400b810 tx=0x7f8104009250 comp rx=0 tx=0).stop 2023-10-06T03:24:00.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.190+0000 7f810ffff700 1 -- 172.21.15.81:0/341641490 reap_dead start 2023-10-06T03:24:00.209 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-06T03:24:00.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.190+0000 7f81161ff700 1 -- 172.21.15.81:0/341641490 shutdown_connections 2023-10-06T03:24:00.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.190+0000 7f81161ff700 1 -- 172.21.15.81:0/341641490 >> 172.21.15.81:0/341641490 conn(0x7f81100cc090 msgr2=0x7f8110156d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:00.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.190+0000 7f81161ff700 1 -- 172.21.15.81:0/341641490 shutdown_connections 2023-10-06T03:24:00.211 INFO:teuthology.orchestra.run.smithi081.stdout:55834574857 2023-10-06T03:24:00.211 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-06T03:24:00.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.191+0000 7f81161ff700 1 -- 172.21.15.81:0/341641490 wait complete. 2023-10-06T03:24:00.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.199+0000 7f7faa1ff700 1 -- 172.21.15.81:0/1437426576 --> [v2:172.21.15.83:6824/85818,v1:172.21.15.83:6825/85818] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7fa404c3c0 con 0x7f7f84070cd0 2023-10-06T03:24:00.213 INFO:teuthology.orchestra.run.smithi081.stdout:55834574856 2023-10-06T03:24:00.213 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-06T03:24:00.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.200+0000 7f7f9bfff700 1 -- 172.21.15.81:0/1437426576 <== osd.5 v2:172.21.15.83:6824/85818 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7fa404c3c0 con 0x7f7f84070cd0 2023-10-06T03:24:00.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.201+0000 7fe94639d700 1 -- 172.21.15.81:0/1855099968 --> [v2:172.21.15.83:6809/85787,v1:172.21.15.83:6811/85787] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe920002d30 con 0x7fe924070dd0 2023-10-06T03:24:00.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.201+0000 7f7faa1ff700 1 -- 172.21.15.81:0/1437426576 >> [v2:172.21.15.83:6824/85818,v1:172.21.15.83:6825/85818] conn(0x7f7f84070cd0 msgr2=0x7f7f84073100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.201+0000 7f7faa1ff700 1 --2- 172.21.15.81:0/1437426576 >> [v2:172.21.15.83:6824/85818,v1:172.21.15.83:6825/85818] conn(0x7f7f84070cd0 0x7f7f84073100 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.201+0000 7fe9317fa700 1 -- 172.21.15.81:0/1855099968 <== osd.6 v2:172.21.15.83:6809/85787 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe920002d30 con 0x7fe924070dd0 2023-10-06T03:24:00.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.201+0000 7f7faa1ff700 1 -- 172.21.15.81:0/1437426576 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7f84067080 msgr2=0x7f7f84069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.201+0000 7f7faa1ff700 1 --2- 172.21.15.81:0/1437426576 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7f84067080 0x7f7f84069530 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c006e80 tx=0x7f7f8c017000 comp rx=0 tx=0).stop 2023-10-06T03:24:00.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.201+0000 7f7faa1ff700 1 -- 172.21.15.81:0/1437426576 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7fa40cd440 msgr2=0x7f7fa41584c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.202+0000 7f7faa1ff700 1 --2- 172.21.15.81:0/1437426576 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7fa40cd440 0x7f7fa41584c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7fa40cd860 tx=0x7f7f9c001690 comp rx=0 tx=0).stop 2023-10-06T03:24:00.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.202+0000 7f7fa3fff700 1 -- 172.21.15.81:0/1437426576 reap_dead start 2023-10-06T03:24:00.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.202+0000 7f7faa1ff700 1 -- 172.21.15.81:0/1437426576 shutdown_connections 2023-10-06T03:24:00.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.202+0000 7f7faa1ff700 1 -- 172.21.15.81:0/1437426576 >> 172.21.15.81:0/1437426576 conn(0x7f7fa406ed10 msgr2=0x7f7fa4157bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:00.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.202+0000 7f7faa1ff700 1 -- 172.21.15.81:0/1437426576 shutdown_connections 2023-10-06T03:24:00.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.202+0000 7fe94639d700 1 -- 172.21.15.81:0/1855099968 >> [v2:172.21.15.83:6809/85787,v1:172.21.15.83:6811/85787] conn(0x7fe924070dd0 msgr2=0x7fe924073200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.202+0000 7fe94639d700 1 --2- 172.21.15.81:0/1855099968 >> [v2:172.21.15.83:6809/85787,v1:172.21.15.83:6811/85787] conn(0x7fe924070dd0 0x7fe924073200 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.202+0000 7f7faa1ff700 1 -- 172.21.15.81:0/1437426576 wait complete. 2023-10-06T03:24:00.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.202+0000 7fe94639d700 1 -- 172.21.15.81:0/1855099968 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fe924067100 msgr2=0x7fe9240695b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.202+0000 7fe94639d700 1 --2- 172.21.15.81:0/1855099968 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fe924067100 0x7fe9240695b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe9400cbc00 tx=0x7fe938018000 comp rx=0 tx=0).stop 2023-10-06T03:24:00.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.202+0000 7fe94639d700 1 -- 172.21.15.81:0/1855099968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9400a6700 msgr2=0x7fe94015e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.202+0000 7fe94639d700 1 --2- 172.21.15.81:0/1855099968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9400a6700 0x7fe94015e090 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe93400c810 tx=0x7fe934007d90 comp rx=0 tx=0).stop 2023-10-06T03:24:00.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.203+0000 7fe945b9c700 1 -- 172.21.15.81:0/1855099968 reap_dead start 2023-10-06T03:24:00.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.203+0000 7fe94639d700 1 -- 172.21.15.81:0/1855099968 shutdown_connections 2023-10-06T03:24:00.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.203+0000 7fe94639d700 1 -- 172.21.15.81:0/1855099968 >> 172.21.15.81:0/1855099968 conn(0x7fe9400cbef0 msgr2=0x7fe94015ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:00.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.203+0000 7fe94639d700 1 -- 172.21.15.81:0/1855099968 shutdown_connections 2023-10-06T03:24:00.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.203+0000 7fe94639d700 1 -- 172.21.15.81:0/1855099968 wait complete. 2023-10-06T03:24:00.220 INFO:teuthology.orchestra.run.smithi081.stdout:55834574857 2023-10-06T03:24:00.220 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-06T03:24:00.221 INFO:teuthology.orchestra.run.smithi081.stdout:55834574856 2023-10-06T03:24:00.222 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-06T03:24:00.222 INFO:teuthology.orchestra.run.smithi081.stdout:55834574857 2023-10-06T03:24:00.223 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-06T03:24:00.224 INFO:teuthology.orchestra.run.smithi081.stdout:55834574856 2023-10-06T03:24:00.225 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-06T03:24:00.234 INFO:teuthology.orchestra.run.smithi081.stdout:55834574856 2023-10-06T03:24:00.235 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-06T03:24:00.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.535+0000 7f4f1359d700 1 Processor -- start 2023-10-06T03:24:00.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.536+0000 7f4f1359d700 1 -- start start 2023-10-06T03:24:00.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.538+0000 7f4f1359d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4f040dbd10 0x7f4f04005f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.538+0000 7f4f1359d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f4f040341a0 0x7f4f040de980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.538+0000 7f4f1359d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f04053310 con 0x7f4f040dc0e0 2023-10-06T03:24:00.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.538+0000 7f4f1359d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f04053bb0 con 0x7f4f040dbd10 2023-10-06T03:24:00.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.538+0000 7f4f1359d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f040df6b0 con 0x7f4f040341a0 2023-10-06T03:24:00.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.539+0000 7f4f11d9a700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4f040dc0e0 0x7f4f04033a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39384/0 (socket says 172.21.15.81:39384) 2023-10-06T03:24:00.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.539+0000 7f4f11d9a700 1 -- 172.21.15.81:0/4229999245 learned_addr learned my addr 172.21.15.81:0/4229999245 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:24:00.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.539+0000 7f4f1259b700 1 --2- 172.21.15.81:0/4229999245 >> v2:172.21.15.81:3300/0 conn(0x7f4f040dbd10 0x7f4f04005f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.540+0000 7f4f12d9c700 1 --2- 172.21.15.81:0/4229999245 >> v2:172.21.15.83:3300/0 conn(0x7f4f040341a0 0x7f4f040de980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.540+0000 7f4f1259b700 1 -- 172.21.15.81:0/4229999245 >> v2:172.21.15.83:3300/0 conn(0x7f4f040341a0 msgr2=0x7f4f040de980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:00.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.540+0000 7f4f1259b700 1 --2- 172.21.15.81:0/4229999245 >> v2:172.21.15.83:3300/0 conn(0x7f4f040341a0 0x7f4f040de980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.540+0000 7f4f1259b700 1 -- 172.21.15.81:0/4229999245 >> v1:172.21.15.81:6789/0 conn(0x7f4f040dc0e0 legacy=0x7f4f04033a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.540+0000 7f4f1259b700 1 -- 172.21.15.81:0/4229999245 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f04053560 con 0x7f4f040dbd10 2023-10-06T03:24:00.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.541+0000 7f4f1259b700 1 --2- 172.21.15.81:0/4229999245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f040dbd10 0x7f4f04005f10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c000eb0 tx=0x7f4f0c066bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=464673c3dd9bcfb1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.542+0000 7f4f11599700 1 -- 172.21.15.81:0/4229999245 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c04bb80 con 0x7f4f040dbd10 2023-10-06T03:24:00.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.542+0000 7f4f11599700 1 -- 172.21.15.81:0/4229999245 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f0c04c3c0 con 0x7f4f040dbd10 2023-10-06T03:24:00.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.542+0000 7f4f11599700 1 -- 172.21.15.81:0/4229999245 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c0647b0 con 0x7f4f040dbd10 2023-10-06T03:24:00.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.543+0000 7f4f1359d700 1 -- 172.21.15.81:0/4229999245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f040dbd10 msgr2=0x7f4f04005f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.543+0000 7f4f1359d700 1 --2- 172.21.15.81:0/4229999245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f040dbd10 0x7f4f04005f10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c000eb0 tx=0x7f4f0c066bb0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.544+0000 7f4f1359d700 1 -- 172.21.15.81:0/4229999245 shutdown_connections 2023-10-06T03:24:00.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.544+0000 7f4f1359d700 1 --2- 172.21.15.81:0/4229999245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f040dbd10 0x7f4f04005f10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.544+0000 7f4f1359d700 1 --2- 172.21.15.81:0/4229999245 >> v2:172.21.15.83:3300/0 conn(0x7f4f040341a0 0x7f4f040de980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.544+0000 7f4f1359d700 1 -- 172.21.15.81:0/4229999245 >> 172.21.15.81:0/4229999245 conn(0x7f4f040517b0 msgr2=0x7f4f04051bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:00.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.545+0000 7f4f1359d700 1 -- 172.21.15.81:0/4229999245 shutdown_connections 2023-10-06T03:24:00.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.545+0000 7f4f1359d700 1 -- 172.21.15.81:0/4229999245 wait complete. 2023-10-06T03:24:00.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.547+0000 7fa646d9d700 1 Processor -- start 2023-10-06T03:24:00.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.547+0000 7fa646d9d700 1 -- start start 2023-10-06T03:24:00.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.548+0000 7f4f1359d700 1 Processor -- start 2023-10-06T03:24:00.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.548+0000 7f4f1359d700 1 -- start start 2023-10-06T03:24:00.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.549+0000 7fa646d9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa640161b40 0x7fa6400cad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.549+0000 7fa646d9d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa640069660 con 0x7fa640157fa0 2023-10-06T03:24:00.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.549+0000 7fa646d9d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6400abd30 con 0x7fa64006a940 2023-10-06T03:24:00.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.549+0000 7fa646d9d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa640158370 con 0x7fa640161b40 2023-10-06T03:24:00.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.549+0000 7fa645d9b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa640157fa0 0x7fa64006a230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39392/0 (socket says 172.21.15.81:39392) 2023-10-06T03:24:00.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.549+0000 7fa645d9b700 1 -- 172.21.15.81:0/2650167382 learned_addr learned my addr 172.21.15.81:0/2650167382 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:24:00.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.550+0000 7fa644d99700 1 -- 172.21.15.81:0/2650167382 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 843451950 0 0) 0x7fa640069660 con 0x7fa640157fa0 2023-10-06T03:24:00.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.550+0000 7fa644d99700 1 -- 172.21.15.81:0/2650167382 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa62c003570 con 0x7fa640157fa0 2023-10-06T03:24:00.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.550+0000 7fa64659c700 1 --2- 172.21.15.81:0/2650167382 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa640161b40 0x7fa6400cad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.551+0000 7fa644d99700 1 -- 172.21.15.81:0/2650167382 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2285895917 0 0) 0x7fa62c003570 con 0x7fa640157fa0 2023-10-06T03:24:00.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.551+0000 7fa644d99700 1 -- 172.21.15.81:0/2650167382 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa640161b40 msgr2=0x7fa6400cad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:00.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.551+0000 7fa644d99700 1 --2- 172.21.15.81:0/2650167382 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa640161b40 0x7fa6400cad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.551+0000 7fa644d99700 1 -- 172.21.15.81:0/2650167382 >> v1:172.21.15.83:6789/0 conn(0x7fa64006a940 legacy=0x7fa640161430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:00.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.551+0000 7fa644d99700 1 -- 172.21.15.81:0/2650167382 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa64006add0 con 0x7fa640157fa0 2023-10-06T03:24:00.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.551+0000 7fa644d99700 1 -- 172.21.15.81:0/2650167382 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2513016936 0 0) 0x7fa63c001470 con 0x7fa640157fa0 2023-10-06T03:24:00.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.551+0000 7fa644d99700 1 -- 172.21.15.81:0/2650167382 >> v1:172.21.15.81:6789/0 conn(0x7fa640157fa0 legacy=0x7fa64006a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.551+0000 7fa644d99700 1 --2- 172.21.15.81:0/2650167382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa62c003b10 0x7fa62c003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.551+0000 7fa644d99700 1 --2- 172.21.15.81:0/2650167382 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa62c004810 0x7fa62c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.551+0000 7fa644d99700 1 --2- 172.21.15.81:0/2650167382 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa62c005290 0x7fa62c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.551+0000 7fa644d99700 1 -- 172.21.15.81:0/2650167382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa640158370 con 0x7fa62c003b10 2023-10-06T03:24:00.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.551+0000 7fa644d99700 1 -- 172.21.15.81:0/2650167382 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c00c130 con 0x7fa62c004810 2023-10-06T03:24:00.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.551+0000 7fa644d99700 1 -- 172.21.15.81:0/2650167382 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c00c2f0 con 0x7fa62c005290 2023-10-06T03:24:00.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.552+0000 7fa645d9b700 1 --2- 172.21.15.81:0/2650167382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa62c003b10 0x7fa62c003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.552+0000 7f70693ff700 1 Processor -- start 2023-10-06T03:24:00.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.552+0000 7f70693ff700 1 -- start start 2023-10-06T03:24:00.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.552+0000 7fa645d9b700 1 -- 172.21.15.81:0/2650167382 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa62c005290 msgr2=0x7fa62c00ba60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T03:24:00.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.552+0000 7fa645d9b700 1 --2- 172.21.15.81:0/2650167382 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa62c005290 0x7fa62c00ba60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.552+0000 7fa64559a700 1 --2- 172.21.15.81:0/2650167382 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa62c004810 0x7fa62c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.552+0000 7fa645d9b700 1 -- 172.21.15.81:0/2650167382 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa62c004810 msgr2=0x7fa62c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:00.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.553+0000 7f4f1359d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4f040341a0 0x7f4f040d6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.553+0000 7f4f1359d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4f040dbd10 0x7f4f04035ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.553+0000 7f4f1359d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f040dadb0 0x7f4f04036530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.553+0000 7f4f1359d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0404e590 con 0x7f4f040dadb0 2023-10-06T03:24:00.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.553+0000 7f4f1359d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0404edd0 con 0x7f4f040341a0 2023-10-06T03:24:00.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.553+0000 7f4f1359d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0404c420 con 0x7f4f040dbd10 2023-10-06T03:24:00.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.552+0000 7fa645d9b700 1 --2- 172.21.15.81:0/2650167382 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa62c004810 0x7fa62c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.552+0000 7fa645d9b700 1 -- 172.21.15.81:0/2650167382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa64006add0 con 0x7fa62c003b10 2023-10-06T03:24:00.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.553+0000 7fa64559a700 1 --2- 172.21.15.81:0/2650167382 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa62c004810 0x7fa62c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:00.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.553+0000 7fa645d9b700 1 --2- 172.21.15.81:0/2650167382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa62c003b10 0x7fa62c003f00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa63c00c320 tx=0x7fa63c00c630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d71bbe8fe08c32c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.553+0000 7f4f11d9a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4f040dbd10 0x7f4f04035ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.553+0000 7f4f11d9a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4f040dbd10 0x7f4f04035ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:51432/0 (socket says 172.21.15.81:51432) 2023-10-06T03:24:00.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.553+0000 7f4f11d9a700 1 -- 172.21.15.81:0/769077714 learned_addr learned my addr 172.21.15.81:0/769077714 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:00.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.553+0000 7f4f1259b700 1 --2- 172.21.15.81:0/769077714 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4f040341a0 0x7f4f040d6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.554+0000 7fa644d99700 1 -- 172.21.15.81:0/2650167382 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63c00ccc0 con 0x7fa62c003b10 2023-10-06T03:24:00.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.554+0000 7fa644d99700 1 -- 172.21.15.81:0/2650167382 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa63c00ce20 con 0x7fa62c003b10 2023-10-06T03:24:00.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.554+0000 7fa644d99700 1 -- 172.21.15.81:0/2650167382 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63c005b50 con 0x7fa62c003b10 2023-10-06T03:24:00.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.554+0000 7f4f12d9c700 1 --2- 172.21.15.81:0/769077714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f040dadb0 0x7f4f04036530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.554+0000 7f4f11d9a700 1 -- 172.21.15.81:0/769077714 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4f040341a0 msgr2=0x7f4f040d6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.554+0000 7f4f11d9a700 1 --2- 172.21.15.81:0/769077714 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4f040341a0 0x7f4f040d6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.554+0000 7f4f11d9a700 1 -- 172.21.15.81:0/769077714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f040dadb0 msgr2=0x7f4f04036530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.554+0000 7f4f11d9a700 1 --2- 172.21.15.81:0/769077714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f040dadb0 0x7f4f04036530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.554+0000 7f4f11d9a700 1 -- 172.21.15.81:0/769077714 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f0c04c9a0 con 0x7f4f040dbd10 2023-10-06T03:24:00.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.554+0000 7f4f12d9c700 1 --2- 172.21.15.81:0/769077714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f040dadb0 0x7f4f04036530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:00.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.554+0000 7f4f11d9a700 1 --2- 172.21.15.81:0/769077714 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4f040dbd10 0x7f4f04035ff0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4f0800ca00 tx=0x7f4f0800a310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.555+0000 7f4f027fc700 1 -- 172.21.15.81:0/769077714 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f080078e0 con 0x7f4f040dbd10 2023-10-06T03:24:00.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.555+0000 7f4f1359d700 1 -- 172.21.15.81:0/769077714 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f0404e7c0 con 0x7f4f040dbd10 2023-10-06T03:24:00.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.555+0000 7f4f1359d700 1 -- 172.21.15.81:0/769077714 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f0404ea60 con 0x7f4f040dbd10 2023-10-06T03:24:00.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.554+0000 7f70693ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f70640c68e0 0x7f70640c6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.554+0000 7f70693ff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70640c7260 con 0x7f7064147140 2023-10-06T03:24:00.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.554+0000 7f70693ff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7064069a10 con 0x7f7064147510 2023-10-06T03:24:00.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.554+0000 7f70693ff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f706406b1c0 con 0x7f70640c68e0 2023-10-06T03:24:00.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.555+0000 7f7062ffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7064147140 0x7f706406aab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39396/0 (socket says 172.21.15.81:39396) 2023-10-06T03:24:00.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.555+0000 7f7062ffd700 1 -- 172.21.15.81:0/814221478 learned_addr learned my addr 172.21.15.81:0/814221478 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:24:00.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.555+0000 7f70637fe700 1 --2- 172.21.15.81:0/814221478 >> v2:172.21.15.83:3300/0 conn(0x7f70640c68e0 0x7f70640c6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.555+0000 7f70637fe700 1 -- 172.21.15.81:0/814221478 >> v1:172.21.15.83:6789/0 conn(0x7f7064147510 legacy=0x7f70640cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:00.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.556+0000 7f7061ffb700 1 -- 172.21.15.81:0/814221478 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3011570548 0 0) 0x7f70640c7260 con 0x7f7064147140 2023-10-06T03:24:00.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.556+0000 7f70637fe700 1 -- 172.21.15.81:0/814221478 >> v1:172.21.15.81:6789/0 conn(0x7f7064147140 legacy=0x7f706406aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.556+0000 7f70637fe700 1 -- 172.21.15.81:0/814221478 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7064069cf0 con 0x7f70640c68e0 2023-10-06T03:24:00.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.556+0000 7f70637fe700 1 --2- 172.21.15.81:0/814221478 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70640c68e0 0x7f70640c6d20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f70540098e0 tx=0x7f70540091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27fe87d1cf142361 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.556+0000 7f7061ffb700 1 -- 172.21.15.81:0/814221478 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7054009e80 con 0x7f70640c68e0 2023-10-06T03:24:00.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.556+0000 7fa646d9d700 1 -- 172.21.15.81:0/2650167382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa62c003b10 msgr2=0x7fa62c003f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.556+0000 7fa646d9d700 1 --2- 172.21.15.81:0/2650167382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa62c003b10 0x7fa62c003f00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa63c00c320 tx=0x7fa63c00c630 comp rx=0 tx=0).stop 2023-10-06T03:24:00.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.556+0000 7fa64659c700 1 -- 172.21.15.81:0/2650167382 reap_dead start 2023-10-06T03:24:00.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.557+0000 7fa646d9d700 1 -- 172.21.15.81:0/2650167382 shutdown_connections 2023-10-06T03:24:00.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.557+0000 7fa646d9d700 1 -- 172.21.15.81:0/2650167382 >> 172.21.15.81:0/2650167382 conn(0x7fa6400cc9c0 msgr2=0x7fa6400a5430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:00.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.557+0000 7f7061ffb700 1 -- 172.21.15.81:0/814221478 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f705400b820 con 0x7f70640c68e0 2023-10-06T03:24:00.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.556+0000 7fcbf0bff700 1 Processor -- start 2023-10-06T03:24:00.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.557+0000 7fcbf0bff700 1 -- start start 2023-10-06T03:24:00.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.557+0000 7f4f027fc700 1 -- 172.21.15.81:0/769077714 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f08007a40 con 0x7f4f040dbd10 2023-10-06T03:24:00.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.558+0000 7f70693ff700 1 -- 172.21.15.81:0/814221478 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70640c68e0 msgr2=0x7f70640c6d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.558+0000 7f70693ff700 1 --2- 172.21.15.81:0/814221478 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70640c68e0 0x7f70640c6d20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f70540098e0 tx=0x7f70540091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.558+0000 7f70693ff700 1 -- 172.21.15.81:0/814221478 shutdown_connections 2023-10-06T03:24:00.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.558+0000 7f70693ff700 1 --2- 172.21.15.81:0/814221478 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70640c68e0 0x7f70640c6d20 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.558+0000 7f70693ff700 1 -- 172.21.15.81:0/814221478 >> 172.21.15.81:0/814221478 conn(0x7f70640cc090 msgr2=0x7f70640cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:00.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.559+0000 7f70693ff700 1 -- 172.21.15.81:0/814221478 shutdown_connections 2023-10-06T03:24:00.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.559+0000 7f4f027fc700 1 -- 172.21.15.81:0/769077714 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f08007de0 con 0x7f4f040dbd10 2023-10-06T03:24:00.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.558+0000 7fcbf0bff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcbec0cb9f0 0x7fcbec0cac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.558+0000 7fcbf0bff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fcbec167980 0x7fcbec087260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.559+0000 7fcbf0bff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbec069e40 con 0x7fcbec0c6fc0 2023-10-06T03:24:00.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.559+0000 7fcbf0bff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbec16cdd0 con 0x7fcbec0cb9f0 2023-10-06T03:24:00.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.559+0000 7fcbf0bff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbec0697f0 con 0x7fcbec167980 2023-10-06T03:24:00.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.559+0000 7fcbea59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcbec0cb9f0 0x7fcbec0cac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.559+0000 7fcbe9d9b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fcbec167980 0x7fcbec087260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.559+0000 7fcbea59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcbec0cb9f0 0x7fcbec0cac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56228/0 (socket says 172.21.15.81:56228) 2023-10-06T03:24:00.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.559+0000 7fcbea59c700 1 -- 172.21.15.81:0/3657975592 learned_addr learned my addr 172.21.15.81:0/3657975592 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:00.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.560+0000 7fcbea59c700 1 -- 172.21.15.81:0/3657975592 >> v2:172.21.15.83:3300/0 conn(0x7fcbec167980 msgr2=0x7fcbec087260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:00.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.560+0000 7fcbea59c700 1 --2- 172.21.15.81:0/3657975592 >> v2:172.21.15.83:3300/0 conn(0x7fcbec167980 0x7fcbec087260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.560+0000 7fcbea59c700 1 -- 172.21.15.81:0/3657975592 >> v1:172.21.15.83:6789/0 conn(0x7fcbec0c6fc0 legacy=0x7fcbec06a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.560+0000 7fcbea59c700 1 -- 172.21.15.81:0/3657975592 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbec069ad0 con 0x7fcbec0cb9f0 2023-10-06T03:24:00.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.560+0000 7f4f027fc700 1 -- 172.21.15.81:0/769077714 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4f0800f450 con 0x7f4f040dbd10 2023-10-06T03:24:00.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.560+0000 7fcbea59c700 1 --2- 172.21.15.81:0/3657975592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbec0cb9f0 0x7fcbec0cac70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcbec0c88a0 tx=0x7fcbdc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48ce85a2ba1619c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.561+0000 7fcbe959a700 1 -- 172.21.15.81:0/3657975592 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc009e70 con 0x7fcbec0cb9f0 2023-10-06T03:24:00.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.561+0000 7fcbe959a700 1 -- 172.21.15.81:0/3657975592 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbdc00b8f0 con 0x7fcbec0cb9f0 2023-10-06T03:24:00.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.561+0000 7fcbe959a700 1 -- 172.21.15.81:0/3657975592 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc00bc90 con 0x7fcbec0cb9f0 2023-10-06T03:24:00.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.562+0000 7f4ef7fff700 1 -- 172.21.15.81:0/769077714 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ee80052b0 con 0x7f4f040dbd10 2023-10-06T03:24:00.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.562+0000 7fcbf0bff700 1 -- 172.21.15.81:0/3657975592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbec0cb9f0 msgr2=0x7fcbec0cac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.562+0000 7fcbf0bff700 1 --2- 172.21.15.81:0/3657975592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbec0cb9f0 0x7fcbec0cac70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcbec0c88a0 tx=0x7fcbdc009250 comp rx=0 tx=0).stop 2023-10-06T03:24:00.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.563+0000 7f4f027fc700 1 --2- 172.21.15.81:0/769077714 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f4ef0067000 0x7f4ef00694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.559+0000 7f70693ff700 1 -- 172.21.15.81:0/814221478 wait complete. 2023-10-06T03:24:00.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.561+0000 7f70693ff700 1 Processor -- start 2023-10-06T03:24:00.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.561+0000 7f70693ff700 1 -- start start 2023-10-06T03:24:00.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.563+0000 7f70693ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7064147140 0x7f70641385e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.563+0000 7f70693ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7064147510 0x7f7064138b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.564+0000 7f70693ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f706415d890 0x7f706415dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.564+0000 7f7062ffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7064147140 0x7f70641385e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.564+0000 7f7062ffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7064147140 0x7f70641385e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:50850/0 (socket says 172.21.15.81:50850) 2023-10-06T03:24:00.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.563+0000 7f4f1259b700 1 --2- 172.21.15.81:0/769077714 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f4ef0067000 0x7f4ef00694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.564+0000 7f4f1259b700 1 --2- 172.21.15.81:0/769077714 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f4ef0067000 0x7f4ef00694b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4f04007af0 tx=0x7f4f0c06e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.564+0000 7f7062ffd700 1 -- 172.21.15.81:0/3269973606 learned_addr learned my addr 172.21.15.81:0/3269973606 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:00.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.564+0000 7f4f027fc700 1 -- 172.21.15.81:0/769077714 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f4f08013070 con 0x7f4f040dbd10 2023-10-06T03:24:00.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.565+0000 7f70637fe700 1 --2- 172.21.15.81:0/3269973606 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f706415d890 0x7f706415dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.565+0000 7f70693ff700 1 -- 172.21.15.81:0/3269973606 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706415e270 con 0x7f7064147510 2023-10-06T03:24:00.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.565+0000 7f70693ff700 1 -- 172.21.15.81:0/3269973606 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706415e510 con 0x7f7064147140 2023-10-06T03:24:00.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.565+0000 7f70693ff700 1 -- 172.21.15.81:0/3269973606 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f706415e7f0 con 0x7f706415d890 2023-10-06T03:24:00.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.565+0000 7f70627fc700 1 --2- 172.21.15.81:0/3269973606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7064147510 0x7f7064138b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.561+0000 7fa646d9d700 1 -- 172.21.15.81:0/2650167382 shutdown_connections 2023-10-06T03:24:00.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.561+0000 7fa646d9d700 1 -- 172.21.15.81:0/2650167382 wait complete. 2023-10-06T03:24:00.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.566+0000 7f70637fe700 1 -- 172.21.15.81:0/3269973606 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7064147140 msgr2=0x7f70641385e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.566+0000 7f70637fe700 1 --2- 172.21.15.81:0/3269973606 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7064147140 0x7f70641385e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.566+0000 7f70637fe700 1 -- 172.21.15.81:0/3269973606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7064147510 msgr2=0x7f7064138b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.566+0000 7f70637fe700 1 --2- 172.21.15.81:0/3269973606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7064147510 0x7f7064138b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.566+0000 7f70637fe700 1 -- 172.21.15.81:0/3269973606 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7054009420 con 0x7f706415d890 2023-10-06T03:24:00.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.563+0000 7fa646d9d700 1 Processor -- start 2023-10-06T03:24:00.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.563+0000 7fa646d9d700 1 -- start start 2023-10-06T03:24:00.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.565+0000 7fa646d9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa640087540 0x7fa640158f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.565+0000 7fa646d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6401594a0 0x7fa640181c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.565+0000 7fa645d9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa640087540 0x7fa640158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.565+0000 7f085bdff700 1 Processor -- start 2023-10-06T03:24:00.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.565+0000 7fa645d9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa640087540 0x7fa640158f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:50866/0 (socket says 172.21.15.81:50866) 2023-10-06T03:24:00.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.566+0000 7fa646d9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa640182170 0x7fa64017e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.566+0000 7fa645d9b700 1 -- 172.21.15.81:0/2604463600 learned_addr learned my addr 172.21.15.81:0/2604463600 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:00.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.566+0000 7fa646d9d700 1 -- 172.21.15.81:0/2604463600 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6401825f0 con 0x7fa6401594a0 2023-10-06T03:24:00.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.566+0000 7fa646d9d700 1 -- 172.21.15.81:0/2604463600 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6400a88f0 con 0x7fa640087540 2023-10-06T03:24:00.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.566+0000 7fa646d9d700 1 -- 172.21.15.81:0/2604463600 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6400a7ce0 con 0x7fa640182170 2023-10-06T03:24:00.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.566+0000 7f085bdff700 1 -- start start 2023-10-06T03:24:00.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.566+0000 7f70637fe700 1 --2- 172.21.15.81:0/3269973606 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f706415d890 0x7f706415dd30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7054015000 tx=0x7f7054016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.566+0000 7fa64559a700 1 --2- 172.21.15.81:0/2604463600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6401594a0 0x7fa640181c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.566+0000 7fa645d9b700 1 -- 172.21.15.81:0/2604463600 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa640182170 msgr2=0x7fa64017e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.566+0000 7fa645d9b700 1 --2- 172.21.15.81:0/2604463600 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa640182170 0x7fa64017e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.566+0000 7fa645d9b700 1 -- 172.21.15.81:0/2604463600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6401594a0 msgr2=0x7fa640181c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.566+0000 7fa645d9b700 1 --2- 172.21.15.81:0/2604463600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6401594a0 0x7fa640181c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.566+0000 7fa645d9b700 1 -- 172.21.15.81:0/2604463600 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6400a7fc0 con 0x7fa640087540 2023-10-06T03:24:00.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.567+0000 7f78797ff700 1 Processor -- start 2023-10-06T03:24:00.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.565+0000 7fa95e5ff700 1 Processor -- start 2023-10-06T03:24:00.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.565+0000 7fa95e5ff700 1 -- start start 2023-10-06T03:24:00.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.567+0000 7fa645d9b700 1 --2- 172.21.15.81:0/2604463600 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa640087540 0x7fa640158f60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa62c0057f0 tx=0x7fa63c015000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.567+0000 7fcbf0bff700 1 -- 172.21.15.81:0/3657975592 shutdown_connections 2023-10-06T03:24:00.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.567+0000 7fcbf0bff700 1 --2- 172.21.15.81:0/3657975592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbec0cb9f0 0x7fcbec0cac70 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.567+0000 7fcbf0bff700 1 --2- 172.21.15.81:0/3657975592 >> v2:172.21.15.83:3300/0 conn(0x7fcbec167980 0x7fcbec087260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.567+0000 7fcbf0bff700 1 -- 172.21.15.81:0/3657975592 >> 172.21.15.81:0/3657975592 conn(0x7fcbec0cc090 msgr2=0x7fcbec0cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:00.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.567+0000 7f78797ff700 1 -- start start 2023-10-06T03:24:00.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.567+0000 7fcbf0bff700 1 -- 172.21.15.81:0/3657975592 shutdown_connections 2023-10-06T03:24:00.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.567+0000 7fcbf0bff700 1 -- 172.21.15.81:0/3657975592 wait complete. 2023-10-06T03:24:00.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.567+0000 7fa635ffb700 1 -- 172.21.15.81:0/2604463600 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63c022070 con 0x7fa640087540 2023-10-06T03:24:00.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.567+0000 7fa635ffb700 1 -- 172.21.15.81:0/2604463600 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa63c0072e0 con 0x7fa640087540 2023-10-06T03:24:00.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.567+0000 7fa95e5ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa9580af200 0x7fa9580875d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.567+0000 7fa95e5ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa95816a340 0x7fa9580acc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.567+0000 7fa635ffb700 1 -- 172.21.15.81:0/2604463600 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63c0076c0 con 0x7fa640087540 2023-10-06T03:24:00.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.567+0000 7fa646d9d700 1 -- 172.21.15.81:0/2604463600 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6400a82a0 con 0x7fa640087540 2023-10-06T03:24:00.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.568+0000 7fa646d9d700 1 -- 172.21.15.81:0/2604463600 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa640087910 con 0x7fa640087540 2023-10-06T03:24:00.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.568+0000 7fa95cb9c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa95816a340 0x7fa9580acc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.568+0000 7fa95cb9c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa95816a340 0x7fa9580acc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56252/0 (socket says 172.21.15.81:56252) 2023-10-06T03:24:00.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.568+0000 7fa957fff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa9580af200 0x7fa9580875d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.568+0000 7f085bdff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f08540c88d0 0x7f085406d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.568+0000 7f085bdff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f085406dd00 con 0x7f0854140e80 2023-10-06T03:24:00.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.568+0000 7f085bdff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0854141250 con 0x7f085406b890 2023-10-06T03:24:00.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.568+0000 7f085bdff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08540c5a50 con 0x7f08540c88d0 2023-10-06T03:24:00.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.568+0000 7fa95cb9c700 1 -- 172.21.15.81:0/3629536519 learned_addr learned my addr 172.21.15.81:0/3629536519 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:00.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.568+0000 7fa95e5ff700 1 -- 172.21.15.81:0/3629536519 --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9580ac7a0 con 0x7fa958087b10 2023-10-06T03:24:00.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.568+0000 7fa95e5ff700 1 -- 172.21.15.81:0/3629536519 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9580abe70 con 0x7fa95816a340 2023-10-06T03:24:00.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.568+0000 7fa95e5ff700 1 -- 172.21.15.81:0/3629536519 --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9580ac150 con 0x7fa9580af200 2023-10-06T03:24:00.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.569+0000 7f0859b9b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0854140e80 0x7f08540c5340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39402/0 (socket says 172.21.15.81:39402) 2023-10-06T03:24:00.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.569+0000 7f0859b9b700 1 -- 172.21.15.81:0/1111651117 learned_addr learned my addr 172.21.15.81:0/1111651117 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:24:00.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.569+0000 7f085a39c700 1 --1- 172.21.15.81:0/1111651117 >> v1:172.21.15.83:6789/0 conn(0x7f085406b890 0x7f08540ccbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:40092/0 (socket says 172.21.15.81:40092) 2023-10-06T03:24:00.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.569+0000 7f78797ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f78740c6a20 0x7f78740c8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.569+0000 7fa95cb9c700 1 -- 172.21.15.81:0/3629536519 >> v2:172.21.15.83:3300/0 conn(0x7fa9580af200 msgr2=0x7fa9580875d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:00.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.569+0000 7fa95cb9c700 1 --2- 172.21.15.81:0/3629536519 >> v2:172.21.15.83:3300/0 conn(0x7fa9580af200 0x7fa9580875d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.569+0000 7f4f027fc700 1 -- 172.21.15.81:0/769077714 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4f080521b0 con 0x7f4f040dbd10 2023-10-06T03:24:00.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.570+0000 7f704affd700 1 -- 172.21.15.81:0/3269973606 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7054006e50 con 0x7f706415d890 2023-10-06T03:24:00.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.569+0000 7f085939a700 1 --2- 172.21.15.81:0/1111651117 >> v2:172.21.15.83:3300/0 conn(0x7f08540c88d0 0x7f085406d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.569+0000 7f0858b99700 1 -- 172.21.15.81:0/1111651117 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 905741113 0 0) 0x7f0854141250 con 0x7f085406b890 2023-10-06T03:24:00.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.570+0000 7f0858b99700 1 -- 172.21.15.81:0/1111651117 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0840003570 con 0x7f085406b890 2023-10-06T03:24:00.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.570+0000 7fcbf0bff700 1 Processor -- start 2023-10-06T03:24:00.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.570+0000 7f0858b99700 1 -- 172.21.15.81:0/1111651117 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2331564399 0 0) 0x7f0850001110 con 0x7f0854140e80 2023-10-06T03:24:00.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.570+0000 7f0858b99700 1 -- 172.21.15.81:0/1111651117 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0854141250 con 0x7f0854140e80 2023-10-06T03:24:00.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.570+0000 7f704affd700 1 -- 172.21.15.81:0/3269973606 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f705401a440 con 0x7f706415d890 2023-10-06T03:24:00.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.570+0000 7f70693ff700 1 -- 172.21.15.81:0/3269973606 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f706415ead0 con 0x7f706415d890 2023-10-06T03:24:00.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.569+0000 7fa95cb9c700 1 -- 172.21.15.81:0/3629536519 >> v1:172.21.15.83:6789/0 conn(0x7fa958087b10 legacy=0x7fa958169c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:00.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.569+0000 7fa95cb9c700 1 -- 172.21.15.81:0/3629536519 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9580ac430 con 0x7fa95816a340 2023-10-06T03:24:00.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.570+0000 7f70693ff700 1 -- 172.21.15.81:0/3269973606 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7064134fa0 con 0x7f706415d890 2023-10-06T03:24:00.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.570+0000 7f78797ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f787406a8a0 0x7f7874163220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.570+0000 7f78727fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f78740caa40 0x7f78740c6df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39414/0 (socket says 172.21.15.81:39414) 2023-10-06T03:24:00.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.570+0000 7f78727fc700 1 -- 172.21.15.81:0/2474569050 learned_addr learned my addr 172.21.15.81:0/2474569050 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:24:00.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.570+0000 7f78797ff700 1 -- 172.21.15.81:0/2474569050 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78740ab2b0 con 0x7f78740caa40 2023-10-06T03:24:00.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.570+0000 7f704affd700 1 -- 172.21.15.81:0/3269973606 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705401a800 con 0x7f706415d890 2023-10-06T03:24:00.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.570+0000 7f7872ffd700 1 --2- 172.21.15.81:0/2474569050 >> v2:172.21.15.83:3300/0 conn(0x7f78740c6a20 0x7f78740c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.570+0000 7f0858b99700 1 -- 172.21.15.81:0/1111651117 <== mon.1 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2564450050 0 0) 0x7f0840003570 con 0x7f085406b890 2023-10-06T03:24:00.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.570+0000 7f0858b99700 1 -- 172.21.15.81:0/1111651117 >> v2:172.21.15.83:3300/0 conn(0x7f08540c88d0 msgr2=0x7f085406d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:00.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.570+0000 7f0858b99700 1 --2- 172.21.15.81:0/1111651117 >> v2:172.21.15.83:3300/0 conn(0x7f08540c88d0 0x7f085406d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.570+0000 7f0858b99700 1 -- 172.21.15.81:0/1111651117 >> v1:172.21.15.81:6789/0 conn(0x7f0854140e80 legacy=0x7f08540c5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.570+0000 7f0858b99700 1 -- 172.21.15.81:0/1111651117 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f085406a710 con 0x7f085406b890 2023-10-06T03:24:00.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.570+0000 7f0858b99700 1 -- 172.21.15.81:0/1111651117 <== mon.1 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2513016936 0 0) 0x7f084c001720 con 0x7f085406b890 2023-10-06T03:24:00.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.570+0000 7f0858b99700 1 -- 172.21.15.81:0/1111651117 >> v1:172.21.15.83:6789/0 conn(0x7f085406b890 legacy=0x7f08540ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.570+0000 7f0858b99700 1 --2- 172.21.15.81:0/1111651117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0840003bf0 0x7f0840003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.570+0000 7f0858b99700 1 --2- 172.21.15.81:0/1111651117 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0840004810 0x7f0840004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.570+0000 7f0858b99700 1 --2- 172.21.15.81:0/1111651117 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08400051c0 0x7f0840014270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.570+0000 7f0858b99700 1 -- 172.21.15.81:0/1111651117 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08540c5a50 con 0x7f0840003bf0 2023-10-06T03:24:00.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.570+0000 7f0858b99700 1 -- 172.21.15.81:0/1111651117 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08400148c0 con 0x7f08400051c0 2023-10-06T03:24:00.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.570+0000 7f0858b99700 1 -- 172.21.15.81:0/1111651117 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0840014a80 con 0x7f0840004810 2023-10-06T03:24:00.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.571+0000 7f085939a700 1 --2- 172.21.15.81:0/1111651117 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0840004810 0x7f0840004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.569+0000 7fa6237fe700 1 -- 172.21.15.81:0/2604463600 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6400ab580 con 0x7fa640087540 2023-10-06T03:24:00.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.571+0000 7f085a39c700 1 --2- 172.21.15.81:0/1111651117 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08400051c0 0x7f0840014270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.571+0000 7fa95cb9c700 1 --2- 172.21.15.81:0/3629536519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa95816a340 0x7fa9580acc30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa9580714d0 tx=0x7fa950009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cb2911aabdf21e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.571+0000 7f78737fe700 1 --2- 172.21.15.81:0/2474569050 >> v2:172.21.15.81:3300/0 conn(0x7f787406a8a0 0x7f7874163220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.571+0000 7f7871ffb700 1 -- 172.21.15.81:0/2474569050 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2881048341 0 0) 0x7f78740ab2b0 con 0x7f78740caa40 2023-10-06T03:24:00.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.571+0000 7f78797ff700 1 -- 172.21.15.81:0/2474569050 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7874159ad0 con 0x7f787406a8a0 2023-10-06T03:24:00.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.571+0000 7f78797ff700 1 -- 172.21.15.81:0/2474569050 --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78740aa980 con 0x7f78740c6a20 2023-10-06T03:24:00.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.571+0000 7f085939a700 1 -- 172.21.15.81:0/1111651117 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08400051c0 msgr2=0x7f0840014270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:00.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.571+0000 7f085939a700 1 --2- 172.21.15.81:0/1111651117 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08400051c0 0x7f0840014270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.571+0000 7f085939a700 1 -- 172.21.15.81:0/1111651117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0840003bf0 msgr2=0x7f0840003fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T03:24:00.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.572+0000 7f0859b9b700 1 --2- 172.21.15.81:0/1111651117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0840003bf0 0x7f0840003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.572+0000 7f7871ffb700 1 -- 172.21.15.81:0/2474569050 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f785c003570 con 0x7f78740caa40 2023-10-06T03:24:00.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.572+0000 7f7871ffb700 1 -- 172.21.15.81:0/2474569050 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2459284995 0 0) 0x7f785c003570 con 0x7f78740caa40 2023-10-06T03:24:00.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.572+0000 7f7871ffb700 1 -- 172.21.15.81:0/2474569050 >> v2:172.21.15.83:3300/0 conn(0x7f78740c6a20 msgr2=0x7f78740c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:00.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.572+0000 7f7871ffb700 1 --2- 172.21.15.81:0/2474569050 >> v2:172.21.15.83:3300/0 conn(0x7f78740c6a20 0x7f78740c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.572+0000 7f7871ffb700 1 -- 172.21.15.81:0/2474569050 >> v2:172.21.15.81:3300/0 conn(0x7f787406a8a0 msgr2=0x7f7874163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:00.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.572+0000 7f7871ffb700 1 --2- 172.21.15.81:0/2474569050 >> v2:172.21.15.81:3300/0 conn(0x7f787406a8a0 0x7f7874163220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.572+0000 7f7871ffb700 1 -- 172.21.15.81:0/2474569050 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78740aac60 con 0x7f78740caa40 2023-10-06T03:24:00.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.572+0000 7f085939a700 1 --2- 172.21.15.81:0/1111651117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0840003bf0 0x7f0840003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.572+0000 7f085939a700 1 -- 172.21.15.81:0/1111651117 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f085406a710 con 0x7f0840004810 2023-10-06T03:24:00.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.572+0000 7fa635ffb700 1 -- 172.21.15.81:0/2604463600 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa63c01e640 con 0x7fa640087540 2023-10-06T03:24:00.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.573+0000 7f7871ffb700 1 -- 172.21.15.81:0/2474569050 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2513016936 0 0) 0x7f7868001470 con 0x7f78740caa40 2023-10-06T03:24:00.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.573+0000 7f7871ffb700 1 -- 172.21.15.81:0/2474569050 >> v1:172.21.15.81:6789/0 conn(0x7f78740caa40 legacy=0x7f78740c6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.571+0000 7fa956ffd700 1 -- 172.21.15.81:0/3629536519 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95000e070 con 0x7fa95816a340 2023-10-06T03:24:00.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.571+0000 7fa956ffd700 1 -- 172.21.15.81:0/3629536519 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa95000ba10 con 0x7fa95816a340 2023-10-06T03:24:00.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.571+0000 7fa956ffd700 1 -- 172.21.15.81:0/3629536519 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9500092e0 con 0x7fa95816a340 2023-10-06T03:24:00.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.572+0000 7fa95e5ff700 1 -- 172.21.15.81:0/3629536519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa95816a340 msgr2=0x7fa9580acc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.572+0000 7fa95e5ff700 1 --2- 172.21.15.81:0/3629536519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa95816a340 0x7fa9580acc30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa9580714d0 tx=0x7fa950009840 comp rx=0 tx=0).stop 2023-10-06T03:24:00.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.573+0000 7f085a39c700 1 -- 172.21.15.81:0/1111651117 reap_dead start 2023-10-06T03:24:00.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.573+0000 7f0859b9b700 1 --2- 172.21.15.81:0/1111651117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0840003bf0 0x7f0840003fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:00.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.573+0000 7fa95e5ff700 1 -- 172.21.15.81:0/3629536519 shutdown_connections 2023-10-06T03:24:00.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.573+0000 7fa95e5ff700 1 --2- 172.21.15.81:0/3629536519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa95816a340 0x7fa9580acc30 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.573+0000 7fa95e5ff700 1 --2- 172.21.15.81:0/3629536519 >> v2:172.21.15.83:3300/0 conn(0x7fa9580af200 0x7fa9580875d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.573+0000 7fa95e5ff700 1 -- 172.21.15.81:0/3629536519 >> 172.21.15.81:0/3629536519 conn(0x7fa9580cc9c0 msgr2=0x7fa9580a5430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:00.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.573+0000 7f704affd700 1 -- 172.21.15.81:0/3269973606 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f705401abf0 con 0x7f706415d890 2023-10-06T03:24:00.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.573+0000 7f7871ffb700 1 --2- 172.21.15.81:0/2474569050 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f785c003bb0 0x7f785c003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.573+0000 7fa95e5ff700 1 -- 172.21.15.81:0/3629536519 shutdown_connections 2023-10-06T03:24:00.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.573+0000 7fa95e5ff700 1 -- 172.21.15.81:0/3629536519 wait complete. 2023-10-06T03:24:00.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.573+0000 7fa635ffb700 1 --2- 172.21.15.81:0/2604463600 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa624066fb0 0x7fa624069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.573+0000 7f085939a700 1 --2- 172.21.15.81:0/1111651117 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0840004810 0x7f0840004c80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0844009c00 tx=0x7f08440091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=907a8da179e8f4ed server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.573+0000 7f7871ffb700 1 --2- 172.21.15.81:0/2474569050 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f785c004810 0x7f785c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.574+0000 7f7872ffd700 1 --2- 172.21.15.81:0/2474569050 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f785c003bb0 0x7f785c003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.574+0000 7f7871ffb700 1 --2- 172.21.15.81:0/2474569050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f785c0052e0 0x7f785c014270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.574+0000 7fa635ffb700 1 -- 172.21.15.81:0/2604463600 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa63c085b10 con 0x7fa640087540 2023-10-06T03:24:00.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.574+0000 7fa64559a700 1 --2- 172.21.15.81:0/2604463600 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa624066fb0 0x7fa624069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.574+0000 7f0858b99700 1 -- 172.21.15.81:0/1111651117 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084400e710 con 0x7f0840004810 2023-10-06T03:24:00.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.574+0000 7f0858b99700 1 -- 172.21.15.81:0/1111651117 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f084400e870 con 0x7f0840004810 2023-10-06T03:24:00.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.574+0000 7f0858b99700 1 -- 172.21.15.81:0/1111651117 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084400ec30 con 0x7f0840004810 2023-10-06T03:24:00.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.574+0000 7f7871ffb700 1 -- 172.21.15.81:0/2474569050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7874159ad0 con 0x7f785c0052e0 2023-10-06T03:24:00.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.572+0000 7fcbf0bff700 1 -- start start 2023-10-06T03:24:00.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.574+0000 7f7871ffb700 1 -- 172.21.15.81:0/2474569050 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78740aa980 con 0x7f785c003bb0 2023-10-06T03:24:00.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.574+0000 7f7871ffb700 1 -- 172.21.15.81:0/2474569050 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f785c014a40 con 0x7f785c004810 2023-10-06T03:24:00.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.575+0000 7f704affd700 1 --2- 172.21.15.81:0/3269973606 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7050067080 0x7f7050069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.574+0000 7f78727fc700 1 --2- 172.21.15.81:0/2474569050 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f785c004810 0x7f785c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.575+0000 7f085bdff700 1 -- 172.21.15.81:0/1111651117 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0840004810 msgr2=0x7f0840004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.575+0000 7f085bdff700 1 --2- 172.21.15.81:0/1111651117 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0840004810 0x7f0840004c80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0844009c00 tx=0x7f08440091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.575+0000 7f78727fc700 1 -- 172.21.15.81:0/2474569050 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f785c003bb0 msgr2=0x7f785c003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:00.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.575+0000 7f78727fc700 1 --2- 172.21.15.81:0/2474569050 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f785c003bb0 0x7f785c003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.575+0000 7f78727fc700 1 -- 172.21.15.81:0/2474569050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f785c0052e0 msgr2=0x7f785c014270 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T03:24:00.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.575+0000 7f78727fc700 1 --2- 172.21.15.81:0/2474569050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f785c0052e0 0x7f785c014270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.575+0000 7f085bdff700 1 -- 172.21.15.81:0/1111651117 shutdown_connections 2023-10-06T03:24:00.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.575+0000 7f085bdff700 1 --2- 172.21.15.81:0/1111651117 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0840004810 0x7f0840004c80 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.575+0000 7f085bdff700 1 -- 172.21.15.81:0/1111651117 >> 172.21.15.81:0/1111651117 conn(0x7f08540ce290 msgr2=0x7f08540ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:00.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.575+0000 7f78727fc700 1 -- 172.21.15.81:0/2474569050 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f785c003570 con 0x7f785c004810 2023-10-06T03:24:00.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.575+0000 7f78737fe700 1 --2- 172.21.15.81:0/2474569050 >> v2:172.21.15.81:3300/0 conn(0x7f787406a8a0 0x7f7874163220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:00.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.575+0000 7f78737fe700 1 -- 172.21.15.81:0/2474569050 reap_dead start 2023-10-06T03:24:00.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.576+0000 7f78727fc700 1 --2- 172.21.15.81:0/2474569050 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f785c004810 0x7f785c004c80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f78680050b0 tx=0x7f7868008b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1175699f20fd3885 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.576+0000 7f085bdff700 1 -- 172.21.15.81:0/1111651117 shutdown_connections 2023-10-06T03:24:00.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.575+0000 7fa95e5ff700 1 Processor -- start 2023-10-06T03:24:00.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.576+0000 7f7062ffd700 1 --2- 172.21.15.81:0/3269973606 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7050067080 0x7f7050069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.576+0000 7fcbf0bff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcbec0c6fc0 0x7fcbec0abd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.576+0000 7fcbf0bff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcbec0cb9f0 0x7fcbec06dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.576+0000 7fcbf0bff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbec167980 0x7fcbec15a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.576+0000 7fcbf0bff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec0ac250 con 0x7fcbec167980 2023-10-06T03:24:00.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.576+0000 7fcbf0bff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec0af1a0 con 0x7fcbec0cb9f0 2023-10-06T03:24:00.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.576+0000 7fcbf0bff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec0af480 con 0x7fcbec0c6fc0 2023-10-06T03:24:00.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.576+0000 7fa95e5ff700 1 -- start start 2023-10-06T03:24:00.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.575+0000 7fa64559a700 1 --2- 172.21.15.81:0/2604463600 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa624066fb0 0x7fa624069460 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa6400a8d50 tx=0x7fa638009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.576+0000 7f085bdff700 1 -- 172.21.15.81:0/1111651117 wait complete. 2023-10-06T03:24:00.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.577+0000 7f7062ffd700 1 --2- 172.21.15.81:0/3269973606 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7050067080 0x7f7050069530 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f705c002250 tx=0x7f705c001a80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.576+0000 7f70693ff700 1 -- 172.21.15.81:0/3269973606 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f706404c3c0 con 0x7f706415d890 2023-10-06T03:24:00.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.577+0000 7f704affd700 1 -- 172.21.15.81:0/3269973606 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f7054086b00 con 0x7f706415d890 2023-10-06T03:24:00.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.577+0000 7f7871ffb700 1 -- 172.21.15.81:0/2474569050 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7868005920 con 0x7f785c004810 2023-10-06T03:24:00.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.577+0000 7f7871ffb700 1 -- 172.21.15.81:0/2474569050 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7868005a80 con 0x7f785c004810 2023-10-06T03:24:00.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.577+0000 7f7871ffb700 1 -- 172.21.15.81:0/2474569050 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7868005e00 con 0x7f785c004810 2023-10-06T03:24:00.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.577+0000 7fa95e5ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa958087b10 0x7fa9581677e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.577+0000 7fa635ffb700 1 -- 172.21.15.81:0/2604463600 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa63c052990 con 0x7fa640087540 2023-10-06T03:24:00.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.577+0000 7fa95e5ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa9580af200 0x7fa958167d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.577+0000 7fa95e5ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa95816a340 0x7fa9581762e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.577+0000 7fa95e5ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa958177f80 con 0x7fa95816a340 2023-10-06T03:24:00.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.577+0000 7fa95e5ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa958177650 con 0x7fa958087b10 2023-10-06T03:24:00.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.577+0000 7fa95e5ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa958177930 con 0x7fa9580af200 2023-10-06T03:24:00.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.578+0000 7f78797ff700 1 -- 172.21.15.81:0/2474569050 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f785c004810 msgr2=0x7f785c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.578+0000 7f78797ff700 1 --2- 172.21.15.81:0/2474569050 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f785c004810 0x7f785c004c80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f78680050b0 tx=0x7f7868008b50 comp rx=0 tx=0).stop 2023-10-06T03:24:00.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.577+0000 7fcbead9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbec167980 0x7fcbec15a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.578+0000 7f085bdff700 1 Processor -- start 2023-10-06T03:24:00.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.578+0000 7f78797ff700 1 -- 172.21.15.81:0/2474569050 shutdown_connections 2023-10-06T03:24:00.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.578+0000 7f78797ff700 1 --2- 172.21.15.81:0/2474569050 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f785c004810 0x7f785c004c80 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.578+0000 7f78797ff700 1 -- 172.21.15.81:0/2474569050 >> 172.21.15.81:0/2474569050 conn(0x7f78740cc090 msgr2=0x7f78740cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:00.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.578+0000 7fa95cb9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa95816a340 0x7fa9581762e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.578+0000 7fa95cb9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa95816a340 0x7fa9581762e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56282/0 (socket says 172.21.15.81:56282) 2023-10-06T03:24:00.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.578+0000 7fa95cb9c700 1 -- 172.21.15.81:0/1697307678 learned_addr learned my addr 172.21.15.81:0/1697307678 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:00.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.578+0000 7f78797ff700 1 -- 172.21.15.81:0/2474569050 shutdown_connections 2023-10-06T03:24:00.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.578+0000 7f78797ff700 1 -- 172.21.15.81:0/2474569050 wait complete. 2023-10-06T03:24:00.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.578+0000 7fa957fff700 1 --2- 172.21.15.81:0/1697307678 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa958087b10 0x7fa9581677e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.578+0000 7f085bdff700 1 -- start start 2023-10-06T03:24:00.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.579+0000 7fa9577fe700 1 --2- 172.21.15.81:0/1697307678 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa9580af200 0x7fa958167d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.579+0000 7fa95cb9c700 1 -- 172.21.15.81:0/1697307678 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa9580af200 msgr2=0x7fa958167d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.578+0000 7fcbead9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbec167980 0x7fcbec15a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56280/0 (socket says 172.21.15.81:56280) 2023-10-06T03:24:00.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.578+0000 7fcbead9d700 1 -- 172.21.15.81:0/3606646590 learned_addr learned my addr 172.21.15.81:0/3606646590 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:00.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.578+0000 7fcbe9d9b700 1 --2- 172.21.15.81:0/3606646590 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcbec0cb9f0 0x7fcbec06dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.579+0000 7fcbea59c700 1 --2- 172.21.15.81:0/3606646590 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcbec0c6fc0 0x7fcbec0abd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.579+0000 7fa95cb9c700 1 --2- 172.21.15.81:0/1697307678 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa9580af200 0x7fa958167d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.579+0000 7fa95cb9c700 1 -- 172.21.15.81:0/1697307678 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa958087b10 msgr2=0x7fa9581677e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.579+0000 7fa95cb9c700 1 --2- 172.21.15.81:0/1697307678 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa958087b10 0x7fa9581677e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.579+0000 7fa95cb9c700 1 -- 172.21.15.81:0/1697307678 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa950009ae0 con 0x7fa95816a340 2023-10-06T03:24:00.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.579+0000 7fa9577fe700 1 --2- 172.21.15.81:0/1697307678 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa9580af200 0x7fa958167d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:00.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.580+0000 7fcbea59c700 1 -- 172.21.15.81:0/3606646590 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcbec0cb9f0 msgr2=0x7fcbec06dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.580+0000 7f085bdff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0840004810 0x7f085413ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.580+0000 7f085bdff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0854157aa0 0x7f0854131a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.580+0000 7fcbea59c700 1 --2- 172.21.15.81:0/3606646590 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcbec0cb9f0 0x7fcbec06dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.580+0000 7f085bdff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0854069900 0x7f0854069d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.580+0000 7fcbea59c700 1 -- 172.21.15.81:0/3606646590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbec167980 msgr2=0x7fcbec15a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.580+0000 7fcbea59c700 1 --2- 172.21.15.81:0/3606646590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbec167980 0x7fcbec15a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.580+0000 7fcbea59c700 1 -- 172.21.15.81:0/3606646590 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbdc0094f0 con 0x7fcbec0c6fc0 2023-10-06T03:24:00.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.580+0000 7f0859b9b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0840004810 0x7f085413ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.580+0000 7fcbead9d700 1 --2- 172.21.15.81:0/3606646590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbec167980 0x7fcbec15a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:24:00.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.581+0000 7f78797ff700 1 Processor -- start 2023-10-06T03:24:00.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.581+0000 7fcbea59c700 1 --2- 172.21.15.81:0/3606646590 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcbec0c6fc0 0x7fcbec0abd10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcbec0c6660 tx=0x7fcbdc017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.580+0000 7fa95cb9c700 1 --2- 172.21.15.81:0/1697307678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa95816a340 0x7fa9581762e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa95000d010 tx=0x7fa950017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.581+0000 7f78797ff700 1 -- start start 2023-10-06T03:24:00.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.581+0000 7fa93ffff700 1 -- 172.21.15.81:0/1697307678 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa950012c00 con 0x7fa95816a340 2023-10-06T03:24:00.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.581+0000 7fa93ffff700 1 -- 172.21.15.81:0/1697307678 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa950012d60 con 0x7fa95816a340 2023-10-06T03:24:00.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.581+0000 7fa95e5ff700 1 -- 172.21.15.81:0/1697307678 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa958177c10 con 0x7fa95816a340 2023-10-06T03:24:00.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.580+0000 7f085939a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0854157aa0 0x7f0854131a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.580+0000 7f0859b9b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0840004810 0x7f085413ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:51494/0 (socket says 172.21.15.81:51494) 2023-10-06T03:24:00.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.580+0000 7f085939a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0854157aa0 0x7f0854131a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:50930/0 (socket says 172.21.15.81:50930) 2023-10-06T03:24:00.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.580+0000 7f085bdff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085406a2b0 con 0x7f0854069900 2023-10-06T03:24:00.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.580+0000 7f085bdff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0854158d90 con 0x7f0854157aa0 2023-10-06T03:24:00.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.580+0000 7f085bdff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0854157f10 con 0x7f0840004810 2023-10-06T03:24:00.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.582+0000 7f78797ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f785c004810 0x7f78740c3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.580+0000 7f0859b9b700 1 -- 172.21.15.81:0/1923332845 learned_addr learned my addr 172.21.15.81:0/1923332845 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:00.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.580+0000 7f085a39c700 1 --2- 172.21.15.81:0/1923332845 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0854069900 0x7f0854069d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.583+0000 7f78797ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78740aee30 0x7f7874169100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.583+0000 7f7872ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f785c004810 0x7f78740c3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.583+0000 7f7872ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f785c004810 0x7f78740c3700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56304/0 (socket says 172.21.15.81:56304) 2023-10-06T03:24:00.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.581+0000 7f0859b9b700 1 -- 172.21.15.81:0/1923332845 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0854157aa0 msgr2=0x7f0854131a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.583+0000 7f78797ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78741589d0 0x7f7874157aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.583+0000 7f78727fc700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78740aee30 0x7f7874169100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.583+0000 7f78727fc700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78740aee30 0x7f7874169100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:51500/0 (socket says 172.21.15.81:51500) 2023-10-06T03:24:00.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.583+0000 7f78797ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78740aff90 con 0x7f785c004810 2023-10-06T03:24:00.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.583+0000 7f78797ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78740c3c40 con 0x7f78741589d0 2023-10-06T03:24:00.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.583+0000 7f78797ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7874169640 con 0x7f78740aee30 2023-10-06T03:24:00.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.583+0000 7f7872ffd700 1 -- 172.21.15.81:0/2549620108 learned_addr learned my addr 172.21.15.81:0/2549620108 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:00.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.583+0000 7f78737fe700 1 --2- 172.21.15.81:0/2549620108 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78741589d0 0x7f7874157aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.583+0000 7fcbda7fc700 1 -- 172.21.15.81:0/3606646590 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc00ba60 con 0x7fcbec0c6fc0 2023-10-06T03:24:00.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.583+0000 7fcbf0bff700 1 -- 172.21.15.81:0/3606646590 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbec0af760 con 0x7fcbec0c6fc0 2023-10-06T03:24:00.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.581+0000 7f0859b9b700 1 --2- 172.21.15.81:0/1923332845 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0854157aa0 0x7f0854131a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.581+0000 7f0859b9b700 1 -- 172.21.15.81:0/1923332845 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0854069900 msgr2=0x7f0854069d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.582+0000 7f0859b9b700 1 --2- 172.21.15.81:0/1923332845 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0854069900 0x7f0854069d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.582+0000 7f0859b9b700 1 -- 172.21.15.81:0/1923332845 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0854158180 con 0x7f0840004810 2023-10-06T03:24:00.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.582+0000 7f085939a700 1 --2- 172.21.15.81:0/1923332845 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0854157aa0 0x7f0854131a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:24:00.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.582+0000 7f085a39c700 1 --2- 172.21.15.81:0/1923332845 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0854069900 0x7f0854069d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:00.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.582+0000 7f0859b9b700 1 --2- 172.21.15.81:0/1923332845 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0840004810 0x7f085413ef90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f085000d860 tx=0x7f0850009040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.582+0000 7f0849ffb700 1 -- 172.21.15.81:0/1923332845 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0850007360 con 0x7f0840004810 2023-10-06T03:24:00.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.584+0000 7f704affd700 1 -- 172.21.15.81:0/3269973606 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7054053900 con 0x7f706415d890 2023-10-06T03:24:00.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.582+0000 7f0849ffb700 1 -- 172.21.15.81:0/1923332845 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08500074c0 con 0x7f0840004810 2023-10-06T03:24:00.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.582+0000 7f0849ffb700 1 -- 172.21.15.81:0/1923332845 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0850004830 con 0x7f0840004810 2023-10-06T03:24:00.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.582+0000 7f085bdff700 1 -- 172.21.15.81:0/1923332845 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0854158460 con 0x7f0840004810 2023-10-06T03:24:00.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.583+0000 7f085bdff700 1 -- 172.21.15.81:0/1923332845 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0854158a20 con 0x7f0840004810 2023-10-06T03:24:00.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.584+0000 7fcbf0bff700 1 -- 172.21.15.81:0/3606646590 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbec0afd20 con 0x7fcbec0c6fc0 2023-10-06T03:24:00.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.584+0000 7fa95e5ff700 1 -- 172.21.15.81:0/1697307678 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9581684a0 con 0x7fa95816a340 2023-10-06T03:24:00.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.584+0000 7f085bdff700 1 -- 172.21.15.81:0/1923332845 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0854158f40 con 0x7f0840004810 2023-10-06T03:24:00.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.585+0000 7fcbda7fc700 1 -- 172.21.15.81:0/3606646590 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbdc00bbc0 con 0x7fcbec0c6fc0 2023-10-06T03:24:00.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.585+0000 7fcbda7fc700 1 -- 172.21.15.81:0/3606646590 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc025650 con 0x7fcbec0c6fc0 2023-10-06T03:24:00.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.586+0000 7fa93ffff700 1 -- 172.21.15.81:0/1697307678 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95001c660 con 0x7fa95816a340 2023-10-06T03:24:00.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.586+0000 7fa95e5ff700 1 -- 172.21.15.81:0/1697307678 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9580ab580 con 0x7fa95816a340 2023-10-06T03:24:00.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.587+0000 7f78727fc700 1 -- 172.21.15.81:0/2549620108 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78741589d0 msgr2=0x7f7874157aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.587+0000 7f78727fc700 1 --2- 172.21.15.81:0/2549620108 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78741589d0 0x7f7874157aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.587+0000 7f78727fc700 1 -- 172.21.15.81:0/2549620108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f785c004810 msgr2=0x7f78740c3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.587+0000 7f78727fc700 1 --2- 172.21.15.81:0/2549620108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f785c004810 0x7f78740c3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.587+0000 7f78727fc700 1 -- 172.21.15.81:0/2549620108 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78740af380 con 0x7f78740aee30 2023-10-06T03:24:00.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.587+0000 7f7872ffd700 1 --2- 172.21.15.81:0/2549620108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f785c004810 0x7f78740c3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:00.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.587+0000 7f78727fc700 1 --2- 172.21.15.81:0/2549620108 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78740aee30 0x7f7874169100 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7868015000 tx=0x7f7868016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.588+0000 7fa93ffff700 1 -- 172.21.15.81:0/1697307678 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa950019070 con 0x7fa95816a340 2023-10-06T03:24:00.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.589+0000 7fcbd3fff700 1 -- 172.21.15.81:0/3606646590 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbc80052b0 con 0x7fcbec0c6fc0 2023-10-06T03:24:00.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.590+0000 7fa93ffff700 1 --2- 172.21.15.81:0/1697307678 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa944066fb0 0x7fa944069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.590+0000 7fcbda7fc700 1 -- 172.21.15.81:0/3606646590 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcbdc023070 con 0x7fcbec0c6fc0 2023-10-06T03:24:00.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.590+0000 7fa93ffff700 1 -- 172.21.15.81:0/1697307678 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa950085cf0 con 0x7fa95816a340 2023-10-06T03:24:00.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.591+0000 7fa957fff700 1 --2- 172.21.15.81:0/1697307678 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa944066fb0 0x7fa944069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.591+0000 7f785affd700 1 -- 172.21.15.81:0/2549620108 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78680082f0 con 0x7f78740aee30 2023-10-06T03:24:00.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.591+0000 7fcbda7fc700 1 --2- 172.21.15.81:0/3606646590 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fcbcc067000 0x7fcbcc0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.591+0000 7f78797ff700 1 -- 172.21.15.81:0/2549620108 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78740af660 con 0x7f78740aee30 2023-10-06T03:24:00.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.592+0000 7f78797ff700 1 -- 172.21.15.81:0/2549620108 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78740afc20 con 0x7f78740aee30 2023-10-06T03:24:00.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.592+0000 7fcbda7fc700 1 -- 172.21.15.81:0/3606646590 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fcbdc085f50 con 0x7fcbec0c6fc0 2023-10-06T03:24:00.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.590+0000 7f0849ffb700 1 -- 172.21.15.81:0/1923332845 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0850004c20 con 0x7f0840004810 2023-10-06T03:24:00.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.592+0000 7f0849ffb700 1 --2- 172.21.15.81:0/1923332845 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0838067080 0x7f0838069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.592+0000 7f0849ffb700 1 -- 172.21.15.81:0/1923332845 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f08500954a0 con 0x7f0840004810 2023-10-06T03:24:00.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.592+0000 7fcbe9d9b700 1 --2- 172.21.15.81:0/3606646590 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fcbcc067000 0x7fcbcc0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.592+0000 7f085939a700 1 --2- 172.21.15.81:0/1923332845 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0838067080 0x7f0838069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.593+0000 7f0849ffb700 1 -- 172.21.15.81:0/1923332845 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0850062320 con 0x7f0840004810 2023-10-06T03:24:00.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.594+0000 7fa957fff700 1 --2- 172.21.15.81:0/1697307678 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa944066fb0 0x7fa944069460 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa948007fd0 tx=0x7fa948013040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.594+0000 7f085939a700 1 --2- 172.21.15.81:0/1923332845 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0838067080 0x7f0838069530 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f08540693b0 tx=0x7f084401a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.594+0000 7fcbe9d9b700 1 --2- 172.21.15.81:0/3606646590 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fcbcc067000 0x7fcbcc0694b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcbec0c6520 tx=0x7fcbe400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.595+0000 7f785affd700 1 -- 172.21.15.81:0/2549620108 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7868008660 con 0x7f78740aee30 2023-10-06T03:24:00.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.595+0000 7f785affd700 1 -- 172.21.15.81:0/2549620108 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78680087d0 con 0x7f78740aee30 2023-10-06T03:24:00.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.596+0000 7fcbda7fc700 1 -- 172.21.15.81:0/3606646590 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcbdc052d50 con 0x7fcbec0c6fc0 2023-10-06T03:24:00.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.597+0000 7f78797ff700 1 -- 172.21.15.81:0/2549620108 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f787404c3c0 con 0x7f78740aee30 2023-10-06T03:24:00.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.597+0000 7fa93ffff700 1 -- 172.21.15.81:0/1697307678 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa950052af0 con 0x7fa95816a340 2023-10-06T03:24:00.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.599+0000 7f785affd700 1 -- 172.21.15.81:0/2549620108 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f786802a460 con 0x7f78740aee30 2023-10-06T03:24:00.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.600+0000 7f785affd700 1 --2- 172.21.15.81:0/2549620108 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7860066fb0 0x7f7860069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.600+0000 7f785affd700 1 -- 172.21.15.81:0/2549620108 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f7868086750 con 0x7f78740aee30 2023-10-06T03:24:00.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.601+0000 7f7872ffd700 1 --2- 172.21.15.81:0/2549620108 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7860066fb0 0x7f7860069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.602+0000 7f7872ffd700 1 --2- 172.21.15.81:0/2549620108 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7860066fb0 0x7f7860069460 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f786400bd00 tx=0x7f7864008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.604+0000 7f785affd700 1 -- 172.21.15.81:0/2549620108 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f78680534d0 con 0x7f78740aee30 2023-10-06T03:24:00.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.619+0000 7fe52a99d700 1 Processor -- start 2023-10-06T03:24:00.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.620+0000 7fe52a99d700 1 -- start start 2023-10-06T03:24:00.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.622+0000 7fe52a99d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe524157cb0 0x7fe5240b4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.622+0000 7fe52a99d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5240b5ed0 con 0x7fe5240b2420 2023-10-06T03:24:00.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.622+0000 7fe52a99d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5240b52c0 con 0x7fe524158080 2023-10-06T03:24:00.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.622+0000 7fe52a99d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5240b55a0 con 0x7fe524157cb0 2023-10-06T03:24:00.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.623+0000 7fe52999b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe524157cb0 0x7fe5240b4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.623+0000 7fe52999b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe524157cb0 0x7fe5240b4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:50950/0 (socket says 172.21.15.81:50950) 2023-10-06T03:24:00.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.623+0000 7fe52999b700 1 -- 172.21.15.81:0/3145568692 learned_addr learned my addr 172.21.15.81:0/3145568692 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:00.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.624+0000 7fe52999b700 1 -- 172.21.15.81:0/3145568692 >> v1:172.21.15.83:6789/0 conn(0x7fe524158080 legacy=0x7fe5240b1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.624+0000 7fe52999b700 1 -- 172.21.15.81:0/3145568692 >> v1:172.21.15.81:6789/0 conn(0x7fe5240b2420 legacy=0x7fe5240d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:00.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.624+0000 7fe52999b700 1 -- 172.21.15.81:0/3145568692 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5240b5880 con 0x7fe524157cb0 2023-10-06T03:24:00.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.628+0000 7fe52999b700 1 --2- 172.21.15.81:0/3145568692 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe524157cb0 0x7fe5240b4bc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe51c009f20 tx=0x7fe51c009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9276c3051c220ea server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.629+0000 7fe528999700 1 -- 172.21.15.81:0/3145568692 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51c00e070 con 0x7fe524157cb0 2023-10-06T03:24:00.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.629+0000 7fe528999700 1 -- 172.21.15.81:0/3145568692 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe51c00ba40 con 0x7fe524157cb0 2023-10-06T03:24:00.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.629+0000 7fe528999700 1 -- 172.21.15.81:0/3145568692 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51c0092e0 con 0x7fe524157cb0 2023-10-06T03:24:00.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.630+0000 7fe52a99d700 1 -- 172.21.15.81:0/3145568692 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe524157cb0 msgr2=0x7fe5240b4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.630+0000 7fe52a99d700 1 --2- 172.21.15.81:0/3145568692 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe524157cb0 0x7fe5240b4bc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe51c009f20 tx=0x7fe51c009840 comp rx=0 tx=0).stop 2023-10-06T03:24:00.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.631+0000 7fe52a99d700 1 -- 172.21.15.81:0/3145568692 shutdown_connections 2023-10-06T03:24:00.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.631+0000 7fe52a99d700 1 --2- 172.21.15.81:0/3145568692 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe524157cb0 0x7fe5240b4bc0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.631+0000 7fe52a99d700 1 -- 172.21.15.81:0/3145568692 >> 172.21.15.81:0/3145568692 conn(0x7fe52406ed10 msgr2=0x7fe52406f110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:00.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.631+0000 7fe52a99d700 1 -- 172.21.15.81:0/3145568692 shutdown_connections 2023-10-06T03:24:00.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.632+0000 7fe52a99d700 1 -- 172.21.15.81:0/3145568692 wait complete. 2023-10-06T03:24:00.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.634+0000 7fe52a99d700 1 Processor -- start 2023-10-06T03:24:00.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.635+0000 7fe52a99d700 1 -- start start 2023-10-06T03:24:00.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.636+0000 7fe52a99d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe5240b2420 0x7fe524155ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.636+0000 7fe52a99d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe524157cb0 0x7fe52415cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.637+0000 7fe52999b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe5240b2420 0x7fe524155ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.637+0000 7fe52999b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe5240b2420 0x7fe524155ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:51504/0 (socket says 172.21.15.81:51504) 2023-10-06T03:24:00.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.637+0000 7fe52a99d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe524158080 0x7fe52415d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.637+0000 7fe52999b700 1 -- 172.21.15.81:0/1441368284 learned_addr learned my addr 172.21.15.81:0/1441368284 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:00.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.637+0000 7fe52a99d700 1 -- 172.21.15.81:0/1441368284 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52406aa30 con 0x7fe524157cb0 2023-10-06T03:24:00.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.637+0000 7fe52a99d700 1 -- 172.21.15.81:0/1441368284 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe524156530 con 0x7fe524158080 2023-10-06T03:24:00.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.637+0000 7fe52a99d700 1 -- 172.21.15.81:0/1441368284 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe52406de80 con 0x7fe5240b2420 2023-10-06T03:24:00.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.637+0000 7fe52919a700 1 --2- 172.21.15.81:0/1441368284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe524157cb0 0x7fe52415cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.638+0000 7fe52a19c700 1 --2- 172.21.15.81:0/1441368284 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe524158080 0x7fe52415d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.638+0000 7fe52999b700 1 -- 172.21.15.81:0/1441368284 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe524158080 msgr2=0x7fe52415d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.638+0000 7fe52999b700 1 --2- 172.21.15.81:0/1441368284 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe524158080 0x7fe52415d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.638+0000 7fe52999b700 1 -- 172.21.15.81:0/1441368284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe524157cb0 msgr2=0x7fe52415cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:00.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.638+0000 7fe52999b700 1 --2- 172.21.15.81:0/1441368284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe524157cb0 0x7fe52415cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:00.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.638+0000 7fe52999b700 1 -- 172.21.15.81:0/1441368284 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe51c009ae0 con 0x7fe5240b2420 2023-10-06T03:24:00.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.638+0000 7fe52a19c700 1 --2- 172.21.15.81:0/1441368284 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe524158080 0x7fe52415d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:00.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.638+0000 7fe52999b700 1 --2- 172.21.15.81:0/1441368284 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe5240b2420 0x7fe524155ff0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe524088f80 tx=0x7fe51c017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:00.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.639+0000 7fe521ffb700 1 -- 172.21.15.81:0/1441368284 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51c0129d0 con 0x7fe5240b2420 2023-10-06T03:24:00.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.640+0000 7fe52a99d700 1 -- 172.21.15.81:0/1441368284 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe52406e160 con 0x7fe5240b2420 2023-10-06T03:24:00.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.640+0000 7fe52a99d700 1 -- 172.21.15.81:0/1441368284 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe52406e720 con 0x7fe5240b2420 2023-10-06T03:24:00.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.641+0000 7fe521ffb700 1 -- 172.21.15.81:0/1441368284 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe51c012b50 con 0x7fe5240b2420 2023-10-06T03:24:00.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.641+0000 7fe521ffb700 1 -- 172.21.15.81:0/1441368284 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51c01d420 con 0x7fe5240b2420 2023-10-06T03:24:00.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.642+0000 7fe52a99d700 1 -- 172.21.15.81:0/1441368284 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5040052b0 con 0x7fe5240b2420 2023-10-06T03:24:00.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.645+0000 7fe521ffb700 1 -- 172.21.15.81:0/1441368284 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe51c01d850 con 0x7fe5240b2420 2023-10-06T03:24:00.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.647+0000 7fe521ffb700 1 --2- 172.21.15.81:0/1441368284 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fe510067080 0x7fe510069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:00.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.647+0000 7fe521ffb700 1 -- 172.21.15.81:0/1441368284 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fe51c086370 con 0x7fe5240b2420 2023-10-06T03:24:00.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.648+0000 7fe52919a700 1 --2- 172.21.15.81:0/1441368284 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fe510067080 0x7fe510069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:00.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.648+0000 7fe521ffb700 1 -- 172.21.15.81:0/1441368284 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe51c0531f0 con 0x7fe5240b2420 2023-10-06T03:24:00.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:00.649+0000 7fe52919a700 1 --2- 172.21.15.81:0/1441368284 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fe510067080 0x7fe510069530 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe52406e9a0 tx=0x7fe518007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:01.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.016+0000 7fa6237fe700 1 -- 172.21.15.81:0/2604463600 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa6400ab9b0 con 0x7fa640087540 2023-10-06T03:24:01.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.016+0000 7fa635ffb700 1 -- 172.21.15.81:0/2604463600 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa63c017090 con 0x7fa640087540 2023-10-06T03:24:01.019 INFO:teuthology.orchestra.run.smithi081.stdout:55834574856 2023-10-06T03:24:01.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.017+0000 7f4ef7fff700 1 -- 172.21.15.81:0/769077714 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4ee8005560 con 0x7f4f040dbd10 2023-10-06T03:24:01.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.018+0000 7f4f027fc700 1 -- 172.21.15.81:0/769077714 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4f0801d020 con 0x7f4f040dbd10 2023-10-06T03:24:01.020 INFO:teuthology.orchestra.run.smithi081.stdout:55834574855 2023-10-06T03:24:01.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.020+0000 7fa6237fe700 1 -- 172.21.15.81:0/2604463600 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa624066fb0 msgr2=0x7fa624069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:01.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.021+0000 7fa6237fe700 1 --2- 172.21.15.81:0/2604463600 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa624066fb0 0x7fa624069460 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa6400a8d50 tx=0x7fa638009040 comp rx=0 tx=0).stop 2023-10-06T03:24:01.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.021+0000 7fa6237fe700 1 -- 172.21.15.81:0/2604463600 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa640087540 msgr2=0x7fa640158f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:01.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.021+0000 7fa6237fe700 1 --2- 172.21.15.81:0/2604463600 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa640087540 0x7fa640158f60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa62c0057f0 tx=0x7fa63c015000 comp rx=0 tx=0).stop 2023-10-06T03:24:01.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.022+0000 7f4f1359d700 1 -- 172.21.15.81:0/769077714 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f4ef0067000 msgr2=0x7f4ef00694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:01.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.022+0000 7f4f1359d700 1 --2- 172.21.15.81:0/769077714 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f4ef0067000 0x7f4ef00694b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4f04007af0 tx=0x7f4f0c06e000 comp rx=0 tx=0).stop 2023-10-06T03:24:01.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.022+0000 7f4f1359d700 1 -- 172.21.15.81:0/769077714 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4f040dbd10 msgr2=0x7f4f04035ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:01.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.022+0000 7f4f1359d700 1 --2- 172.21.15.81:0/769077714 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4f040dbd10 0x7f4f04035ff0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4f0800ca00 tx=0x7f4f0800a310 comp rx=0 tx=0).stop 2023-10-06T03:24:01.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.022+0000 7fa6237fe700 1 -- 172.21.15.81:0/2604463600 shutdown_connections 2023-10-06T03:24:01.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.022+0000 7f4f1359d700 1 -- 172.21.15.81:0/769077714 shutdown_connections 2023-10-06T03:24:01.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.022+0000 7f4f1359d700 1 --2- 172.21.15.81:0/769077714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f040dadb0 0x7f4f04036530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:01.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.022+0000 7f4f1359d700 1 --2- 172.21.15.81:0/769077714 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4f040341a0 0x7f4f040d6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:01.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.022+0000 7f4f1359d700 1 --2- 172.21.15.81:0/769077714 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f4ef0067000 0x7f4ef00694b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:01.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.022+0000 7f4f1359d700 1 --2- 172.21.15.81:0/769077714 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4f040dbd10 0x7f4f04035ff0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:01.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.022+0000 7f4f1359d700 1 -- 172.21.15.81:0/769077714 >> 172.21.15.81:0/769077714 conn(0x7f4f040517b0 msgr2=0x7f4f04006840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:01.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.023+0000 7fa6237fe700 1 --2- 172.21.15.81:0/2604463600 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa624066fb0 0x7fa624069460 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:01.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.023+0000 7f4f1359d700 1 -- 172.21.15.81:0/769077714 shutdown_connections 2023-10-06T03:24:01.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.023+0000 7f4f1359d700 1 -- 172.21.15.81:0/769077714 wait complete. 2023-10-06T03:24:01.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.023+0000 7fa6237fe700 1 --2- 172.21.15.81:0/2604463600 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa640182170 0x7fa64017e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:01.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.023+0000 7fa6237fe700 1 --2- 172.21.15.81:0/2604463600 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa640087540 0x7fa640158f60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:01.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.023+0000 7fa6237fe700 1 --2- 172.21.15.81:0/2604463600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6401594a0 0x7fa640181c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:01.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.023+0000 7fa6237fe700 1 -- 172.21.15.81:0/2604463600 >> 172.21.15.81:0/2604463600 conn(0x7fa6400cc9c0 msgr2=0x7fa6400afbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:01.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.024+0000 7fa6237fe700 1 -- 172.21.15.81:0/2604463600 shutdown_connections 2023-10-06T03:24:01.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.024+0000 7fa6237fe700 1 -- 172.21.15.81:0/2604463600 wait complete. 2023-10-06T03:24:01.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.035+0000 7f085bdff700 1 -- 172.21.15.81:0/1923332845 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f085406dd00 con 0x7f0840004810 2023-10-06T03:24:01.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.035+0000 7f0849ffb700 1 -- 172.21.15.81:0/1923332845 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f085406dd00 con 0x7f0840004810 2023-10-06T03:24:01.038 INFO:teuthology.orchestra.run.smithi081.stdout:55834574855 2023-10-06T03:24:01.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.036+0000 7fcbd3fff700 1 -- 172.21.15.81:0/3606646590 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcbc8005560 con 0x7fcbec0c6fc0 2023-10-06T03:24:01.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.037+0000 7fcbda7fc700 1 -- 172.21.15.81:0/3606646590 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcbdc015090 con 0x7fcbec0c6fc0 2023-10-06T03:24:01.039 INFO:teuthology.orchestra.run.smithi081.stdout:55834574855 2023-10-06T03:24:01.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.038+0000 7f70693ff700 1 -- 172.21.15.81:0/3269973606 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f706404c3c0 con 0x7f706415d890 2023-10-06T03:24:01.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.039+0000 7f704affd700 1 -- 172.21.15.81:0/3269973606 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7054056f20 con 0x7f706415d890 2023-10-06T03:24:01.041 INFO:teuthology.orchestra.run.smithi081.stdout:55834574856 2023-10-06T03:24:01.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.040+0000 7f085bdff700 1 -- 172.21.15.81:0/1923332845 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0838067080 msgr2=0x7f0838069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:01.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.040+0000 7f085bdff700 1 --2- 172.21.15.81:0/1923332845 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0838067080 0x7f0838069530 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f08540693b0 tx=0x7f084401a000 comp rx=0 tx=0).stop 2023-10-06T03:24:01.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.040+0000 7f085bdff700 1 -- 172.21.15.81:0/1923332845 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0840004810 msgr2=0x7f085413ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:01.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.040+0000 7f085bdff700 1 --2- 172.21.15.81:0/1923332845 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0840004810 0x7f085413ef90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f085000d860 tx=0x7f0850009040 comp rx=0 tx=0).stop 2023-10-06T03:24:01.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.040+0000 7f085bdff700 1 -- 172.21.15.81:0/1923332845 shutdown_connections 2023-10-06T03:24:01.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.040+0000 7f085bdff700 1 --2- 172.21.15.81:0/1923332845 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0854069900 0x7f0854069d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:01.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.041+0000 7fcbf0bff700 1 -- 172.21.15.81:0/3606646590 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fcbcc067000 msgr2=0x7fcbcc0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:01.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.041+0000 7fcbf0bff700 1 --2- 172.21.15.81:0/3606646590 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fcbcc067000 0x7fcbcc0694b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcbec0c6520 tx=0x7fcbe400b040 comp rx=0 tx=0).stop 2023-10-06T03:24:01.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.040+0000 7f085bdff700 1 --2- 172.21.15.81:0/1923332845 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0838067080 0x7f0838069530 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:01.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.040+0000 7f085bdff700 1 --2- 172.21.15.81:0/1923332845 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0840004810 0x7f085413ef90 secure :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f085000d860 tx=0x7f0850009040 comp rx=0 tx=0).stop 2023-10-06T03:24:01.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.040+0000 7f085bdff700 1 --2- 172.21.15.81:0/1923332845 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0854157aa0 0x7f0854131a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:01.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.040+0000 7f085bdff700 1 -- 172.21.15.81:0/1923332845 >> 172.21.15.81:0/1923332845 conn(0x7f08540ce290 msgr2=0x7f08540686f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:01.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.040+0000 7f085bdff700 1 -- 172.21.15.81:0/1923332845 shutdown_connections 2023-10-06T03:24:01.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.041+0000 7fcbf0bff700 1 -- 172.21.15.81:0/3606646590 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcbec0c6fc0 msgr2=0x7fcbec0abd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:01.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.041+0000 7fcbf0bff700 1 --2- 172.21.15.81:0/3606646590 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcbec0c6fc0 0x7fcbec0abd10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcbec0c6660 tx=0x7fcbdc017000 comp rx=0 tx=0).stop 2023-10-06T03:24:01.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.041+0000 7f085bdff700 1 -- 172.21.15.81:0/1923332845 wait complete. 2023-10-06T03:24:01.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.042+0000 7fcbf0bff700 1 -- 172.21.15.81:0/3606646590 shutdown_connections 2023-10-06T03:24:01.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.042+0000 7fcbf0bff700 1 --2- 172.21.15.81:0/3606646590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbec167980 0x7fcbec15a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:01.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.042+0000 7fcbf0bff700 1 --2- 172.21.15.81:0/3606646590 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fcbcc067000 0x7fcbcc0694b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:01.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.042+0000 7fcbf0bff700 1 --2- 172.21.15.81:0/3606646590 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcbec0c6fc0 0x7fcbec0abd10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:01.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.042+0000 7fcbf0bff700 1 --2- 172.21.15.81:0/3606646590 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcbec0cb9f0 0x7fcbec06dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:01.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.042+0000 7fcbf0bff700 1 -- 172.21.15.81:0/3606646590 >> 172.21.15.81:0/3606646590 conn(0x7fcbec0cc090 msgr2=0x7fcbec0c22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:01.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.042+0000 7fcbf0bff700 1 -- 172.21.15.81:0/3606646590 shutdown_connections 2023-10-06T03:24:01.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.042+0000 7fcbf0bff700 1 -- 172.21.15.81:0/3606646590 wait complete. 2023-10-06T03:24:01.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.043+0000 7f7048ff9700 1 -- 172.21.15.81:0/3269973606 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7050067080 msgr2=0x7f7050069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:01.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.043+0000 7f7048ff9700 1 --2- 172.21.15.81:0/3269973606 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7050067080 0x7f7050069530 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f705c002250 tx=0x7f705c001a80 comp rx=0 tx=0).stop 2023-10-06T03:24:01.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.043+0000 7f7048ff9700 1 -- 172.21.15.81:0/3269973606 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f706415d890 msgr2=0x7f706415dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:01.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.044+0000 7f7048ff9700 1 --2- 172.21.15.81:0/3269973606 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f706415d890 0x7f706415dd30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7054015000 tx=0x7f7054016000 comp rx=0 tx=0).stop 2023-10-06T03:24:01.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.044+0000 7f7048ff9700 1 -- 172.21.15.81:0/3269973606 shutdown_connections 2023-10-06T03:24:01.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.044+0000 7f7048ff9700 1 --2- 172.21.15.81:0/3269973606 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7050067080 0x7f7050069530 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:01.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.044+0000 7f7048ff9700 1 --2- 172.21.15.81:0/3269973606 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f706415d890 0x7f706415dd30 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:01.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.044+0000 7f7048ff9700 1 --2- 172.21.15.81:0/3269973606 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7064147140 0x7f70641385e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:01.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.044+0000 7f7048ff9700 1 --2- 172.21.15.81:0/3269973606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7064147510 0x7f7064138b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:01.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.044+0000 7f7048ff9700 1 -- 172.21.15.81:0/3269973606 >> 172.21.15.81:0/3269973606 conn(0x7f70640cc090 msgr2=0x7f70641595b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:01.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.044+0000 7f7048ff9700 1 -- 172.21.15.81:0/3269973606 shutdown_connections 2023-10-06T03:24:01.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.045+0000 7f7048ff9700 1 -- 172.21.15.81:0/3269973606 wait complete. 2023-10-06T03:24:01.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.050+0000 7f78797ff700 1 -- 172.21.15.81:0/2549620108 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f787404c3c0 con 0x7f78740aee30 2023-10-06T03:24:01.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.052+0000 7f785affd700 1 -- 172.21.15.81:0/2549620108 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7868056af0 con 0x7f78740aee30 2023-10-06T03:24:01.054 INFO:teuthology.orchestra.run.smithi081.stdout:55834574855 2023-10-06T03:24:01.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.054+0000 7fa95e5ff700 1 -- 172.21.15.81:0/1697307678 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fa9581664a0 con 0x7fa95816a340 2023-10-06T03:24:01.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.055+0000 7fa93ffff700 1 -- 172.21.15.81:0/1697307678 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa95002a090 con 0x7fa95816a340 2023-10-06T03:24:01.057 INFO:teuthology.orchestra.run.smithi081.stdout:55834574856 2023-10-06T03:24:01.059 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.0 2023-10-06T03:24:01.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.057+0000 7f78797ff700 1 -- 172.21.15.81:0/2549620108 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7860066fb0 msgr2=0x7f7860069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:01.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.057+0000 7f78797ff700 1 --2- 172.21.15.81:0/2549620108 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7860066fb0 0x7f7860069460 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f786400bd00 tx=0x7f7864008040 comp rx=0 tx=0).stop 2023-10-06T03:24:01.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.057+0000 7f78797ff700 1 -- 172.21.15.81:0/2549620108 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78740aee30 msgr2=0x7f7874169100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:01.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.057+0000 7f78797ff700 1 --2- 172.21.15.81:0/2549620108 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78740aee30 0x7f7874169100 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7868015000 tx=0x7f7868016000 comp rx=0 tx=0).stop 2023-10-06T03:24:01.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.057+0000 7f78797ff700 1 -- 172.21.15.81:0/2549620108 shutdown_connections 2023-10-06T03:24:01.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.057+0000 7f78797ff700 1 --2- 172.21.15.81:0/2549620108 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78741589d0 0x7f7874157aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:01.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.057+0000 7f78797ff700 1 --2- 172.21.15.81:0/2549620108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f785c004810 0x7f78740c3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:01.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.057+0000 7f78797ff700 1 --2- 172.21.15.81:0/2549620108 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7860066fb0 0x7f7860069460 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:01.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.057+0000 7f78797ff700 1 --2- 172.21.15.81:0/2549620108 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78740aee30 0x7f7874169100 secure :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7868015000 tx=0x7f7868016000 comp rx=0 tx=0).stop 2023-10-06T03:24:01.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.058+0000 7f78797ff700 1 -- 172.21.15.81:0/2549620108 >> 172.21.15.81:0/2549620108 conn(0x7f78740cc090 msgr2=0x7f78740c7ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:01.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.059+0000 7fa95e5ff700 1 -- 172.21.15.81:0/1697307678 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa944066fb0 msgr2=0x7fa944069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:01.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.059+0000 7fa95e5ff700 1 --2- 172.21.15.81:0/1697307678 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa944066fb0 0x7fa944069460 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa948007fd0 tx=0x7fa948013040 comp rx=0 tx=0).stop 2023-10-06T03:24:01.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.059+0000 7fa95e5ff700 1 -- 172.21.15.81:0/1697307678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa95816a340 msgr2=0x7fa9581762e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:01.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.059+0000 7fa95e5ff700 1 --2- 172.21.15.81:0/1697307678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa95816a340 0x7fa9581762e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa95000d010 tx=0x7fa950017000 comp rx=0 tx=0).stop 2023-10-06T03:24:01.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.060+0000 7fa95e5ff700 1 -- 172.21.15.81:0/1697307678 shutdown_connections 2023-10-06T03:24:01.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.060+0000 7fa95e5ff700 1 --2- 172.21.15.81:0/1697307678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa95816a340 0x7fa9581762e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:01.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.060+0000 7fa95e5ff700 1 --2- 172.21.15.81:0/1697307678 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa958087b10 0x7fa9581677e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:01.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.060+0000 7fa95e5ff700 1 --2- 172.21.15.81:0/1697307678 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa944066fb0 0x7fa944069460 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:01.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.060+0000 7fa95e5ff700 1 --2- 172.21.15.81:0/1697307678 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa9580af200 0x7fa958167d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:01.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.060+0000 7fa95e5ff700 1 -- 172.21.15.81:0/1697307678 >> 172.21.15.81:0/1697307678 conn(0x7fa9580cc9c0 msgr2=0x7fa958087380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:01.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.060+0000 7fa95e5ff700 1 -- 172.21.15.81:0/1697307678 shutdown_connections 2023-10-06T03:24:01.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.060+0000 7fa95e5ff700 1 -- 172.21.15.81:0/1697307678 wait complete. 2023-10-06T03:24:01.063 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.2 2023-10-06T03:24:01.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.060+0000 7f78797ff700 1 -- 172.21.15.81:0/2549620108 shutdown_connections 2023-10-06T03:24:01.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.060+0000 7f78797ff700 1 -- 172.21.15.81:0/2549620108 wait complete. 2023-10-06T03:24:01.072 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.4 2023-10-06T03:24:01.073 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.3 2023-10-06T03:24:01.081 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.1 2023-10-06T03:24:01.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.083+0000 7fe52a99d700 1 -- 172.21.15.81:0/1441368284 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fe504005830 con 0x7fe5240b2420 2023-10-06T03:24:01.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.084+0000 7fe521ffb700 1 -- 172.21.15.81:0/1441368284 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe51c056810 con 0x7fe5240b2420 2023-10-06T03:24:01.086 INFO:teuthology.orchestra.run.smithi081.stdout:55834574855 2023-10-06T03:24:01.087 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.7 2023-10-06T03:24:01.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.087+0000 7fe52a99d700 1 -- 172.21.15.81:0/1441368284 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fe510067080 msgr2=0x7fe510069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:01.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.087+0000 7fe52a99d700 1 --2- 172.21.15.81:0/1441368284 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fe510067080 0x7fe510069530 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe52406e9a0 tx=0x7fe518007ec0 comp rx=0 tx=0).stop 2023-10-06T03:24:01.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.087+0000 7fe52a99d700 1 -- 172.21.15.81:0/1441368284 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe5240b2420 msgr2=0x7fe524155ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:01.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.087+0000 7fe52a99d700 1 --2- 172.21.15.81:0/1441368284 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe5240b2420 0x7fe524155ff0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe524088f80 tx=0x7fe51c017000 comp rx=0 tx=0).stop 2023-10-06T03:24:01.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.087+0000 7fe52a99d700 1 -- 172.21.15.81:0/1441368284 shutdown_connections 2023-10-06T03:24:01.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.087+0000 7fe52a99d700 1 --2- 172.21.15.81:0/1441368284 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe524158080 0x7fe52415d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:01.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.087+0000 7fe52a99d700 1 --2- 172.21.15.81:0/1441368284 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fe510067080 0x7fe510069530 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:01.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.087+0000 7fe52a99d700 1 --2- 172.21.15.81:0/1441368284 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe5240b2420 0x7fe524155ff0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:01.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.087+0000 7fe52a99d700 1 --2- 172.21.15.81:0/1441368284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe524157cb0 0x7fe52415cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:01.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.087+0000 7fe52a99d700 1 -- 172.21.15.81:0/1441368284 >> 172.21.15.81:0/1441368284 conn(0x7fe52406ed10 msgr2=0x7fe524160090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:01.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.087+0000 7fe52a99d700 1 -- 172.21.15.81:0/1441368284 shutdown_connections 2023-10-06T03:24:01.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:01.087+0000 7fe52a99d700 1 -- 172.21.15.81:0/1441368284 wait complete. 2023-10-06T03:24:01.092 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.6 2023-10-06T03:24:01.108 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.5 2023-10-06T03:24:02.059 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-06T03:24:02.064 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-06T03:24:02.073 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-06T03:24:02.074 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-06T03:24:02.082 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-06T03:24:02.088 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-06T03:24:02.093 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-06T03:24:02.109 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-06T03:24:02.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.351+0000 7fe52d59d700 1 Processor -- start 2023-10-06T03:24:02.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.351+0000 7fe52d59d700 1 -- start start 2023-10-06T03:24:02.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.353+0000 7fe52d59d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe5280875d0 0x7fe52806ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.353+0000 7fe52d59d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe5280879a0 0x7fe5280af200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.353+0000 7fe52d59d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5280ac7a0 con 0x7fe528169c30 2023-10-06T03:24:02.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.353+0000 7fe52d59d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe528087e10 con 0x7fe5280879a0 2023-10-06T03:24:02.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.353+0000 7fe52d59d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5280af740 con 0x7fe5280875d0 2023-10-06T03:24:02.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.354+0000 7fe5277fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe5280879a0 0x7fe5280af200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:02.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.354+0000 7fe5277fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe5280879a0 0x7fe5280af200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:50980/0 (socket says 172.21.15.81:50980) 2023-10-06T03:24:02.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.354+0000 7fe5277fe700 1 -- 172.21.15.81:0/556259017 learned_addr learned my addr 172.21.15.81:0/556259017 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:02.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.354+0000 7fe527fff700 1 --2- 172.21.15.81:0/556259017 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe5280875d0 0x7fe52806ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:02.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.354+0000 7fe5277fe700 1 -- 172.21.15.81:0/556259017 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe5280875d0 msgr2=0x7fe52806ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:02.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.355+0000 7fe5277fe700 1 --2- 172.21.15.81:0/556259017 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe5280875d0 0x7fe52806ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.355+0000 7fe5277fe700 1 -- 172.21.15.81:0/556259017 >> v1:172.21.15.83:6789/0 conn(0x7fe528169c30 legacy=0x7fe5280acc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.355+0000 7fe5277fe700 1 -- 172.21.15.81:0/556259017 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5280abb90 con 0x7fe5280879a0 2023-10-06T03:24:02.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.355+0000 7fe5277fe700 1 --2- 172.21.15.81:0/556259017 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5280879a0 0x7fe5280af200 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe51800ab70 tx=0x7fe51800a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6781ac8646c62326 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:02.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.356+0000 7fe526ffd700 1 -- 172.21.15.81:0/556259017 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe518019a60 con 0x7fe5280879a0 2023-10-06T03:24:02.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.356+0000 7fe526ffd700 1 -- 172.21.15.81:0/556259017 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe518019bc0 con 0x7fe5280879a0 2023-10-06T03:24:02.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.357+0000 7fe526ffd700 1 -- 172.21.15.81:0/556259017 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe518019d70 con 0x7fe5280879a0 2023-10-06T03:24:02.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.357+0000 7f2a08d9d700 1 Processor -- start 2023-10-06T03:24:02.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.357+0000 7fe52d59d700 1 -- 172.21.15.81:0/556259017 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5280879a0 msgr2=0x7fe5280af200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.357+0000 7fe52d59d700 1 --2- 172.21.15.81:0/556259017 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5280879a0 0x7fe5280af200 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe51800ab70 tx=0x7fe51800a410 comp rx=0 tx=0).stop 2023-10-06T03:24:02.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.357+0000 7f2a08d9d700 1 -- start start 2023-10-06T03:24:02.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.359+0000 7fe52d59d700 1 -- 172.21.15.81:0/556259017 shutdown_connections 2023-10-06T03:24:02.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.359+0000 7fe52d59d700 1 --2- 172.21.15.81:0/556259017 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe5280875d0 0x7fe52806ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.359+0000 7fe52d59d700 1 --2- 172.21.15.81:0/556259017 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5280879a0 0x7fe5280af200 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.359+0000 7fe52d59d700 1 -- 172.21.15.81:0/556259017 >> 172.21.15.81:0/556259017 conn(0x7fe5280cc9c0 msgr2=0x7fe5280a5430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:02.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.360+0000 7f2a08d9d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2a040ab7b0 0x7f2a04069310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.360+0000 7f2a08d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2a040acad0 0x7f2a040acef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.360+0000 7f2a08d9d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a04069850 con 0x7f2a041592e0 2023-10-06T03:24:02.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.360+0000 7f2a08d9d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a0406a690 con 0x7f2a040acad0 2023-10-06T03:24:02.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.360+0000 7f2a08d9d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a040ad430 con 0x7f2a040ab7b0 2023-10-06T03:24:02.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.361+0000 7f2a02ffd700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2a040ab7b0 0x7f2a04069310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:02.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.361+0000 7f2a02ffd700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2a040ab7b0 0x7f2a04069310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:50990/0 (socket says 172.21.15.81:50990) 2023-10-06T03:24:02.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.361+0000 7f2a02ffd700 1 -- 172.21.15.81:0/1355757752 learned_addr learned my addr 172.21.15.81:0/1355757752 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:02.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.362+0000 7f2a02ffd700 1 -- 172.21.15.81:0/1355757752 >> v2:172.21.15.81:3300/0 conn(0x7f2a040acad0 msgr2=0x7f2a040acef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T03:24:02.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.362+0000 7f2a027fc700 1 -- 172.21.15.81:0/1355757752 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 433415072 0 0) 0x7f2a04069850 con 0x7f2a041592e0 2023-10-06T03:24:02.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.363+0000 7f2a03fff700 1 --2- 172.21.15.81:0/1355757752 >> v2:172.21.15.81:3300/0 conn(0x7f2a040acad0 0x7f2a040acef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:02.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.363+0000 7f2a02ffd700 1 --2- 172.21.15.81:0/1355757752 >> v2:172.21.15.81:3300/0 conn(0x7f2a040acad0 0x7f2a040acef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.363+0000 7f2a02ffd700 1 -- 172.21.15.81:0/1355757752 >> v1:172.21.15.83:6789/0 conn(0x7f2a041592e0 legacy=0x7f2a0406ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.363+0000 7f2a02ffd700 1 -- 172.21.15.81:0/1355757752 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a04069a80 con 0x7f2a040ab7b0 2023-10-06T03:24:02.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.364+0000 7f2a03fff700 1 --2- 172.21.15.81:0/1355757752 >> v2:172.21.15.81:3300/0 conn(0x7f2a040acad0 0x7f2a040acef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:02.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.364+0000 7f2a02ffd700 1 --2- 172.21.15.81:0/1355757752 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2a040ab7b0 0x7f2a04069310 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2a04068fa0 tx=0x7f29f8009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=410f0f7303439993 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:02.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.359+0000 7fe52d59d700 1 -- 172.21.15.81:0/556259017 shutdown_connections 2023-10-06T03:24:02.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.360+0000 7fe52d59d700 1 -- 172.21.15.81:0/556259017 wait complete. 2023-10-06T03:24:02.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.362+0000 7fe52d59d700 1 Processor -- start 2023-10-06T03:24:02.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.362+0000 7fe52d59d700 1 -- start start 2023-10-06T03:24:02.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.364+0000 7fe52d59d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5280875d0 0x7fe5280b1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.364+0000 7fe52d59d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5280879a0 0x7fe52817c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.365+0000 7fe5277fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5280879a0 0x7fe52817c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:02.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.365+0000 7fe5277fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5280879a0 0x7fe52817c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56316/0 (socket says 172.21.15.81:56316) 2023-10-06T03:24:02.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.365+0000 7fe527fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5280875d0 0x7fe5280b1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:02.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.365+0000 7fe5277fe700 1 -- 172.21.15.81:0/4168927781 learned_addr learned my addr 172.21.15.81:0/4168927781 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:02.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.365+0000 7fe52d59d700 1 --2- 172.21.15.81:0/4168927781 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe528169c30 0x7fe52815ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.365+0000 7fe52d59d700 1 -- 172.21.15.81:0/4168927781 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52817bc50 con 0x7fe5280879a0 2023-10-06T03:24:02.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.365+0000 7fe52d59d700 1 -- 172.21.15.81:0/4168927781 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52815b9a0 con 0x7fe5280875d0 2023-10-06T03:24:02.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.365+0000 7fe52d59d700 1 -- 172.21.15.81:0/4168927781 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe52817b600 con 0x7fe528169c30 2023-10-06T03:24:02.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.365+0000 7f2a027fc700 1 -- 172.21.15.81:0/1355757752 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f800b860 con 0x7f2a040ab7b0 2023-10-06T03:24:02.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.365+0000 7f2a027fc700 1 -- 172.21.15.81:0/1355757752 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f800b9c0 con 0x7f2a040ab7b0 2023-10-06T03:24:02.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.365+0000 7f2a027fc700 1 -- 172.21.15.81:0/1355757752 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f800bd60 con 0x7f2a040ab7b0 2023-10-06T03:24:02.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.366+0000 7f2a08d9d700 1 -- 172.21.15.81:0/1355757752 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2a040ab7b0 msgr2=0x7f2a04069310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.366+0000 7f2a08d9d700 1 --2- 172.21.15.81:0/1355757752 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2a040ab7b0 0x7f2a04069310 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2a04068fa0 tx=0x7f29f8009250 comp rx=0 tx=0).stop 2023-10-06T03:24:02.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.366+0000 7fe52cd9c700 1 --2- 172.21.15.81:0/4168927781 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe528169c30 0x7fe52815ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:02.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.367+0000 7f2a08d9d700 1 -- 172.21.15.81:0/1355757752 shutdown_connections 2023-10-06T03:24:02.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.367+0000 7f2a08d9d700 1 --2- 172.21.15.81:0/1355757752 >> v2:172.21.15.81:3300/0 conn(0x7f2a040acad0 0x7f2a040acef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.367+0000 7f2a08d9d700 1 --2- 172.21.15.81:0/1355757752 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2a040ab7b0 0x7f2a04069310 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.367+0000 7f2a08d9d700 1 -- 172.21.15.81:0/1355757752 >> 172.21.15.81:0/1355757752 conn(0x7f2a040cc9c0 msgr2=0x7f2a040a5430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:02.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.367+0000 7f2a08d9d700 1 -- 172.21.15.81:0/1355757752 shutdown_connections 2023-10-06T03:24:02.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.366+0000 7fe5277fe700 1 -- 172.21.15.81:0/4168927781 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe528169c30 msgr2=0x7fe52815ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.366+0000 7fe5277fe700 1 --2- 172.21.15.81:0/4168927781 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe528169c30 0x7fe52815ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.366+0000 7fe5277fe700 1 -- 172.21.15.81:0/4168927781 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5280875d0 msgr2=0x7fe5280b1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.366+0000 7fe5277fe700 1 --2- 172.21.15.81:0/4168927781 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5280875d0 0x7fe5280b1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.367+0000 7f2a08d9d700 1 -- 172.21.15.81:0/1355757752 wait complete. 2023-10-06T03:24:02.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.370+0000 7f2a08d9d700 1 Processor -- start 2023-10-06T03:24:02.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.370+0000 7f2a08d9d700 1 -- start start 2023-10-06T03:24:02.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.372+0000 7f2a08d9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2a040ab7b0 0x7f2a0406e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.372+0000 7f2a08d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a040acad0 0x7f2a0415acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.374+0000 7f2a08d9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2a041592e0 0x7f2a0415b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.374+0000 7f2a08d9d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0415b730 con 0x7f2a040acad0 2023-10-06T03:24:02.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.374+0000 7f2a02ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a040acad0 0x7f2a0415acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:02.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.374+0000 7f2a02ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a040acad0 0x7f2a0415acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56328/0 (socket says 172.21.15.81:56328) 2023-10-06T03:24:02.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.374+0000 7f2a02ffd700 1 -- 172.21.15.81:0/1040975569 learned_addr learned my addr 172.21.15.81:0/1040975569 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:02.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.375+0000 7f2a037fe700 1 --2- 172.21.15.81:0/1040975569 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2a040ab7b0 0x7f2a0406e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:02.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.375+0000 7f2a03fff700 1 --2- 172.21.15.81:0/1040975569 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2a041592e0 0x7f2a0415b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:02.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.375+0000 7f2a08d9d700 1 -- 172.21.15.81:0/1040975569 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a041596b0 con 0x7f2a041592e0 2023-10-06T03:24:02.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.375+0000 7f2a08d9d700 1 -- 172.21.15.81:0/1040975569 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a04159990 con 0x7f2a040ab7b0 2023-10-06T03:24:02.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.376+0000 7f2a02ffd700 1 -- 172.21.15.81:0/1040975569 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2a040ab7b0 msgr2=0x7f2a0406e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.376+0000 7f2a02ffd700 1 --2- 172.21.15.81:0/1040975569 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2a040ab7b0 0x7f2a0406e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.376+0000 7f2a02ffd700 1 -- 172.21.15.81:0/1040975569 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2a041592e0 msgr2=0x7f2a0415b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.376+0000 7f2a02ffd700 1 --2- 172.21.15.81:0/1040975569 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2a041592e0 0x7f2a0415b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.376+0000 7f2a02ffd700 1 -- 172.21.15.81:0/1040975569 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f80094f0 con 0x7f2a040acad0 2023-10-06T03:24:02.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.377+0000 7f2a02ffd700 1 --2- 172.21.15.81:0/1040975569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a040acad0 0x7f2a0415acb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2a040ad570 tx=0x7f29f8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:02.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.379+0000 7f29eb7fe700 1 -- 172.21.15.81:0/1040975569 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f8026450 con 0x7f2a040acad0 2023-10-06T03:24:02.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.379+0000 7f29eb7fe700 1 -- 172.21.15.81:0/1040975569 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f80265b0 con 0x7f2a040acad0 2023-10-06T03:24:02.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.379+0000 7f29eb7fe700 1 -- 172.21.15.81:0/1040975569 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f8026970 con 0x7f2a040acad0 2023-10-06T03:24:02.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.379+0000 7f2a08d9d700 1 -- 172.21.15.81:0/1040975569 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a04159c70 con 0x7f2a040acad0 2023-10-06T03:24:02.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.379+0000 7f2a08d9d700 1 -- 172.21.15.81:0/1040975569 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a0415a230 con 0x7f2a040acad0 2023-10-06T03:24:02.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.383+0000 7f2a08d9d700 1 -- 172.21.15.81:0/1040975569 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29e40052b0 con 0x7f2a040acad0 2023-10-06T03:24:02.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.366+0000 7fe5277fe700 1 -- 172.21.15.81:0/4168927781 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe51800a6b0 con 0x7fe5280879a0 2023-10-06T03:24:02.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.366+0000 7fe5277fe700 1 --2- 172.21.15.81:0/4168927781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5280879a0 0x7fe52817c0e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe51800d010 tx=0x7fe51801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:02.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.367+0000 7fe527fff700 1 --2- 172.21.15.81:0/4168927781 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5280875d0 0x7fe5280b1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:02.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.367+0000 7fe50ffff700 1 -- 172.21.15.81:0/4168927781 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe518019e00 con 0x7fe5280879a0 2023-10-06T03:24:02.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.368+0000 7fe52d59d700 1 -- 172.21.15.81:0/4168927781 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe52817b8e0 con 0x7fe5280879a0 2023-10-06T03:24:02.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.371+0000 7fe52d59d700 1 -- 172.21.15.81:0/4168927781 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5280b1980 con 0x7fe5280879a0 2023-10-06T03:24:02.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.372+0000 7fe50ffff700 1 -- 172.21.15.81:0/4168927781 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe518018070 con 0x7fe5280879a0 2023-10-06T03:24:02.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.373+0000 7fe50ffff700 1 -- 172.21.15.81:0/4168927781 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe518013be0 con 0x7fe5280879a0 2023-10-06T03:24:02.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.373+0000 7fe50ffff700 1 -- 172.21.15.81:0/4168927781 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe518019190 con 0x7fe5280879a0 2023-10-06T03:24:02.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.375+0000 7fe50ffff700 1 --2- 172.21.15.81:0/4168927781 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fe514067080 0x7fe514069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.377+0000 7fe52d59d700 1 -- 172.21.15.81:0/4168927781 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5080052b0 con 0x7fe5280879a0 2023-10-06T03:24:02.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.377+0000 7fe50ffff700 1 -- 172.21.15.81:0/4168927781 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fe51801d020 con 0x7fe5280879a0 2023-10-06T03:24:02.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.378+0000 7fe527fff700 1 --2- 172.21.15.81:0/4168927781 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fe514067080 0x7fe514069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:02.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.379+0000 7fe527fff700 1 --2- 172.21.15.81:0/4168927781 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fe514067080 0x7fe514069530 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe51c009990 tx=0x7fe51c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:02.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.388+0000 7fe50ffff700 1 -- 172.21.15.81:0/4168927781 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe518052bd0 con 0x7fe5280879a0 2023-10-06T03:24:02.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.391+0000 7f29eb7fe700 1 -- 172.21.15.81:0/1040975569 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f29f801a420 con 0x7f2a040acad0 2023-10-06T03:24:02.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.392+0000 7f29eb7fe700 1 --2- 172.21.15.81:0/1040975569 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f29f0067080 0x7f29f0069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.392+0000 7f29eb7fe700 1 -- 172.21.15.81:0/1040975569 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f29f8086a90 con 0x7f2a040acad0 2023-10-06T03:24:02.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.393+0000 7f2a037fe700 1 --2- 172.21.15.81:0/1040975569 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f29f0067080 0x7f29f0069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:02.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.395+0000 7f2a037fe700 1 --2- 172.21.15.81:0/1040975569 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f29f0067080 0x7f29f0069530 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2a0415c7b0 tx=0x7f29f4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:02.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.401+0000 7f29eb7fe700 1 -- 172.21.15.81:0/1040975569 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f29f8053910 con 0x7f2a040acad0 2023-10-06T03:24:02.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.438+0000 7f42d0d9d700 1 Processor -- start 2023-10-06T03:24:02.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.438+0000 7f42d0d9d700 1 -- start start 2023-10-06T03:24:02.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.438+0000 7f037579d700 1 Processor -- start 2023-10-06T03:24:02.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.438+0000 7f037579d700 1 -- start start 2023-10-06T03:24:02.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.441+0000 7f037579d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f037015dbd0 0x7f03700ccf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.441+0000 7f037579d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03700b3110 con 0x7f03700ce3b0 2023-10-06T03:24:02.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.441+0000 7f037579d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03700b33f0 con 0x7f037015d800 2023-10-06T03:24:02.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.441+0000 7f037579d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03700cd640 con 0x7f037015dbd0 2023-10-06T03:24:02.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.441+0000 7f42d0d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f42cc15a4b0 0x7f42cc0b1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.441+0000 7f42d0d9d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f42cc15ca90 0x7f42cc0b2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.442+0000 7f0374f9c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f03700ce3b0 0x7f03700b3880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39428/0 (socket says 172.21.15.81:39428) 2023-10-06T03:24:02.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.442+0000 7f0374f9c700 1 -- 172.21.15.81:0/372212985 learned_addr learned my addr 172.21.15.81:0/372212985 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:24:02.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.442+0000 7f42cbfff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f42cc15ac70 0x7f42cc15b0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39444/0 (socket says 172.21.15.81:39444) 2023-10-06T03:24:02.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.442+0000 7f42cbfff700 1 -- 172.21.15.81:0/1133723418 learned_addr learned my addr 172.21.15.81:0/1133723418 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:24:02.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.443+0000 7f036f7fe700 1 --2- 172.21.15.81:0/372212985 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f037015dbd0 0x7f03700ccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:02.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.442+0000 7f42d0d9d700 1 -- 172.21.15.81:0/1133723418 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42cc15b7c0 con 0x7f42cc15ac70 2023-10-06T03:24:02.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.443+0000 7f42d0d9d700 1 -- 172.21.15.81:0/1133723418 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42cc150970 con 0x7f42cc15a4b0 2023-10-06T03:24:02.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.443+0000 7f42d0d9d700 1 -- 172.21.15.81:0/1133723418 --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42cc15c600 con 0x7f42cc15ca90 2023-10-06T03:24:02.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.443+0000 7f036effd700 1 -- 172.21.15.81:0/372212985 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3730354169 0 0) 0x7f03700b3110 con 0x7f03700ce3b0 2023-10-06T03:24:02.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.443+0000 7f036effd700 1 -- 172.21.15.81:0/372212985 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f035c003570 con 0x7f03700ce3b0 2023-10-06T03:24:02.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.444+0000 7f42c2ffd700 1 --2- 172.21.15.81:0/1133723418 >> v2:172.21.15.83:3300/0 conn(0x7f42cc15ca90 0x7f42cc0b2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:02.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.444+0000 7f42cb7fe700 1 --2- 172.21.15.81:0/1133723418 >> v2:172.21.15.81:3300/0 conn(0x7f42cc15a4b0 0x7f42cc0b1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:02.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.444+0000 7f42caffd700 1 -- 172.21.15.81:0/1133723418 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 300795241 0 0) 0x7f42cc15b7c0 con 0x7f42cc15ac70 2023-10-06T03:24:02.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.445+0000 7f42caffd700 1 -- 172.21.15.81:0/1133723418 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42b8003570 con 0x7f42cc15ac70 2023-10-06T03:24:02.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.445+0000 7f036effd700 1 -- 172.21.15.81:0/372212985 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 463506224 0 0) 0x7f03700b33f0 con 0x7f037015d800 2023-10-06T03:24:02.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.445+0000 7f036effd700 1 -- 172.21.15.81:0/372212985 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03700b3110 con 0x7f037015d800 2023-10-06T03:24:02.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.445+0000 7f0ffeb9d700 1 Processor -- start 2023-10-06T03:24:02.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.446+0000 7f036effd700 1 -- 172.21.15.81:0/372212985 <== mon.1 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 881844611 0 0) 0x7f03700b3110 con 0x7f037015d800 2023-10-06T03:24:02.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.446+0000 7f036effd700 1 -- 172.21.15.81:0/372212985 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f037015dbd0 msgr2=0x7f03700ccf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:02.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.446+0000 7f036effd700 1 --2- 172.21.15.81:0/372212985 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f037015dbd0 0x7f03700ccf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.446+0000 7f036effd700 1 -- 172.21.15.81:0/372212985 >> v1:172.21.15.81:6789/0 conn(0x7f03700ce3b0 legacy=0x7f03700b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.446+0000 7f036effd700 1 -- 172.21.15.81:0/372212985 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03700cd920 con 0x7f037015d800 2023-10-06T03:24:02.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.446+0000 7f036effd700 1 -- 172.21.15.81:0/372212985 <== mon.1 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2513016936 0 0) 0x7f0368001470 con 0x7f037015d800 2023-10-06T03:24:02.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.446+0000 7f036effd700 1 -- 172.21.15.81:0/372212985 >> v1:172.21.15.83:6789/0 conn(0x7f037015d800 legacy=0x7f03700b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.446+0000 7f036effd700 1 --2- 172.21.15.81:0/372212985 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f035c003bf0 0x7f035c003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.446+0000 7f0ffeb9d700 1 -- start start 2023-10-06T03:24:02.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.445+0000 7f42c2ffd700 1 -- 172.21.15.81:0/1133723418 >> v2:172.21.15.81:3300/0 conn(0x7f42cc15a4b0 msgr2=0x7f42cc0b1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:02.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.445+0000 7f42c2ffd700 1 --2- 172.21.15.81:0/1133723418 >> v2:172.21.15.81:3300/0 conn(0x7f42cc15a4b0 0x7f42cc0b1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.445+0000 7f42c2ffd700 1 -- 172.21.15.81:0/1133723418 >> v1:172.21.15.81:6789/0 conn(0x7f42cc15ac70 legacy=0x7f42cc15b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.445+0000 7f42c2ffd700 1 -- 172.21.15.81:0/1133723418 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42cc15b9f0 con 0x7f42cc15ca90 2023-10-06T03:24:02.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.446+0000 7f036effd700 1 --2- 172.21.15.81:0/372212985 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f035c004810 0x7f035c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.446+0000 7f036effd700 1 --2- 172.21.15.81:0/372212985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f035c0051c0 0x7f035c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.447+0000 7f036ffff700 1 --2- 172.21.15.81:0/372212985 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f035c003bf0 0x7f035c003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:02.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.447+0000 7f42c2ffd700 1 --2- 172.21.15.81:0/1133723418 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f42cc15ca90 0x7f42cc0b2260 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f42cc0891a0 tx=0x7f42b40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e532ae092fd51dd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:02.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.447+0000 7f036effd700 1 -- 172.21.15.81:0/372212985 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03700cd640 con 0x7f035c0051c0 2023-10-06T03:24:02.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.447+0000 7f036effd700 1 -- 172.21.15.81:0/372212985 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f035c00c050 con 0x7f035c004810 2023-10-06T03:24:02.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.447+0000 7f036effd700 1 -- 172.21.15.81:0/372212985 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f035c00c210 con 0x7f035c003bf0 2023-10-06T03:24:02.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.447+0000 7f036ffff700 1 -- 172.21.15.81:0/372212985 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f035c004810 msgr2=0x7f035c004c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T03:24:02.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.447+0000 7f036ffff700 1 --2- 172.21.15.81:0/372212985 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f035c004810 0x7f035c004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.447+0000 7f036ffff700 1 -- 172.21.15.81:0/372212985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f035c0051c0 msgr2=0x7f035c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:02.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.447+0000 7f036ffff700 1 --2- 172.21.15.81:0/372212985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f035c0051c0 0x7f035c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.447+0000 7f036ffff700 1 -- 172.21.15.81:0/372212985 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03700b3110 con 0x7f035c003bf0 2023-10-06T03:24:02.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.448+0000 7f42caffd700 1 -- 172.21.15.81:0/1133723418 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b4011630 con 0x7f42cc15ca90 2023-10-06T03:24:02.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.448+0000 7f036ffff700 1 --2- 172.21.15.81:0/372212985 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f035c003bf0 0x7f035c003fe0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f036800c110 tx=0x7f0368002d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31ce5f6180772d12 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:02.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.448+0000 7f42caffd700 1 -- 172.21.15.81:0/1133723418 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b4011790 con 0x7f42cc15ca90 2023-10-06T03:24:02.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.448+0000 7f42caffd700 1 -- 172.21.15.81:0/1133723418 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b4011b10 con 0x7f42cc15ca90 2023-10-06T03:24:02.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.448+0000 7f0ffeb9d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f0ff806b830 0x7f0ff80af650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.449+0000 7fb87279d700 1 Processor -- start 2023-10-06T03:24:02.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.448+0000 7f0ffeb9d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ff8069b00 con 0x7f0ff80ac6d0 2023-10-06T03:24:02.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.448+0000 7f0ffeb9d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ff81558e0 con 0x7f0ff806f2e0 2023-10-06T03:24:02.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.448+0000 7f0ffeb9d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ff80abb80 con 0x7f0ff806b830 2023-10-06T03:24:02.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.449+0000 7f0ffdb9b700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f0ff806f2e0 0x7f0ff81551d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:40128/0 (socket says 172.21.15.81:40128) 2023-10-06T03:24:02.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.449+0000 7f0ffdb9b700 1 -- 172.21.15.81:0/890342490 learned_addr learned my addr 172.21.15.81:0/890342490 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:24:02.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.449+0000 7f0ffd39a700 1 --2- 172.21.15.81:0/890342490 >> v2:172.21.15.83:3300/0 conn(0x7f0ff806b830 0x7f0ff80af650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:02.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.449+0000 7f222f3ff700 1 Processor -- start 2023-10-06T03:24:02.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.450+0000 7f42d0d9d700 1 -- 172.21.15.81:0/1133723418 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f42cc15ca90 msgr2=0x7f42cc0b2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.450+0000 7f42d0d9d700 1 --2- 172.21.15.81:0/1133723418 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f42cc15ca90 0x7f42cc0b2260 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f42cc0891a0 tx=0x7f42b40091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.449+0000 7f0ffd39a700 1 -- 172.21.15.81:0/890342490 >> v1:172.21.15.83:6789/0 conn(0x7f0ff806f2e0 legacy=0x7f0ff81551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.449+0000 7f0ffd39a700 1 -- 172.21.15.81:0/890342490 >> v1:172.21.15.81:6789/0 conn(0x7f0ff80ac6d0 legacy=0x7f0ff80ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.449+0000 7f0ffd39a700 1 -- 172.21.15.81:0/890342490 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff80694b0 con 0x7f0ff806b830 2023-10-06T03:24:02.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.450+0000 7f0ffd39a700 1 --2- 172.21.15.81:0/890342490 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ff806b830 0x7f0ff80af650 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8009910 tx=0x7f0fe80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2b8bed6d31245ba server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:02.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.449+0000 7f222f3ff700 1 -- start start 2023-10-06T03:24:02.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.450+0000 7f42d0d9d700 1 -- 172.21.15.81:0/1133723418 shutdown_connections 2023-10-06T03:24:02.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.450+0000 7f42d0d9d700 1 --2- 172.21.15.81:0/1133723418 >> v2:172.21.15.81:3300/0 conn(0x7f42cc15a4b0 0x7f42cc0b1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.450+0000 7f42d0d9d700 1 --2- 172.21.15.81:0/1133723418 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f42cc15ca90 0x7f42cc0b2260 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.450+0000 7f42d0d9d700 1 -- 172.21.15.81:0/1133723418 >> 172.21.15.81:0/1133723418 conn(0x7f42cc06ed10 msgr2=0x7f42cc06f110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:02.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.450+0000 7f0ffcb99700 1 -- 172.21.15.81:0/890342490 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe800b820 con 0x7f0ff806b830 2023-10-06T03:24:02.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.451+0000 7f0ffcb99700 1 -- 172.21.15.81:0/890342490 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe800b980 con 0x7f0ff806b830 2023-10-06T03:24:02.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.451+0000 7f0ffcb99700 1 -- 172.21.15.81:0/890342490 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe800bd20 con 0x7f0ff806b830 2023-10-06T03:24:02.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.449+0000 7fb87279d700 1 -- start start 2023-10-06T03:24:02.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.451+0000 7f42d0d9d700 1 -- 172.21.15.81:0/1133723418 shutdown_connections 2023-10-06T03:24:02.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.451+0000 7f42d0d9d700 1 -- 172.21.15.81:0/1133723418 wait complete. 2023-10-06T03:24:02.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.451+0000 7fb87279d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8640e20d0 0x7fb864006080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.451+0000 7fb87279d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb8640e24a0 0x7fb8640065c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.451+0000 7fb87279d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8640399d0 con 0x7fb864038be0 2023-10-06T03:24:02.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.452+0000 7f222f3ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f22281551d0 0x7f22280af650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.451+0000 7fb87279d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb864007870 con 0x7fb8640e24a0 2023-10-06T03:24:02.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.451+0000 7fb87279d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb864006bf0 con 0x7fb8640e20d0 2023-10-06T03:24:02.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.452+0000 7fb871f9c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb864038be0 0x7fb8640e5ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39454/0 (socket says 172.21.15.81:39454) 2023-10-06T03:24:02.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.452+0000 7fb871f9c700 1 -- 172.21.15.81:0/1488865464 learned_addr learned my addr 172.21.15.81:0/1488865464 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:24:02.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.452+0000 7f0ffeb9d700 1 -- 172.21.15.81:0/890342490 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ff806b830 msgr2=0x7f0ff80af650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.452+0000 7f0ffeb9d700 1 --2- 172.21.15.81:0/890342490 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ff806b830 0x7f0ff80af650 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8009910 tx=0x7f0fe80091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.452+0000 7f0ffeb9d700 1 -- 172.21.15.81:0/890342490 shutdown_connections 2023-10-06T03:24:02.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.452+0000 7f0ffeb9d700 1 --2- 172.21.15.81:0/890342490 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ff806b830 0x7f0ff80af650 secure :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8009910 tx=0x7f0fe80091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.452+0000 7fb87179b700 1 --2- 172.21.15.81:0/1488865464 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8640e20d0 0x7fb864006080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:02.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.453+0000 7fb870f9a700 1 --2- 172.21.15.81:0/1488865464 >> v2:172.21.15.83:3300/0 conn(0x7fb8640e24a0 0x7fb8640065c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:02.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.453+0000 7fb863fff700 1 -- 172.21.15.81:0/1488865464 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2622912119 0 0) 0x7fb8640399d0 con 0x7fb864038be0 2023-10-06T03:24:02.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.453+0000 7fb87179b700 1 -- 172.21.15.81:0/1488865464 >> v2:172.21.15.83:3300/0 conn(0x7fb8640e24a0 msgr2=0x7fb8640065c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:02.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.453+0000 7fb87179b700 1 --2- 172.21.15.81:0/1488865464 >> v2:172.21.15.83:3300/0 conn(0x7fb8640e24a0 0x7fb8640065c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.453+0000 7fb87179b700 1 -- 172.21.15.81:0/1488865464 >> v1:172.21.15.81:6789/0 conn(0x7fb864038be0 legacy=0x7fb8640e5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.453+0000 7fb87179b700 1 -- 172.21.15.81:0/1488865464 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb864006ed0 con 0x7fb8640e20d0 2023-10-06T03:24:02.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.454+0000 7fb87179b700 1 --2- 172.21.15.81:0/1488865464 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8640e20d0 0x7fb864006080 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb85c0098e0 tx=0x7fb85c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c1d4dc7bf4642b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:02.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.453+0000 7f036effd700 1 -- 172.21.15.81:0/372212985 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036800ca00 con 0x7f035c003bf0 2023-10-06T03:24:02.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.453+0000 7f036effd700 1 -- 172.21.15.81:0/372212985 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f036800cb60 con 0x7f035c003bf0 2023-10-06T03:24:02.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.452+0000 7f0ffeb9d700 1 -- 172.21.15.81:0/890342490 >> 172.21.15.81:0/890342490 conn(0x7f0ff80cc9c0 msgr2=0x7f0ff80a5430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:02.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.453+0000 7f0ffeb9d700 1 -- 172.21.15.81:0/890342490 shutdown_connections 2023-10-06T03:24:02.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.453+0000 7f222f3ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f222806b830 0x7f22280ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.453+0000 7f222f3ff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2228069b00 con 0x7f222806f2e0 2023-10-06T03:24:02.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.453+0000 7f222f3ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22280abb80 con 0x7f22281551d0 2023-10-06T03:24:02.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.453+0000 7f222f3ff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22280afb90 con 0x7f222806b830 2023-10-06T03:24:02.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.453+0000 7f222d19b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f22281551d0 0x7f22280af650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:02.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.453+0000 7f222d19b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f22281551d0 0x7f22280af650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56356/0 (socket says 172.21.15.81:56356) 2023-10-06T03:24:02.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.453+0000 7f222d19b700 1 -- 172.21.15.81:0/3108507208 learned_addr learned my addr 172.21.15.81:0/3108507208 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:02.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.453+0000 7f222c99a700 1 --2- 172.21.15.81:0/3108507208 >> v2:172.21.15.83:3300/0 conn(0x7f222806b830 0x7f22280ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:02.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.454+0000 7f222c99a700 1 -- 172.21.15.81:0/3108507208 >> v2:172.21.15.81:3300/0 conn(0x7f22281551d0 msgr2=0x7f22280af650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:02.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.454+0000 7f222c99a700 1 --2- 172.21.15.81:0/3108507208 >> v2:172.21.15.81:3300/0 conn(0x7f22281551d0 0x7f22280af650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.454+0000 7f222c99a700 1 -- 172.21.15.81:0/3108507208 >> v1:172.21.15.81:6789/0 conn(0x7f222806f2e0 legacy=0x7f2228159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:02.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.454+0000 7f037579d700 1 -- 172.21.15.81:0/372212985 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f035c003bf0 msgr2=0x7f035c003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.454+0000 7f037579d700 1 --2- 172.21.15.81:0/372212985 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f035c003bf0 0x7f035c003fe0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f036800c110 tx=0x7f0368002d70 comp rx=0 tx=0).stop 2023-10-06T03:24:02.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.454+0000 7f0374f9c700 1 -- 172.21.15.81:0/372212985 reap_dead start 2023-10-06T03:24:02.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.454+0000 7f222c99a700 1 -- 172.21.15.81:0/3108507208 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22280ab8e0 con 0x7f222806b830 2023-10-06T03:24:02.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.454+0000 7f037579d700 1 -- 172.21.15.81:0/372212985 shutdown_connections 2023-10-06T03:24:02.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.454+0000 7f037579d700 1 -- 172.21.15.81:0/372212985 >> 172.21.15.81:0/372212985 conn(0x7f03700d0350 msgr2=0x7f03700d0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:02.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.454+0000 7f42d0d9d700 1 Processor -- start 2023-10-06T03:24:02.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.454+0000 7f222d19b700 1 --2- 172.21.15.81:0/3108507208 >> v2:172.21.15.81:3300/0 conn(0x7f22281551d0 0x7f22280af650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:24:02.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.455+0000 7f037579d700 1 -- 172.21.15.81:0/372212985 shutdown_connections 2023-10-06T03:24:02.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.455+0000 7f222c99a700 1 --2- 172.21.15.81:0/3108507208 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f222806b830 0x7f22280ad0c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f22280aeeb0 tx=0x7f2220009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0a1e747c8292320 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:02.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.455+0000 7f42d0d9d700 1 -- start start 2023-10-06T03:24:02.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.455+0000 7fb863fff700 1 -- 172.21.15.81:0/1488865464 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c009e80 con 0x7fb8640e20d0 2023-10-06T03:24:02.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.454+0000 7f0ffeb9d700 1 -- 172.21.15.81:0/890342490 wait complete. 2023-10-06T03:24:02.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.455+0000 7fb863fff700 1 -- 172.21.15.81:0/1488865464 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85c00b860 con 0x7fb8640e20d0 2023-10-06T03:24:02.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.455+0000 7f221ffff700 1 -- 172.21.15.81:0/3108507208 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222000e070 con 0x7f222806b830 2023-10-06T03:24:02.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.455+0000 7f221ffff700 1 -- 172.21.15.81:0/3108507208 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f222000bb20 con 0x7f222806b830 2023-10-06T03:24:02.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.455+0000 7f221ffff700 1 -- 172.21.15.81:0/3108507208 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222000e070 con 0x7f222806b830 2023-10-06T03:24:02.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.455+0000 7fb863fff700 1 -- 172.21.15.81:0/1488865464 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c00bbe0 con 0x7fb8640e20d0 2023-10-06T03:24:02.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.456+0000 7f783db9d700 1 Processor -- start 2023-10-06T03:24:02.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.456+0000 7f0ffeb9d700 1 Processor -- start 2023-10-06T03:24:02.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.456+0000 7f783db9d700 1 -- start start 2023-10-06T03:24:02.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.456+0000 7f222f3ff700 1 -- 172.21.15.81:0/3108507208 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f222806b830 msgr2=0x7f22280ad0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.456+0000 7f222f3ff700 1 --2- 172.21.15.81:0/3108507208 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f222806b830 0x7f22280ad0c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f22280aeeb0 tx=0x7f2220009780 comp rx=0 tx=0).stop 2023-10-06T03:24:02.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.456+0000 7f222f3ff700 1 -- 172.21.15.81:0/3108507208 shutdown_connections 2023-10-06T03:24:02.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.456+0000 7fb87279d700 1 -- 172.21.15.81:0/1488865464 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8640e20d0 msgr2=0x7fb864006080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.456+0000 7fb87279d700 1 --2- 172.21.15.81:0/1488865464 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8640e20d0 0x7fb864006080 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb85c0098e0 tx=0x7fb85c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.456+0000 7f42d0d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42cc15a4b0 0x7f42cc0cc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.457+0000 7f222f3ff700 1 --2- 172.21.15.81:0/3108507208 >> v2:172.21.15.81:3300/0 conn(0x7f22281551d0 0x7f22280af650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.457+0000 7f222f3ff700 1 --2- 172.21.15.81:0/3108507208 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f222806b830 0x7f22280ad0c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.457+0000 7fb87279d700 1 -- 172.21.15.81:0/1488865464 shutdown_connections 2023-10-06T03:24:02.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.457+0000 7fb87279d700 1 --2- 172.21.15.81:0/1488865464 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8640e20d0 0x7fb864006080 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.457+0000 7f222f3ff700 1 -- 172.21.15.81:0/3108507208 >> 172.21.15.81:0/3108507208 conn(0x7f22280cc9c0 msgr2=0x7f22280a5430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:02.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.457+0000 7fb87279d700 1 --2- 172.21.15.81:0/1488865464 >> v2:172.21.15.83:3300/0 conn(0x7fb8640e24a0 0x7fb8640065c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.457+0000 7fb87279d700 1 -- 172.21.15.81:0/1488865464 >> 172.21.15.81:0/1488865464 conn(0x7fb86400efe0 msgr2=0x7fb864059000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:02.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.457+0000 7f037579d700 1 -- 172.21.15.81:0/372212985 wait complete. 2023-10-06T03:24:02.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.457+0000 7fb87279d700 1 -- 172.21.15.81:0/1488865464 shutdown_connections 2023-10-06T03:24:02.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.457+0000 7f42d0d9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f42cc15ac70 0x7f42cc150ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.457+0000 7f42d0d9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42cc15ca90 0x7f42cc150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.457+0000 7f42cb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42cc15a4b0 0x7f42cc0cc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:02.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.457+0000 7f42cb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42cc15a4b0 0x7f42cc0cc5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56362/0 (socket says 172.21.15.81:56362) 2023-10-06T03:24:02.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.457+0000 7f42d0d9d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42cc16aeb0 con 0x7f42cc15a4b0 2023-10-06T03:24:02.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.457+0000 7fb87279d700 1 -- 172.21.15.81:0/1488865464 wait complete. 2023-10-06T03:24:02.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.458+0000 7f42d0d9d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42cc16a220 con 0x7f42cc15ac70 2023-10-06T03:24:02.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.458+0000 7f42d0d9d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42cc16b020 con 0x7f42cc15ca90 2023-10-06T03:24:02.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.458+0000 7f42cbfff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42cc15ca90 0x7f42cc150ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:02.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.458+0000 7f42cb7fe700 1 -- 172.21.15.81:0/3484806055 learned_addr learned my addr 172.21.15.81:0/3484806055 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:02.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.456+0000 7f0ffeb9d700 1 -- start start 2023-10-06T03:24:02.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.458+0000 7f0ffeb9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ff806f2e0 0x7f0ff8141130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.458+0000 7f0ffeb9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ff80ac6d0 0x7f0ff8143780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.458+0000 7f0ffeb9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ff8140960 0x7f0ff80a5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.458+0000 7f0ffeb9d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff80afb90 con 0x7f0ff80ac6d0 2023-10-06T03:24:02.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.458+0000 7f0ffeb9d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff8142320 con 0x7f0ff8140960 2023-10-06T03:24:02.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.458+0000 7f0ffeb9d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff8141710 con 0x7f0ff806f2e0 2023-10-06T03:24:02.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.458+0000 7f0ffe39c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ff8140960 0x7f0ff80a5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:02.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.459+0000 7f0ffe39c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ff8140960 0x7f0ff80a5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:51036/0 (socket says 172.21.15.81:51036) 2023-10-06T03:24:02.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.459+0000 7f0ffe39c700 1 -- 172.21.15.81:0/3765746119 learned_addr learned my addr 172.21.15.81:0/3765746119 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:02.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.459+0000 7f42c2ffd700 1 --2- 172.21.15.81:0/3484806055 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f42cc15ac70 0x7f42cc150ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:02.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.459+0000 7f037579d700 1 Processor -- start 2023-10-06T03:24:02.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.459+0000 7f42cbfff700 1 -- 172.21.15.81:0/3484806055 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f42cc15ac70 msgr2=0x7f42cc150ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.459+0000 7f42cbfff700 1 --2- 172.21.15.81:0/3484806055 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f42cc15ac70 0x7f42cc150ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.459+0000 7f42cbfff700 1 -- 172.21.15.81:0/3484806055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42cc15a4b0 msgr2=0x7f42cc0cc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.459+0000 7f42cbfff700 1 --2- 172.21.15.81:0/3484806055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42cc15a4b0 0x7f42cc0cc5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.459+0000 7f0ffd39a700 1 --2- 172.21.15.81:0/3765746119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ff80ac6d0 0x7f0ff8143780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:02.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.459+0000 7f42cbfff700 1 -- 172.21.15.81:0/3484806055 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b4009420 con 0x7f42cc15ca90 2023-10-06T03:24:02.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.459+0000 7f42cb7fe700 1 --2- 172.21.15.81:0/3484806055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42cc15a4b0 0x7f42cc0cc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:24:02.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.460+0000 7f42cbfff700 1 --2- 172.21.15.81:0/3484806055 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42cc15ca90 0x7f42cc150ff0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f42c400c4b0 tx=0x7f42c4007c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:02.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.460+0000 7fb87279d700 1 Processor -- start 2023-10-06T03:24:02.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.460+0000 7f0ffe39c700 1 -- 172.21.15.81:0/3765746119 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ff806f2e0 msgr2=0x7f0ff8141130 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T03:24:02.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.459+0000 7f783db9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78381537f0 0x7f78380ac170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.460+0000 7f0ffe39c700 1 --2- 172.21.15.81:0/3765746119 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ff806f2e0 0x7f0ff8141130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.460+0000 7f0ffe39c700 1 -- 172.21.15.81:0/3765746119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ff80ac6d0 msgr2=0x7f0ff8143780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.460+0000 7f42c3fff700 1 -- 172.21.15.81:0/3484806055 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c4005b30 con 0x7f42cc15ca90 2023-10-06T03:24:02.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.460+0000 7f783db9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f78380ad1e0 0x7f783806d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.460+0000 7f783db9d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f783815a9c0 con 0x7f7838153bc0 2023-10-06T03:24:02.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.460+0000 7f42d0d9d700 1 -- 172.21.15.81:0/3484806055 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42cc1538a0 con 0x7f42cc15ca90 2023-10-06T03:24:02.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.460+0000 7f0ffe39c700 1 --2- 172.21.15.81:0/3765746119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ff80ac6d0 0x7f0ff8143780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.460+0000 7f783db9d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78380ac6b0 con 0x7f78380ad1e0 2023-10-06T03:24:02.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.460+0000 7f0ffe39c700 1 -- 172.21.15.81:0/3765746119 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe8009420 con 0x7f0ff8140960 2023-10-06T03:24:02.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.460+0000 7fb87279d700 1 -- start start 2023-10-06T03:24:02.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.460+0000 7f0ffd39a700 1 --2- 172.21.15.81:0/3765746119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ff80ac6d0 0x7f0ff8143780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:24:02.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.461+0000 7f42d0d9d700 1 -- 172.21.15.81:0/3484806055 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42cc0b01d0 con 0x7f42cc15ca90 2023-10-06T03:24:02.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.461+0000 7f42c3fff700 1 -- 172.21.15.81:0/3484806055 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c4005c90 con 0x7f42cc15ca90 2023-10-06T03:24:02.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.461+0000 7f42c3fff700 1 -- 172.21.15.81:0/3484806055 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c40072e0 con 0x7f42cc15ca90 2023-10-06T03:24:02.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.459+0000 7f037579d700 1 -- start start 2023-10-06T03:24:02.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.461+0000 7f037579d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0370171980 0x7f0370171d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.460+0000 7f783db9d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7838159db0 con 0x7f78381537f0 2023-10-06T03:24:02.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.461+0000 7f037579d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03700a90d0 0x7f03700a9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.460+0000 7f783cb9b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78381537f0 0x7f78380ac170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:02.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.461+0000 7f7837fff700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f7838153bc0 0x7f78380acad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:40134/0 (socket says 172.21.15.81:40134) 2023-10-06T03:24:02.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.461+0000 7f0ffe39c700 1 --2- 172.21.15.81:0/3765746119 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ff8140960 0x7f0ff80a5430 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0ff400c560 tx=0x7f0ff4007eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:02.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.461+0000 7f7837fff700 1 -- 172.21.15.81:0/1072976268 learned_addr learned my addr 172.21.15.81:0/1072976268 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:24:02.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.461+0000 7f036ffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0370171980 0x7f0370171d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:02.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.461+0000 7f036ffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0370171980 0x7f0370171d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:51050/0 (socket says 172.21.15.81:51050) 2023-10-06T03:24:02.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.461+0000 7f036ffff700 1 -- 172.21.15.81:0/3507336612 learned_addr learned my addr 172.21.15.81:0/3507336612 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:02.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.461+0000 7f036f7fe700 1 --2- 172.21.15.81:0/3507336612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03700a90d0 0x7f03700a9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:02.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.461+0000 7f037579d700 1 --2- 172.21.15.81:0/3507336612 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f037015b000 0x7f037015b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.461+0000 7f783d39c700 1 --2- 172.21.15.81:0/1072976268 >> v2:172.21.15.81:3300/0 conn(0x7f78380ad1e0 0x7f783806d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:02.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.462+0000 7fb87279d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb864038be0 0x7fb864050c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.462+0000 7fb87279d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8640e24a0 0x7fb86403cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.462+0000 7fb87279d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8640d9510 0x7fb8640d99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.462+0000 7f037579d700 1 -- 172.21.15.81:0/3507336612 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03700aa8c0 con 0x7f03700a90d0 2023-10-06T03:24:02.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.462+0000 7f037579d700 1 -- 172.21.15.81:0/3507336612 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03700a8030 con 0x7f0370171980 2023-10-06T03:24:02.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.462+0000 7f0374f9c700 1 --2- 172.21.15.81:0/3507336612 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f037015b000 0x7f037015b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:02.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.462+0000 7f037579d700 1 -- 172.21.15.81:0/3507336612 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03700a7ba0 con 0x7f037015b000 2023-10-06T03:24:02.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.462+0000 7fb87279d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8640d9ef0 con 0x7fb864038be0 2023-10-06T03:24:02.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.462+0000 7fb87279d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb864050790 con 0x7fb8640d9510 2023-10-06T03:24:02.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.462+0000 7fb87279d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb864051160 con 0x7fb8640e24a0 2023-10-06T03:24:02.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.462+0000 7f783d39c700 1 -- 172.21.15.81:0/1072976268 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78381537f0 msgr2=0x7f78380ac170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:02.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.462+0000 7f783d39c700 1 --2- 172.21.15.81:0/1072976268 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78381537f0 0x7f78380ac170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.462+0000 7f783d39c700 1 -- 172.21.15.81:0/1072976268 >> v1:172.21.15.83:6789/0 conn(0x7f7838153bc0 legacy=0x7f78380acad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.462+0000 7f783d39c700 1 -- 172.21.15.81:0/1072976268 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f783815a090 con 0x7f78380ad1e0 2023-10-06T03:24:02.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.462+0000 7fb870f9a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8640e24a0 0x7fb86403cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:02.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.462+0000 7fb870f9a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8640e24a0 0x7fb86403cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:51614/0 (socket says 172.21.15.81:51614) 2023-10-06T03:24:02.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.462+0000 7fb870f9a700 1 -- 172.21.15.81:0/1482318166 learned_addr learned my addr 172.21.15.81:0/1482318166 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:02.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.462+0000 7fb871f9c700 1 --2- 172.21.15.81:0/1482318166 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8640d9510 0x7fb8640d99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:02.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.462+0000 7f0fedffb700 1 -- 172.21.15.81:0/3765746119 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff4011590 con 0x7f0ff8140960 2023-10-06T03:24:02.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.462+0000 7f783d39c700 1 --2- 172.21.15.81:0/1072976268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78380ad1e0 0x7f783806d5b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7830009e60 tx=0x7f7830009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbff315f8e0b85d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:02.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.463+0000 7f42c17fa700 1 -- 172.21.15.81:0/3484806055 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42cc15bcd0 con 0x7f42cc15ca90 2023-10-06T03:24:02.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.463+0000 7f0ffeb9d700 1 -- 172.21.15.81:0/3765746119 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ff81419f0 con 0x7f0ff8140960 2023-10-06T03:24:02.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.463+0000 7f0ffeb9d700 1 -- 172.21.15.81:0/3765746119 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff8141fb0 con 0x7f0ff8140960 2023-10-06T03:24:02.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.463+0000 7f0fedffb700 1 -- 172.21.15.81:0/3765746119 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff40116f0 con 0x7f0ff8140960 2023-10-06T03:24:02.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.463+0000 7f222f3ff700 1 -- 172.21.15.81:0/3108507208 shutdown_connections 2023-10-06T03:24:02.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.463+0000 7fb870f9a700 1 -- 172.21.15.81:0/1482318166 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8640d9510 msgr2=0x7fb8640d99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.463+0000 7fb870f9a700 1 --2- 172.21.15.81:0/1482318166 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8640d9510 0x7fb8640d99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.463+0000 7fb870f9a700 1 -- 172.21.15.81:0/1482318166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb864038be0 msgr2=0x7fb864050c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.463+0000 7fb870f9a700 1 --2- 172.21.15.81:0/1482318166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb864038be0 0x7fb864050c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.463+0000 7fb870f9a700 1 -- 172.21.15.81:0/1482318166 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb85c009420 con 0x7fb8640e24a0 2023-10-06T03:24:02.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.463+0000 7fb871f9c700 1 --2- 172.21.15.81:0/1482318166 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8640d9510 0x7fb8640d99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:24:02.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.463+0000 7f0fedffb700 1 -- 172.21.15.81:0/3765746119 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff4011590 con 0x7f0ff8140960 2023-10-06T03:24:02.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.463+0000 7f222f3ff700 1 -- 172.21.15.81:0/3108507208 wait complete. 2023-10-06T03:24:02.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.463+0000 7f036ffff700 1 -- 172.21.15.81:0/3507336612 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f037015b000 msgr2=0x7f037015b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.463+0000 7f036ffff700 1 --2- 172.21.15.81:0/3507336612 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f037015b000 0x7f037015b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.463+0000 7f036ffff700 1 -- 172.21.15.81:0/3507336612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03700a90d0 msgr2=0x7f03700a9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.463+0000 7f036ffff700 1 --2- 172.21.15.81:0/3507336612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03700a90d0 0x7f03700a9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.463+0000 7f036ffff700 1 -- 172.21.15.81:0/3507336612 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03700ae750 con 0x7f0370171980 2023-10-06T03:24:02.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.463+0000 7f78377fe700 1 -- 172.21.15.81:0/1072976268 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783000e070 con 0x7f78380ad1e0 2023-10-06T03:24:02.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.463+0000 7f78377fe700 1 -- 172.21.15.81:0/1072976268 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f783000bb60 con 0x7f78380ad1e0 2023-10-06T03:24:02.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.463+0000 7f78377fe700 1 -- 172.21.15.81:0/1072976268 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7830012430 con 0x7f78380ad1e0 2023-10-06T03:24:02.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.464+0000 7f036ffff700 1 --2- 172.21.15.81:0/3507336612 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0370171980 0x7f0370171d50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f035c00c3a0 tx=0x7f0368017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:02.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.464+0000 7fb870f9a700 1 --2- 172.21.15.81:0/1482318166 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8640e24a0 0x7fb86403cfd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb86800d8c0 tx=0x7fb868008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:02.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.464+0000 7f0367fff700 1 -- 172.21.15.81:0/3507336612 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0368012950 con 0x7f0370171980 2023-10-06T03:24:02.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.464+0000 7f037579d700 1 -- 172.21.15.81:0/3507336612 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0370172290 con 0x7f0370171980 2023-10-06T03:24:02.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.464+0000 7f783db9d700 1 -- 172.21.15.81:0/1072976268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78380ad1e0 msgr2=0x7f783806d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.464+0000 7f783db9d700 1 --2- 172.21.15.81:0/1072976268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78380ad1e0 0x7f783806d5b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7830009e60 tx=0x7f7830009780 comp rx=0 tx=0).stop 2023-10-06T03:24:02.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.465+0000 7f783db9d700 1 -- 172.21.15.81:0/1072976268 shutdown_connections 2023-10-06T03:24:02.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.465+0000 7f783db9d700 1 --2- 172.21.15.81:0/1072976268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78380ad1e0 0x7f783806d5b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.465+0000 7f783db9d700 1 --2- 172.21.15.81:0/1072976268 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78381537f0 0x7f78380ac170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.465+0000 7f783db9d700 1 -- 172.21.15.81:0/1072976268 >> 172.21.15.81:0/1072976268 conn(0x7f78380cbef0 msgr2=0x7f78380cc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:02.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.465+0000 7fb8617fa700 1 -- 172.21.15.81:0/1482318166 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86800de60 con 0x7fb8640e24a0 2023-10-06T03:24:02.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.465+0000 7fb87279d700 1 -- 172.21.15.81:0/1482318166 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8640db720 con 0x7fb8640e24a0 2023-10-06T03:24:02.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.465+0000 7fb87279d700 1 -- 172.21.15.81:0/1482318166 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb864050420 con 0x7fb8640e24a0 2023-10-06T03:24:02.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.465+0000 7f0367fff700 1 -- 172.21.15.81:0/3507336612 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0368021070 con 0x7f0370171980 2023-10-06T03:24:02.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.465+0000 7f0367fff700 1 -- 172.21.15.81:0/3507336612 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0368012d60 con 0x7f0370171980 2023-10-06T03:24:02.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.465+0000 7f0ffeb9d700 1 -- 172.21.15.81:0/3765746119 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fd80052b0 con 0x7f0ff8140960 2023-10-06T03:24:02.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.466+0000 7f037579d700 1 -- 172.21.15.81:0/3507336612 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03700a7270 con 0x7f0370171980 2023-10-06T03:24:02.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.466+0000 7fb8617fa700 1 -- 172.21.15.81:0/1482318166 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb86800b780 con 0x7fb8640e24a0 2023-10-06T03:24:02.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.467+0000 7f42c3fff700 1 -- 172.21.15.81:0/3484806055 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f42c401b3b0 con 0x7f42cc15ca90 2023-10-06T03:24:02.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.466+0000 7f222f3ff700 1 Processor -- start 2023-10-06T03:24:02.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.466+0000 7f222f3ff700 1 -- start start 2023-10-06T03:24:02.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.466+0000 7f0fedffb700 1 -- 172.21.15.81:0/3765746119 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0ff4011860 con 0x7f0ff8140960 2023-10-06T03:24:02.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.467+0000 7f0fedffb700 1 --2- 172.21.15.81:0/3765746119 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0fdc066ff0 0x7f0fdc0694a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.467+0000 7fb8617fa700 1 -- 172.21.15.81:0/1482318166 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86800bb00 con 0x7fb8640e24a0 2023-10-06T03:24:02.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.467+0000 7f0fedffb700 1 -- 172.21.15.81:0/3765746119 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f0ff4054190 con 0x7f0ff8140960 2023-10-06T03:24:02.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.467+0000 7f783db9d700 1 -- 172.21.15.81:0/1072976268 shutdown_connections 2023-10-06T03:24:02.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.468+0000 7f0367fff700 1 -- 172.21.15.81:0/3507336612 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0368023030 con 0x7f0370171980 2023-10-06T03:24:02.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.468+0000 7f783db9d700 1 -- 172.21.15.81:0/1072976268 wait complete. 2023-10-06T03:24:02.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.468+0000 7f42c3fff700 1 --2- 172.21.15.81:0/3484806055 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f42ac067000 0x7f42ac0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.468+0000 7f42c3fff700 1 -- 172.21.15.81:0/3484806055 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f42c4083d30 con 0x7f42cc15ca90 2023-10-06T03:24:02.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.468+0000 7f222f3ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f222806b830 0x7f222814a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.468+0000 7f222f3ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f222806f2e0 0x7f2228145800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.469+0000 7f222d19b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f222806b830 0x7f222814a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:02.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.469+0000 7f222d19b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f222806b830 0x7f222814a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:51066/0 (socket says 172.21.15.81:51066) 2023-10-06T03:24:02.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.469+0000 7f222d19b700 1 -- 172.21.15.81:0/241255486 learned_addr learned my addr 172.21.15.81:0/241255486 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:02.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.469+0000 7f42cb7fe700 1 --2- 172.21.15.81:0/3484806055 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f42ac067000 0x7f42ac0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:02.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.469+0000 7f222c99a700 1 --2- 172.21.15.81:0/241255486 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f222806f2e0 0x7f2228145800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:02.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.469+0000 7f0ffdb9b700 1 --2- 172.21.15.81:0/3765746119 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0fdc066ff0 0x7f0fdc0694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:02.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.469+0000 7f222f3ff700 1 --2- 172.21.15.81:0/241255486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22281551d0 0x7f222806e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.469+0000 7fb87279d700 1 -- 172.21.15.81:0/1482318166 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb84c0052b0 con 0x7fb8640e24a0 2023-10-06T03:24:02.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.470+0000 7f222f3ff700 1 -- 172.21.15.81:0/241255486 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22281658d0 con 0x7f22281551d0 2023-10-06T03:24:02.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.470+0000 7f222d99c700 1 --2- 172.21.15.81:0/241255486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22281551d0 0x7f222806e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:02.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.470+0000 7f222f3ff700 1 -- 172.21.15.81:0/241255486 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2228165bb0 con 0x7f222806b830 2023-10-06T03:24:02.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.470+0000 7f0ffdb9b700 1 --2- 172.21.15.81:0/3765746119 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0fdc066ff0 0x7f0fdc0694a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0005c50 tx=0x7f0ff0001620 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:02.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.470+0000 7f42cb7fe700 1 --2- 172.21.15.81:0/3484806055 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f42ac067000 0x7f42ac0694b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f42bc007af0 tx=0x7f42bc009920 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:02.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.469+0000 7f037579d700 1 -- 172.21.15.81:0/3507336612 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03700cdc00 con 0x7f0370171980 2023-10-06T03:24:02.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.470+0000 7fb8617fa700 1 -- 172.21.15.81:0/1482318166 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb86801e460 con 0x7fb8640e24a0 2023-10-06T03:24:02.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.470+0000 7f222f3ff700 1 -- 172.21.15.81:0/241255486 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2228165e90 con 0x7f222806f2e0 2023-10-06T03:24:02.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.470+0000 7f0367fff700 1 --2- 172.21.15.81:0/3507336612 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0350067000 0x7f03500694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.470+0000 7f783db9d700 1 Processor -- start 2023-10-06T03:24:02.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.471+0000 7f036f7fe700 1 --2- 172.21.15.81:0/3507336612 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0350067000 0x7f03500694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:02.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.471+0000 7f783db9d700 1 -- start start 2023-10-06T03:24:02.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.471+0000 7f222d19b700 1 -- 172.21.15.81:0/241255486 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f222806f2e0 msgr2=0x7f2228145800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.471+0000 7fb8617fa700 1 --2- 172.21.15.81:0/1482318166 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb850066f30 0x7fb8500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.471+0000 7f036f7fe700 1 --2- 172.21.15.81:0/3507336612 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0350067000 0x7f03500694b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f03700aeaf0 tx=0x7f036000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:02.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.471+0000 7f222d19b700 1 --2- 172.21.15.81:0/241255486 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f222806f2e0 0x7f2228145800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.471+0000 7f222d19b700 1 -- 172.21.15.81:0/241255486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22281551d0 msgr2=0x7f222806e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.471+0000 7f222d19b700 1 --2- 172.21.15.81:0/241255486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22281551d0 0x7f222806e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.471+0000 7f222d19b700 1 -- 172.21.15.81:0/241255486 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22180094f0 con 0x7f222806b830 2023-10-06T03:24:02.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.471+0000 7f222d99c700 1 --2- 172.21.15.81:0/241255486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22281551d0 0x7f222806e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:24:02.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.471+0000 7f222c99a700 1 --2- 172.21.15.81:0/241255486 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f222806f2e0 0x7f2228145800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:02.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.472+0000 7f222d19b700 1 --2- 172.21.15.81:0/241255486 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f222806b830 0x7f222814a740 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f221800ec50 tx=0x7f2218009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:02.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.472+0000 7fb87179b700 1 --2- 172.21.15.81:0/1482318166 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb850066f30 0x7fb8500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:02.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.472+0000 7fb87179b700 1 --2- 172.21.15.81:0/1482318166 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb850066f30 0x7fb8500693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb8640119e0 tx=0x7fb85c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:02.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.473+0000 7fb8617fa700 1 -- 172.21.15.81:0/1482318166 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fb868084f40 con 0x7fb8640e24a0 2023-10-06T03:24:02.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.473+0000 7f783db9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78380ad1e0 0x7f783815bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.473+0000 7f42c3fff700 1 -- 172.21.15.81:0/3484806055 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f42c404b5a0 con 0x7f42cc15ca90 2023-10-06T03:24:02.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.473+0000 7f783db9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78381537f0 0x7f783815c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.473+0000 7f0367fff700 1 -- 172.21.15.81:0/3507336612 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f0368056bd0 con 0x7f0370171980 2023-10-06T03:24:02.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.473+0000 7f221d7fa700 1 -- 172.21.15.81:0/241255486 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221800c920 con 0x7f222806b830 2023-10-06T03:24:02.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.473+0000 7f783cb9b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78380ad1e0 0x7f783815bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:02.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.473+0000 7f783cb9b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78380ad1e0 0x7f783815bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:51636/0 (socket says 172.21.15.81:51636) 2023-10-06T03:24:02.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.473+0000 7f7837fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78381537f0 0x7f783815c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:02.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.473+0000 7f7837fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78381537f0 0x7f783815c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56424/0 (socket says 172.21.15.81:56424) 2023-10-06T03:24:02.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.473+0000 7f783db9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7838153bc0 0x7f7838169440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.473+0000 7f783cb9b700 1 -- 172.21.15.81:0/960662052 learned_addr learned my addr 172.21.15.81:0/960662052 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:02.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.473+0000 7f783db9d700 1 -- 172.21.15.81:0/960662052 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7838069310 con 0x7f78381537f0 2023-10-06T03:24:02.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.473+0000 7f222f3ff700 1 -- 172.21.15.81:0/241255486 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2220009a20 con 0x7f222806b830 2023-10-06T03:24:02.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.474+0000 7f783db9d700 1 -- 172.21.15.81:0/960662052 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f783806a170 con 0x7f7838153bc0 2023-10-06T03:24:02.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.474+0000 7f783db9d700 1 -- 172.21.15.81:0/960662052 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7838069560 con 0x7f78380ad1e0 2023-10-06T03:24:02.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.474+0000 7f222f3ff700 1 -- 172.21.15.81:0/241255486 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2228166450 con 0x7f222806b830 2023-10-06T03:24:02.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.474+0000 7f783d39c700 1 --2- 172.21.15.81:0/960662052 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7838153bc0 0x7f7838169440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:02.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.474+0000 7f783d39c700 1 -- 172.21.15.81:0/960662052 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78380ad1e0 msgr2=0x7f783815bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.474+0000 7f783d39c700 1 --2- 172.21.15.81:0/960662052 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78380ad1e0 0x7f783815bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.474+0000 7f783d39c700 1 -- 172.21.15.81:0/960662052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78381537f0 msgr2=0x7f783815c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.474+0000 7f783d39c700 1 --2- 172.21.15.81:0/960662052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78381537f0 0x7f783815c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.474+0000 7f783d39c700 1 -- 172.21.15.81:0/960662052 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7830009a20 con 0x7f7838153bc0 2023-10-06T03:24:02.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.475+0000 7f7837fff700 1 --2- 172.21.15.81:0/960662052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78381537f0 0x7f783815c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:24:02.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.475+0000 7f783d39c700 1 --2- 172.21.15.81:0/960662052 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7838153bc0 0x7f7838169440 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7830016000 tx=0x7f7830019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:02.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.475+0000 7f222f3ff700 1 -- 172.21.15.81:0/241255486 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22280ab580 con 0x7f222806b830 2023-10-06T03:24:02.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.476+0000 7f0fedffb700 1 -- 172.21.15.81:0/3765746119 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0ff4050c60 con 0x7f0ff8140960 2023-10-06T03:24:02.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.477+0000 7fb8617fa700 1 -- 172.21.15.81:0/1482318166 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb868051d80 con 0x7fb8640e24a0 2023-10-06T03:24:02.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.478+0000 7f0367fff700 1 -- 172.21.15.81:0/3507336612 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0368052810 con 0x7f0370171980 2023-10-06T03:24:02.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.479+0000 7f7834ff9700 1 -- 172.21.15.81:0/960662052 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7830027470 con 0x7f7838153bc0 2023-10-06T03:24:02.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.479+0000 7f7834ff9700 1 -- 172.21.15.81:0/960662052 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7830027610 con 0x7f7838153bc0 2023-10-06T03:24:02.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.479+0000 7f7834ff9700 1 -- 172.21.15.81:0/960662052 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78300279d0 con 0x7f7838153bc0 2023-10-06T03:24:02.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.479+0000 7f783db9d700 1 -- 172.21.15.81:0/960662052 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7838069840 con 0x7f7838153bc0 2023-10-06T03:24:02.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.479+0000 7f783db9d700 1 -- 172.21.15.81:0/960662052 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7838069e00 con 0x7f7838153bc0 2023-10-06T03:24:02.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.481+0000 7f221d7fa700 1 -- 172.21.15.81:0/241255486 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f221800cc90 con 0x7f222806b830 2023-10-06T03:24:02.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.481+0000 7f221d7fa700 1 -- 172.21.15.81:0/241255486 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221800ce20 con 0x7f222806b830 2023-10-06T03:24:02.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.481+0000 7f221d7fa700 1 -- 172.21.15.81:0/241255486 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2218013470 con 0x7f222806b830 2023-10-06T03:24:02.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.483+0000 7f221d7fa700 1 --2- 172.21.15.81:0/241255486 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f220c067030 0x7f220c0694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.483+0000 7f222c99a700 1 --2- 172.21.15.81:0/241255486 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f220c067030 0x7f220c0694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:02.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.483+0000 7f781e7fc700 1 -- 172.21.15.81:0/960662052 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78180052b0 con 0x7f7838153bc0 2023-10-06T03:24:02.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.484+0000 7f222c99a700 1 --2- 172.21.15.81:0/241255486 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f220c067030 0x7f220c0694e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2220000f80 tx=0x7f2220018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:02.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.484+0000 7f221d7fa700 1 -- 172.21.15.81:0/241255486 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f2218085050 con 0x7f222806b830 2023-10-06T03:24:02.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.486+0000 7f221d7fa700 1 -- 172.21.15.81:0/241255486 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2218055940 con 0x7f222806b830 2023-10-06T03:24:02.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.486+0000 7f7834ff9700 1 -- 172.21.15.81:0/960662052 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7830024070 con 0x7f7838153bc0 2023-10-06T03:24:02.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.487+0000 7f7834ff9700 1 --2- 172.21.15.81:0/960662052 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7824067080 0x7f7824069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:02.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.487+0000 7f7834ff9700 1 -- 172.21.15.81:0/960662052 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f78300873d0 con 0x7f7838153bc0 2023-10-06T03:24:02.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.489+0000 7f7834ff9700 1 -- 172.21.15.81:0/960662052 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7830054250 con 0x7f7838153bc0 2023-10-06T03:24:02.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.489+0000 7f783cb9b700 1 --2- 172.21.15.81:0/960662052 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7824067080 0x7f7824069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:02.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.494+0000 7f783cb9b700 1 --2- 172.21.15.81:0/960662052 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7824067080 0x7f7824069530 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7838158e00 tx=0x7f782c0091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:02.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.824+0000 7fe52d59d700 1 -- 172.21.15.81:0/4168927781 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe508005830 con 0x7fe5280879a0 2023-10-06T03:24:02.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.826+0000 7fe50ffff700 1 -- 172.21.15.81:0/4168927781 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe5180561f0 con 0x7fe5280879a0 2023-10-06T03:24:02.828 INFO:teuthology.orchestra.run.smithi081.stdout:55834574857 2023-10-06T03:24:02.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.828+0000 7f2a08d9d700 1 -- 172.21.15.81:0/1040975569 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f29e4005830 con 0x7f2a040acad0 2023-10-06T03:24:02.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.829+0000 7f29eb7fe700 1 -- 172.21.15.81:0/1040975569 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f29f8015020 con 0x7f2a040acad0 2023-10-06T03:24:02.832 INFO:teuthology.orchestra.run.smithi081.stdout:55834574856 2023-10-06T03:24:02.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.831+0000 7fe50dffb700 1 -- 172.21.15.81:0/4168927781 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fe514067080 msgr2=0x7fe514069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.831+0000 7fe50dffb700 1 --2- 172.21.15.81:0/4168927781 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fe514067080 0x7fe514069530 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe51c009990 tx=0x7fe51c008040 comp rx=0 tx=0).stop 2023-10-06T03:24:02.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.831+0000 7fe50dffb700 1 -- 172.21.15.81:0/4168927781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5280879a0 msgr2=0x7fe52817c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.831+0000 7fe50dffb700 1 --2- 172.21.15.81:0/4168927781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5280879a0 0x7fe52817c0e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe51800d010 tx=0x7fe51801f000 comp rx=0 tx=0).stop 2023-10-06T03:24:02.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.831+0000 7fe50dffb700 1 -- 172.21.15.81:0/4168927781 shutdown_connections 2023-10-06T03:24:02.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.831+0000 7fe50dffb700 1 --2- 172.21.15.81:0/4168927781 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fe514067080 0x7fe514069530 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.831+0000 7fe50dffb700 1 --2- 172.21.15.81:0/4168927781 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe528169c30 0x7fe52815ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.831+0000 7fe50dffb700 1 --2- 172.21.15.81:0/4168927781 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5280875d0 0x7fe5280b1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.832+0000 7fe50dffb700 1 --2- 172.21.15.81:0/4168927781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5280879a0 0x7fe52817c0e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.832+0000 7fe50dffb700 1 -- 172.21.15.81:0/4168927781 >> 172.21.15.81:0/4168927781 conn(0x7fe5280cc9c0 msgr2=0x7fe5280b0340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:02.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.832+0000 7fe50dffb700 1 -- 172.21.15.81:0/4168927781 shutdown_connections 2023-10-06T03:24:02.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.832+0000 7fe50dffb700 1 -- 172.21.15.81:0/4168927781 wait complete. 2023-10-06T03:24:02.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.834+0000 7f2a08d9d700 1 -- 172.21.15.81:0/1040975569 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f29f0067080 msgr2=0x7f29f0069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.834+0000 7f2a08d9d700 1 --2- 172.21.15.81:0/1040975569 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f29f0067080 0x7f29f0069530 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2a0415c7b0 tx=0x7f29f4009040 comp rx=0 tx=0).stop 2023-10-06T03:24:02.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.835+0000 7f2a08d9d700 1 -- 172.21.15.81:0/1040975569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a040acad0 msgr2=0x7f2a0415acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.835+0000 7f2a08d9d700 1 --2- 172.21.15.81:0/1040975569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a040acad0 0x7f2a0415acb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2a040ad570 tx=0x7f29f8017000 comp rx=0 tx=0).stop 2023-10-06T03:24:02.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.836+0000 7f2a08d9d700 1 -- 172.21.15.81:0/1040975569 shutdown_connections 2023-10-06T03:24:02.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.836+0000 7f2a08d9d700 1 --2- 172.21.15.81:0/1040975569 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2a041592e0 0x7f2a0415b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.836+0000 7f2a08d9d700 1 --2- 172.21.15.81:0/1040975569 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f29f0067080 0x7f29f0069530 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.836+0000 7f2a08d9d700 1 --2- 172.21.15.81:0/1040975569 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2a040ab7b0 0x7f2a0406e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.836+0000 7f2a08d9d700 1 --2- 172.21.15.81:0/1040975569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a040acad0 0x7f2a0415acb0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.836+0000 7f2a08d9d700 1 -- 172.21.15.81:0/1040975569 >> 172.21.15.81:0/1040975569 conn(0x7f2a040cc9c0 msgr2=0x7f2a041537a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:02.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.837+0000 7f2a08d9d700 1 -- 172.21.15.81:0/1040975569 shutdown_connections 2023-10-06T03:24:02.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.837+0000 7f2a08d9d700 1 -- 172.21.15.81:0/1040975569 wait complete. 2023-10-06T03:24:02.864 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.2 2023-10-06T03:24:02.865 DEBUG:teuthology.parallel:result is None 2023-10-06T03:24:02.870 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.0 2023-10-06T03:24:02.871 DEBUG:teuthology.parallel:result is None 2023-10-06T03:24:02.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.891+0000 7fb87279d700 1 -- 172.21.15.81:0/1482318166 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fb84c005560 con 0x7fb8640e24a0 2023-10-06T03:24:02.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.891+0000 7f781e7fc700 1 -- 172.21.15.81:0/960662052 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f7818005830 con 0x7f7838153bc0 2023-10-06T03:24:02.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.891+0000 7fb8617fa700 1 -- 172.21.15.81:0/1482318166 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb8680553a0 con 0x7fb8640e24a0 2023-10-06T03:24:02.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.891+0000 7f7834ff9700 1 -- 172.21.15.81:0/960662052 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7830057870 con 0x7f7838153bc0 2023-10-06T03:24:02.895 INFO:teuthology.orchestra.run.smithi081.stdout:55834574856 2023-10-06T03:24:02.896 INFO:teuthology.orchestra.run.smithi081.stdout:55834574856 2023-10-06T03:24:02.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.894+0000 7fb87279d700 1 -- 172.21.15.81:0/1482318166 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb850066f30 msgr2=0x7fb8500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.894+0000 7fb87279d700 1 --2- 172.21.15.81:0/1482318166 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb850066f30 0x7fb8500693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb8640119e0 tx=0x7fb85c017000 comp rx=0 tx=0).stop 2023-10-06T03:24:02.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.894+0000 7fb87279d700 1 -- 172.21.15.81:0/1482318166 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8640e24a0 msgr2=0x7fb86403cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.894+0000 7fb87279d700 1 --2- 172.21.15.81:0/1482318166 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8640e24a0 0x7fb86403cfd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb86800d8c0 tx=0x7fb868008040 comp rx=0 tx=0).stop 2023-10-06T03:24:02.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.894+0000 7f781e7fc700 1 -- 172.21.15.81:0/960662052 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7824067080 msgr2=0x7f7824069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.894+0000 7f781e7fc700 1 --2- 172.21.15.81:0/960662052 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7824067080 0x7f7824069530 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7838158e00 tx=0x7f782c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.894+0000 7f781e7fc700 1 -- 172.21.15.81:0/960662052 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7838153bc0 msgr2=0x7f7838169440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.894+0000 7f781e7fc700 1 --2- 172.21.15.81:0/960662052 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7838153bc0 0x7f7838169440 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7830016000 tx=0x7f7830019000 comp rx=0 tx=0).stop 2023-10-06T03:24:02.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.894+0000 7f781e7fc700 1 -- 172.21.15.81:0/960662052 shutdown_connections 2023-10-06T03:24:02.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.894+0000 7f781e7fc700 1 --2- 172.21.15.81:0/960662052 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7838153bc0 0x7f7838169440 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.894+0000 7f781e7fc700 1 --2- 172.21.15.81:0/960662052 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7824067080 0x7f7824069530 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.894+0000 7f781e7fc700 1 --2- 172.21.15.81:0/960662052 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78380ad1e0 0x7f783815bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.894+0000 7f781e7fc700 1 --2- 172.21.15.81:0/960662052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78381537f0 0x7f783815c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.894+0000 7f781e7fc700 1 -- 172.21.15.81:0/960662052 >> 172.21.15.81:0/960662052 conn(0x7f78380cbef0 msgr2=0x7f78380cc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:02.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.894+0000 7fb87279d700 1 -- 172.21.15.81:0/1482318166 shutdown_connections 2023-10-06T03:24:02.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.895+0000 7fb87279d700 1 --2- 172.21.15.81:0/1482318166 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8640d9510 0x7fb8640d99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.895+0000 7fb87279d700 1 --2- 172.21.15.81:0/1482318166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb864038be0 0x7fb864050c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.895+0000 7fb87279d700 1 --2- 172.21.15.81:0/1482318166 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb850066f30 0x7fb8500693e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.895+0000 7fb87279d700 1 --2- 172.21.15.81:0/1482318166 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8640e24a0 0x7fb86403cfd0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.895+0000 7fb87279d700 1 -- 172.21.15.81:0/1482318166 >> 172.21.15.81:0/1482318166 conn(0x7fb86400efe0 msgr2=0x7fb8640e0310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:02.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.895+0000 7fb87279d700 1 -- 172.21.15.81:0/1482318166 shutdown_connections 2023-10-06T03:24:02.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.895+0000 7fb87279d700 1 -- 172.21.15.81:0/1482318166 wait complete. 2023-10-06T03:24:02.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.895+0000 7f781e7fc700 1 -- 172.21.15.81:0/960662052 shutdown_connections 2023-10-06T03:24:02.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.895+0000 7f781e7fc700 1 -- 172.21.15.81:0/960662052 wait complete. 2023-10-06T03:24:02.917 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.5 2023-10-06T03:24:02.918 DEBUG:teuthology.parallel:result is None 2023-10-06T03:24:02.918 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.4 2023-10-06T03:24:02.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.916+0000 7f42c17fa700 1 -- 172.21.15.81:0/3484806055 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f42cc04bb80 con 0x7f42cc15ca90 2023-10-06T03:24:02.919 DEBUG:teuthology.parallel:result is None 2023-10-06T03:24:02.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.917+0000 7f42c3fff700 1 -- 172.21.15.81:0/3484806055 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f42c4017020 con 0x7f42cc15ca90 2023-10-06T03:24:02.920 INFO:teuthology.orchestra.run.smithi081.stdout:55834574856 2023-10-06T03:24:02.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.919+0000 7f222f3ff700 1 -- 172.21.15.81:0/241255486 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f222804bb80 con 0x7f222806b830 2023-10-06T03:24:02.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.919+0000 7f037579d700 1 -- 172.21.15.81:0/3507336612 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0370063500 con 0x7f0370171980 2023-10-06T03:24:02.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.919+0000 7f221d7fa700 1 -- 172.21.15.81:0/241255486 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2218017090 con 0x7f222806b830 2023-10-06T03:24:02.922 INFO:teuthology.orchestra.run.smithi081.stdout:55834574856 2023-10-06T03:24:02.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.920+0000 7f0367fff700 1 -- 172.21.15.81:0/3507336612 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0368055e30 con 0x7f0370171980 2023-10-06T03:24:02.922 INFO:teuthology.orchestra.run.smithi081.stdout:55834574857 2023-10-06T03:24:02.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.921+0000 7f42c17fa700 1 -- 172.21.15.81:0/3484806055 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f42ac067000 msgr2=0x7f42ac0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.921+0000 7f42c17fa700 1 --2- 172.21.15.81:0/3484806055 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f42ac067000 0x7f42ac0694b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f42bc007af0 tx=0x7f42bc009920 comp rx=0 tx=0).stop 2023-10-06T03:24:02.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.921+0000 7f42c17fa700 1 -- 172.21.15.81:0/3484806055 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42cc15ca90 msgr2=0x7f42cc150ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.921+0000 7f42c17fa700 1 --2- 172.21.15.81:0/3484806055 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42cc15ca90 0x7f42cc150ff0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f42c400c4b0 tx=0x7f42c4007c70 comp rx=0 tx=0).stop 2023-10-06T03:24:02.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.921+0000 7f0ffeb9d700 1 -- 172.21.15.81:0/3765746119 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f0fd8005830 con 0x7f0ff8140960 2023-10-06T03:24:02.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.921+0000 7f42c17fa700 1 -- 172.21.15.81:0/3484806055 shutdown_connections 2023-10-06T03:24:02.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.921+0000 7f42c17fa700 1 --2- 172.21.15.81:0/3484806055 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f42ac067000 0x7f42ac0694b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.921+0000 7f42c17fa700 1 --2- 172.21.15.81:0/3484806055 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42cc15ca90 0x7f42cc150ff0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.921+0000 7f42c17fa700 1 --2- 172.21.15.81:0/3484806055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42cc15a4b0 0x7f42cc0cc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.921+0000 7f42c17fa700 1 --2- 172.21.15.81:0/3484806055 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f42cc15ac70 0x7f42cc150ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.921+0000 7f42c17fa700 1 -- 172.21.15.81:0/3484806055 >> 172.21.15.81:0/3484806055 conn(0x7f42cc06ed10 msgr2=0x7f42cc06f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:02.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.921+0000 7f42c17fa700 1 -- 172.21.15.81:0/3484806055 shutdown_connections 2023-10-06T03:24:02.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.921+0000 7f42c17fa700 1 -- 172.21.15.81:0/3484806055 wait complete. 2023-10-06T03:24:02.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.922+0000 7f0fedffb700 1 -- 172.21.15.81:0/3765746119 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0ff4017020 con 0x7f0ff8140960 2023-10-06T03:24:02.925 INFO:teuthology.orchestra.run.smithi081.stdout:55834574857 2023-10-06T03:24:02.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.923+0000 7f222f3ff700 1 -- 172.21.15.81:0/241255486 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f220c067030 msgr2=0x7f220c0694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.923+0000 7f222f3ff700 1 --2- 172.21.15.81:0/241255486 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f220c067030 0x7f220c0694e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2220000f80 tx=0x7f2220018000 comp rx=0 tx=0).stop 2023-10-06T03:24:02.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.923+0000 7f222f3ff700 1 -- 172.21.15.81:0/241255486 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f222806b830 msgr2=0x7f222814a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.923+0000 7f222f3ff700 1 --2- 172.21.15.81:0/241255486 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f222806b830 0x7f222814a740 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f221800ec50 tx=0x7f2218009250 comp rx=0 tx=0).stop 2023-10-06T03:24:02.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.923+0000 7f037579d700 1 -- 172.21.15.81:0/3507336612 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0350067000 msgr2=0x7f03500694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.923+0000 7f037579d700 1 --2- 172.21.15.81:0/3507336612 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0350067000 0x7f03500694b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f03700aeaf0 tx=0x7f036000b040 comp rx=0 tx=0).stop 2023-10-06T03:24:02.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.923+0000 7f222f3ff700 1 -- 172.21.15.81:0/241255486 shutdown_connections 2023-10-06T03:24:02.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.923+0000 7f222f3ff700 1 --2- 172.21.15.81:0/241255486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22281551d0 0x7f222806e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.923+0000 7f222f3ff700 1 --2- 172.21.15.81:0/241255486 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f222806b830 0x7f222814a740 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.923+0000 7f222f3ff700 1 --2- 172.21.15.81:0/241255486 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f220c067030 0x7f220c0694e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.923+0000 7f222f3ff700 1 --2- 172.21.15.81:0/241255486 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f222806f2e0 0x7f2228145800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.923+0000 7f222f3ff700 1 -- 172.21.15.81:0/241255486 >> 172.21.15.81:0/241255486 conn(0x7f22280cc9c0 msgr2=0x7f222806db00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:02.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.923+0000 7f037579d700 1 -- 172.21.15.81:0/3507336612 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0370171980 msgr2=0x7f0370171d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.923+0000 7f037579d700 1 --2- 172.21.15.81:0/3507336612 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0370171980 0x7f0370171d50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f035c00c3a0 tx=0x7f0368017000 comp rx=0 tx=0).stop 2023-10-06T03:24:02.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.923+0000 7f222f3ff700 1 -- 172.21.15.81:0/241255486 shutdown_connections 2023-10-06T03:24:02.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.923+0000 7f037579d700 1 -- 172.21.15.81:0/3507336612 shutdown_connections 2023-10-06T03:24:02.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.923+0000 7f037579d700 1 --2- 172.21.15.81:0/3507336612 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0350067000 0x7f03500694b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.923+0000 7f037579d700 1 --2- 172.21.15.81:0/3507336612 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f037015b000 0x7f037015b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.923+0000 7f037579d700 1 --2- 172.21.15.81:0/3507336612 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0370171980 0x7f0370171d50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.923+0000 7f037579d700 1 --2- 172.21.15.81:0/3507336612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03700a90d0 0x7f03700a9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.923+0000 7f037579d700 1 -- 172.21.15.81:0/3507336612 >> 172.21.15.81:0/3507336612 conn(0x7f03700d0350 msgr2=0x7f03700b24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:02.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.923+0000 7f037579d700 1 -- 172.21.15.81:0/3507336612 shutdown_connections 2023-10-06T03:24:02.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.923+0000 7f037579d700 1 -- 172.21.15.81:0/3507336612 wait complete. 2023-10-06T03:24:02.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.924+0000 7f222f3ff700 1 -- 172.21.15.81:0/241255486 wait complete. 2023-10-06T03:24:02.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.925+0000 7f0ffeb9d700 1 -- 172.21.15.81:0/3765746119 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0fdc066ff0 msgr2=0x7f0fdc0694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.925+0000 7f0ffeb9d700 1 --2- 172.21.15.81:0/3765746119 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0fdc066ff0 0x7f0fdc0694a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0005c50 tx=0x7f0ff0001620 comp rx=0 tx=0).stop 2023-10-06T03:24:02.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.925+0000 7f0ffeb9d700 1 -- 172.21.15.81:0/3765746119 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ff8140960 msgr2=0x7f0ff80a5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:02.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.925+0000 7f0ffeb9d700 1 --2- 172.21.15.81:0/3765746119 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ff8140960 0x7f0ff80a5430 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0ff400c560 tx=0x7f0ff4007eb0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.925+0000 7f0ffeb9d700 1 -- 172.21.15.81:0/3765746119 shutdown_connections 2023-10-06T03:24:02.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.925+0000 7f0ffeb9d700 1 --2- 172.21.15.81:0/3765746119 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ff8140960 0x7f0ff80a5430 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.925+0000 7f0ffeb9d700 1 --2- 172.21.15.81:0/3765746119 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0fdc066ff0 0x7f0fdc0694a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.925+0000 7f0ffeb9d700 1 --2- 172.21.15.81:0/3765746119 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ff806f2e0 0x7f0ff8141130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.925+0000 7f0ffeb9d700 1 --2- 172.21.15.81:0/3765746119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ff80ac6d0 0x7f0ff8143780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:02.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.925+0000 7f0ffeb9d700 1 -- 172.21.15.81:0/3765746119 >> 172.21.15.81:0/3765746119 conn(0x7f0ff80cc9c0 msgr2=0x7f0ff814a720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:02.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.927+0000 7f0ffeb9d700 1 -- 172.21.15.81:0/3765746119 shutdown_connections 2023-10-06T03:24:02.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:02.927+0000 7f0ffeb9d700 1 -- 172.21.15.81:0/3765746119 wait complete. 2023-10-06T03:24:02.948 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.3 2023-10-06T03:24:02.948 DEBUG:teuthology.parallel:result is None 2023-10-06T03:24:02.949 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.6 2023-10-06T03:24:02.949 DEBUG:teuthology.parallel:result is None 2023-10-06T03:24:02.956 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.1 2023-10-06T03:24:02.956 DEBUG:teuthology.parallel:result is None 2023-10-06T03:24:02.958 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.7 2023-10-06T03:24:02.959 DEBUG:teuthology.parallel:result is None 2023-10-06T03:24:02.959 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-06T03:24:02.959 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:24:03.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.176+0000 7f099959d700 1 Processor -- start 2023-10-06T03:24:03.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.176+0000 7f099959d700 1 -- start start 2023-10-06T03:24:03.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.177+0000 7f099959d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f09940cc670 0x7f09940ccd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:03.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.177+0000 7f099959d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09940b4760 con 0x7f09940b2420 2023-10-06T03:24:03.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.177+0000 7f099959d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09940cd320 con 0x7f099415a450 2023-10-06T03:24:03.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.177+0000 7f099959d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09940b60f0 con 0x7f09940cc670 2023-10-06T03:24:03.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.178+0000 7f0998d9c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f09940b2420 0x7f09940b4bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39470/0 (socket says 172.21.15.81:39470) 2023-10-06T03:24:03.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.178+0000 7f0998d9c700 1 -- 172.21.15.81:0/1426818334 learned_addr learned my addr 172.21.15.81:0/1426818334 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:24:03.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.178+0000 7f0993fff700 1 --2- 172.21.15.81:0/1426818334 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f09940cc670 0x7f09940ccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:03.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.178+0000 7f0992ffd700 1 -- 172.21.15.81:0/1426818334 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4227520123 0 0) 0x7f09940b4760 con 0x7f09940b2420 2023-10-06T03:24:03.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.178+0000 7f0992ffd700 1 -- 172.21.15.81:0/1426818334 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f097c003570 con 0x7f09940b2420 2023-10-06T03:24:03.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.178+0000 7f0992ffd700 1 -- 172.21.15.81:0/1426818334 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 519193115 0 0) 0x7f09940cd320 con 0x7f099415a450 2023-10-06T03:24:03.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.178+0000 7f0992ffd700 1 -- 172.21.15.81:0/1426818334 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09940b4760 con 0x7f099415a450 2023-10-06T03:24:03.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.178+0000 7f0993fff700 1 -- 172.21.15.81:0/1426818334 >> v1:172.21.15.83:6789/0 conn(0x7f099415a450 legacy=0x7f09940b1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:03.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.178+0000 7f0993fff700 1 -- 172.21.15.81:0/1426818334 >> v1:172.21.15.81:6789/0 conn(0x7f09940b2420 legacy=0x7f09940b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:03.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.178+0000 7f0993fff700 1 -- 172.21.15.81:0/1426818334 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09940b3e30 con 0x7f09940cc670 2023-10-06T03:24:03.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.179+0000 7f0993fff700 1 --2- 172.21.15.81:0/1426818334 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f09940cc670 0x7f09940ccd40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0984009910 tx=0x7f09840091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa2ff4465be082a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:03.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.179+0000 7f0992ffd700 1 -- 172.21.15.81:0/1426818334 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0984011630 con 0x7f09940cc670 2023-10-06T03:24:03.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.179+0000 7f0992ffd700 1 -- 172.21.15.81:0/1426818334 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0984011790 con 0x7f09940cc670 2023-10-06T03:24:03.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.179+0000 7f0992ffd700 1 -- 172.21.15.81:0/1426818334 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0984011b30 con 0x7f09940cc670 2023-10-06T03:24:03.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.179+0000 7f099959d700 1 -- 172.21.15.81:0/1426818334 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f09940cc670 msgr2=0x7f09940ccd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:03.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.179+0000 7f099959d700 1 --2- 172.21.15.81:0/1426818334 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f09940cc670 0x7f09940ccd40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0984009910 tx=0x7f09840091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:03.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.179+0000 7f099959d700 1 -- 172.21.15.81:0/1426818334 shutdown_connections 2023-10-06T03:24:03.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.179+0000 7f099959d700 1 --2- 172.21.15.81:0/1426818334 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f09940cc670 0x7f09940ccd40 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:03.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.179+0000 7f099959d700 1 -- 172.21.15.81:0/1426818334 >> 172.21.15.81:0/1426818334 conn(0x7f099406ed10 msgr2=0x7f099406f110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:03.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.180+0000 7f099959d700 1 -- 172.21.15.81:0/1426818334 shutdown_connections 2023-10-06T03:24:03.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.180+0000 7f099959d700 1 -- 172.21.15.81:0/1426818334 wait complete. 2023-10-06T03:24:03.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.181+0000 7f099959d700 1 Processor -- start 2023-10-06T03:24:03.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.181+0000 7f099959d700 1 -- start start 2023-10-06T03:24:03.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.182+0000 7f099959d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09940b2420 0x7f099413ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:03.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.182+0000 7f099959d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f09940cc670 0x7f0994155a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:03.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.182+0000 7f099959d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f099415a450 0x7f099415b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:03.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.182+0000 7f099959d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0994156a30 con 0x7f09940b2420 2023-10-06T03:24:03.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.182+0000 7f099959d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0994156470 con 0x7f099415a450 2023-10-06T03:24:03.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.182+0000 7f099959d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0994156750 con 0x7f09940cc670 2023-10-06T03:24:03.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.182+0000 7f0993fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09940b2420 0x7f099413ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:03.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.182+0000 7f0993fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09940b2420 0x7f099413ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56426/0 (socket says 172.21.15.81:56426) 2023-10-06T03:24:03.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.182+0000 7f0993fff700 1 -- 172.21.15.81:0/3525675736 learned_addr learned my addr 172.21.15.81:0/3525675736 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:03.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.182+0000 7f0998d9c700 1 --2- 172.21.15.81:0/3525675736 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f099415a450 0x7f099415b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:03.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.182+0000 7f09937fe700 1 --2- 172.21.15.81:0/3525675736 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f09940cc670 0x7f0994155a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:03.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.183+0000 7f0993fff700 1 -- 172.21.15.81:0/3525675736 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f09940cc670 msgr2=0x7f0994155a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:03.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.183+0000 7f0993fff700 1 --2- 172.21.15.81:0/3525675736 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f09940cc670 0x7f0994155a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:03.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.183+0000 7f0993fff700 1 -- 172.21.15.81:0/3525675736 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f099415a450 msgr2=0x7f099415b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:03.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.183+0000 7f0993fff700 1 --2- 172.21.15.81:0/3525675736 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f099415a450 0x7f099415b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:03.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.183+0000 7f0993fff700 1 -- 172.21.15.81:0/3525675736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0984009420 con 0x7f09940b2420 2023-10-06T03:24:03.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.183+0000 7f0993fff700 1 --2- 172.21.15.81:0/3525675736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09940b2420 0x7f099413ec20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0984009f00 tx=0x7f0984017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:03.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.183+0000 7f097bfff700 1 -- 172.21.15.81:0/3525675736 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098401f070 con 0x7f09940b2420 2023-10-06T03:24:03.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.183+0000 7f097bfff700 1 -- 172.21.15.81:0/3525675736 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0984002f70 con 0x7f09940b2420 2023-10-06T03:24:03.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.183+0000 7f099959d700 1 -- 172.21.15.81:0/3525675736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0994157480 con 0x7f09940b2420 2023-10-06T03:24:03.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.183+0000 7f097bfff700 1 -- 172.21.15.81:0/3525675736 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0984011900 con 0x7f09940b2420 2023-10-06T03:24:03.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.183+0000 7f099959d700 1 -- 172.21.15.81:0/3525675736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f099415ae80 con 0x7f09940b2420 2023-10-06T03:24:03.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.184+0000 7f099959d700 1 -- 172.21.15.81:0/3525675736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09941572e0 con 0x7f09940b2420 2023-10-06T03:24:03.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.185+0000 7f097bfff700 1 -- 172.21.15.81:0/3525675736 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0984023070 con 0x7f09940b2420 2023-10-06T03:24:03.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.186+0000 7f097bfff700 1 --2- 172.21.15.81:0/3525675736 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0980066f30 0x7f09800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:03.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.186+0000 7f097bfff700 1 -- 172.21.15.81:0/3525675736 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f0984085d60 con 0x7f09940b2420 2023-10-06T03:24:03.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.186+0000 7f09937fe700 1 --2- 172.21.15.81:0/3525675736 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0980066f30 0x7f09800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:03.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.187+0000 7f09937fe700 1 --2- 172.21.15.81:0/3525675736 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0980066f30 0x7f09800693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0988007fd0 tx=0x7f0988007d10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:03.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.190+0000 7f097bfff700 1 -- 172.21.15.81:0/3525675736 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f09941572e0 con 0x7f09940b2420 2023-10-06T03:24:03.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.377+0000 7f099959d700 1 -- 172.21.15.81:0/3525675736 --> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f09941572e0 con 0x7f0980066f30 2023-10-06T03:24:03.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.388+0000 7f097bfff700 1 -- 172.21.15.81:0/3525675736 <== mgr.4100 v2:172.21.15.81:6832/85286 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367537 (secure 0 0 0) 0x7f09941572e0 con 0x7f0980066f30 2023-10-06T03:24:03.396 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:24:03.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.392+0000 7f099959d700 1 -- 172.21.15.81:0/3525675736 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0980066f30 msgr2=0x7f09800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:03.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.392+0000 7f099959d700 1 --2- 172.21.15.81:0/3525675736 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0980066f30 0x7f09800693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0988007fd0 tx=0x7f0988007d10 comp rx=0 tx=0).stop 2023-10-06T03:24:03.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.392+0000 7f099959d700 1 -- 172.21.15.81:0/3525675736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09940b2420 msgr2=0x7f099413ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:03.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.392+0000 7f099959d700 1 --2- 172.21.15.81:0/3525675736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09940b2420 0x7f099413ec20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0984009f00 tx=0x7f0984017000 comp rx=0 tx=0).stop 2023-10-06T03:24:03.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.392+0000 7f099959d700 1 -- 172.21.15.81:0/3525675736 shutdown_connections 2023-10-06T03:24:03.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.392+0000 7f099959d700 1 --2- 172.21.15.81:0/3525675736 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f099415a450 0x7f099415b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:03.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.392+0000 7f099959d700 1 --2- 172.21.15.81:0/3525675736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09940b2420 0x7f099413ec20 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:03.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.392+0000 7f099959d700 1 --2- 172.21.15.81:0/3525675736 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0980066f30 0x7f09800693e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:03.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.392+0000 7f099959d700 1 --2- 172.21.15.81:0/3525675736 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f09940cc670 0x7f0994155a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:03.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.392+0000 7f099959d700 1 -- 172.21.15.81:0/3525675736 >> 172.21.15.81:0/3525675736 conn(0x7f099406ed10 msgr2=0x7f09940ce810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:03.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.393+0000 7f099959d700 1 -- 172.21.15.81:0/3525675736 shutdown_connections 2023-10-06T03:24:03.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.393+0000 7f099959d700 1 -- 172.21.15.81:0/3525675736 wait complete. 2023-10-06T03:24:03.401 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-06T03:24:03.412 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2023-10-06T03:24:01.558344+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594852,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381508,"kb_used_data":3204,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593212,"statfs":{"total":773094113280,"available":770655449088,"internally_reserved":0,"allocated":3280896,"data_stored":2023855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2178,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002825"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.934944+0000","last_change":"2023-10-06T03:23:40.657927+0000","last_active":"2023-10-06T03:23:44.934944+0000","last_peered":"2023-10-06T03:23:44.934944+0000","last_clean":"2023-10-06T03:23:44.934944+0000","last_became_active":"2023-10-06T03:23:40.657628+0000","last_became_peered":"2023-10-06T03:23:40.657628+0000","last_unstale":"2023-10-06T03:23:44.934944+0000","last_undegraded":"2023-10-06T03:23:44.934944+0000","last_fullsized":"2023-10-06T03:23:44.934944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:53.566006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936939+0000","last_change":"2023-10-06T03:23:40.669392+0000","last_active":"2023-10-06T03:23:44.936939+0000","last_peered":"2023-10-06T03:23:44.936939+0000","last_clean":"2023-10-06T03:23:44.936939+0000","last_became_active":"2023-10-06T03:23:40.669068+0000","last_became_peered":"2023-10-06T03:23:40.669068+0000","last_unstale":"2023-10-06T03:23:44.936939+0000","last_undegraded":"2023-10-06T03:23:44.936939+0000","last_fullsized":"2023-10-06T03:23:44.936939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:15.293618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937675+0000","last_change":"2023-10-06T03:23:40.672182+0000","last_active":"2023-10-06T03:23:44.937675+0000","last_peered":"2023-10-06T03:23:44.937675+0000","last_clean":"2023-10-06T03:23:44.937675+0000","last_became_active":"2023-10-06T03:23:40.671082+0000","last_became_peered":"2023-10-06T03:23:40.671082+0000","last_unstale":"2023-10-06T03:23:44.937675+0000","last_undegraded":"2023-10-06T03:23:44.937675+0000","last_fullsized":"2023-10-06T03:23:44.937675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:37:07.602543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.944602+0000","last_change":"2023-10-06T03:23:40.669872+0000","last_active":"2023-10-06T03:23:44.944602+0000","last_peered":"2023-10-06T03:23:44.944602+0000","last_clean":"2023-10-06T03:23:44.944602+0000","last_became_active":"2023-10-06T03:23:40.669607+0000","last_became_peered":"2023-10-06T03:23:40.669607+0000","last_unstale":"2023-10-06T03:23:44.944602+0000","last_undegraded":"2023-10-06T03:23:44.944602+0000","last_fullsized":"2023-10-06T03:23:44.944602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:45.363103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.947565+0000","last_change":"2023-10-06T03:23:40.673713+0000","last_active":"2023-10-06T03:23:44.947565+0000","last_peered":"2023-10-06T03:23:44.947565+0000","last_clean":"2023-10-06T03:23:44.947565+0000","last_became_active":"2023-10-06T03:23:40.673350+0000","last_became_peered":"2023-10-06T03:23:40.673350+0000","last_unstale":"2023-10-06T03:23:44.947565+0000","last_undegraded":"2023-10-06T03:23:44.947565+0000","last_fullsized":"2023-10-06T03:23:44.947565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:54:33.855202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936531+0000","last_change":"2023-10-06T03:23:40.672923+0000","last_active":"2023-10-06T03:23:44.936531+0000","last_peered":"2023-10-06T03:23:44.936531+0000","last_clean":"2023-10-06T03:23:44.936531+0000","last_became_active":"2023-10-06T03:23:40.672651+0000","last_became_peered":"2023-10-06T03:23:40.672651+0000","last_unstale":"2023-10-06T03:23:44.936531+0000","last_undegraded":"2023-10-06T03:23:44.936531+0000","last_fullsized":"2023-10-06T03:23:44.936531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:30:38.801700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937090+0000","last_change":"2023-10-06T03:23:40.670079+0000","last_active":"2023-10-06T03:23:44.937090+0000","last_peered":"2023-10-06T03:23:44.937090+0000","last_clean":"2023-10-06T03:23:44.937090+0000","last_became_active":"2023-10-06T03:23:40.669460+0000","last_became_peered":"2023-10-06T03:23:40.669460+0000","last_unstale":"2023-10-06T03:23:44.937090+0000","last_undegraded":"2023-10-06T03:23:44.937090+0000","last_fullsized":"2023-10-06T03:23:44.937090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:21.489097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.934267+0000","last_change":"2023-10-06T03:23:40.670214+0000","last_active":"2023-10-06T03:23:44.934267+0000","last_peered":"2023-10-06T03:23:44.934267+0000","last_clean":"2023-10-06T03:23:44.934267+0000","last_became_active":"2023-10-06T03:23:40.669794+0000","last_became_peered":"2023-10-06T03:23:40.669794+0000","last_unstale":"2023-10-06T03:23:44.934267+0000","last_undegraded":"2023-10-06T03:23:44.934267+0000","last_fullsized":"2023-10-06T03:23:44.934267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:51:39.105798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.947704+0000","last_change":"2023-10-06T03:23:40.673814+0000","last_active":"2023-10-06T03:23:44.947704+0000","last_peered":"2023-10-06T03:23:44.947704+0000","last_clean":"2023-10-06T03:23:44.947704+0000","last_became_active":"2023-10-06T03:23:40.673518+0000","last_became_peered":"2023-10-06T03:23:40.673518+0000","last_unstale":"2023-10-06T03:23:44.947704+0000","last_undegraded":"2023-10-06T03:23:44.947704+0000","last_fullsized":"2023-10-06T03:23:44.947704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:36:33.973063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937252+0000","last_change":"2023-10-06T03:23:40.674286+0000","last_active":"2023-10-06T03:23:44.937252+0000","last_peered":"2023-10-06T03:23:44.937252+0000","last_clean":"2023-10-06T03:23:44.937252+0000","last_became_active":"2023-10-06T03:23:40.673972+0000","last_became_peered":"2023-10-06T03:23:40.673972+0000","last_unstale":"2023-10-06T03:23:44.937252+0000","last_undegraded":"2023-10-06T03:23:44.937252+0000","last_fullsized":"2023-10-06T03:23:44.937252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:35.462631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937591+0000","last_change":"2023-10-06T03:23:40.672377+0000","last_active":"2023-10-06T03:23:44.937591+0000","last_peered":"2023-10-06T03:23:44.937591+0000","last_clean":"2023-10-06T03:23:44.937591+0000","last_became_active":"2023-10-06T03:23:40.671914+0000","last_became_peered":"2023-10-06T03:23:40.671914+0000","last_unstale":"2023-10-06T03:23:44.937591+0000","last_undegraded":"2023-10-06T03:23:44.937591+0000","last_fullsized":"2023-10-06T03:23:44.937591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:49.615169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.934679+0000","last_change":"2023-10-06T03:23:40.664677+0000","last_active":"2023-10-06T03:23:44.934679+0000","last_peered":"2023-10-06T03:23:44.934679+0000","last_clean":"2023-10-06T03:23:44.934679+0000","last_became_active":"2023-10-06T03:23:40.664274+0000","last_became_peered":"2023-10-06T03:23:40.664274+0000","last_unstale":"2023-10-06T03:23:44.934679+0000","last_undegraded":"2023-10-06T03:23:44.934679+0000","last_fullsized":"2023-10-06T03:23:44.934679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:46:25.920290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936715+0000","last_change":"2023-10-06T03:23:40.661431+0000","last_active":"2023-10-06T03:23:44.936715+0000","last_peered":"2023-10-06T03:23:44.936715+0000","last_clean":"2023-10-06T03:23:44.936715+0000","last_became_active":"2023-10-06T03:23:40.661152+0000","last_became_peered":"2023-10-06T03:23:40.661152+0000","last_unstale":"2023-10-06T03:23:44.936715+0000","last_undegraded":"2023-10-06T03:23:44.936715+0000","last_fullsized":"2023-10-06T03:23:44.936715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:35.968610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.934879+0000","last_change":"2023-10-06T03:23:40.654344+0000","last_active":"2023-10-06T03:23:44.934879+0000","last_peered":"2023-10-06T03:23:44.934879+0000","last_clean":"2023-10-06T03:23:44.934879+0000","last_became_active":"2023-10-06T03:23:40.654053+0000","last_became_peered":"2023-10-06T03:23:40.654053+0000","last_unstale":"2023-10-06T03:23:44.934879+0000","last_undegraded":"2023-10-06T03:23:44.934879+0000","last_fullsized":"2023-10-06T03:23:44.934879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:04:49.664462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936826+0000","last_change":"2023-10-06T03:23:40.669778+0000","last_active":"2023-10-06T03:23:44.936826+0000","last_peered":"2023-10-06T03:23:44.936826+0000","last_clean":"2023-10-06T03:23:44.936826+0000","last_became_active":"2023-10-06T03:23:40.669080+0000","last_became_peered":"2023-10-06T03:23:40.669080+0000","last_unstale":"2023-10-06T03:23:44.936826+0000","last_undegraded":"2023-10-06T03:23:44.936826+0000","last_fullsized":"2023-10-06T03:23:44.936826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:51:39.105798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937246+0000","last_change":"2023-10-06T03:23:40.675925+0000","last_active":"2023-10-06T03:23:44.937246+0000","last_peered":"2023-10-06T03:23:44.937246+0000","last_clean":"2023-10-06T03:23:44.937246+0000","last_became_active":"2023-10-06T03:23:40.673050+0000","last_became_peered":"2023-10-06T03:23:40.673050+0000","last_unstale":"2023-10-06T03:23:44.937246+0000","last_undegraded":"2023-10-06T03:23:44.937246+0000","last_fullsized":"2023-10-06T03:23:44.937246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:38:27.078009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.947782+0000","last_change":"2023-10-06T03:23:40.670497+0000","last_active":"2023-10-06T03:23:44.947782+0000","last_peered":"2023-10-06T03:23:44.947782+0000","last_clean":"2023-10-06T03:23:44.947782+0000","last_became_active":"2023-10-06T03:23:40.670254+0000","last_became_peered":"2023-10-06T03:23:40.670254+0000","last_unstale":"2023-10-06T03:23:44.947782+0000","last_undegraded":"2023-10-06T03:23:44.947782+0000","last_fullsized":"2023-10-06T03:23:44.947782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:18.546154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937896+0000","last_change":"2023-10-06T03:23:40.664385+0000","last_active":"2023-10-06T03:23:44.937896+0000","last_peered":"2023-10-06T03:23:44.937896+0000","last_clean":"2023-10-06T03:23:44.937896+0000","last_became_active":"2023-10-06T03:23:40.664019+0000","last_became_peered":"2023-10-06T03:23:40.664019+0000","last_unstale":"2023-10-06T03:23:44.937896+0000","last_undegraded":"2023-10-06T03:23:44.937896+0000","last_fullsized":"2023-10-06T03:23:44.937896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:18.834001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.935061+0000","last_change":"2023-10-06T03:23:40.664719+0000","last_active":"2023-10-06T03:23:44.935061+0000","last_peered":"2023-10-06T03:23:44.935061+0000","last_clean":"2023-10-06T03:23:44.935061+0000","last_became_active":"2023-10-06T03:23:40.664292+0000","last_became_peered":"2023-10-06T03:23:40.664292+0000","last_unstale":"2023-10-06T03:23:44.935061+0000","last_undegraded":"2023-10-06T03:23:44.935061+0000","last_fullsized":"2023-10-06T03:23:44.935061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:25:22.431703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937565+0000","last_change":"2023-10-06T03:23:40.676968+0000","last_active":"2023-10-06T03:23:44.937565+0000","last_peered":"2023-10-06T03:23:44.937565+0000","last_clean":"2023-10-06T03:23:44.937565+0000","last_became_active":"2023-10-06T03:23:40.671490+0000","last_became_peered":"2023-10-06T03:23:40.671490+0000","last_unstale":"2023-10-06T03:23:44.937565+0000","last_undegraded":"2023-10-06T03:23:44.937565+0000","last_fullsized":"2023-10-06T03:23:44.937565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:57.849203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936664+0000","last_change":"2023-10-06T03:23:40.664089+0000","last_active":"2023-10-06T03:23:44.936664+0000","last_peered":"2023-10-06T03:23:44.936664+0000","last_clean":"2023-10-06T03:23:44.936664+0000","last_became_active":"2023-10-06T03:23:40.662392+0000","last_became_peered":"2023-10-06T03:23:40.662392+0000","last_unstale":"2023-10-06T03:23:44.936664+0000","last_undegraded":"2023-10-06T03:23:44.936664+0000","last_fullsized":"2023-10-06T03:23:44.936664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:35.462631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.945221+0000","last_change":"2023-10-06T03:23:40.673025+0000","last_active":"2023-10-06T03:23:44.945221+0000","last_peered":"2023-10-06T03:23:44.945221+0000","last_clean":"2023-10-06T03:23:44.945221+0000","last_became_active":"2023-10-06T03:23:40.672797+0000","last_became_peered":"2023-10-06T03:23:40.672797+0000","last_unstale":"2023-10-06T03:23:44.945221+0000","last_undegraded":"2023-10-06T03:23:44.945221+0000","last_fullsized":"2023-10-06T03:23:44.945221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:21.489097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.930431+0000","last_change":"2023-10-06T03:23:40.670561+0000","last_active":"2023-10-06T03:23:44.930431+0000","last_peered":"2023-10-06T03:23:44.930431+0000","last_clean":"2023-10-06T03:23:44.930431+0000","last_became_active":"2023-10-06T03:23:40.670272+0000","last_became_peered":"2023-10-06T03:23:40.670272+0000","last_unstale":"2023-10-06T03:23:44.930431+0000","last_undegraded":"2023-10-06T03:23:44.930431+0000","last_fullsized":"2023-10-06T03:23:44.930431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:18.834001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936341+0000","last_change":"2023-10-06T03:23:40.662281+0000","last_active":"2023-10-06T03:23:44.936341+0000","last_peered":"2023-10-06T03:23:44.936341+0000","last_clean":"2023-10-06T03:23:44.936341+0000","last_became_active":"2023-10-06T03:23:40.661686+0000","last_became_peered":"2023-10-06T03:23:40.661686+0000","last_unstale":"2023-10-06T03:23:44.936341+0000","last_undegraded":"2023-10-06T03:23:44.936341+0000","last_fullsized":"2023-10-06T03:23:44.936341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:15.293618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.938818+0000","last_change":"2023-10-06T03:23:40.668204+0000","last_active":"2023-10-06T03:23:44.938818+0000","last_peered":"2023-10-06T03:23:44.938818+0000","last_clean":"2023-10-06T03:23:44.938818+0000","last_became_active":"2023-10-06T03:23:40.665998+0000","last_became_peered":"2023-10-06T03:23:40.665998+0000","last_unstale":"2023-10-06T03:23:44.938818+0000","last_undegraded":"2023-10-06T03:23:44.938818+0000","last_fullsized":"2023-10-06T03:23:44.938818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:15.293618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936984+0000","last_change":"2023-10-06T03:23:40.654367+0000","last_active":"2023-10-06T03:23:44.936984+0000","last_peered":"2023-10-06T03:23:44.936984+0000","last_clean":"2023-10-06T03:23:44.936984+0000","last_became_active":"2023-10-06T03:23:40.654082+0000","last_became_peered":"2023-10-06T03:23:40.654082+0000","last_unstale":"2023-10-06T03:23:44.936984+0000","last_undegraded":"2023-10-06T03:23:44.936984+0000","last_fullsized":"2023-10-06T03:23:44.936984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:56.483789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.938900+0000","last_change":"2023-10-06T03:23:40.662226+0000","last_active":"2023-10-06T03:23:44.938900+0000","last_peered":"2023-10-06T03:23:44.938900+0000","last_clean":"2023-10-06T03:23:44.938900+0000","last_became_active":"2023-10-06T03:23:40.662025+0000","last_became_peered":"2023-10-06T03:23:40.662025+0000","last_unstale":"2023-10-06T03:23:44.938900+0000","last_undegraded":"2023-10-06T03:23:44.938900+0000","last_fullsized":"2023-10-06T03:23:44.938900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:37.167322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.955136+0000","last_change":"2023-10-06T03:23:44.949281+0000","last_active":"2023-10-06T03:23:44.955136+0000","last_peered":"2023-10-06T03:23:44.955136+0000","last_clean":"2023-10-06T03:23:44.955136+0000","last_became_active":"2023-10-06T03:23:44.948885+0000","last_became_peered":"2023-10-06T03:23:44.948885+0000","last_unstale":"2023-10-06T03:23:44.955136+0000","last_undegraded":"2023-10-06T03:23:44.955136+0000","last_fullsized":"2023-10-06T03:23:44.955136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:31:16.317335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936350+0000","last_change":"2023-10-06T03:23:39.919181+0000","last_active":"2023-10-06T03:23:44.936350+0000","last_peered":"2023-10-06T03:23:44.936350+0000","last_clean":"2023-10-06T03:23:44.936350+0000","last_became_active":"2023-10-06T03:23:39.918331+0000","last_became_peered":"2023-10-06T03:23:39.918331+0000","last_unstale":"2023-10-06T03:23:44.936350+0000","last_undegraded":"2023-10-06T03:23:44.936350+0000","last_fullsized":"2023-10-06T03:23:44.936350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:46:24.911513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.931056+0000","last_change":"2023-10-06T03:23:40.666693+0000","last_active":"2023-10-06T03:23:44.931056+0000","last_peered":"2023-10-06T03:23:44.931056+0000","last_clean":"2023-10-06T03:23:44.931056+0000","last_became_active":"2023-10-06T03:23:40.666435+0000","last_became_peered":"2023-10-06T03:23:40.666435+0000","last_unstale":"2023-10-06T03:23:44.931056+0000","last_undegraded":"2023-10-06T03:23:44.931056+0000","last_fullsized":"2023-10-06T03:23:44.931056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:35.462631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.962151+0000","last_change":"2023-10-06T03:23:44.958592+0000","last_active":"2023-10-06T03:23:44.962151+0000","last_peered":"2023-10-06T03:23:44.962151+0000","last_clean":"2023-10-06T03:23:44.962151+0000","last_became_active":"2023-10-06T03:23:44.957907+0000","last_became_peered":"2023-10-06T03:23:44.957907+0000","last_unstale":"2023-10-06T03:23:44.962151+0000","last_undegraded":"2023-10-06T03:23:44.962151+0000","last_fullsized":"2023-10-06T03:23:44.962151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:22.863565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.938027+0000","last_change":"2023-10-06T03:23:39.927167+0000","last_active":"2023-10-06T03:23:44.938027+0000","last_peered":"2023-10-06T03:23:44.938027+0000","last_clean":"2023-10-06T03:23:44.938027+0000","last_became_active":"2023-10-06T03:23:39.926796+0000","last_became_peered":"2023-10-06T03:23:39.926796+0000","last_unstale":"2023-10-06T03:23:44.938027+0000","last_undegraded":"2023-10-06T03:23:44.938027+0000","last_fullsized":"2023-10-06T03:23:44.938027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:10:12.819926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.948077+0000","last_change":"2023-10-06T03:23:40.676555+0000","last_active":"2023-10-06T03:23:44.948077+0000","last_peered":"2023-10-06T03:23:44.948077+0000","last_clean":"2023-10-06T03:23:44.948077+0000","last_became_active":"2023-10-06T03:23:40.676292+0000","last_became_peered":"2023-10-06T03:23:40.676292+0000","last_unstale":"2023-10-06T03:23:44.948077+0000","last_undegraded":"2023-10-06T03:23:44.948077+0000","last_fullsized":"2023-10-06T03:23:44.948077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:15.293618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.966214+0000","last_change":"2023-10-06T03:23:44.963581+0000","last_active":"2023-10-06T03:23:44.966214+0000","last_peered":"2023-10-06T03:23:44.966214+0000","last_clean":"2023-10-06T03:23:44.966214+0000","last_became_active":"2023-10-06T03:23:44.963132+0000","last_became_peered":"2023-10-06T03:23:44.963132+0000","last_unstale":"2023-10-06T03:23:44.966214+0000","last_undegraded":"2023-10-06T03:23:44.966214+0000","last_fullsized":"2023-10-06T03:23:44.966214+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:39.997230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.930690+0000","last_change":"2023-10-06T03:23:39.931987+0000","last_active":"2023-10-06T03:23:44.930690+0000","last_peered":"2023-10-06T03:23:44.930690+0000","last_clean":"2023-10-06T03:23:44.930690+0000","last_became_active":"2023-10-06T03:23:39.931330+0000","last_became_peered":"2023-10-06T03:23:39.931330+0000","last_unstale":"2023-10-06T03:23:44.930690+0000","last_undegraded":"2023-10-06T03:23:44.930690+0000","last_fullsized":"2023-10-06T03:23:44.930690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:41.245899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.947767+0000","last_change":"2023-10-06T03:23:40.666106+0000","last_active":"2023-10-06T03:23:44.947767+0000","last_peered":"2023-10-06T03:23:44.947767+0000","last_clean":"2023-10-06T03:23:44.947767+0000","last_became_active":"2023-10-06T03:23:40.665767+0000","last_became_peered":"2023-10-06T03:23:40.665767+0000","last_unstale":"2023-10-06T03:23:44.947767+0000","last_undegraded":"2023-10-06T03:23:44.947767+0000","last_fullsized":"2023-10-06T03:23:44.947767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:35.738270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.959918+0000","last_change":"2023-10-06T03:23:44.957763+0000","last_active":"2023-10-06T03:23:44.959918+0000","last_peered":"2023-10-06T03:23:44.959918+0000","last_clean":"2023-10-06T03:23:44.959918+0000","last_became_active":"2023-10-06T03:23:44.957461+0000","last_became_peered":"2023-10-06T03:23:44.957461+0000","last_unstale":"2023-10-06T03:23:44.959918+0000","last_undegraded":"2023-10-06T03:23:44.959918+0000","last_fullsized":"2023-10-06T03:23:44.959918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:27:46.202488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.947861+0000","last_change":"2023-10-06T03:23:39.926868+0000","last_active":"2023-10-06T03:23:44.947861+0000","last_peered":"2023-10-06T03:23:44.947861+0000","last_clean":"2023-10-06T03:23:44.947861+0000","last_became_active":"2023-10-06T03:23:39.926602+0000","last_became_peered":"2023-10-06T03:23:39.926602+0000","last_unstale":"2023-10-06T03:23:44.947861+0000","last_undegraded":"2023-10-06T03:23:44.947861+0000","last_fullsized":"2023-10-06T03:23:44.947861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:34.959833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.930596+0000","last_change":"2023-10-06T03:23:40.666666+0000","last_active":"2023-10-06T03:23:44.930596+0000","last_peered":"2023-10-06T03:23:44.930596+0000","last_clean":"2023-10-06T03:23:44.930596+0000","last_became_active":"2023-10-06T03:23:40.666333+0000","last_became_peered":"2023-10-06T03:23:40.666333+0000","last_unstale":"2023-10-06T03:23:44.930596+0000","last_undegraded":"2023-10-06T03:23:44.930596+0000","last_fullsized":"2023-10-06T03:23:44.930596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:21.489097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.963680+0000","last_change":"2023-10-06T03:23:44.956770+0000","last_active":"2023-10-06T03:23:44.963680+0000","last_peered":"2023-10-06T03:23:44.963680+0000","last_clean":"2023-10-06T03:23:44.963680+0000","last_became_active":"2023-10-06T03:23:44.956335+0000","last_became_peered":"2023-10-06T03:23:44.956335+0000","last_unstale":"2023-10-06T03:23:44.963680+0000","last_undegraded":"2023-10-06T03:23:44.963680+0000","last_fullsized":"2023-10-06T03:23:44.963680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:26.358389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937057+0000","last_change":"2023-10-06T03:23:39.918613+0000","last_active":"2023-10-06T03:23:44.937057+0000","last_peered":"2023-10-06T03:23:44.937057+0000","last_clean":"2023-10-06T03:23:44.937057+0000","last_became_active":"2023-10-06T03:23:39.918224+0000","last_became_peered":"2023-10-06T03:23:39.918224+0000","last_unstale":"2023-10-06T03:23:44.937057+0000","last_undegraded":"2023-10-06T03:23:44.937057+0000","last_fullsized":"2023-10-06T03:23:44.937057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:10:12.819926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.930293+0000","last_change":"2023-10-06T03:23:40.665896+0000","last_active":"2023-10-06T03:23:44.930293+0000","last_peered":"2023-10-06T03:23:44.930293+0000","last_clean":"2023-10-06T03:23:44.930293+0000","last_became_active":"2023-10-06T03:23:40.665625+0000","last_became_peered":"2023-10-06T03:23:40.665625+0000","last_unstale":"2023-10-06T03:23:44.930293+0000","last_undegraded":"2023-10-06T03:23:44.930293+0000","last_fullsized":"2023-10-06T03:23:44.930293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:00.382000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.959626+0000","last_change":"2023-10-06T03:23:44.950950+0000","last_active":"2023-10-06T03:23:44.959626+0000","last_peered":"2023-10-06T03:23:44.959626+0000","last_clean":"2023-10-06T03:23:44.959626+0000","last_became_active":"2023-10-06T03:23:44.950383+0000","last_became_peered":"2023-10-06T03:23:44.950383+0000","last_unstale":"2023-10-06T03:23:44.959626+0000","last_undegraded":"2023-10-06T03:23:44.959626+0000","last_fullsized":"2023-10-06T03:23:44.959626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:41.590979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936358+0000","last_change":"2023-10-06T03:23:39.928175+0000","last_active":"2023-10-06T03:23:44.936358+0000","last_peered":"2023-10-06T03:23:44.936358+0000","last_clean":"2023-10-06T03:23:44.936358+0000","last_became_active":"2023-10-06T03:23:39.927870+0000","last_became_peered":"2023-10-06T03:23:39.927870+0000","last_unstale":"2023-10-06T03:23:44.936358+0000","last_undegraded":"2023-10-06T03:23:44.936358+0000","last_fullsized":"2023-10-06T03:23:44.936358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:15:53.608164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.938038+0000","last_change":"2023-10-06T03:23:40.668044+0000","last_active":"2023-10-06T03:23:44.938038+0000","last_peered":"2023-10-06T03:23:44.938038+0000","last_clean":"2023-10-06T03:23:44.938038+0000","last_became_active":"2023-10-06T03:23:40.667677+0000","last_became_peered":"2023-10-06T03:23:40.667677+0000","last_unstale":"2023-10-06T03:23:44.938038+0000","last_undegraded":"2023-10-06T03:23:44.938038+0000","last_fullsized":"2023-10-06T03:23:44.938038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:37.167322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.962261+0000","last_change":"2023-10-06T03:23:44.957225+0000","last_active":"2023-10-06T03:23:44.962261+0000","last_peered":"2023-10-06T03:23:44.962261+0000","last_clean":"2023-10-06T03:23:44.962261+0000","last_became_active":"2023-10-06T03:23:44.956809+0000","last_became_peered":"2023-10-06T03:23:44.956809+0000","last_unstale":"2023-10-06T03:23:44.962261+0000","last_undegraded":"2023-10-06T03:23:44.962261+0000","last_fullsized":"2023-10-06T03:23:44.962261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:46:57.334758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"24'9","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:23:53.837606+0000","last_change":"2023-10-06T03:23:39.926096+0000","last_active":"2023-10-06T03:23:53.837606+0000","last_peered":"2023-10-06T03:23:53.837606+0000","last_clean":"2023-10-06T03:23:53.837606+0000","last_became_active":"2023-10-06T03:23:39.925763+0000","last_became_peered":"2023-10-06T03:23:39.925763+0000","last_unstale":"2023-10-06T03:23:53.837606+0000","last_undegraded":"2023-10-06T03:23:53.837606+0000","last_fullsized":"2023-10-06T03:23:53.837606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:25:21.422926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3714,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936727+0000","last_change":"2023-10-06T03:23:40.668353+0000","last_active":"2023-10-06T03:23:44.936727+0000","last_peered":"2023-10-06T03:23:44.936727+0000","last_clean":"2023-10-06T03:23:44.936727+0000","last_became_active":"2023-10-06T03:23:40.668068+0000","last_became_peered":"2023-10-06T03:23:40.668068+0000","last_unstale":"2023-10-06T03:23:44.936727+0000","last_undegraded":"2023-10-06T03:23:44.936727+0000","last_fullsized":"2023-10-06T03:23:44.936727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:07:52.772047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.955742+0000","last_change":"2023-10-06T03:23:44.954499+0000","last_active":"2023-10-06T03:23:44.955742+0000","last_peered":"2023-10-06T03:23:44.955742+0000","last_clean":"2023-10-06T03:23:44.955742+0000","last_became_active":"2023-10-06T03:23:44.954033+0000","last_became_peered":"2023-10-06T03:23:44.954033+0000","last_unstale":"2023-10-06T03:23:44.955742+0000","last_undegraded":"2023-10-06T03:23:44.955742+0000","last_fullsized":"2023-10-06T03:23:44.955742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:39.997230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936587+0000","last_change":"2023-10-06T03:23:39.929796+0000","last_active":"2023-10-06T03:23:44.936587+0000","last_peered":"2023-10-06T03:23:44.936587+0000","last_clean":"2023-10-06T03:23:44.936587+0000","last_became_active":"2023-10-06T03:23:39.929503+0000","last_became_peered":"2023-10-06T03:23:39.929503+0000","last_unstale":"2023-10-06T03:23:44.936587+0000","last_undegraded":"2023-10-06T03:23:44.936587+0000","last_fullsized":"2023-10-06T03:23:44.936587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:44.354326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.931035+0000","last_change":"2023-10-06T03:23:40.670640+0000","last_active":"2023-10-06T03:23:44.931035+0000","last_peered":"2023-10-06T03:23:44.931035+0000","last_clean":"2023-10-06T03:23:44.931035+0000","last_became_active":"2023-10-06T03:23:40.670295+0000","last_became_peered":"2023-10-06T03:23:40.670295+0000","last_unstale":"2023-10-06T03:23:44.931035+0000","last_undegraded":"2023-10-06T03:23:44.931035+0000","last_fullsized":"2023-10-06T03:23:44.931035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:18.546154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.959802+0000","last_change":"2023-10-06T03:23:44.952973+0000","last_active":"2023-10-06T03:23:44.959802+0000","last_peered":"2023-10-06T03:23:44.959802+0000","last_clean":"2023-10-06T03:23:44.959802+0000","last_became_active":"2023-10-06T03:23:44.952573+0000","last_became_peered":"2023-10-06T03:23:44.952573+0000","last_unstale":"2023-10-06T03:23:44.959802+0000","last_undegraded":"2023-10-06T03:23:44.959802+0000","last_fullsized":"2023-10-06T03:23:44.959802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:47:31.959148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.946424+0000","last_change":"2023-10-06T03:23:39.920586+0000","last_active":"2023-10-06T03:23:44.946424+0000","last_peered":"2023-10-06T03:23:44.946424+0000","last_clean":"2023-10-06T03:23:44.946424+0000","last_became_active":"2023-10-06T03:23:39.920273+0000","last_became_peered":"2023-10-06T03:23:39.920273+0000","last_unstale":"2023-10-06T03:23:44.946424+0000","last_undegraded":"2023-10-06T03:23:44.946424+0000","last_fullsized":"2023-10-06T03:23:44.946424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:25:21.422926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.938789+0000","last_change":"2023-10-06T03:23:40.660488+0000","last_active":"2023-10-06T03:23:44.938789+0000","last_peered":"2023-10-06T03:23:44.938789+0000","last_clean":"2023-10-06T03:23:44.938789+0000","last_became_active":"2023-10-06T03:23:40.660218+0000","last_became_peered":"2023-10-06T03:23:40.660218+0000","last_unstale":"2023-10-06T03:23:44.938789+0000","last_undegraded":"2023-10-06T03:23:44.938789+0000","last_fullsized":"2023-10-06T03:23:44.938789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:29:10.177304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.959965+0000","last_change":"2023-10-06T03:23:44.957434+0000","last_active":"2023-10-06T03:23:44.959965+0000","last_peered":"2023-10-06T03:23:44.959965+0000","last_clean":"2023-10-06T03:23:44.959965+0000","last_became_active":"2023-10-06T03:23:44.957081+0000","last_became_peered":"2023-10-06T03:23:44.957081+0000","last_unstale":"2023-10-06T03:23:44.959965+0000","last_undegraded":"2023-10-06T03:23:44.959965+0000","last_fullsized":"2023-10-06T03:23:44.959965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:23.189419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936994+0000","last_change":"2023-10-06T03:23:39.929775+0000","last_active":"2023-10-06T03:23:44.936994+0000","last_peered":"2023-10-06T03:23:44.936994+0000","last_clean":"2023-10-06T03:23:44.936994+0000","last_became_active":"2023-10-06T03:23:39.929442+0000","last_became_peered":"2023-10-06T03:23:39.929442+0000","last_unstale":"2023-10-06T03:23:44.936994+0000","last_undegraded":"2023-10-06T03:23:44.936994+0000","last_fullsized":"2023-10-06T03:23:44.936994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:13:39.307938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.949506+0000","last_change":"2023-10-06T03:23:40.667709+0000","last_active":"2023-10-06T03:23:44.949506+0000","last_peered":"2023-10-06T03:23:44.949506+0000","last_clean":"2023-10-06T03:23:44.949506+0000","last_became_active":"2023-10-06T03:23:40.667393+0000","last_became_peered":"2023-10-06T03:23:40.667393+0000","last_unstale":"2023-10-06T03:23:44.949506+0000","last_undegraded":"2023-10-06T03:23:44.949506+0000","last_fullsized":"2023-10-06T03:23:44.949506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:00.382000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.964649+0000","last_change":"2023-10-06T03:23:44.961540+0000","last_active":"2023-10-06T03:23:44.964649+0000","last_peered":"2023-10-06T03:23:44.964649+0000","last_clean":"2023-10-06T03:23:44.964649+0000","last_became_active":"2023-10-06T03:23:44.961152+0000","last_became_peered":"2023-10-06T03:23:44.961152+0000","last_unstale":"2023-10-06T03:23:44.964649+0000","last_undegraded":"2023-10-06T03:23:44.964649+0000","last_fullsized":"2023-10-06T03:23:44.964649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:48.424006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.944147+0000","last_change":"2023-10-06T03:23:39.930656+0000","last_active":"2023-10-06T03:23:44.944147+0000","last_peered":"2023-10-06T03:23:44.944147+0000","last_clean":"2023-10-06T03:23:44.944147+0000","last_became_active":"2023-10-06T03:23:39.930340+0000","last_became_peered":"2023-10-06T03:23:39.930340+0000","last_unstale":"2023-10-06T03:23:44.944147+0000","last_undegraded":"2023-10-06T03:23:44.944147+0000","last_fullsized":"2023-10-06T03:23:44.944147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:10:12.819926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.931492+0000","last_change":"2023-10-06T03:23:40.666356+0000","last_active":"2023-10-06T03:23:44.931492+0000","last_peered":"2023-10-06T03:23:44.931492+0000","last_clean":"2023-10-06T03:23:44.931492+0000","last_became_active":"2023-10-06T03:23:40.666092+0000","last_became_peered":"2023-10-06T03:23:40.666092+0000","last_unstale":"2023-10-06T03:23:44.931492+0000","last_undegraded":"2023-10-06T03:23:44.931492+0000","last_fullsized":"2023-10-06T03:23:44.931492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:15.293618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.969201+0000","last_change":"2023-10-06T03:23:44.965794+0000","last_active":"2023-10-06T03:23:44.969201+0000","last_peered":"2023-10-06T03:23:44.969201+0000","last_clean":"2023-10-06T03:23:44.969201+0000","last_became_active":"2023-10-06T03:23:44.959858+0000","last_became_peered":"2023-10-06T03:23:44.959858+0000","last_unstale":"2023-10-06T03:23:44.969201+0000","last_undegraded":"2023-10-06T03:23:44.969201+0000","last_fullsized":"2023-10-06T03:23:44.969201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:53.182371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.944656+0000","last_change":"2023-10-06T03:23:39.927449+0000","last_active":"2023-10-06T03:23:44.944656+0000","last_peered":"2023-10-06T03:23:44.944656+0000","last_clean":"2023-10-06T03:23:44.944656+0000","last_became_active":"2023-10-06T03:23:39.927150+0000","last_became_peered":"2023-10-06T03:23:39.927150+0000","last_unstale":"2023-10-06T03:23:44.944656+0000","last_undegraded":"2023-10-06T03:23:44.944656+0000","last_fullsized":"2023-10-06T03:23:44.944656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:34.729493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.934229+0000","last_change":"2023-10-06T03:23:40.660603+0000","last_active":"2023-10-06T03:23:44.934229+0000","last_peered":"2023-10-06T03:23:44.934229+0000","last_clean":"2023-10-06T03:23:44.934229+0000","last_became_active":"2023-10-06T03:23:40.660310+0000","last_became_peered":"2023-10-06T03:23:40.660310+0000","last_unstale":"2023-10-06T03:23:44.934229+0000","last_undegraded":"2023-10-06T03:23:44.934229+0000","last_fullsized":"2023-10-06T03:23:44.934229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:21.489097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.965034+0000","last_change":"2023-10-06T03:23:44.958953+0000","last_active":"2023-10-06T03:23:44.965034+0000","last_peered":"2023-10-06T03:23:44.965034+0000","last_clean":"2023-10-06T03:23:44.965034+0000","last_became_active":"2023-10-06T03:23:44.958414+0000","last_became_peered":"2023-10-06T03:23:44.958414+0000","last_unstale":"2023-10-06T03:23:44.965034+0000","last_undegraded":"2023-10-06T03:23:44.965034+0000","last_fullsized":"2023-10-06T03:23:44.965034+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:22.575718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936667+0000","last_change":"2023-10-06T03:23:39.924645+0000","last_active":"2023-10-06T03:23:44.936667+0000","last_peered":"2023-10-06T03:23:44.936667+0000","last_clean":"2023-10-06T03:23:44.936667+0000","last_became_active":"2023-10-06T03:23:39.924375+0000","last_became_peered":"2023-10-06T03:23:39.924375+0000","last_unstale":"2023-10-06T03:23:44.936667+0000","last_undegraded":"2023-10-06T03:23:44.936667+0000","last_fullsized":"2023-10-06T03:23:44.936667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:21.428737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936388+0000","last_change":"2023-10-06T03:23:40.671688+0000","last_active":"2023-10-06T03:23:44.936388+0000","last_peered":"2023-10-06T03:23:44.936388+0000","last_clean":"2023-10-06T03:23:44.936388+0000","last_became_active":"2023-10-06T03:23:40.671408+0000","last_became_peered":"2023-10-06T03:23:40.671408+0000","last_unstale":"2023-10-06T03:23:44.936388+0000","last_undegraded":"2023-10-06T03:23:44.936388+0000","last_fullsized":"2023-10-06T03:23:44.936388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:43:56.448825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.959633+0000","last_change":"2023-10-06T03:23:44.955142+0000","last_active":"2023-10-06T03:23:44.959633+0000","last_peered":"2023-10-06T03:23:44.959633+0000","last_clean":"2023-10-06T03:23:44.959633+0000","last_became_active":"2023-10-06T03:23:44.954726+0000","last_became_peered":"2023-10-06T03:23:44.954726+0000","last_unstale":"2023-10-06T03:23:44.959633+0000","last_undegraded":"2023-10-06T03:23:44.959633+0000","last_fullsized":"2023-10-06T03:23:44.959633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:55:01.878766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936253+0000","last_change":"2023-10-06T03:23:39.917247+0000","last_active":"2023-10-06T03:23:44.936253+0000","last_peered":"2023-10-06T03:23:44.936253+0000","last_clean":"2023-10-06T03:23:44.936253+0000","last_became_active":"2023-10-06T03:23:39.916954+0000","last_became_peered":"2023-10-06T03:23:39.916954+0000","last_unstale":"2023-10-06T03:23:44.936253+0000","last_undegraded":"2023-10-06T03:23:44.936253+0000","last_fullsized":"2023-10-06T03:23:44.936253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:05.109047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.944090+0000","last_change":"2023-10-06T03:23:40.671497+0000","last_active":"2023-10-06T03:23:44.944090+0000","last_peered":"2023-10-06T03:23:44.944090+0000","last_clean":"2023-10-06T03:23:44.944090+0000","last_became_active":"2023-10-06T03:23:40.671220+0000","last_became_peered":"2023-10-06T03:23:40.671220+0000","last_unstale":"2023-10-06T03:23:44.944090+0000","last_undegraded":"2023-10-06T03:23:44.944090+0000","last_fullsized":"2023-10-06T03:23:44.944090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:13:40.316715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.953035+0000","last_change":"2023-10-06T03:23:44.950490+0000","last_active":"2023-10-06T03:23:44.953035+0000","last_peered":"2023-10-06T03:23:44.953035+0000","last_clean":"2023-10-06T03:23:44.953035+0000","last_became_active":"2023-10-06T03:23:44.949773+0000","last_became_peered":"2023-10-06T03:23:44.949773+0000","last_unstale":"2023-10-06T03:23:44.953035+0000","last_undegraded":"2023-10-06T03:23:44.953035+0000","last_fullsized":"2023-10-06T03:23:44.953035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:27:46.202488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.934555+0000","last_change":"2023-10-06T03:23:39.927421+0000","last_active":"2023-10-06T03:23:44.934555+0000","last_peered":"2023-10-06T03:23:44.934555+0000","last_clean":"2023-10-06T03:23:44.934555+0000","last_became_active":"2023-10-06T03:23:39.927038+0000","last_became_peered":"2023-10-06T03:23:39.927038+0000","last_unstale":"2023-10-06T03:23:44.934555+0000","last_undegraded":"2023-10-06T03:23:44.934555+0000","last_fullsized":"2023-10-06T03:23:44.934555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:41.245899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.947302+0000","last_change":"2023-10-06T03:23:40.668861+0000","last_active":"2023-10-06T03:23:44.947302+0000","last_peered":"2023-10-06T03:23:44.947302+0000","last_clean":"2023-10-06T03:23:44.947302+0000","last_became_active":"2023-10-06T03:23:40.668596+0000","last_became_peered":"2023-10-06T03:23:40.668596+0000","last_unstale":"2023-10-06T03:23:44.947302+0000","last_undegraded":"2023-10-06T03:23:44.947302+0000","last_fullsized":"2023-10-06T03:23:44.947302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:51:39.105798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.959600+0000","last_change":"2023-10-06T03:23:44.956193+0000","last_active":"2023-10-06T03:23:44.959600+0000","last_peered":"2023-10-06T03:23:44.959600+0000","last_clean":"2023-10-06T03:23:44.959600+0000","last_became_active":"2023-10-06T03:23:44.955814+0000","last_became_peered":"2023-10-06T03:23:44.955814+0000","last_unstale":"2023-10-06T03:23:44.959600+0000","last_undegraded":"2023-10-06T03:23:44.959600+0000","last_fullsized":"2023-10-06T03:23:44.959600+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:22.863565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.930753+0000","last_change":"2023-10-06T03:23:39.927251+0000","last_active":"2023-10-06T03:23:44.930753+0000","last_peered":"2023-10-06T03:23:44.930753+0000","last_clean":"2023-10-06T03:23:44.930753+0000","last_became_active":"2023-10-06T03:23:39.926999+0000","last_became_peered":"2023-10-06T03:23:39.926999+0000","last_unstale":"2023-10-06T03:23:44.930753+0000","last_undegraded":"2023-10-06T03:23:44.930753+0000","last_fullsized":"2023-10-06T03:23:44.930753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:10:12.819926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937381+0000","last_change":"2023-10-06T03:23:40.666463+0000","last_active":"2023-10-06T03:23:44.937381+0000","last_peered":"2023-10-06T03:23:44.937381+0000","last_clean":"2023-10-06T03:23:44.937381+0000","last_became_active":"2023-10-06T03:23:40.666227+0000","last_became_peered":"2023-10-06T03:23:40.666227+0000","last_unstale":"2023-10-06T03:23:44.937381+0000","last_undegraded":"2023-10-06T03:23:44.937381+0000","last_fullsized":"2023-10-06T03:23:44.937381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:51:39.105798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.962121+0000","last_change":"2023-10-06T03:23:44.955034+0000","last_active":"2023-10-06T03:23:44.962121+0000","last_peered":"2023-10-06T03:23:44.962121+0000","last_clean":"2023-10-06T03:23:44.962121+0000","last_became_active":"2023-10-06T03:23:44.954644+0000","last_became_peered":"2023-10-06T03:23:44.954644+0000","last_unstale":"2023-10-06T03:23:44.962121+0000","last_undegraded":"2023-10-06T03:23:44.962121+0000","last_fullsized":"2023-10-06T03:23:44.962121+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:48:22.544086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.944177+0000","last_change":"2023-10-06T03:23:39.924561+0000","last_active":"2023-10-06T03:23:44.944177+0000","last_peered":"2023-10-06T03:23:44.944177+0000","last_clean":"2023-10-06T03:23:44.944177+0000","last_became_active":"2023-10-06T03:23:39.924258+0000","last_became_peered":"2023-10-06T03:23:39.924258+0000","last_unstale":"2023-10-06T03:23:44.944177+0000","last_undegraded":"2023-10-06T03:23:44.944177+0000","last_fullsized":"2023-10-06T03:23:44.944177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:25:21.422926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937352+0000","last_change":"2023-10-06T03:23:40.664384+0000","last_active":"2023-10-06T03:23:44.937352+0000","last_peered":"2023-10-06T03:23:44.937352+0000","last_clean":"2023-10-06T03:23:44.937352+0000","last_became_active":"2023-10-06T03:23:40.664072+0000","last_became_peered":"2023-10-06T03:23:40.664072+0000","last_unstale":"2023-10-06T03:23:44.937352+0000","last_undegraded":"2023-10-06T03:23:44.937352+0000","last_fullsized":"2023-10-06T03:23:44.937352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:00.382000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.962692+0000","last_change":"2023-10-06T03:23:44.956737+0000","last_active":"2023-10-06T03:23:44.962692+0000","last_peered":"2023-10-06T03:23:44.962692+0000","last_clean":"2023-10-06T03:23:44.962692+0000","last_became_active":"2023-10-06T03:23:44.956371+0000","last_became_peered":"2023-10-06T03:23:44.956371+0000","last_unstale":"2023-10-06T03:23:44.962692+0000","last_undegraded":"2023-10-06T03:23:44.962692+0000","last_fullsized":"2023-10-06T03:23:44.962692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:11.304312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936209+0000","last_change":"2023-10-06T03:23:39.918323+0000","last_active":"2023-10-06T03:23:44.936209+0000","last_peered":"2023-10-06T03:23:44.936209+0000","last_clean":"2023-10-06T03:23:44.936209+0000","last_became_active":"2023-10-06T03:23:39.916159+0000","last_became_peered":"2023-10-06T03:23:39.916159+0000","last_unstale":"2023-10-06T03:23:44.936209+0000","last_undegraded":"2023-10-06T03:23:44.936209+0000","last_fullsized":"2023-10-06T03:23:44.936209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:34.959833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937989+0000","last_change":"2023-10-06T03:23:40.663057+0000","last_active":"2023-10-06T03:23:44.937989+0000","last_peered":"2023-10-06T03:23:44.937989+0000","last_clean":"2023-10-06T03:23:44.937989+0000","last_became_active":"2023-10-06T03:23:40.662793+0000","last_became_peered":"2023-10-06T03:23:40.662793+0000","last_unstale":"2023-10-06T03:23:44.937989+0000","last_undegraded":"2023-10-06T03:23:44.937989+0000","last_fullsized":"2023-10-06T03:23:44.937989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:29:24.713990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.954896+0000","last_change":"2023-10-06T03:23:44.951565+0000","last_active":"2023-10-06T03:23:44.954896+0000","last_peered":"2023-10-06T03:23:44.954896+0000","last_clean":"2023-10-06T03:23:44.954896+0000","last_became_active":"2023-10-06T03:23:44.951124+0000","last_became_peered":"2023-10-06T03:23:44.951124+0000","last_unstale":"2023-10-06T03:23:44.954896+0000","last_undegraded":"2023-10-06T03:23:44.954896+0000","last_fullsized":"2023-10-06T03:23:44.954896+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:40:21.613547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.930481+0000","last_change":"2023-10-06T03:23:39.927594+0000","last_active":"2023-10-06T03:23:44.930481+0000","last_peered":"2023-10-06T03:23:44.930481+0000","last_clean":"2023-10-06T03:23:44.930481+0000","last_became_active":"2023-10-06T03:23:39.926962+0000","last_became_peered":"2023-10-06T03:23:39.926962+0000","last_unstale":"2023-10-06T03:23:44.930481+0000","last_undegraded":"2023-10-06T03:23:44.930481+0000","last_fullsized":"2023-10-06T03:23:44.930481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:46:24.911513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.939034+0000","last_change":"2023-10-06T03:23:40.658994+0000","last_active":"2023-10-06T03:23:44.939034+0000","last_peered":"2023-10-06T03:23:44.939034+0000","last_clean":"2023-10-06T03:23:44.939034+0000","last_became_active":"2023-10-06T03:23:40.658600+0000","last_became_peered":"2023-10-06T03:23:40.658600+0000","last_unstale":"2023-10-06T03:23:44.939034+0000","last_undegraded":"2023-10-06T03:23:44.939034+0000","last_fullsized":"2023-10-06T03:23:44.939034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:21.489097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.962887+0000","last_change":"2023-10-06T03:23:44.961313+0000","last_active":"2023-10-06T03:23:44.962887+0000","last_peered":"2023-10-06T03:23:44.962887+0000","last_clean":"2023-10-06T03:23:44.962887+0000","last_became_active":"2023-10-06T03:23:44.960885+0000","last_became_peered":"2023-10-06T03:23:44.960885+0000","last_unstale":"2023-10-06T03:23:44.962887+0000","last_undegraded":"2023-10-06T03:23:44.962887+0000","last_fullsized":"2023-10-06T03:23:44.962887+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:26:37.645345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.931270+0000","last_change":"2023-10-06T03:23:39.926444+0000","last_active":"2023-10-06T03:23:44.931270+0000","last_peered":"2023-10-06T03:23:44.931270+0000","last_clean":"2023-10-06T03:23:44.931270+0000","last_became_active":"2023-10-06T03:23:39.925823+0000","last_became_peered":"2023-10-06T03:23:39.925823+0000","last_unstale":"2023-10-06T03:23:44.931270+0000","last_undegraded":"2023-10-06T03:23:44.931270+0000","last_fullsized":"2023-10-06T03:23:44.931270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:34.959833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937506+0000","last_change":"2023-10-06T03:23:35.397971+0000","last_active":"2023-10-06T03:23:44.937506+0000","last_peered":"2023-10-06T03:23:44.937506+0000","last_clean":"2023-10-06T03:23:44.937506+0000","last_became_active":"2023-10-06T03:23:35.397649+0000","last_became_peered":"2023-10-06T03:23:35.397649+0000","last_unstale":"2023-10-06T03:23:44.937506+0000","last_undegraded":"2023-10-06T03:23:44.937506+0000","last_fullsized":"2023-10-06T03:23:44.937506+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:11.974461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.930368+0000","last_change":"2023-10-06T03:23:40.669097+0000","last_active":"2023-10-06T03:23:44.930368+0000","last_peered":"2023-10-06T03:23:44.930368+0000","last_clean":"2023-10-06T03:23:44.930368+0000","last_became_active":"2023-10-06T03:23:40.668871+0000","last_became_peered":"2023-10-06T03:23:40.668871+0000","last_unstale":"2023-10-06T03:23:44.930368+0000","last_undegraded":"2023-10-06T03:23:44.930368+0000","last_fullsized":"2023-10-06T03:23:44.930368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:49.615169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.959612+0000","last_change":"2023-10-06T03:23:44.951296+0000","last_active":"2023-10-06T03:23:44.959612+0000","last_peered":"2023-10-06T03:23:44.959612+0000","last_clean":"2023-10-06T03:23:44.959612+0000","last_became_active":"2023-10-06T03:23:44.950936+0000","last_became_peered":"2023-10-06T03:23:44.950936+0000","last_unstale":"2023-10-06T03:23:44.959612+0000","last_undegraded":"2023-10-06T03:23:44.959612+0000","last_fullsized":"2023-10-06T03:23:44.959612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:45:45.700670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.930926+0000","last_change":"2023-10-06T03:23:34.866196+0000","last_active":"2023-10-06T03:23:44.930926+0000","last_peered":"2023-10-06T03:23:44.930926+0000","last_clean":"2023-10-06T03:23:44.930926+0000","last_became_active":"2023-10-06T03:23:34.865914+0000","last_became_peered":"2023-10-06T03:23:34.865914+0000","last_unstale":"2023-10-06T03:23:44.930926+0000","last_undegraded":"2023-10-06T03:23:44.930926+0000","last_fullsized":"2023-10-06T03:23:44.930926+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:11.974461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:45.052691+0000","last_change":"2023-10-06T03:23:39.927514+0000","last_active":"2023-10-06T03:23:45.052691+0000","last_peered":"2023-10-06T03:23:45.052691+0000","last_clean":"2023-10-06T03:23:45.052691+0000","last_became_active":"2023-10-06T03:23:39.927274+0000","last_became_peered":"2023-10-06T03:23:39.927274+0000","last_unstale":"2023-10-06T03:23:45.052691+0000","last_undegraded":"2023-10-06T03:23:45.052691+0000","last_fullsized":"2023-10-06T03:23:45.052691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:41.245899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936299+0000","last_change":"2023-10-06T03:23:40.662222+0000","last_active":"2023-10-06T03:23:44.936299+0000","last_peered":"2023-10-06T03:23:44.936299+0000","last_clean":"2023-10-06T03:23:44.936299+0000","last_became_active":"2023-10-06T03:23:40.661970+0000","last_became_peered":"2023-10-06T03:23:40.661970+0000","last_unstale":"2023-10-06T03:23:44.936299+0000","last_undegraded":"2023-10-06T03:23:44.936299+0000","last_fullsized":"2023-10-06T03:23:44.936299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:54:33.855202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.955860+0000","last_change":"2023-10-06T03:23:44.954326+0000","last_active":"2023-10-06T03:23:44.955860+0000","last_peered":"2023-10-06T03:23:44.955860+0000","last_clean":"2023-10-06T03:23:44.955860+0000","last_became_active":"2023-10-06T03:23:44.953952+0000","last_became_peered":"2023-10-06T03:23:44.953952+0000","last_unstale":"2023-10-06T03:23:44.955860+0000","last_undegraded":"2023-10-06T03:23:44.955860+0000","last_fullsized":"2023-10-06T03:23:44.955860+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:38:22.970164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.934805+0000","last_change":"2023-10-06T03:23:34.874380+0000","last_active":"2023-10-06T03:23:44.934805+0000","last_peered":"2023-10-06T03:23:44.934805+0000","last_clean":"2023-10-06T03:23:44.934805+0000","last_became_active":"2023-10-06T03:23:34.873972+0000","last_became_peered":"2023-10-06T03:23:34.873972+0000","last_unstale":"2023-10-06T03:23:44.934805+0000","last_undegraded":"2023-10-06T03:23:44.934805+0000","last_fullsized":"2023-10-06T03:23:44.934805+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:30.204999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":167,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936436+0000","last_change":"2023-10-06T03:23:34.864626+0000","last_active":"2023-10-06T03:23:44.936436+0000","last_peered":"2023-10-06T03:23:44.936436+0000","last_clean":"2023-10-06T03:23:44.936436+0000","last_became_active":"2023-10-06T03:23:34.863539+0000","last_became_peered":"2023-10-06T03:23:34.863539+0000","last_unstale":"2023-10-06T03:23:44.936436+0000","last_undegraded":"2023-10-06T03:23:44.936436+0000","last_fullsized":"2023-10-06T03:23:44.936436+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:11.750836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.944554+0000","last_change":"2023-10-06T03:23:39.930157+0000","last_active":"2023-10-06T03:23:44.944554+0000","last_peered":"2023-10-06T03:23:44.944554+0000","last_clean":"2023-10-06T03:23:44.944554+0000","last_became_active":"2023-10-06T03:23:39.929906+0000","last_became_peered":"2023-10-06T03:23:39.929906+0000","last_unstale":"2023-10-06T03:23:44.944554+0000","last_undegraded":"2023-10-06T03:23:44.944554+0000","last_fullsized":"2023-10-06T03:23:44.944554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:52.557228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.949418+0000","last_change":"2023-10-06T03:23:40.668183+0000","last_active":"2023-10-06T03:23:44.949418+0000","last_peered":"2023-10-06T03:23:44.949418+0000","last_clean":"2023-10-06T03:23:44.949418+0000","last_became_active":"2023-10-06T03:23:40.667934+0000","last_became_peered":"2023-10-06T03:23:40.667934+0000","last_unstale":"2023-10-06T03:23:44.949418+0000","last_undegraded":"2023-10-06T03:23:44.949418+0000","last_fullsized":"2023-10-06T03:23:44.949418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:35.462631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.969737+0000","last_change":"2023-10-06T03:23:44.961492+0000","last_active":"2023-10-06T03:23:44.969737+0000","last_peered":"2023-10-06T03:23:44.969737+0000","last_clean":"2023-10-06T03:23:44.969737+0000","last_became_active":"2023-10-06T03:23:44.961050+0000","last_became_peered":"2023-10-06T03:23:44.961050+0000","last_unstale":"2023-10-06T03:23:44.969737+0000","last_undegraded":"2023-10-06T03:23:44.969737+0000","last_fullsized":"2023-10-06T03:23:44.969737+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:39.492194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.938294+0000","last_change":"2023-10-06T03:23:34.864399+0000","last_active":"2023-10-06T03:23:44.938294+0000","last_peered":"2023-10-06T03:23:44.938294+0000","last_clean":"2023-10-06T03:23:44.938294+0000","last_became_active":"2023-10-06T03:23:34.863991+0000","last_became_peered":"2023-10-06T03:23:34.863991+0000","last_unstale":"2023-10-06T03:23:44.938294+0000","last_undegraded":"2023-10-06T03:23:44.938294+0000","last_fullsized":"2023-10-06T03:23:44.938294+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:56:32.358597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.935729+0000","last_change":"2023-10-06T03:23:39.925094+0000","last_active":"2023-10-06T03:23:44.935729+0000","last_peered":"2023-10-06T03:23:44.935729+0000","last_clean":"2023-10-06T03:23:44.935729+0000","last_became_active":"2023-10-06T03:23:39.923918+0000","last_became_peered":"2023-10-06T03:23:39.923918+0000","last_unstale":"2023-10-06T03:23:44.935729+0000","last_undegraded":"2023-10-06T03:23:44.935729+0000","last_fullsized":"2023-10-06T03:23:44.935729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:25:21.422926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.938945+0000","last_change":"2023-10-06T03:23:40.663620+0000","last_active":"2023-10-06T03:23:44.938945+0000","last_peered":"2023-10-06T03:23:44.938945+0000","last_clean":"2023-10-06T03:23:44.938945+0000","last_became_active":"2023-10-06T03:23:40.663339+0000","last_became_peered":"2023-10-06T03:23:40.663339+0000","last_unstale":"2023-10-06T03:23:44.938945+0000","last_undegraded":"2023-10-06T03:23:44.938945+0000","last_fullsized":"2023-10-06T03:23:44.938945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:51:39.105798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.970567+0000","last_change":"2023-10-06T03:23:44.969165+0000","last_active":"2023-10-06T03:23:44.970567+0000","last_peered":"2023-10-06T03:23:44.970567+0000","last_clean":"2023-10-06T03:23:44.970567+0000","last_became_active":"2023-10-06T03:23:44.966357+0000","last_became_peered":"2023-10-06T03:23:44.966357+0000","last_unstale":"2023-10-06T03:23:44.970567+0000","last_undegraded":"2023-10-06T03:23:44.970567+0000","last_fullsized":"2023-10-06T03:23:44.970567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:56:31.830855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936245+0000","last_change":"2023-10-06T03:23:34.865125+0000","last_active":"2023-10-06T03:23:44.936245+0000","last_peered":"2023-10-06T03:23:44.936245+0000","last_clean":"2023-10-06T03:23:44.936245+0000","last_became_active":"2023-10-06T03:23:34.864752+0000","last_became_peered":"2023-10-06T03:23:34.864752+0000","last_unstale":"2023-10-06T03:23:44.936245+0000","last_undegraded":"2023-10-06T03:23:44.936245+0000","last_fullsized":"2023-10-06T03:23:44.936245+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:00.374963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.930358+0000","last_change":"2023-10-06T03:23:39.922954+0000","last_active":"2023-10-06T03:23:44.930358+0000","last_peered":"2023-10-06T03:23:44.930358+0000","last_clean":"2023-10-06T03:23:44.930358+0000","last_became_active":"2023-10-06T03:23:39.922405+0000","last_became_peered":"2023-10-06T03:23:39.922405+0000","last_unstale":"2023-10-06T03:23:44.930358+0000","last_undegraded":"2023-10-06T03:23:44.930358+0000","last_fullsized":"2023-10-06T03:23:44.930358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:52.557228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.944559+0000","last_change":"2023-10-06T03:23:40.672406+0000","last_active":"2023-10-06T03:23:44.944559+0000","last_peered":"2023-10-06T03:23:44.944559+0000","last_clean":"2023-10-06T03:23:44.944559+0000","last_became_active":"2023-10-06T03:23:40.672113+0000","last_became_peered":"2023-10-06T03:23:40.672113+0000","last_unstale":"2023-10-06T03:23:44.944559+0000","last_undegraded":"2023-10-06T03:23:44.944559+0000","last_fullsized":"2023-10-06T03:23:44.944559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:58.012559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.966608+0000","last_change":"2023-10-06T03:23:44.957635+0000","last_active":"2023-10-06T03:23:44.966608+0000","last_peered":"2023-10-06T03:23:44.966608+0000","last_clean":"2023-10-06T03:23:44.966608+0000","last_became_active":"2023-10-06T03:23:44.957238+0000","last_became_peered":"2023-10-06T03:23:44.957238+0000","last_unstale":"2023-10-06T03:23:44.966608+0000","last_undegraded":"2023-10-06T03:23:44.966608+0000","last_fullsized":"2023-10-06T03:23:44.966608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:53.182371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.934131+0000","last_change":"2023-10-06T03:23:34.864329+0000","last_active":"2023-10-06T03:23:44.934131+0000","last_peered":"2023-10-06T03:23:44.934131+0000","last_clean":"2023-10-06T03:23:44.934131+0000","last_became_active":"2023-10-06T03:23:34.863953+0000","last_became_peered":"2023-10-06T03:23:34.863953+0000","last_unstale":"2023-10-06T03:23:44.934131+0000","last_undegraded":"2023-10-06T03:23:44.934131+0000","last_fullsized":"2023-10-06T03:23:44.934131+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:30.204999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936822+0000","last_change":"2023-10-06T03:23:39.930279+0000","last_active":"2023-10-06T03:23:44.936822+0000","last_peered":"2023-10-06T03:23:44.936822+0000","last_clean":"2023-10-06T03:23:44.936822+0000","last_became_active":"2023-10-06T03:23:39.929992+0000","last_became_peered":"2023-10-06T03:23:39.929992+0000","last_unstale":"2023-10-06T03:23:44.936822+0000","last_undegraded":"2023-10-06T03:23:44.936822+0000","last_fullsized":"2023-10-06T03:23:44.936822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:10:12.819926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936204+0000","last_change":"2023-10-06T03:23:40.662851+0000","last_active":"2023-10-06T03:23:44.936204+0000","last_peered":"2023-10-06T03:23:44.936204+0000","last_clean":"2023-10-06T03:23:44.936204+0000","last_became_active":"2023-10-06T03:23:40.662555+0000","last_became_peered":"2023-10-06T03:23:40.662555+0000","last_unstale":"2023-10-06T03:23:44.936204+0000","last_undegraded":"2023-10-06T03:23:44.936204+0000","last_fullsized":"2023-10-06T03:23:44.936204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:29:10.177304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.958925+0000","last_change":"2023-10-06T03:23:44.955457+0000","last_active":"2023-10-06T03:23:44.958925+0000","last_peered":"2023-10-06T03:23:44.958925+0000","last_clean":"2023-10-06T03:23:44.958925+0000","last_became_active":"2023-10-06T03:23:44.954842+0000","last_became_peered":"2023-10-06T03:23:44.954842+0000","last_unstale":"2023-10-06T03:23:44.958925+0000","last_undegraded":"2023-10-06T03:23:44.958925+0000","last_fullsized":"2023-10-06T03:23:44.958925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:00.478388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.944665+0000","last_change":"2023-10-06T03:23:34.873939+0000","last_active":"2023-10-06T03:23:44.944665+0000","last_peered":"2023-10-06T03:23:44.944665+0000","last_clean":"2023-10-06T03:23:44.944665+0000","last_became_active":"2023-10-06T03:23:34.873623+0000","last_became_peered":"2023-10-06T03:23:34.873623+0000","last_unstale":"2023-10-06T03:23:44.944665+0000","last_undegraded":"2023-10-06T03:23:44.944665+0000","last_fullsized":"2023-10-06T03:23:44.944665+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:30.204999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936368+0000","last_change":"2023-10-06T03:23:39.923260+0000","last_active":"2023-10-06T03:23:44.936368+0000","last_peered":"2023-10-06T03:23:44.936368+0000","last_clean":"2023-10-06T03:23:44.936368+0000","last_became_active":"2023-10-06T03:23:39.922927+0000","last_became_peered":"2023-10-06T03:23:39.922927+0000","last_unstale":"2023-10-06T03:23:44.936368+0000","last_undegraded":"2023-10-06T03:23:44.936368+0000","last_fullsized":"2023-10-06T03:23:44.936368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:34.959833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.947472+0000","last_change":"2023-10-06T03:23:40.669315+0000","last_active":"2023-10-06T03:23:44.947472+0000","last_peered":"2023-10-06T03:23:44.947472+0000","last_clean":"2023-10-06T03:23:44.947472+0000","last_became_active":"2023-10-06T03:23:40.669061+0000","last_became_peered":"2023-10-06T03:23:40.669061+0000","last_unstale":"2023-10-06T03:23:44.947472+0000","last_undegraded":"2023-10-06T03:23:44.947472+0000","last_fullsized":"2023-10-06T03:23:44.947472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:56.483789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.966208+0000","last_change":"2023-10-06T03:23:44.962703+0000","last_active":"2023-10-06T03:23:44.966208+0000","last_peered":"2023-10-06T03:23:44.966208+0000","last_clean":"2023-10-06T03:23:44.966208+0000","last_became_active":"2023-10-06T03:23:44.957582+0000","last_became_peered":"2023-10-06T03:23:44.957582+0000","last_unstale":"2023-10-06T03:23:44.966208+0000","last_undegraded":"2023-10-06T03:23:44.966208+0000","last_fullsized":"2023-10-06T03:23:44.966208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:56:31.830855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.947663+0000","last_change":"2023-10-06T03:23:34.872453+0000","last_active":"2023-10-06T03:23:44.947663+0000","last_peered":"2023-10-06T03:23:44.947663+0000","last_clean":"2023-10-06T03:23:44.947663+0000","last_became_active":"2023-10-06T03:23:34.872139+0000","last_became_peered":"2023-10-06T03:23:34.872139+0000","last_unstale":"2023-10-06T03:23:44.947663+0000","last_undegraded":"2023-10-06T03:23:44.947663+0000","last_fullsized":"2023-10-06T03:23:44.947663+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:25:46.214290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.938700+0000","last_change":"2023-10-06T03:23:39.927321+0000","last_active":"2023-10-06T03:23:44.938700+0000","last_peered":"2023-10-06T03:23:44.938700+0000","last_clean":"2023-10-06T03:23:44.938700+0000","last_became_active":"2023-10-06T03:23:39.927057+0000","last_became_peered":"2023-10-06T03:23:39.927057+0000","last_unstale":"2023-10-06T03:23:44.938700+0000","last_undegraded":"2023-10-06T03:23:44.938700+0000","last_fullsized":"2023-10-06T03:23:44.938700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:52.557228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937835+0000","last_change":"2023-10-06T03:23:40.662143+0000","last_active":"2023-10-06T03:23:44.937835+0000","last_peered":"2023-10-06T03:23:44.937835+0000","last_clean":"2023-10-06T03:23:44.937835+0000","last_became_active":"2023-10-06T03:23:40.661885+0000","last_became_peered":"2023-10-06T03:23:40.661885+0000","last_unstale":"2023-10-06T03:23:44.937835+0000","last_undegraded":"2023-10-06T03:23:44.937835+0000","last_fullsized":"2023-10-06T03:23:44.937835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:04:49.664462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.954580+0000","last_change":"2023-10-06T03:23:44.952490+0000","last_active":"2023-10-06T03:23:44.954580+0000","last_peered":"2023-10-06T03:23:44.954580+0000","last_clean":"2023-10-06T03:23:44.954580+0000","last_became_active":"2023-10-06T03:23:44.951755+0000","last_became_peered":"2023-10-06T03:23:44.951755+0000","last_unstale":"2023-10-06T03:23:44.954580+0000","last_undegraded":"2023-10-06T03:23:44.954580+0000","last_fullsized":"2023-10-06T03:23:44.954580+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:37:11.632106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.947387+0000","last_change":"2023-10-06T03:23:39.927188+0000","last_active":"2023-10-06T03:23:44.947387+0000","last_peered":"2023-10-06T03:23:44.947387+0000","last_clean":"2023-10-06T03:23:44.947387+0000","last_became_active":"2023-10-06T03:23:39.926830+0000","last_became_peered":"2023-10-06T03:23:39.926830+0000","last_unstale":"2023-10-06T03:23:44.947387+0000","last_undegraded":"2023-10-06T03:23:44.947387+0000","last_fullsized":"2023-10-06T03:23:44.947387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:36.047828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.934779+0000","last_change":"2023-10-06T03:23:40.671601+0000","last_active":"2023-10-06T03:23:44.934779+0000","last_peered":"2023-10-06T03:23:44.934779+0000","last_clean":"2023-10-06T03:23:44.934779+0000","last_became_active":"2023-10-06T03:23:40.671312+0000","last_became_peered":"2023-10-06T03:23:40.671312+0000","last_unstale":"2023-10-06T03:23:44.934779+0000","last_undegraded":"2023-10-06T03:23:44.934779+0000","last_fullsized":"2023-10-06T03:23:44.934779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:42.254676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.966019+0000","last_change":"2023-10-06T03:23:44.964087+0000","last_active":"2023-10-06T03:23:44.966019+0000","last_peered":"2023-10-06T03:23:44.966019+0000","last_clean":"2023-10-06T03:23:44.966019+0000","last_became_active":"2023-10-06T03:23:44.963323+0000","last_became_peered":"2023-10-06T03:23:44.963323+0000","last_unstale":"2023-10-06T03:23:44.966019+0000","last_undegraded":"2023-10-06T03:23:44.966019+0000","last_fullsized":"2023-10-06T03:23:44.966019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:37:11.632106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.934389+0000","last_change":"2023-10-06T03:23:39.921245+0000","last_active":"2023-10-06T03:23:44.934389+0000","last_peered":"2023-10-06T03:23:44.934389+0000","last_clean":"2023-10-06T03:23:44.934389+0000","last_became_active":"2023-10-06T03:23:39.920740+0000","last_became_peered":"2023-10-06T03:23:39.920740+0000","last_unstale":"2023-10-06T03:23:44.934389+0000","last_undegraded":"2023-10-06T03:23:44.934389+0000","last_fullsized":"2023-10-06T03:23:44.934389+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:46:24.911513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936975+0000","last_change":"2023-10-06T03:23:40.665175+0000","last_active":"2023-10-06T03:23:44.936975+0000","last_peered":"2023-10-06T03:23:44.936975+0000","last_clean":"2023-10-06T03:23:44.936975+0000","last_became_active":"2023-10-06T03:23:40.664926+0000","last_became_peered":"2023-10-06T03:23:40.664926+0000","last_unstale":"2023-10-06T03:23:44.936975+0000","last_undegraded":"2023-10-06T03:23:44.936975+0000","last_fullsized":"2023-10-06T03:23:44.936975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:21.489097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.964364+0000","last_change":"2023-10-06T03:23:44.958192+0000","last_active":"2023-10-06T03:23:44.964364+0000","last_peered":"2023-10-06T03:23:44.964364+0000","last_clean":"2023-10-06T03:23:44.964364+0000","last_became_active":"2023-10-06T03:23:44.957757+0000","last_became_peered":"2023-10-06T03:23:44.957757+0000","last_unstale":"2023-10-06T03:23:44.964364+0000","last_undegraded":"2023-10-06T03:23:44.964364+0000","last_fullsized":"2023-10-06T03:23:44.964364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:32.743988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.938605+0000","last_change":"2023-10-06T03:23:39.923600+0000","last_active":"2023-10-06T03:23:44.938605+0000","last_peered":"2023-10-06T03:23:44.938605+0000","last_clean":"2023-10-06T03:23:44.938605+0000","last_became_active":"2023-10-06T03:23:39.923304+0000","last_became_peered":"2023-10-06T03:23:39.923304+0000","last_unstale":"2023-10-06T03:23:44.938605+0000","last_undegraded":"2023-10-06T03:23:44.938605+0000","last_fullsized":"2023-10-06T03:23:44.938605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:34.959833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936185+0000","last_change":"2023-10-06T03:23:40.665909+0000","last_active":"2023-10-06T03:23:44.936185+0000","last_peered":"2023-10-06T03:23:44.936185+0000","last_clean":"2023-10-06T03:23:44.936185+0000","last_became_active":"2023-10-06T03:23:40.665618+0000","last_became_peered":"2023-10-06T03:23:40.665618+0000","last_unstale":"2023-10-06T03:23:44.936185+0000","last_undegraded":"2023-10-06T03:23:44.936185+0000","last_fullsized":"2023-10-06T03:23:44.936185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:15.293618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.964221+0000","last_change":"2023-10-06T03:23:44.962232+0000","last_active":"2023-10-06T03:23:44.964221+0000","last_peered":"2023-10-06T03:23:44.964221+0000","last_clean":"2023-10-06T03:23:44.964221+0000","last_became_active":"2023-10-06T03:23:44.961871+0000","last_became_peered":"2023-10-06T03:23:44.961871+0000","last_unstale":"2023-10-06T03:23:44.964221+0000","last_undegraded":"2023-10-06T03:23:44.964221+0000","last_fullsized":"2023-10-06T03:23:44.964221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:17.153983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.931188+0000","last_change":"2023-10-06T03:23:39.922068+0000","last_active":"2023-10-06T03:23:44.931188+0000","last_peered":"2023-10-06T03:23:44.931188+0000","last_clean":"2023-10-06T03:23:44.931188+0000","last_became_active":"2023-10-06T03:23:39.921763+0000","last_became_peered":"2023-10-06T03:23:39.921763+0000","last_unstale":"2023-10-06T03:23:44.931188+0000","last_undegraded":"2023-10-06T03:23:44.931188+0000","last_fullsized":"2023-10-06T03:23:44.931188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:36.047828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.930511+0000","last_change":"2023-10-06T03:23:40.664327+0000","last_active":"2023-10-06T03:23:44.930511+0000","last_peered":"2023-10-06T03:23:44.930511+0000","last_clean":"2023-10-06T03:23:44.930511+0000","last_became_active":"2023-10-06T03:23:40.664073+0000","last_became_peered":"2023-10-06T03:23:40.664073+0000","last_unstale":"2023-10-06T03:23:44.930511+0000","last_undegraded":"2023-10-06T03:23:44.930511+0000","last_fullsized":"2023-10-06T03:23:44.930511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:36:33.973063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.962224+0000","last_change":"2023-10-06T03:23:44.956207+0000","last_active":"2023-10-06T03:23:44.962224+0000","last_peered":"2023-10-06T03:23:44.962224+0000","last_clean":"2023-10-06T03:23:44.962224+0000","last_became_active":"2023-10-06T03:23:44.955806+0000","last_became_peered":"2023-10-06T03:23:44.955806+0000","last_unstale":"2023-10-06T03:23:44.962224+0000","last_undegraded":"2023-10-06T03:23:44.962224+0000","last_fullsized":"2023-10-06T03:23:44.962224+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:26.358389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.947996+0000","last_change":"2023-10-06T03:23:39.923144+0000","last_active":"2023-10-06T03:23:44.947996+0000","last_peered":"2023-10-06T03:23:44.947996+0000","last_clean":"2023-10-06T03:23:44.947996+0000","last_became_active":"2023-10-06T03:23:39.922061+0000","last_became_peered":"2023-10-06T03:23:39.922061+0000","last_unstale":"2023-10-06T03:23:44.947996+0000","last_undegraded":"2023-10-06T03:23:44.947996+0000","last_fullsized":"2023-10-06T03:23:44.947996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:46:24.911513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937147+0000","last_change":"2023-10-06T03:23:40.676711+0000","last_active":"2023-10-06T03:23:44.937147+0000","last_peered":"2023-10-06T03:23:44.937147+0000","last_clean":"2023-10-06T03:23:44.937147+0000","last_became_active":"2023-10-06T03:23:40.671550+0000","last_became_peered":"2023-10-06T03:23:40.671550+0000","last_unstale":"2023-10-06T03:23:44.937147+0000","last_undegraded":"2023-10-06T03:23:44.937147+0000","last_fullsized":"2023-10-06T03:23:44.937147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:27:42.172925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.944242+0000","last_change":"2023-10-06T03:23:40.661484+0000","last_active":"2023-10-06T03:23:44.944242+0000","last_peered":"2023-10-06T03:23:44.944242+0000","last_clean":"2023-10-06T03:23:44.944242+0000","last_became_active":"2023-10-06T03:23:40.661161+0000","last_became_peered":"2023-10-06T03:23:40.661161+0000","last_unstale":"2023-10-06T03:23:44.944242+0000","last_undegraded":"2023-10-06T03:23:44.944242+0000","last_fullsized":"2023-10-06T03:23:44.944242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:22.437514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.930421+0000","last_change":"2023-10-06T03:23:40.667283+0000","last_active":"2023-10-06T03:23:44.930421+0000","last_peered":"2023-10-06T03:23:44.930421+0000","last_clean":"2023-10-06T03:23:44.930421+0000","last_became_active":"2023-10-06T03:23:40.667036+0000","last_became_peered":"2023-10-06T03:23:40.667036+0000","last_unstale":"2023-10-06T03:23:44.930421+0000","last_undegraded":"2023-10-06T03:23:44.930421+0000","last_fullsized":"2023-10-06T03:23:44.930421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:54:33.855202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936441+0000","last_change":"2023-10-06T03:23:40.672592+0000","last_active":"2023-10-06T03:23:44.936441+0000","last_peered":"2023-10-06T03:23:44.936441+0000","last_clean":"2023-10-06T03:23:44.936441+0000","last_became_active":"2023-10-06T03:23:40.668259+0000","last_became_peered":"2023-10-06T03:23:40.668259+0000","last_unstale":"2023-10-06T03:23:44.936441+0000","last_undegraded":"2023-10-06T03:23:44.936441+0000","last_fullsized":"2023-10-06T03:23:44.936441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:42:53.927175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.930385+0000","last_change":"2023-10-06T03:23:40.668141+0000","last_active":"2023-10-06T03:23:44.930385+0000","last_peered":"2023-10-06T03:23:44.930385+0000","last_clean":"2023-10-06T03:23:44.930385+0000","last_became_active":"2023-10-06T03:23:40.667709+0000","last_became_peered":"2023-10-06T03:23:40.667709+0000","last_unstale":"2023-10-06T03:23:44.930385+0000","last_undegraded":"2023-10-06T03:23:44.930385+0000","last_fullsized":"2023-10-06T03:23:44.930385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:43:56.448825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936286+0000","last_change":"2023-10-06T03:23:40.662860+0000","last_active":"2023-10-06T03:23:44.936286+0000","last_peered":"2023-10-06T03:23:44.936286+0000","last_clean":"2023-10-06T03:23:44.936286+0000","last_became_active":"2023-10-06T03:23:40.662635+0000","last_became_peered":"2023-10-06T03:23:40.662635+0000","last_unstale":"2023-10-06T03:23:44.936286+0000","last_undegraded":"2023-10-06T03:23:44.936286+0000","last_fullsized":"2023-10-06T03:23:44.936286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:58.012559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4484,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298144,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073696,"statfs":{"total":96636764160,"available":96331464704,"internally_reserved":0,"allocated":876544,"data_stored":698736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297532,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074308,"statfs":{"total":96636764160,"available":96332091392,"internally_reserved":0,"allocated":249856,"data_stored":103085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298116,"kb_used_data":828,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073724,"statfs":{"total":96636764160,"available":96331493376,"internally_reserved":0,"allocated":847872,"data_stored":694806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297540,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074300,"statfs":{"total":96636764160,"available":96332083200,"internally_reserved":0,"allocated":258048,"data_stored":104992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":253952,"data_stored":104438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297540,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074300,"statfs":{"total":96636764160,"available":96332083200,"internally_reserved":0,"allocated":258048,"data_stored":104528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297556,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074284,"statfs":{"total":96636764160,"available":96332066816,"internally_reserved":0,"allocated":274432,"data_stored":108208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297544,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074296,"statfs":{"total":96636764160,"available":96332079104,"internally_reserved":0,"allocated":262144,"data_stored":105062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:24:03.421 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:24:03.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.632+0000 7faecdf9d700 1 Processor -- start 2023-10-06T03:24:03.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.632+0000 7faecdf9d700 1 -- start start 2023-10-06T03:24:03.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.633+0000 7faecdf9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faec8156220 0x7faec80ab7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:03.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.633+0000 7faecdf9d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7faec80a6730 0x7faec806e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:03.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.633+0000 7faecdf9d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faec806ed80 con 0x7faec806e920 2023-10-06T03:24:03.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.633+0000 7faecdf9d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faec80b0390 con 0x7faec8156220 2023-10-06T03:24:03.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.633+0000 7faecdf9d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faec80b0910 con 0x7faec80a6730 2023-10-06T03:24:03.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.634+0000 7faeccf9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faec8156220 0x7faec80ab7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:03.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.634+0000 7faeccf9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faec8156220 0x7faec80ab7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56436/0 (socket says 172.21.15.81:56436) 2023-10-06T03:24:03.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.634+0000 7faeccf9b700 1 -- 172.21.15.81:0/2009849036 learned_addr learned my addr 172.21.15.81:0/2009849036 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:03.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.634+0000 7faec7fff700 1 --2- 172.21.15.81:0/2009849036 >> v2:172.21.15.83:3300/0 conn(0x7faec80a6730 0x7faec806e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:03.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.634+0000 7faeccf9b700 1 -- 172.21.15.81:0/2009849036 >> v2:172.21.15.83:3300/0 conn(0x7faec80a6730 msgr2=0x7faec806e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:03.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.634+0000 7faeccf9b700 1 --2- 172.21.15.81:0/2009849036 >> v2:172.21.15.83:3300/0 conn(0x7faec80a6730 0x7faec806e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:03.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.634+0000 7faeccf9b700 1 -- 172.21.15.81:0/2009849036 >> v1:172.21.15.83:6789/0 conn(0x7faec806e920 legacy=0x7faec81565f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:03.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.634+0000 7faeccf9b700 1 -- 172.21.15.81:0/2009849036 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec8157800 con 0x7faec8156220 2023-10-06T03:24:03.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.634+0000 7faeccf9b700 1 --2- 172.21.15.81:0/2009849036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faec8156220 0x7faec80ab7b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7faec806b720 tx=0x7faebc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f27e1cd4a138ddcc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:03.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.634+0000 7faec77fe700 1 -- 172.21.15.81:0/2009849036 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faebc00b860 con 0x7faec8156220 2023-10-06T03:24:03.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.634+0000 7faec77fe700 1 -- 172.21.15.81:0/2009849036 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faebc00b9c0 con 0x7faec8156220 2023-10-06T03:24:03.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.635+0000 7faec77fe700 1 -- 172.21.15.81:0/2009849036 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faebc00bd60 con 0x7faec8156220 2023-10-06T03:24:03.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.635+0000 7faecdf9d700 1 -- 172.21.15.81:0/2009849036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faec8156220 msgr2=0x7faec80ab7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:03.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.635+0000 7faecdf9d700 1 --2- 172.21.15.81:0/2009849036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faec8156220 0x7faec80ab7b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7faec806b720 tx=0x7faebc009250 comp rx=0 tx=0).stop 2023-10-06T03:24:03.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.635+0000 7faecdf9d700 1 -- 172.21.15.81:0/2009849036 shutdown_connections 2023-10-06T03:24:03.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.635+0000 7faecdf9d700 1 --2- 172.21.15.81:0/2009849036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faec8156220 0x7faec80ab7b0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:03.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.635+0000 7faecdf9d700 1 --2- 172.21.15.81:0/2009849036 >> v2:172.21.15.83:3300/0 conn(0x7faec80a6730 0x7faec806e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:03.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.635+0000 7faecdf9d700 1 -- 172.21.15.81:0/2009849036 >> 172.21.15.81:0/2009849036 conn(0x7faec80cbef0 msgr2=0x7faec80cc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:03.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.635+0000 7faecdf9d700 1 -- 172.21.15.81:0/2009849036 shutdown_connections 2023-10-06T03:24:03.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.635+0000 7faecdf9d700 1 -- 172.21.15.81:0/2009849036 wait complete. 2023-10-06T03:24:03.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.637+0000 7faecdf9d700 1 Processor -- start 2023-10-06T03:24:03.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.637+0000 7faecdf9d700 1 -- start start 2023-10-06T03:24:03.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.638+0000 7faecdf9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faec806e920 0x7faec80abd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:03.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.638+0000 7faecdf9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faec80a6730 0x7faec80aa7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:03.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.638+0000 7faecdf9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faec8156220 0x7faec814f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:03.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.638+0000 7faecdf9d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec80aace0 con 0x7faec806e920 2023-10-06T03:24:03.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.638+0000 7faecdf9d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec80ac410 con 0x7faec80a6730 2023-10-06T03:24:03.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.638+0000 7faecdf9d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec80ac6f0 con 0x7faec8156220 2023-10-06T03:24:03.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.638+0000 7faeccf9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faec806e920 0x7faec80abd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:03.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.638+0000 7faeccf9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faec806e920 0x7faec80abd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56446/0 (socket says 172.21.15.81:56446) 2023-10-06T03:24:03.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.638+0000 7faeccf9b700 1 -- 172.21.15.81:0/3933508061 learned_addr learned my addr 172.21.15.81:0/3933508061 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:03.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.638+0000 7faec7fff700 1 --2- 172.21.15.81:0/3933508061 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faec80a6730 0x7faec80aa7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:03.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.638+0000 7faecd79c700 1 --2- 172.21.15.81:0/3933508061 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faec8156220 0x7faec814f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:03.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.638+0000 7faeccf9b700 1 -- 172.21.15.81:0/3933508061 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faec8156220 msgr2=0x7faec814f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:03.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.638+0000 7faeccf9b700 1 --2- 172.21.15.81:0/3933508061 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faec8156220 0x7faec814f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:03.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.638+0000 7faeccf9b700 1 -- 172.21.15.81:0/3933508061 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faec80a6730 msgr2=0x7faec80aa7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:03.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.638+0000 7faeccf9b700 1 --2- 172.21.15.81:0/3933508061 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faec80a6730 0x7faec80aa7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:03.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.638+0000 7faeccf9b700 1 -- 172.21.15.81:0/3933508061 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faebc0094f0 con 0x7faec806e920 2023-10-06T03:24:03.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.639+0000 7faeccf9b700 1 --2- 172.21.15.81:0/3933508061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faec806e920 0x7faec80abd80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7faec806c600 tx=0x7faebc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:03.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.639+0000 7faec4ff9700 1 -- 172.21.15.81:0/3933508061 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faebc024440 con 0x7faec806e920 2023-10-06T03:24:03.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.639+0000 7faec4ff9700 1 -- 172.21.15.81:0/3933508061 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faebc0245a0 con 0x7faec806e920 2023-10-06T03:24:03.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.639+0000 7faecdf9d700 1 -- 172.21.15.81:0/3933508061 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faec80ac9d0 con 0x7faec806e920 2023-10-06T03:24:03.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.639+0000 7faec4ff9700 1 -- 172.21.15.81:0/3933508061 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faebc024960 con 0x7faec806e920 2023-10-06T03:24:03.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.639+0000 7faecdf9d700 1 -- 172.21.15.81:0/3933508061 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faec80acf90 con 0x7faec806e920 2023-10-06T03:24:03.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.640+0000 7faecdf9d700 1 -- 172.21.15.81:0/3933508061 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faec80ad1b0 con 0x7faec806e920 2023-10-06T03:24:03.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.641+0000 7faec4ff9700 1 -- 172.21.15.81:0/3933508061 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faebc01a420 con 0x7faec806e920 2023-10-06T03:24:03.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.642+0000 7faec4ff9700 1 --2- 172.21.15.81:0/3933508061 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7faeac066f30 0x7faeac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:03.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.642+0000 7faec4ff9700 1 -- 172.21.15.81:0/3933508061 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7faebc0867f0 con 0x7faec806e920 2023-10-06T03:24:03.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.642+0000 7faec7fff700 1 --2- 172.21.15.81:0/3933508061 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7faeac066f30 0x7faeac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:03.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.643+0000 7faec7fff700 1 --2- 172.21.15.81:0/3933508061 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7faeac066f30 0x7faeac0693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7faeb4006fd0 tx=0x7faeb4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:03.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.646+0000 7faec4ff9700 1 -- 172.21.15.81:0/3933508061 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faebc053570 con 0x7faec806e920 2023-10-06T03:24:03.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.834+0000 7faecdf9d700 1 -- 172.21.15.81:0/3933508061 --> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faec8157240 con 0x7faeac066f30 2023-10-06T03:24:03.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.844+0000 7faec4ff9700 1 -- 172.21.15.81:0/3933508061 <== mgr.4100 v2:172.21.15.81:6832/85286 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367537 (secure 0 0 0) 0x7faec8157240 con 0x7faeac066f30 2023-10-06T03:24:03.851 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:24:03.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.849+0000 7faecdf9d700 1 -- 172.21.15.81:0/3933508061 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7faeac066f30 msgr2=0x7faeac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:03.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.849+0000 7faecdf9d700 1 --2- 172.21.15.81:0/3933508061 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7faeac066f30 0x7faeac0693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7faeb4006fd0 tx=0x7faeb4008040 comp rx=0 tx=0).stop 2023-10-06T03:24:03.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.849+0000 7faecdf9d700 1 -- 172.21.15.81:0/3933508061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faec806e920 msgr2=0x7faec80abd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:03.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.849+0000 7faecdf9d700 1 --2- 172.21.15.81:0/3933508061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faec806e920 0x7faec80abd80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7faec806c600 tx=0x7faebc017000 comp rx=0 tx=0).stop 2023-10-06T03:24:03.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.849+0000 7faecdf9d700 1 -- 172.21.15.81:0/3933508061 shutdown_connections 2023-10-06T03:24:03.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.849+0000 7faecdf9d700 1 --2- 172.21.15.81:0/3933508061 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7faeac066f30 0x7faeac0693e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:03.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.849+0000 7faecdf9d700 1 --2- 172.21.15.81:0/3933508061 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faec8156220 0x7faec814f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:03.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.849+0000 7faecdf9d700 1 --2- 172.21.15.81:0/3933508061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faec806e920 0x7faec80abd80 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:03.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.849+0000 7faecdf9d700 1 --2- 172.21.15.81:0/3933508061 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faec80a6730 0x7faec80aa7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:03.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.849+0000 7faecdf9d700 1 -- 172.21.15.81:0/3933508061 >> 172.21.15.81:0/3933508061 conn(0x7faec80cbef0 msgr2=0x7faec80adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:03.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.849+0000 7faecdf9d700 1 -- 172.21.15.81:0/3933508061 shutdown_connections 2023-10-06T03:24:03.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:03.849+0000 7faecdf9d700 1 -- 172.21.15.81:0/3933508061 wait complete. 2023-10-06T03:24:03.855 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-06T03:24:03.868 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2023-10-06T03:24:03.558945+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594852,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381508,"kb_used_data":3204,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593212,"statfs":{"total":773094113280,"available":770655449088,"internally_reserved":0,"allocated":3280896,"data_stored":2023855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2178,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002775"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.934944+0000","last_change":"2023-10-06T03:23:40.657927+0000","last_active":"2023-10-06T03:23:44.934944+0000","last_peered":"2023-10-06T03:23:44.934944+0000","last_clean":"2023-10-06T03:23:44.934944+0000","last_became_active":"2023-10-06T03:23:40.657628+0000","last_became_peered":"2023-10-06T03:23:40.657628+0000","last_unstale":"2023-10-06T03:23:44.934944+0000","last_undegraded":"2023-10-06T03:23:44.934944+0000","last_fullsized":"2023-10-06T03:23:44.934944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:53.566006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936939+0000","last_change":"2023-10-06T03:23:40.669392+0000","last_active":"2023-10-06T03:23:44.936939+0000","last_peered":"2023-10-06T03:23:44.936939+0000","last_clean":"2023-10-06T03:23:44.936939+0000","last_became_active":"2023-10-06T03:23:40.669068+0000","last_became_peered":"2023-10-06T03:23:40.669068+0000","last_unstale":"2023-10-06T03:23:44.936939+0000","last_undegraded":"2023-10-06T03:23:44.936939+0000","last_fullsized":"2023-10-06T03:23:44.936939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:15.293618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937675+0000","last_change":"2023-10-06T03:23:40.672182+0000","last_active":"2023-10-06T03:23:44.937675+0000","last_peered":"2023-10-06T03:23:44.937675+0000","last_clean":"2023-10-06T03:23:44.937675+0000","last_became_active":"2023-10-06T03:23:40.671082+0000","last_became_peered":"2023-10-06T03:23:40.671082+0000","last_unstale":"2023-10-06T03:23:44.937675+0000","last_undegraded":"2023-10-06T03:23:44.937675+0000","last_fullsized":"2023-10-06T03:23:44.937675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:37:07.602543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.944602+0000","last_change":"2023-10-06T03:23:40.669872+0000","last_active":"2023-10-06T03:23:44.944602+0000","last_peered":"2023-10-06T03:23:44.944602+0000","last_clean":"2023-10-06T03:23:44.944602+0000","last_became_active":"2023-10-06T03:23:40.669607+0000","last_became_peered":"2023-10-06T03:23:40.669607+0000","last_unstale":"2023-10-06T03:23:44.944602+0000","last_undegraded":"2023-10-06T03:23:44.944602+0000","last_fullsized":"2023-10-06T03:23:44.944602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:45.363103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.947565+0000","last_change":"2023-10-06T03:23:40.673713+0000","last_active":"2023-10-06T03:23:44.947565+0000","last_peered":"2023-10-06T03:23:44.947565+0000","last_clean":"2023-10-06T03:23:44.947565+0000","last_became_active":"2023-10-06T03:23:40.673350+0000","last_became_peered":"2023-10-06T03:23:40.673350+0000","last_unstale":"2023-10-06T03:23:44.947565+0000","last_undegraded":"2023-10-06T03:23:44.947565+0000","last_fullsized":"2023-10-06T03:23:44.947565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:54:33.855202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936531+0000","last_change":"2023-10-06T03:23:40.672923+0000","last_active":"2023-10-06T03:23:44.936531+0000","last_peered":"2023-10-06T03:23:44.936531+0000","last_clean":"2023-10-06T03:23:44.936531+0000","last_became_active":"2023-10-06T03:23:40.672651+0000","last_became_peered":"2023-10-06T03:23:40.672651+0000","last_unstale":"2023-10-06T03:23:44.936531+0000","last_undegraded":"2023-10-06T03:23:44.936531+0000","last_fullsized":"2023-10-06T03:23:44.936531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:30:38.801700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937090+0000","last_change":"2023-10-06T03:23:40.670079+0000","last_active":"2023-10-06T03:23:44.937090+0000","last_peered":"2023-10-06T03:23:44.937090+0000","last_clean":"2023-10-06T03:23:44.937090+0000","last_became_active":"2023-10-06T03:23:40.669460+0000","last_became_peered":"2023-10-06T03:23:40.669460+0000","last_unstale":"2023-10-06T03:23:44.937090+0000","last_undegraded":"2023-10-06T03:23:44.937090+0000","last_fullsized":"2023-10-06T03:23:44.937090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:21.489097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.934267+0000","last_change":"2023-10-06T03:23:40.670214+0000","last_active":"2023-10-06T03:23:44.934267+0000","last_peered":"2023-10-06T03:23:44.934267+0000","last_clean":"2023-10-06T03:23:44.934267+0000","last_became_active":"2023-10-06T03:23:40.669794+0000","last_became_peered":"2023-10-06T03:23:40.669794+0000","last_unstale":"2023-10-06T03:23:44.934267+0000","last_undegraded":"2023-10-06T03:23:44.934267+0000","last_fullsized":"2023-10-06T03:23:44.934267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:51:39.105798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.947704+0000","last_change":"2023-10-06T03:23:40.673814+0000","last_active":"2023-10-06T03:23:44.947704+0000","last_peered":"2023-10-06T03:23:44.947704+0000","last_clean":"2023-10-06T03:23:44.947704+0000","last_became_active":"2023-10-06T03:23:40.673518+0000","last_became_peered":"2023-10-06T03:23:40.673518+0000","last_unstale":"2023-10-06T03:23:44.947704+0000","last_undegraded":"2023-10-06T03:23:44.947704+0000","last_fullsized":"2023-10-06T03:23:44.947704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:36:33.973063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937252+0000","last_change":"2023-10-06T03:23:40.674286+0000","last_active":"2023-10-06T03:23:44.937252+0000","last_peered":"2023-10-06T03:23:44.937252+0000","last_clean":"2023-10-06T03:23:44.937252+0000","last_became_active":"2023-10-06T03:23:40.673972+0000","last_became_peered":"2023-10-06T03:23:40.673972+0000","last_unstale":"2023-10-06T03:23:44.937252+0000","last_undegraded":"2023-10-06T03:23:44.937252+0000","last_fullsized":"2023-10-06T03:23:44.937252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:35.462631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937591+0000","last_change":"2023-10-06T03:23:40.672377+0000","last_active":"2023-10-06T03:23:44.937591+0000","last_peered":"2023-10-06T03:23:44.937591+0000","last_clean":"2023-10-06T03:23:44.937591+0000","last_became_active":"2023-10-06T03:23:40.671914+0000","last_became_peered":"2023-10-06T03:23:40.671914+0000","last_unstale":"2023-10-06T03:23:44.937591+0000","last_undegraded":"2023-10-06T03:23:44.937591+0000","last_fullsized":"2023-10-06T03:23:44.937591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:49.615169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.934679+0000","last_change":"2023-10-06T03:23:40.664677+0000","last_active":"2023-10-06T03:23:44.934679+0000","last_peered":"2023-10-06T03:23:44.934679+0000","last_clean":"2023-10-06T03:23:44.934679+0000","last_became_active":"2023-10-06T03:23:40.664274+0000","last_became_peered":"2023-10-06T03:23:40.664274+0000","last_unstale":"2023-10-06T03:23:44.934679+0000","last_undegraded":"2023-10-06T03:23:44.934679+0000","last_fullsized":"2023-10-06T03:23:44.934679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:46:25.920290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936715+0000","last_change":"2023-10-06T03:23:40.661431+0000","last_active":"2023-10-06T03:23:44.936715+0000","last_peered":"2023-10-06T03:23:44.936715+0000","last_clean":"2023-10-06T03:23:44.936715+0000","last_became_active":"2023-10-06T03:23:40.661152+0000","last_became_peered":"2023-10-06T03:23:40.661152+0000","last_unstale":"2023-10-06T03:23:44.936715+0000","last_undegraded":"2023-10-06T03:23:44.936715+0000","last_fullsized":"2023-10-06T03:23:44.936715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:35.968610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.934879+0000","last_change":"2023-10-06T03:23:40.654344+0000","last_active":"2023-10-06T03:23:44.934879+0000","last_peered":"2023-10-06T03:23:44.934879+0000","last_clean":"2023-10-06T03:23:44.934879+0000","last_became_active":"2023-10-06T03:23:40.654053+0000","last_became_peered":"2023-10-06T03:23:40.654053+0000","last_unstale":"2023-10-06T03:23:44.934879+0000","last_undegraded":"2023-10-06T03:23:44.934879+0000","last_fullsized":"2023-10-06T03:23:44.934879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:04:49.664462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936826+0000","last_change":"2023-10-06T03:23:40.669778+0000","last_active":"2023-10-06T03:23:44.936826+0000","last_peered":"2023-10-06T03:23:44.936826+0000","last_clean":"2023-10-06T03:23:44.936826+0000","last_became_active":"2023-10-06T03:23:40.669080+0000","last_became_peered":"2023-10-06T03:23:40.669080+0000","last_unstale":"2023-10-06T03:23:44.936826+0000","last_undegraded":"2023-10-06T03:23:44.936826+0000","last_fullsized":"2023-10-06T03:23:44.936826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:51:39.105798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937246+0000","last_change":"2023-10-06T03:23:40.675925+0000","last_active":"2023-10-06T03:23:44.937246+0000","last_peered":"2023-10-06T03:23:44.937246+0000","last_clean":"2023-10-06T03:23:44.937246+0000","last_became_active":"2023-10-06T03:23:40.673050+0000","last_became_peered":"2023-10-06T03:23:40.673050+0000","last_unstale":"2023-10-06T03:23:44.937246+0000","last_undegraded":"2023-10-06T03:23:44.937246+0000","last_fullsized":"2023-10-06T03:23:44.937246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:38:27.078009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.947782+0000","last_change":"2023-10-06T03:23:40.670497+0000","last_active":"2023-10-06T03:23:44.947782+0000","last_peered":"2023-10-06T03:23:44.947782+0000","last_clean":"2023-10-06T03:23:44.947782+0000","last_became_active":"2023-10-06T03:23:40.670254+0000","last_became_peered":"2023-10-06T03:23:40.670254+0000","last_unstale":"2023-10-06T03:23:44.947782+0000","last_undegraded":"2023-10-06T03:23:44.947782+0000","last_fullsized":"2023-10-06T03:23:44.947782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:18.546154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937896+0000","last_change":"2023-10-06T03:23:40.664385+0000","last_active":"2023-10-06T03:23:44.937896+0000","last_peered":"2023-10-06T03:23:44.937896+0000","last_clean":"2023-10-06T03:23:44.937896+0000","last_became_active":"2023-10-06T03:23:40.664019+0000","last_became_peered":"2023-10-06T03:23:40.664019+0000","last_unstale":"2023-10-06T03:23:44.937896+0000","last_undegraded":"2023-10-06T03:23:44.937896+0000","last_fullsized":"2023-10-06T03:23:44.937896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:18.834001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.935061+0000","last_change":"2023-10-06T03:23:40.664719+0000","last_active":"2023-10-06T03:23:44.935061+0000","last_peered":"2023-10-06T03:23:44.935061+0000","last_clean":"2023-10-06T03:23:44.935061+0000","last_became_active":"2023-10-06T03:23:40.664292+0000","last_became_peered":"2023-10-06T03:23:40.664292+0000","last_unstale":"2023-10-06T03:23:44.935061+0000","last_undegraded":"2023-10-06T03:23:44.935061+0000","last_fullsized":"2023-10-06T03:23:44.935061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:25:22.431703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937565+0000","last_change":"2023-10-06T03:23:40.676968+0000","last_active":"2023-10-06T03:23:44.937565+0000","last_peered":"2023-10-06T03:23:44.937565+0000","last_clean":"2023-10-06T03:23:44.937565+0000","last_became_active":"2023-10-06T03:23:40.671490+0000","last_became_peered":"2023-10-06T03:23:40.671490+0000","last_unstale":"2023-10-06T03:23:44.937565+0000","last_undegraded":"2023-10-06T03:23:44.937565+0000","last_fullsized":"2023-10-06T03:23:44.937565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:57.849203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936664+0000","last_change":"2023-10-06T03:23:40.664089+0000","last_active":"2023-10-06T03:23:44.936664+0000","last_peered":"2023-10-06T03:23:44.936664+0000","last_clean":"2023-10-06T03:23:44.936664+0000","last_became_active":"2023-10-06T03:23:40.662392+0000","last_became_peered":"2023-10-06T03:23:40.662392+0000","last_unstale":"2023-10-06T03:23:44.936664+0000","last_undegraded":"2023-10-06T03:23:44.936664+0000","last_fullsized":"2023-10-06T03:23:44.936664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:35.462631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.945221+0000","last_change":"2023-10-06T03:23:40.673025+0000","last_active":"2023-10-06T03:23:44.945221+0000","last_peered":"2023-10-06T03:23:44.945221+0000","last_clean":"2023-10-06T03:23:44.945221+0000","last_became_active":"2023-10-06T03:23:40.672797+0000","last_became_peered":"2023-10-06T03:23:40.672797+0000","last_unstale":"2023-10-06T03:23:44.945221+0000","last_undegraded":"2023-10-06T03:23:44.945221+0000","last_fullsized":"2023-10-06T03:23:44.945221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:21.489097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.930431+0000","last_change":"2023-10-06T03:23:40.670561+0000","last_active":"2023-10-06T03:23:44.930431+0000","last_peered":"2023-10-06T03:23:44.930431+0000","last_clean":"2023-10-06T03:23:44.930431+0000","last_became_active":"2023-10-06T03:23:40.670272+0000","last_became_peered":"2023-10-06T03:23:40.670272+0000","last_unstale":"2023-10-06T03:23:44.930431+0000","last_undegraded":"2023-10-06T03:23:44.930431+0000","last_fullsized":"2023-10-06T03:23:44.930431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:18.834001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936341+0000","last_change":"2023-10-06T03:23:40.662281+0000","last_active":"2023-10-06T03:23:44.936341+0000","last_peered":"2023-10-06T03:23:44.936341+0000","last_clean":"2023-10-06T03:23:44.936341+0000","last_became_active":"2023-10-06T03:23:40.661686+0000","last_became_peered":"2023-10-06T03:23:40.661686+0000","last_unstale":"2023-10-06T03:23:44.936341+0000","last_undegraded":"2023-10-06T03:23:44.936341+0000","last_fullsized":"2023-10-06T03:23:44.936341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:15.293618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.938818+0000","last_change":"2023-10-06T03:23:40.668204+0000","last_active":"2023-10-06T03:23:44.938818+0000","last_peered":"2023-10-06T03:23:44.938818+0000","last_clean":"2023-10-06T03:23:44.938818+0000","last_became_active":"2023-10-06T03:23:40.665998+0000","last_became_peered":"2023-10-06T03:23:40.665998+0000","last_unstale":"2023-10-06T03:23:44.938818+0000","last_undegraded":"2023-10-06T03:23:44.938818+0000","last_fullsized":"2023-10-06T03:23:44.938818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:15.293618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936984+0000","last_change":"2023-10-06T03:23:40.654367+0000","last_active":"2023-10-06T03:23:44.936984+0000","last_peered":"2023-10-06T03:23:44.936984+0000","last_clean":"2023-10-06T03:23:44.936984+0000","last_became_active":"2023-10-06T03:23:40.654082+0000","last_became_peered":"2023-10-06T03:23:40.654082+0000","last_unstale":"2023-10-06T03:23:44.936984+0000","last_undegraded":"2023-10-06T03:23:44.936984+0000","last_fullsized":"2023-10-06T03:23:44.936984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:56.483789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.938900+0000","last_change":"2023-10-06T03:23:40.662226+0000","last_active":"2023-10-06T03:23:44.938900+0000","last_peered":"2023-10-06T03:23:44.938900+0000","last_clean":"2023-10-06T03:23:44.938900+0000","last_became_active":"2023-10-06T03:23:40.662025+0000","last_became_peered":"2023-10-06T03:23:40.662025+0000","last_unstale":"2023-10-06T03:23:44.938900+0000","last_undegraded":"2023-10-06T03:23:44.938900+0000","last_fullsized":"2023-10-06T03:23:44.938900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:37.167322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.955136+0000","last_change":"2023-10-06T03:23:44.949281+0000","last_active":"2023-10-06T03:23:44.955136+0000","last_peered":"2023-10-06T03:23:44.955136+0000","last_clean":"2023-10-06T03:23:44.955136+0000","last_became_active":"2023-10-06T03:23:44.948885+0000","last_became_peered":"2023-10-06T03:23:44.948885+0000","last_unstale":"2023-10-06T03:23:44.955136+0000","last_undegraded":"2023-10-06T03:23:44.955136+0000","last_fullsized":"2023-10-06T03:23:44.955136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:31:16.317335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936350+0000","last_change":"2023-10-06T03:23:39.919181+0000","last_active":"2023-10-06T03:23:44.936350+0000","last_peered":"2023-10-06T03:23:44.936350+0000","last_clean":"2023-10-06T03:23:44.936350+0000","last_became_active":"2023-10-06T03:23:39.918331+0000","last_became_peered":"2023-10-06T03:23:39.918331+0000","last_unstale":"2023-10-06T03:23:44.936350+0000","last_undegraded":"2023-10-06T03:23:44.936350+0000","last_fullsized":"2023-10-06T03:23:44.936350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:46:24.911513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.931056+0000","last_change":"2023-10-06T03:23:40.666693+0000","last_active":"2023-10-06T03:23:44.931056+0000","last_peered":"2023-10-06T03:23:44.931056+0000","last_clean":"2023-10-06T03:23:44.931056+0000","last_became_active":"2023-10-06T03:23:40.666435+0000","last_became_peered":"2023-10-06T03:23:40.666435+0000","last_unstale":"2023-10-06T03:23:44.931056+0000","last_undegraded":"2023-10-06T03:23:44.931056+0000","last_fullsized":"2023-10-06T03:23:44.931056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:35.462631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.962151+0000","last_change":"2023-10-06T03:23:44.958592+0000","last_active":"2023-10-06T03:23:44.962151+0000","last_peered":"2023-10-06T03:23:44.962151+0000","last_clean":"2023-10-06T03:23:44.962151+0000","last_became_active":"2023-10-06T03:23:44.957907+0000","last_became_peered":"2023-10-06T03:23:44.957907+0000","last_unstale":"2023-10-06T03:23:44.962151+0000","last_undegraded":"2023-10-06T03:23:44.962151+0000","last_fullsized":"2023-10-06T03:23:44.962151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:22.863565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.938027+0000","last_change":"2023-10-06T03:23:39.927167+0000","last_active":"2023-10-06T03:23:44.938027+0000","last_peered":"2023-10-06T03:23:44.938027+0000","last_clean":"2023-10-06T03:23:44.938027+0000","last_became_active":"2023-10-06T03:23:39.926796+0000","last_became_peered":"2023-10-06T03:23:39.926796+0000","last_unstale":"2023-10-06T03:23:44.938027+0000","last_undegraded":"2023-10-06T03:23:44.938027+0000","last_fullsized":"2023-10-06T03:23:44.938027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:10:12.819926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.948077+0000","last_change":"2023-10-06T03:23:40.676555+0000","last_active":"2023-10-06T03:23:44.948077+0000","last_peered":"2023-10-06T03:23:44.948077+0000","last_clean":"2023-10-06T03:23:44.948077+0000","last_became_active":"2023-10-06T03:23:40.676292+0000","last_became_peered":"2023-10-06T03:23:40.676292+0000","last_unstale":"2023-10-06T03:23:44.948077+0000","last_undegraded":"2023-10-06T03:23:44.948077+0000","last_fullsized":"2023-10-06T03:23:44.948077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:15.293618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.966214+0000","last_change":"2023-10-06T03:23:44.963581+0000","last_active":"2023-10-06T03:23:44.966214+0000","last_peered":"2023-10-06T03:23:44.966214+0000","last_clean":"2023-10-06T03:23:44.966214+0000","last_became_active":"2023-10-06T03:23:44.963132+0000","last_became_peered":"2023-10-06T03:23:44.963132+0000","last_unstale":"2023-10-06T03:23:44.966214+0000","last_undegraded":"2023-10-06T03:23:44.966214+0000","last_fullsized":"2023-10-06T03:23:44.966214+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:39.997230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.930690+0000","last_change":"2023-10-06T03:23:39.931987+0000","last_active":"2023-10-06T03:23:44.930690+0000","last_peered":"2023-10-06T03:23:44.930690+0000","last_clean":"2023-10-06T03:23:44.930690+0000","last_became_active":"2023-10-06T03:23:39.931330+0000","last_became_peered":"2023-10-06T03:23:39.931330+0000","last_unstale":"2023-10-06T03:23:44.930690+0000","last_undegraded":"2023-10-06T03:23:44.930690+0000","last_fullsized":"2023-10-06T03:23:44.930690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:41.245899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.947767+0000","last_change":"2023-10-06T03:23:40.666106+0000","last_active":"2023-10-06T03:23:44.947767+0000","last_peered":"2023-10-06T03:23:44.947767+0000","last_clean":"2023-10-06T03:23:44.947767+0000","last_became_active":"2023-10-06T03:23:40.665767+0000","last_became_peered":"2023-10-06T03:23:40.665767+0000","last_unstale":"2023-10-06T03:23:44.947767+0000","last_undegraded":"2023-10-06T03:23:44.947767+0000","last_fullsized":"2023-10-06T03:23:44.947767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:35.738270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.959918+0000","last_change":"2023-10-06T03:23:44.957763+0000","last_active":"2023-10-06T03:23:44.959918+0000","last_peered":"2023-10-06T03:23:44.959918+0000","last_clean":"2023-10-06T03:23:44.959918+0000","last_became_active":"2023-10-06T03:23:44.957461+0000","last_became_peered":"2023-10-06T03:23:44.957461+0000","last_unstale":"2023-10-06T03:23:44.959918+0000","last_undegraded":"2023-10-06T03:23:44.959918+0000","last_fullsized":"2023-10-06T03:23:44.959918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:27:46.202488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.947861+0000","last_change":"2023-10-06T03:23:39.926868+0000","last_active":"2023-10-06T03:23:44.947861+0000","last_peered":"2023-10-06T03:23:44.947861+0000","last_clean":"2023-10-06T03:23:44.947861+0000","last_became_active":"2023-10-06T03:23:39.926602+0000","last_became_peered":"2023-10-06T03:23:39.926602+0000","last_unstale":"2023-10-06T03:23:44.947861+0000","last_undegraded":"2023-10-06T03:23:44.947861+0000","last_fullsized":"2023-10-06T03:23:44.947861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:34.959833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.930596+0000","last_change":"2023-10-06T03:23:40.666666+0000","last_active":"2023-10-06T03:23:44.930596+0000","last_peered":"2023-10-06T03:23:44.930596+0000","last_clean":"2023-10-06T03:23:44.930596+0000","last_became_active":"2023-10-06T03:23:40.666333+0000","last_became_peered":"2023-10-06T03:23:40.666333+0000","last_unstale":"2023-10-06T03:23:44.930596+0000","last_undegraded":"2023-10-06T03:23:44.930596+0000","last_fullsized":"2023-10-06T03:23:44.930596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:21.489097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.963680+0000","last_change":"2023-10-06T03:23:44.956770+0000","last_active":"2023-10-06T03:23:44.963680+0000","last_peered":"2023-10-06T03:23:44.963680+0000","last_clean":"2023-10-06T03:23:44.963680+0000","last_became_active":"2023-10-06T03:23:44.956335+0000","last_became_peered":"2023-10-06T03:23:44.956335+0000","last_unstale":"2023-10-06T03:23:44.963680+0000","last_undegraded":"2023-10-06T03:23:44.963680+0000","last_fullsized":"2023-10-06T03:23:44.963680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:26.358389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937057+0000","last_change":"2023-10-06T03:23:39.918613+0000","last_active":"2023-10-06T03:23:44.937057+0000","last_peered":"2023-10-06T03:23:44.937057+0000","last_clean":"2023-10-06T03:23:44.937057+0000","last_became_active":"2023-10-06T03:23:39.918224+0000","last_became_peered":"2023-10-06T03:23:39.918224+0000","last_unstale":"2023-10-06T03:23:44.937057+0000","last_undegraded":"2023-10-06T03:23:44.937057+0000","last_fullsized":"2023-10-06T03:23:44.937057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:10:12.819926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.930293+0000","last_change":"2023-10-06T03:23:40.665896+0000","last_active":"2023-10-06T03:23:44.930293+0000","last_peered":"2023-10-06T03:23:44.930293+0000","last_clean":"2023-10-06T03:23:44.930293+0000","last_became_active":"2023-10-06T03:23:40.665625+0000","last_became_peered":"2023-10-06T03:23:40.665625+0000","last_unstale":"2023-10-06T03:23:44.930293+0000","last_undegraded":"2023-10-06T03:23:44.930293+0000","last_fullsized":"2023-10-06T03:23:44.930293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:00.382000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.959626+0000","last_change":"2023-10-06T03:23:44.950950+0000","last_active":"2023-10-06T03:23:44.959626+0000","last_peered":"2023-10-06T03:23:44.959626+0000","last_clean":"2023-10-06T03:23:44.959626+0000","last_became_active":"2023-10-06T03:23:44.950383+0000","last_became_peered":"2023-10-06T03:23:44.950383+0000","last_unstale":"2023-10-06T03:23:44.959626+0000","last_undegraded":"2023-10-06T03:23:44.959626+0000","last_fullsized":"2023-10-06T03:23:44.959626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:41.590979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936358+0000","last_change":"2023-10-06T03:23:39.928175+0000","last_active":"2023-10-06T03:23:44.936358+0000","last_peered":"2023-10-06T03:23:44.936358+0000","last_clean":"2023-10-06T03:23:44.936358+0000","last_became_active":"2023-10-06T03:23:39.927870+0000","last_became_peered":"2023-10-06T03:23:39.927870+0000","last_unstale":"2023-10-06T03:23:44.936358+0000","last_undegraded":"2023-10-06T03:23:44.936358+0000","last_fullsized":"2023-10-06T03:23:44.936358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:15:53.608164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.938038+0000","last_change":"2023-10-06T03:23:40.668044+0000","last_active":"2023-10-06T03:23:44.938038+0000","last_peered":"2023-10-06T03:23:44.938038+0000","last_clean":"2023-10-06T03:23:44.938038+0000","last_became_active":"2023-10-06T03:23:40.667677+0000","last_became_peered":"2023-10-06T03:23:40.667677+0000","last_unstale":"2023-10-06T03:23:44.938038+0000","last_undegraded":"2023-10-06T03:23:44.938038+0000","last_fullsized":"2023-10-06T03:23:44.938038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:37.167322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.962261+0000","last_change":"2023-10-06T03:23:44.957225+0000","last_active":"2023-10-06T03:23:44.962261+0000","last_peered":"2023-10-06T03:23:44.962261+0000","last_clean":"2023-10-06T03:23:44.962261+0000","last_became_active":"2023-10-06T03:23:44.956809+0000","last_became_peered":"2023-10-06T03:23:44.956809+0000","last_unstale":"2023-10-06T03:23:44.962261+0000","last_undegraded":"2023-10-06T03:23:44.962261+0000","last_fullsized":"2023-10-06T03:23:44.962261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:46:57.334758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"24'9","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:23:53.837606+0000","last_change":"2023-10-06T03:23:39.926096+0000","last_active":"2023-10-06T03:23:53.837606+0000","last_peered":"2023-10-06T03:23:53.837606+0000","last_clean":"2023-10-06T03:23:53.837606+0000","last_became_active":"2023-10-06T03:23:39.925763+0000","last_became_peered":"2023-10-06T03:23:39.925763+0000","last_unstale":"2023-10-06T03:23:53.837606+0000","last_undegraded":"2023-10-06T03:23:53.837606+0000","last_fullsized":"2023-10-06T03:23:53.837606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:25:21.422926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3714,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936727+0000","last_change":"2023-10-06T03:23:40.668353+0000","last_active":"2023-10-06T03:23:44.936727+0000","last_peered":"2023-10-06T03:23:44.936727+0000","last_clean":"2023-10-06T03:23:44.936727+0000","last_became_active":"2023-10-06T03:23:40.668068+0000","last_became_peered":"2023-10-06T03:23:40.668068+0000","last_unstale":"2023-10-06T03:23:44.936727+0000","last_undegraded":"2023-10-06T03:23:44.936727+0000","last_fullsized":"2023-10-06T03:23:44.936727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:07:52.772047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.955742+0000","last_change":"2023-10-06T03:23:44.954499+0000","last_active":"2023-10-06T03:23:44.955742+0000","last_peered":"2023-10-06T03:23:44.955742+0000","last_clean":"2023-10-06T03:23:44.955742+0000","last_became_active":"2023-10-06T03:23:44.954033+0000","last_became_peered":"2023-10-06T03:23:44.954033+0000","last_unstale":"2023-10-06T03:23:44.955742+0000","last_undegraded":"2023-10-06T03:23:44.955742+0000","last_fullsized":"2023-10-06T03:23:44.955742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:39.997230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936587+0000","last_change":"2023-10-06T03:23:39.929796+0000","last_active":"2023-10-06T03:23:44.936587+0000","last_peered":"2023-10-06T03:23:44.936587+0000","last_clean":"2023-10-06T03:23:44.936587+0000","last_became_active":"2023-10-06T03:23:39.929503+0000","last_became_peered":"2023-10-06T03:23:39.929503+0000","last_unstale":"2023-10-06T03:23:44.936587+0000","last_undegraded":"2023-10-06T03:23:44.936587+0000","last_fullsized":"2023-10-06T03:23:44.936587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:44.354326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.931035+0000","last_change":"2023-10-06T03:23:40.670640+0000","last_active":"2023-10-06T03:23:44.931035+0000","last_peered":"2023-10-06T03:23:44.931035+0000","last_clean":"2023-10-06T03:23:44.931035+0000","last_became_active":"2023-10-06T03:23:40.670295+0000","last_became_peered":"2023-10-06T03:23:40.670295+0000","last_unstale":"2023-10-06T03:23:44.931035+0000","last_undegraded":"2023-10-06T03:23:44.931035+0000","last_fullsized":"2023-10-06T03:23:44.931035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:18.546154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.959802+0000","last_change":"2023-10-06T03:23:44.952973+0000","last_active":"2023-10-06T03:23:44.959802+0000","last_peered":"2023-10-06T03:23:44.959802+0000","last_clean":"2023-10-06T03:23:44.959802+0000","last_became_active":"2023-10-06T03:23:44.952573+0000","last_became_peered":"2023-10-06T03:23:44.952573+0000","last_unstale":"2023-10-06T03:23:44.959802+0000","last_undegraded":"2023-10-06T03:23:44.959802+0000","last_fullsized":"2023-10-06T03:23:44.959802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:47:31.959148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.946424+0000","last_change":"2023-10-06T03:23:39.920586+0000","last_active":"2023-10-06T03:23:44.946424+0000","last_peered":"2023-10-06T03:23:44.946424+0000","last_clean":"2023-10-06T03:23:44.946424+0000","last_became_active":"2023-10-06T03:23:39.920273+0000","last_became_peered":"2023-10-06T03:23:39.920273+0000","last_unstale":"2023-10-06T03:23:44.946424+0000","last_undegraded":"2023-10-06T03:23:44.946424+0000","last_fullsized":"2023-10-06T03:23:44.946424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:25:21.422926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.938789+0000","last_change":"2023-10-06T03:23:40.660488+0000","last_active":"2023-10-06T03:23:44.938789+0000","last_peered":"2023-10-06T03:23:44.938789+0000","last_clean":"2023-10-06T03:23:44.938789+0000","last_became_active":"2023-10-06T03:23:40.660218+0000","last_became_peered":"2023-10-06T03:23:40.660218+0000","last_unstale":"2023-10-06T03:23:44.938789+0000","last_undegraded":"2023-10-06T03:23:44.938789+0000","last_fullsized":"2023-10-06T03:23:44.938789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:29:10.177304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.959965+0000","last_change":"2023-10-06T03:23:44.957434+0000","last_active":"2023-10-06T03:23:44.959965+0000","last_peered":"2023-10-06T03:23:44.959965+0000","last_clean":"2023-10-06T03:23:44.959965+0000","last_became_active":"2023-10-06T03:23:44.957081+0000","last_became_peered":"2023-10-06T03:23:44.957081+0000","last_unstale":"2023-10-06T03:23:44.959965+0000","last_undegraded":"2023-10-06T03:23:44.959965+0000","last_fullsized":"2023-10-06T03:23:44.959965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:23.189419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936994+0000","last_change":"2023-10-06T03:23:39.929775+0000","last_active":"2023-10-06T03:23:44.936994+0000","last_peered":"2023-10-06T03:23:44.936994+0000","last_clean":"2023-10-06T03:23:44.936994+0000","last_became_active":"2023-10-06T03:23:39.929442+0000","last_became_peered":"2023-10-06T03:23:39.929442+0000","last_unstale":"2023-10-06T03:23:44.936994+0000","last_undegraded":"2023-10-06T03:23:44.936994+0000","last_fullsized":"2023-10-06T03:23:44.936994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:13:39.307938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.949506+0000","last_change":"2023-10-06T03:23:40.667709+0000","last_active":"2023-10-06T03:23:44.949506+0000","last_peered":"2023-10-06T03:23:44.949506+0000","last_clean":"2023-10-06T03:23:44.949506+0000","last_became_active":"2023-10-06T03:23:40.667393+0000","last_became_peered":"2023-10-06T03:23:40.667393+0000","last_unstale":"2023-10-06T03:23:44.949506+0000","last_undegraded":"2023-10-06T03:23:44.949506+0000","last_fullsized":"2023-10-06T03:23:44.949506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:00.382000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.964649+0000","last_change":"2023-10-06T03:23:44.961540+0000","last_active":"2023-10-06T03:23:44.964649+0000","last_peered":"2023-10-06T03:23:44.964649+0000","last_clean":"2023-10-06T03:23:44.964649+0000","last_became_active":"2023-10-06T03:23:44.961152+0000","last_became_peered":"2023-10-06T03:23:44.961152+0000","last_unstale":"2023-10-06T03:23:44.964649+0000","last_undegraded":"2023-10-06T03:23:44.964649+0000","last_fullsized":"2023-10-06T03:23:44.964649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:48.424006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.944147+0000","last_change":"2023-10-06T03:23:39.930656+0000","last_active":"2023-10-06T03:23:44.944147+0000","last_peered":"2023-10-06T03:23:44.944147+0000","last_clean":"2023-10-06T03:23:44.944147+0000","last_became_active":"2023-10-06T03:23:39.930340+0000","last_became_peered":"2023-10-06T03:23:39.930340+0000","last_unstale":"2023-10-06T03:23:44.944147+0000","last_undegraded":"2023-10-06T03:23:44.944147+0000","last_fullsized":"2023-10-06T03:23:44.944147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:10:12.819926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.931492+0000","last_change":"2023-10-06T03:23:40.666356+0000","last_active":"2023-10-06T03:23:44.931492+0000","last_peered":"2023-10-06T03:23:44.931492+0000","last_clean":"2023-10-06T03:23:44.931492+0000","last_became_active":"2023-10-06T03:23:40.666092+0000","last_became_peered":"2023-10-06T03:23:40.666092+0000","last_unstale":"2023-10-06T03:23:44.931492+0000","last_undegraded":"2023-10-06T03:23:44.931492+0000","last_fullsized":"2023-10-06T03:23:44.931492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:15.293618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.969201+0000","last_change":"2023-10-06T03:23:44.965794+0000","last_active":"2023-10-06T03:23:44.969201+0000","last_peered":"2023-10-06T03:23:44.969201+0000","last_clean":"2023-10-06T03:23:44.969201+0000","last_became_active":"2023-10-06T03:23:44.959858+0000","last_became_peered":"2023-10-06T03:23:44.959858+0000","last_unstale":"2023-10-06T03:23:44.969201+0000","last_undegraded":"2023-10-06T03:23:44.969201+0000","last_fullsized":"2023-10-06T03:23:44.969201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:53.182371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.944656+0000","last_change":"2023-10-06T03:23:39.927449+0000","last_active":"2023-10-06T03:23:44.944656+0000","last_peered":"2023-10-06T03:23:44.944656+0000","last_clean":"2023-10-06T03:23:44.944656+0000","last_became_active":"2023-10-06T03:23:39.927150+0000","last_became_peered":"2023-10-06T03:23:39.927150+0000","last_unstale":"2023-10-06T03:23:44.944656+0000","last_undegraded":"2023-10-06T03:23:44.944656+0000","last_fullsized":"2023-10-06T03:23:44.944656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:34.729493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.934229+0000","last_change":"2023-10-06T03:23:40.660603+0000","last_active":"2023-10-06T03:23:44.934229+0000","last_peered":"2023-10-06T03:23:44.934229+0000","last_clean":"2023-10-06T03:23:44.934229+0000","last_became_active":"2023-10-06T03:23:40.660310+0000","last_became_peered":"2023-10-06T03:23:40.660310+0000","last_unstale":"2023-10-06T03:23:44.934229+0000","last_undegraded":"2023-10-06T03:23:44.934229+0000","last_fullsized":"2023-10-06T03:23:44.934229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:21.489097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.965034+0000","last_change":"2023-10-06T03:23:44.958953+0000","last_active":"2023-10-06T03:23:44.965034+0000","last_peered":"2023-10-06T03:23:44.965034+0000","last_clean":"2023-10-06T03:23:44.965034+0000","last_became_active":"2023-10-06T03:23:44.958414+0000","last_became_peered":"2023-10-06T03:23:44.958414+0000","last_unstale":"2023-10-06T03:23:44.965034+0000","last_undegraded":"2023-10-06T03:23:44.965034+0000","last_fullsized":"2023-10-06T03:23:44.965034+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:22.575718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936667+0000","last_change":"2023-10-06T03:23:39.924645+0000","last_active":"2023-10-06T03:23:44.936667+0000","last_peered":"2023-10-06T03:23:44.936667+0000","last_clean":"2023-10-06T03:23:44.936667+0000","last_became_active":"2023-10-06T03:23:39.924375+0000","last_became_peered":"2023-10-06T03:23:39.924375+0000","last_unstale":"2023-10-06T03:23:44.936667+0000","last_undegraded":"2023-10-06T03:23:44.936667+0000","last_fullsized":"2023-10-06T03:23:44.936667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:21.428737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936388+0000","last_change":"2023-10-06T03:23:40.671688+0000","last_active":"2023-10-06T03:23:44.936388+0000","last_peered":"2023-10-06T03:23:44.936388+0000","last_clean":"2023-10-06T03:23:44.936388+0000","last_became_active":"2023-10-06T03:23:40.671408+0000","last_became_peered":"2023-10-06T03:23:40.671408+0000","last_unstale":"2023-10-06T03:23:44.936388+0000","last_undegraded":"2023-10-06T03:23:44.936388+0000","last_fullsized":"2023-10-06T03:23:44.936388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:43:56.448825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.959633+0000","last_change":"2023-10-06T03:23:44.955142+0000","last_active":"2023-10-06T03:23:44.959633+0000","last_peered":"2023-10-06T03:23:44.959633+0000","last_clean":"2023-10-06T03:23:44.959633+0000","last_became_active":"2023-10-06T03:23:44.954726+0000","last_became_peered":"2023-10-06T03:23:44.954726+0000","last_unstale":"2023-10-06T03:23:44.959633+0000","last_undegraded":"2023-10-06T03:23:44.959633+0000","last_fullsized":"2023-10-06T03:23:44.959633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:55:01.878766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936253+0000","last_change":"2023-10-06T03:23:39.917247+0000","last_active":"2023-10-06T03:23:44.936253+0000","last_peered":"2023-10-06T03:23:44.936253+0000","last_clean":"2023-10-06T03:23:44.936253+0000","last_became_active":"2023-10-06T03:23:39.916954+0000","last_became_peered":"2023-10-06T03:23:39.916954+0000","last_unstale":"2023-10-06T03:23:44.936253+0000","last_undegraded":"2023-10-06T03:23:44.936253+0000","last_fullsized":"2023-10-06T03:23:44.936253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:05.109047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.944090+0000","last_change":"2023-10-06T03:23:40.671497+0000","last_active":"2023-10-06T03:23:44.944090+0000","last_peered":"2023-10-06T03:23:44.944090+0000","last_clean":"2023-10-06T03:23:44.944090+0000","last_became_active":"2023-10-06T03:23:40.671220+0000","last_became_peered":"2023-10-06T03:23:40.671220+0000","last_unstale":"2023-10-06T03:23:44.944090+0000","last_undegraded":"2023-10-06T03:23:44.944090+0000","last_fullsized":"2023-10-06T03:23:44.944090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:13:40.316715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.953035+0000","last_change":"2023-10-06T03:23:44.950490+0000","last_active":"2023-10-06T03:23:44.953035+0000","last_peered":"2023-10-06T03:23:44.953035+0000","last_clean":"2023-10-06T03:23:44.953035+0000","last_became_active":"2023-10-06T03:23:44.949773+0000","last_became_peered":"2023-10-06T03:23:44.949773+0000","last_unstale":"2023-10-06T03:23:44.953035+0000","last_undegraded":"2023-10-06T03:23:44.953035+0000","last_fullsized":"2023-10-06T03:23:44.953035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:27:46.202488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.934555+0000","last_change":"2023-10-06T03:23:39.927421+0000","last_active":"2023-10-06T03:23:44.934555+0000","last_peered":"2023-10-06T03:23:44.934555+0000","last_clean":"2023-10-06T03:23:44.934555+0000","last_became_active":"2023-10-06T03:23:39.927038+0000","last_became_peered":"2023-10-06T03:23:39.927038+0000","last_unstale":"2023-10-06T03:23:44.934555+0000","last_undegraded":"2023-10-06T03:23:44.934555+0000","last_fullsized":"2023-10-06T03:23:44.934555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:41.245899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.947302+0000","last_change":"2023-10-06T03:23:40.668861+0000","last_active":"2023-10-06T03:23:44.947302+0000","last_peered":"2023-10-06T03:23:44.947302+0000","last_clean":"2023-10-06T03:23:44.947302+0000","last_became_active":"2023-10-06T03:23:40.668596+0000","last_became_peered":"2023-10-06T03:23:40.668596+0000","last_unstale":"2023-10-06T03:23:44.947302+0000","last_undegraded":"2023-10-06T03:23:44.947302+0000","last_fullsized":"2023-10-06T03:23:44.947302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:51:39.105798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.959600+0000","last_change":"2023-10-06T03:23:44.956193+0000","last_active":"2023-10-06T03:23:44.959600+0000","last_peered":"2023-10-06T03:23:44.959600+0000","last_clean":"2023-10-06T03:23:44.959600+0000","last_became_active":"2023-10-06T03:23:44.955814+0000","last_became_peered":"2023-10-06T03:23:44.955814+0000","last_unstale":"2023-10-06T03:23:44.959600+0000","last_undegraded":"2023-10-06T03:23:44.959600+0000","last_fullsized":"2023-10-06T03:23:44.959600+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:22.863565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.930753+0000","last_change":"2023-10-06T03:23:39.927251+0000","last_active":"2023-10-06T03:23:44.930753+0000","last_peered":"2023-10-06T03:23:44.930753+0000","last_clean":"2023-10-06T03:23:44.930753+0000","last_became_active":"2023-10-06T03:23:39.926999+0000","last_became_peered":"2023-10-06T03:23:39.926999+0000","last_unstale":"2023-10-06T03:23:44.930753+0000","last_undegraded":"2023-10-06T03:23:44.930753+0000","last_fullsized":"2023-10-06T03:23:44.930753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:10:12.819926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937381+0000","last_change":"2023-10-06T03:23:40.666463+0000","last_active":"2023-10-06T03:23:44.937381+0000","last_peered":"2023-10-06T03:23:44.937381+0000","last_clean":"2023-10-06T03:23:44.937381+0000","last_became_active":"2023-10-06T03:23:40.666227+0000","last_became_peered":"2023-10-06T03:23:40.666227+0000","last_unstale":"2023-10-06T03:23:44.937381+0000","last_undegraded":"2023-10-06T03:23:44.937381+0000","last_fullsized":"2023-10-06T03:23:44.937381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:51:39.105798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.962121+0000","last_change":"2023-10-06T03:23:44.955034+0000","last_active":"2023-10-06T03:23:44.962121+0000","last_peered":"2023-10-06T03:23:44.962121+0000","last_clean":"2023-10-06T03:23:44.962121+0000","last_became_active":"2023-10-06T03:23:44.954644+0000","last_became_peered":"2023-10-06T03:23:44.954644+0000","last_unstale":"2023-10-06T03:23:44.962121+0000","last_undegraded":"2023-10-06T03:23:44.962121+0000","last_fullsized":"2023-10-06T03:23:44.962121+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:48:22.544086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.944177+0000","last_change":"2023-10-06T03:23:39.924561+0000","last_active":"2023-10-06T03:23:44.944177+0000","last_peered":"2023-10-06T03:23:44.944177+0000","last_clean":"2023-10-06T03:23:44.944177+0000","last_became_active":"2023-10-06T03:23:39.924258+0000","last_became_peered":"2023-10-06T03:23:39.924258+0000","last_unstale":"2023-10-06T03:23:44.944177+0000","last_undegraded":"2023-10-06T03:23:44.944177+0000","last_fullsized":"2023-10-06T03:23:44.944177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:25:21.422926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937352+0000","last_change":"2023-10-06T03:23:40.664384+0000","last_active":"2023-10-06T03:23:44.937352+0000","last_peered":"2023-10-06T03:23:44.937352+0000","last_clean":"2023-10-06T03:23:44.937352+0000","last_became_active":"2023-10-06T03:23:40.664072+0000","last_became_peered":"2023-10-06T03:23:40.664072+0000","last_unstale":"2023-10-06T03:23:44.937352+0000","last_undegraded":"2023-10-06T03:23:44.937352+0000","last_fullsized":"2023-10-06T03:23:44.937352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:00.382000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.962692+0000","last_change":"2023-10-06T03:23:44.956737+0000","last_active":"2023-10-06T03:23:44.962692+0000","last_peered":"2023-10-06T03:23:44.962692+0000","last_clean":"2023-10-06T03:23:44.962692+0000","last_became_active":"2023-10-06T03:23:44.956371+0000","last_became_peered":"2023-10-06T03:23:44.956371+0000","last_unstale":"2023-10-06T03:23:44.962692+0000","last_undegraded":"2023-10-06T03:23:44.962692+0000","last_fullsized":"2023-10-06T03:23:44.962692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:11.304312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936209+0000","last_change":"2023-10-06T03:23:39.918323+0000","last_active":"2023-10-06T03:23:44.936209+0000","last_peered":"2023-10-06T03:23:44.936209+0000","last_clean":"2023-10-06T03:23:44.936209+0000","last_became_active":"2023-10-06T03:23:39.916159+0000","last_became_peered":"2023-10-06T03:23:39.916159+0000","last_unstale":"2023-10-06T03:23:44.936209+0000","last_undegraded":"2023-10-06T03:23:44.936209+0000","last_fullsized":"2023-10-06T03:23:44.936209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:34.959833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937989+0000","last_change":"2023-10-06T03:23:40.663057+0000","last_active":"2023-10-06T03:23:44.937989+0000","last_peered":"2023-10-06T03:23:44.937989+0000","last_clean":"2023-10-06T03:23:44.937989+0000","last_became_active":"2023-10-06T03:23:40.662793+0000","last_became_peered":"2023-10-06T03:23:40.662793+0000","last_unstale":"2023-10-06T03:23:44.937989+0000","last_undegraded":"2023-10-06T03:23:44.937989+0000","last_fullsized":"2023-10-06T03:23:44.937989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:29:24.713990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.954896+0000","last_change":"2023-10-06T03:23:44.951565+0000","last_active":"2023-10-06T03:23:44.954896+0000","last_peered":"2023-10-06T03:23:44.954896+0000","last_clean":"2023-10-06T03:23:44.954896+0000","last_became_active":"2023-10-06T03:23:44.951124+0000","last_became_peered":"2023-10-06T03:23:44.951124+0000","last_unstale":"2023-10-06T03:23:44.954896+0000","last_undegraded":"2023-10-06T03:23:44.954896+0000","last_fullsized":"2023-10-06T03:23:44.954896+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:40:21.613547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.930481+0000","last_change":"2023-10-06T03:23:39.927594+0000","last_active":"2023-10-06T03:23:44.930481+0000","last_peered":"2023-10-06T03:23:44.930481+0000","last_clean":"2023-10-06T03:23:44.930481+0000","last_became_active":"2023-10-06T03:23:39.926962+0000","last_became_peered":"2023-10-06T03:23:39.926962+0000","last_unstale":"2023-10-06T03:23:44.930481+0000","last_undegraded":"2023-10-06T03:23:44.930481+0000","last_fullsized":"2023-10-06T03:23:44.930481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:46:24.911513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.939034+0000","last_change":"2023-10-06T03:23:40.658994+0000","last_active":"2023-10-06T03:23:44.939034+0000","last_peered":"2023-10-06T03:23:44.939034+0000","last_clean":"2023-10-06T03:23:44.939034+0000","last_became_active":"2023-10-06T03:23:40.658600+0000","last_became_peered":"2023-10-06T03:23:40.658600+0000","last_unstale":"2023-10-06T03:23:44.939034+0000","last_undegraded":"2023-10-06T03:23:44.939034+0000","last_fullsized":"2023-10-06T03:23:44.939034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:21.489097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.962887+0000","last_change":"2023-10-06T03:23:44.961313+0000","last_active":"2023-10-06T03:23:44.962887+0000","last_peered":"2023-10-06T03:23:44.962887+0000","last_clean":"2023-10-06T03:23:44.962887+0000","last_became_active":"2023-10-06T03:23:44.960885+0000","last_became_peered":"2023-10-06T03:23:44.960885+0000","last_unstale":"2023-10-06T03:23:44.962887+0000","last_undegraded":"2023-10-06T03:23:44.962887+0000","last_fullsized":"2023-10-06T03:23:44.962887+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:26:37.645345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.931270+0000","last_change":"2023-10-06T03:23:39.926444+0000","last_active":"2023-10-06T03:23:44.931270+0000","last_peered":"2023-10-06T03:23:44.931270+0000","last_clean":"2023-10-06T03:23:44.931270+0000","last_became_active":"2023-10-06T03:23:39.925823+0000","last_became_peered":"2023-10-06T03:23:39.925823+0000","last_unstale":"2023-10-06T03:23:44.931270+0000","last_undegraded":"2023-10-06T03:23:44.931270+0000","last_fullsized":"2023-10-06T03:23:44.931270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:34.959833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937506+0000","last_change":"2023-10-06T03:23:35.397971+0000","last_active":"2023-10-06T03:23:44.937506+0000","last_peered":"2023-10-06T03:23:44.937506+0000","last_clean":"2023-10-06T03:23:44.937506+0000","last_became_active":"2023-10-06T03:23:35.397649+0000","last_became_peered":"2023-10-06T03:23:35.397649+0000","last_unstale":"2023-10-06T03:23:44.937506+0000","last_undegraded":"2023-10-06T03:23:44.937506+0000","last_fullsized":"2023-10-06T03:23:44.937506+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:11.974461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.930368+0000","last_change":"2023-10-06T03:23:40.669097+0000","last_active":"2023-10-06T03:23:44.930368+0000","last_peered":"2023-10-06T03:23:44.930368+0000","last_clean":"2023-10-06T03:23:44.930368+0000","last_became_active":"2023-10-06T03:23:40.668871+0000","last_became_peered":"2023-10-06T03:23:40.668871+0000","last_unstale":"2023-10-06T03:23:44.930368+0000","last_undegraded":"2023-10-06T03:23:44.930368+0000","last_fullsized":"2023-10-06T03:23:44.930368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:49.615169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.959612+0000","last_change":"2023-10-06T03:23:44.951296+0000","last_active":"2023-10-06T03:23:44.959612+0000","last_peered":"2023-10-06T03:23:44.959612+0000","last_clean":"2023-10-06T03:23:44.959612+0000","last_became_active":"2023-10-06T03:23:44.950936+0000","last_became_peered":"2023-10-06T03:23:44.950936+0000","last_unstale":"2023-10-06T03:23:44.959612+0000","last_undegraded":"2023-10-06T03:23:44.959612+0000","last_fullsized":"2023-10-06T03:23:44.959612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:45:45.700670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.930926+0000","last_change":"2023-10-06T03:23:34.866196+0000","last_active":"2023-10-06T03:23:44.930926+0000","last_peered":"2023-10-06T03:23:44.930926+0000","last_clean":"2023-10-06T03:23:44.930926+0000","last_became_active":"2023-10-06T03:23:34.865914+0000","last_became_peered":"2023-10-06T03:23:34.865914+0000","last_unstale":"2023-10-06T03:23:44.930926+0000","last_undegraded":"2023-10-06T03:23:44.930926+0000","last_fullsized":"2023-10-06T03:23:44.930926+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:11.974461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:45.052691+0000","last_change":"2023-10-06T03:23:39.927514+0000","last_active":"2023-10-06T03:23:45.052691+0000","last_peered":"2023-10-06T03:23:45.052691+0000","last_clean":"2023-10-06T03:23:45.052691+0000","last_became_active":"2023-10-06T03:23:39.927274+0000","last_became_peered":"2023-10-06T03:23:39.927274+0000","last_unstale":"2023-10-06T03:23:45.052691+0000","last_undegraded":"2023-10-06T03:23:45.052691+0000","last_fullsized":"2023-10-06T03:23:45.052691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:41.245899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936299+0000","last_change":"2023-10-06T03:23:40.662222+0000","last_active":"2023-10-06T03:23:44.936299+0000","last_peered":"2023-10-06T03:23:44.936299+0000","last_clean":"2023-10-06T03:23:44.936299+0000","last_became_active":"2023-10-06T03:23:40.661970+0000","last_became_peered":"2023-10-06T03:23:40.661970+0000","last_unstale":"2023-10-06T03:23:44.936299+0000","last_undegraded":"2023-10-06T03:23:44.936299+0000","last_fullsized":"2023-10-06T03:23:44.936299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:54:33.855202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.955860+0000","last_change":"2023-10-06T03:23:44.954326+0000","last_active":"2023-10-06T03:23:44.955860+0000","last_peered":"2023-10-06T03:23:44.955860+0000","last_clean":"2023-10-06T03:23:44.955860+0000","last_became_active":"2023-10-06T03:23:44.953952+0000","last_became_peered":"2023-10-06T03:23:44.953952+0000","last_unstale":"2023-10-06T03:23:44.955860+0000","last_undegraded":"2023-10-06T03:23:44.955860+0000","last_fullsized":"2023-10-06T03:23:44.955860+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:38:22.970164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.934805+0000","last_change":"2023-10-06T03:23:34.874380+0000","last_active":"2023-10-06T03:23:44.934805+0000","last_peered":"2023-10-06T03:23:44.934805+0000","last_clean":"2023-10-06T03:23:44.934805+0000","last_became_active":"2023-10-06T03:23:34.873972+0000","last_became_peered":"2023-10-06T03:23:34.873972+0000","last_unstale":"2023-10-06T03:23:44.934805+0000","last_undegraded":"2023-10-06T03:23:44.934805+0000","last_fullsized":"2023-10-06T03:23:44.934805+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:30.204999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":167,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936436+0000","last_change":"2023-10-06T03:23:34.864626+0000","last_active":"2023-10-06T03:23:44.936436+0000","last_peered":"2023-10-06T03:23:44.936436+0000","last_clean":"2023-10-06T03:23:44.936436+0000","last_became_active":"2023-10-06T03:23:34.863539+0000","last_became_peered":"2023-10-06T03:23:34.863539+0000","last_unstale":"2023-10-06T03:23:44.936436+0000","last_undegraded":"2023-10-06T03:23:44.936436+0000","last_fullsized":"2023-10-06T03:23:44.936436+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:11.750836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.944554+0000","last_change":"2023-10-06T03:23:39.930157+0000","last_active":"2023-10-06T03:23:44.944554+0000","last_peered":"2023-10-06T03:23:44.944554+0000","last_clean":"2023-10-06T03:23:44.944554+0000","last_became_active":"2023-10-06T03:23:39.929906+0000","last_became_peered":"2023-10-06T03:23:39.929906+0000","last_unstale":"2023-10-06T03:23:44.944554+0000","last_undegraded":"2023-10-06T03:23:44.944554+0000","last_fullsized":"2023-10-06T03:23:44.944554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:52.557228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.949418+0000","last_change":"2023-10-06T03:23:40.668183+0000","last_active":"2023-10-06T03:23:44.949418+0000","last_peered":"2023-10-06T03:23:44.949418+0000","last_clean":"2023-10-06T03:23:44.949418+0000","last_became_active":"2023-10-06T03:23:40.667934+0000","last_became_peered":"2023-10-06T03:23:40.667934+0000","last_unstale":"2023-10-06T03:23:44.949418+0000","last_undegraded":"2023-10-06T03:23:44.949418+0000","last_fullsized":"2023-10-06T03:23:44.949418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:35.462631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.969737+0000","last_change":"2023-10-06T03:23:44.961492+0000","last_active":"2023-10-06T03:23:44.969737+0000","last_peered":"2023-10-06T03:23:44.969737+0000","last_clean":"2023-10-06T03:23:44.969737+0000","last_became_active":"2023-10-06T03:23:44.961050+0000","last_became_peered":"2023-10-06T03:23:44.961050+0000","last_unstale":"2023-10-06T03:23:44.969737+0000","last_undegraded":"2023-10-06T03:23:44.969737+0000","last_fullsized":"2023-10-06T03:23:44.969737+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:39.492194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.938294+0000","last_change":"2023-10-06T03:23:34.864399+0000","last_active":"2023-10-06T03:23:44.938294+0000","last_peered":"2023-10-06T03:23:44.938294+0000","last_clean":"2023-10-06T03:23:44.938294+0000","last_became_active":"2023-10-06T03:23:34.863991+0000","last_became_peered":"2023-10-06T03:23:34.863991+0000","last_unstale":"2023-10-06T03:23:44.938294+0000","last_undegraded":"2023-10-06T03:23:44.938294+0000","last_fullsized":"2023-10-06T03:23:44.938294+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:56:32.358597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.935729+0000","last_change":"2023-10-06T03:23:39.925094+0000","last_active":"2023-10-06T03:23:44.935729+0000","last_peered":"2023-10-06T03:23:44.935729+0000","last_clean":"2023-10-06T03:23:44.935729+0000","last_became_active":"2023-10-06T03:23:39.923918+0000","last_became_peered":"2023-10-06T03:23:39.923918+0000","last_unstale":"2023-10-06T03:23:44.935729+0000","last_undegraded":"2023-10-06T03:23:44.935729+0000","last_fullsized":"2023-10-06T03:23:44.935729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:25:21.422926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.938945+0000","last_change":"2023-10-06T03:23:40.663620+0000","last_active":"2023-10-06T03:23:44.938945+0000","last_peered":"2023-10-06T03:23:44.938945+0000","last_clean":"2023-10-06T03:23:44.938945+0000","last_became_active":"2023-10-06T03:23:40.663339+0000","last_became_peered":"2023-10-06T03:23:40.663339+0000","last_unstale":"2023-10-06T03:23:44.938945+0000","last_undegraded":"2023-10-06T03:23:44.938945+0000","last_fullsized":"2023-10-06T03:23:44.938945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:51:39.105798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.970567+0000","last_change":"2023-10-06T03:23:44.969165+0000","last_active":"2023-10-06T03:23:44.970567+0000","last_peered":"2023-10-06T03:23:44.970567+0000","last_clean":"2023-10-06T03:23:44.970567+0000","last_became_active":"2023-10-06T03:23:44.966357+0000","last_became_peered":"2023-10-06T03:23:44.966357+0000","last_unstale":"2023-10-06T03:23:44.970567+0000","last_undegraded":"2023-10-06T03:23:44.970567+0000","last_fullsized":"2023-10-06T03:23:44.970567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:56:31.830855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936245+0000","last_change":"2023-10-06T03:23:34.865125+0000","last_active":"2023-10-06T03:23:44.936245+0000","last_peered":"2023-10-06T03:23:44.936245+0000","last_clean":"2023-10-06T03:23:44.936245+0000","last_became_active":"2023-10-06T03:23:34.864752+0000","last_became_peered":"2023-10-06T03:23:34.864752+0000","last_unstale":"2023-10-06T03:23:44.936245+0000","last_undegraded":"2023-10-06T03:23:44.936245+0000","last_fullsized":"2023-10-06T03:23:44.936245+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:00.374963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.930358+0000","last_change":"2023-10-06T03:23:39.922954+0000","last_active":"2023-10-06T03:23:44.930358+0000","last_peered":"2023-10-06T03:23:44.930358+0000","last_clean":"2023-10-06T03:23:44.930358+0000","last_became_active":"2023-10-06T03:23:39.922405+0000","last_became_peered":"2023-10-06T03:23:39.922405+0000","last_unstale":"2023-10-06T03:23:44.930358+0000","last_undegraded":"2023-10-06T03:23:44.930358+0000","last_fullsized":"2023-10-06T03:23:44.930358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:52.557228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.944559+0000","last_change":"2023-10-06T03:23:40.672406+0000","last_active":"2023-10-06T03:23:44.944559+0000","last_peered":"2023-10-06T03:23:44.944559+0000","last_clean":"2023-10-06T03:23:44.944559+0000","last_became_active":"2023-10-06T03:23:40.672113+0000","last_became_peered":"2023-10-06T03:23:40.672113+0000","last_unstale":"2023-10-06T03:23:44.944559+0000","last_undegraded":"2023-10-06T03:23:44.944559+0000","last_fullsized":"2023-10-06T03:23:44.944559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:58.012559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.966608+0000","last_change":"2023-10-06T03:23:44.957635+0000","last_active":"2023-10-06T03:23:44.966608+0000","last_peered":"2023-10-06T03:23:44.966608+0000","last_clean":"2023-10-06T03:23:44.966608+0000","last_became_active":"2023-10-06T03:23:44.957238+0000","last_became_peered":"2023-10-06T03:23:44.957238+0000","last_unstale":"2023-10-06T03:23:44.966608+0000","last_undegraded":"2023-10-06T03:23:44.966608+0000","last_fullsized":"2023-10-06T03:23:44.966608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:53.182371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.934131+0000","last_change":"2023-10-06T03:23:34.864329+0000","last_active":"2023-10-06T03:23:44.934131+0000","last_peered":"2023-10-06T03:23:44.934131+0000","last_clean":"2023-10-06T03:23:44.934131+0000","last_became_active":"2023-10-06T03:23:34.863953+0000","last_became_peered":"2023-10-06T03:23:34.863953+0000","last_unstale":"2023-10-06T03:23:44.934131+0000","last_undegraded":"2023-10-06T03:23:44.934131+0000","last_fullsized":"2023-10-06T03:23:44.934131+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:30.204999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936822+0000","last_change":"2023-10-06T03:23:39.930279+0000","last_active":"2023-10-06T03:23:44.936822+0000","last_peered":"2023-10-06T03:23:44.936822+0000","last_clean":"2023-10-06T03:23:44.936822+0000","last_became_active":"2023-10-06T03:23:39.929992+0000","last_became_peered":"2023-10-06T03:23:39.929992+0000","last_unstale":"2023-10-06T03:23:44.936822+0000","last_undegraded":"2023-10-06T03:23:44.936822+0000","last_fullsized":"2023-10-06T03:23:44.936822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:10:12.819926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936204+0000","last_change":"2023-10-06T03:23:40.662851+0000","last_active":"2023-10-06T03:23:44.936204+0000","last_peered":"2023-10-06T03:23:44.936204+0000","last_clean":"2023-10-06T03:23:44.936204+0000","last_became_active":"2023-10-06T03:23:40.662555+0000","last_became_peered":"2023-10-06T03:23:40.662555+0000","last_unstale":"2023-10-06T03:23:44.936204+0000","last_undegraded":"2023-10-06T03:23:44.936204+0000","last_fullsized":"2023-10-06T03:23:44.936204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:29:10.177304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.958925+0000","last_change":"2023-10-06T03:23:44.955457+0000","last_active":"2023-10-06T03:23:44.958925+0000","last_peered":"2023-10-06T03:23:44.958925+0000","last_clean":"2023-10-06T03:23:44.958925+0000","last_became_active":"2023-10-06T03:23:44.954842+0000","last_became_peered":"2023-10-06T03:23:44.954842+0000","last_unstale":"2023-10-06T03:23:44.958925+0000","last_undegraded":"2023-10-06T03:23:44.958925+0000","last_fullsized":"2023-10-06T03:23:44.958925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:00.478388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.944665+0000","last_change":"2023-10-06T03:23:34.873939+0000","last_active":"2023-10-06T03:23:44.944665+0000","last_peered":"2023-10-06T03:23:44.944665+0000","last_clean":"2023-10-06T03:23:44.944665+0000","last_became_active":"2023-10-06T03:23:34.873623+0000","last_became_peered":"2023-10-06T03:23:34.873623+0000","last_unstale":"2023-10-06T03:23:44.944665+0000","last_undegraded":"2023-10-06T03:23:44.944665+0000","last_fullsized":"2023-10-06T03:23:44.944665+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:30.204999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936368+0000","last_change":"2023-10-06T03:23:39.923260+0000","last_active":"2023-10-06T03:23:44.936368+0000","last_peered":"2023-10-06T03:23:44.936368+0000","last_clean":"2023-10-06T03:23:44.936368+0000","last_became_active":"2023-10-06T03:23:39.922927+0000","last_became_peered":"2023-10-06T03:23:39.922927+0000","last_unstale":"2023-10-06T03:23:44.936368+0000","last_undegraded":"2023-10-06T03:23:44.936368+0000","last_fullsized":"2023-10-06T03:23:44.936368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:34.959833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.947472+0000","last_change":"2023-10-06T03:23:40.669315+0000","last_active":"2023-10-06T03:23:44.947472+0000","last_peered":"2023-10-06T03:23:44.947472+0000","last_clean":"2023-10-06T03:23:44.947472+0000","last_became_active":"2023-10-06T03:23:40.669061+0000","last_became_peered":"2023-10-06T03:23:40.669061+0000","last_unstale":"2023-10-06T03:23:44.947472+0000","last_undegraded":"2023-10-06T03:23:44.947472+0000","last_fullsized":"2023-10-06T03:23:44.947472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:56.483789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.966208+0000","last_change":"2023-10-06T03:23:44.962703+0000","last_active":"2023-10-06T03:23:44.966208+0000","last_peered":"2023-10-06T03:23:44.966208+0000","last_clean":"2023-10-06T03:23:44.966208+0000","last_became_active":"2023-10-06T03:23:44.957582+0000","last_became_peered":"2023-10-06T03:23:44.957582+0000","last_unstale":"2023-10-06T03:23:44.966208+0000","last_undegraded":"2023-10-06T03:23:44.966208+0000","last_fullsized":"2023-10-06T03:23:44.966208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:56:31.830855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.947663+0000","last_change":"2023-10-06T03:23:34.872453+0000","last_active":"2023-10-06T03:23:44.947663+0000","last_peered":"2023-10-06T03:23:44.947663+0000","last_clean":"2023-10-06T03:23:44.947663+0000","last_became_active":"2023-10-06T03:23:34.872139+0000","last_became_peered":"2023-10-06T03:23:34.872139+0000","last_unstale":"2023-10-06T03:23:44.947663+0000","last_undegraded":"2023-10-06T03:23:44.947663+0000","last_fullsized":"2023-10-06T03:23:44.947663+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:25:46.214290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.938700+0000","last_change":"2023-10-06T03:23:39.927321+0000","last_active":"2023-10-06T03:23:44.938700+0000","last_peered":"2023-10-06T03:23:44.938700+0000","last_clean":"2023-10-06T03:23:44.938700+0000","last_became_active":"2023-10-06T03:23:39.927057+0000","last_became_peered":"2023-10-06T03:23:39.927057+0000","last_unstale":"2023-10-06T03:23:44.938700+0000","last_undegraded":"2023-10-06T03:23:44.938700+0000","last_fullsized":"2023-10-06T03:23:44.938700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:52.557228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937835+0000","last_change":"2023-10-06T03:23:40.662143+0000","last_active":"2023-10-06T03:23:44.937835+0000","last_peered":"2023-10-06T03:23:44.937835+0000","last_clean":"2023-10-06T03:23:44.937835+0000","last_became_active":"2023-10-06T03:23:40.661885+0000","last_became_peered":"2023-10-06T03:23:40.661885+0000","last_unstale":"2023-10-06T03:23:44.937835+0000","last_undegraded":"2023-10-06T03:23:44.937835+0000","last_fullsized":"2023-10-06T03:23:44.937835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:04:49.664462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.954580+0000","last_change":"2023-10-06T03:23:44.952490+0000","last_active":"2023-10-06T03:23:44.954580+0000","last_peered":"2023-10-06T03:23:44.954580+0000","last_clean":"2023-10-06T03:23:44.954580+0000","last_became_active":"2023-10-06T03:23:44.951755+0000","last_became_peered":"2023-10-06T03:23:44.951755+0000","last_unstale":"2023-10-06T03:23:44.954580+0000","last_undegraded":"2023-10-06T03:23:44.954580+0000","last_fullsized":"2023-10-06T03:23:44.954580+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:37:11.632106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.947387+0000","last_change":"2023-10-06T03:23:39.927188+0000","last_active":"2023-10-06T03:23:44.947387+0000","last_peered":"2023-10-06T03:23:44.947387+0000","last_clean":"2023-10-06T03:23:44.947387+0000","last_became_active":"2023-10-06T03:23:39.926830+0000","last_became_peered":"2023-10-06T03:23:39.926830+0000","last_unstale":"2023-10-06T03:23:44.947387+0000","last_undegraded":"2023-10-06T03:23:44.947387+0000","last_fullsized":"2023-10-06T03:23:44.947387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:36.047828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.934779+0000","last_change":"2023-10-06T03:23:40.671601+0000","last_active":"2023-10-06T03:23:44.934779+0000","last_peered":"2023-10-06T03:23:44.934779+0000","last_clean":"2023-10-06T03:23:44.934779+0000","last_became_active":"2023-10-06T03:23:40.671312+0000","last_became_peered":"2023-10-06T03:23:40.671312+0000","last_unstale":"2023-10-06T03:23:44.934779+0000","last_undegraded":"2023-10-06T03:23:44.934779+0000","last_fullsized":"2023-10-06T03:23:44.934779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:42.254676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.966019+0000","last_change":"2023-10-06T03:23:44.964087+0000","last_active":"2023-10-06T03:23:44.966019+0000","last_peered":"2023-10-06T03:23:44.966019+0000","last_clean":"2023-10-06T03:23:44.966019+0000","last_became_active":"2023-10-06T03:23:44.963323+0000","last_became_peered":"2023-10-06T03:23:44.963323+0000","last_unstale":"2023-10-06T03:23:44.966019+0000","last_undegraded":"2023-10-06T03:23:44.966019+0000","last_fullsized":"2023-10-06T03:23:44.966019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:37:11.632106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.934389+0000","last_change":"2023-10-06T03:23:39.921245+0000","last_active":"2023-10-06T03:23:44.934389+0000","last_peered":"2023-10-06T03:23:44.934389+0000","last_clean":"2023-10-06T03:23:44.934389+0000","last_became_active":"2023-10-06T03:23:39.920740+0000","last_became_peered":"2023-10-06T03:23:39.920740+0000","last_unstale":"2023-10-06T03:23:44.934389+0000","last_undegraded":"2023-10-06T03:23:44.934389+0000","last_fullsized":"2023-10-06T03:23:44.934389+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:46:24.911513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936975+0000","last_change":"2023-10-06T03:23:40.665175+0000","last_active":"2023-10-06T03:23:44.936975+0000","last_peered":"2023-10-06T03:23:44.936975+0000","last_clean":"2023-10-06T03:23:44.936975+0000","last_became_active":"2023-10-06T03:23:40.664926+0000","last_became_peered":"2023-10-06T03:23:40.664926+0000","last_unstale":"2023-10-06T03:23:44.936975+0000","last_undegraded":"2023-10-06T03:23:44.936975+0000","last_fullsized":"2023-10-06T03:23:44.936975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:21.489097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.964364+0000","last_change":"2023-10-06T03:23:44.958192+0000","last_active":"2023-10-06T03:23:44.964364+0000","last_peered":"2023-10-06T03:23:44.964364+0000","last_clean":"2023-10-06T03:23:44.964364+0000","last_became_active":"2023-10-06T03:23:44.957757+0000","last_became_peered":"2023-10-06T03:23:44.957757+0000","last_unstale":"2023-10-06T03:23:44.964364+0000","last_undegraded":"2023-10-06T03:23:44.964364+0000","last_fullsized":"2023-10-06T03:23:44.964364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:32.743988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.938605+0000","last_change":"2023-10-06T03:23:39.923600+0000","last_active":"2023-10-06T03:23:44.938605+0000","last_peered":"2023-10-06T03:23:44.938605+0000","last_clean":"2023-10-06T03:23:44.938605+0000","last_became_active":"2023-10-06T03:23:39.923304+0000","last_became_peered":"2023-10-06T03:23:39.923304+0000","last_unstale":"2023-10-06T03:23:44.938605+0000","last_undegraded":"2023-10-06T03:23:44.938605+0000","last_fullsized":"2023-10-06T03:23:44.938605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:34.959833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936185+0000","last_change":"2023-10-06T03:23:40.665909+0000","last_active":"2023-10-06T03:23:44.936185+0000","last_peered":"2023-10-06T03:23:44.936185+0000","last_clean":"2023-10-06T03:23:44.936185+0000","last_became_active":"2023-10-06T03:23:40.665618+0000","last_became_peered":"2023-10-06T03:23:40.665618+0000","last_unstale":"2023-10-06T03:23:44.936185+0000","last_undegraded":"2023-10-06T03:23:44.936185+0000","last_fullsized":"2023-10-06T03:23:44.936185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:15.293618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.964221+0000","last_change":"2023-10-06T03:23:44.962232+0000","last_active":"2023-10-06T03:23:44.964221+0000","last_peered":"2023-10-06T03:23:44.964221+0000","last_clean":"2023-10-06T03:23:44.964221+0000","last_became_active":"2023-10-06T03:23:44.961871+0000","last_became_peered":"2023-10-06T03:23:44.961871+0000","last_unstale":"2023-10-06T03:23:44.964221+0000","last_undegraded":"2023-10-06T03:23:44.964221+0000","last_fullsized":"2023-10-06T03:23:44.964221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:17.153983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.931188+0000","last_change":"2023-10-06T03:23:39.922068+0000","last_active":"2023-10-06T03:23:44.931188+0000","last_peered":"2023-10-06T03:23:44.931188+0000","last_clean":"2023-10-06T03:23:44.931188+0000","last_became_active":"2023-10-06T03:23:39.921763+0000","last_became_peered":"2023-10-06T03:23:39.921763+0000","last_unstale":"2023-10-06T03:23:44.931188+0000","last_undegraded":"2023-10-06T03:23:44.931188+0000","last_fullsized":"2023-10-06T03:23:44.931188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:36.047828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.930511+0000","last_change":"2023-10-06T03:23:40.664327+0000","last_active":"2023-10-06T03:23:44.930511+0000","last_peered":"2023-10-06T03:23:44.930511+0000","last_clean":"2023-10-06T03:23:44.930511+0000","last_became_active":"2023-10-06T03:23:40.664073+0000","last_became_peered":"2023-10-06T03:23:40.664073+0000","last_unstale":"2023-10-06T03:23:44.930511+0000","last_undegraded":"2023-10-06T03:23:44.930511+0000","last_fullsized":"2023-10-06T03:23:44.930511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:36:33.973063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.962224+0000","last_change":"2023-10-06T03:23:44.956207+0000","last_active":"2023-10-06T03:23:44.962224+0000","last_peered":"2023-10-06T03:23:44.962224+0000","last_clean":"2023-10-06T03:23:44.962224+0000","last_became_active":"2023-10-06T03:23:44.955806+0000","last_became_peered":"2023-10-06T03:23:44.955806+0000","last_unstale":"2023-10-06T03:23:44.962224+0000","last_undegraded":"2023-10-06T03:23:44.962224+0000","last_fullsized":"2023-10-06T03:23:44.962224+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:43.920201+0000","last_clean_scrub_stamp":"2023-10-06T03:23:43.920201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:26.358389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.947996+0000","last_change":"2023-10-06T03:23:39.923144+0000","last_active":"2023-10-06T03:23:44.947996+0000","last_peered":"2023-10-06T03:23:44.947996+0000","last_clean":"2023-10-06T03:23:44.947996+0000","last_became_active":"2023-10-06T03:23:39.922061+0000","last_became_peered":"2023-10-06T03:23:39.922061+0000","last_unstale":"2023-10-06T03:23:44.947996+0000","last_undegraded":"2023-10-06T03:23:44.947996+0000","last_fullsized":"2023-10-06T03:23:44.947996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:38.881860+0000","last_clean_scrub_stamp":"2023-10-06T03:23:38.881860+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:46:24.911513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.937147+0000","last_change":"2023-10-06T03:23:40.676711+0000","last_active":"2023-10-06T03:23:44.937147+0000","last_peered":"2023-10-06T03:23:44.937147+0000","last_clean":"2023-10-06T03:23:44.937147+0000","last_became_active":"2023-10-06T03:23:40.671550+0000","last_became_peered":"2023-10-06T03:23:40.671550+0000","last_unstale":"2023-10-06T03:23:44.937147+0000","last_undegraded":"2023-10-06T03:23:44.937147+0000","last_fullsized":"2023-10-06T03:23:44.937147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:27:42.172925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.944242+0000","last_change":"2023-10-06T03:23:40.661484+0000","last_active":"2023-10-06T03:23:44.944242+0000","last_peered":"2023-10-06T03:23:44.944242+0000","last_clean":"2023-10-06T03:23:44.944242+0000","last_became_active":"2023-10-06T03:23:40.661161+0000","last_became_peered":"2023-10-06T03:23:40.661161+0000","last_unstale":"2023-10-06T03:23:44.944242+0000","last_undegraded":"2023-10-06T03:23:44.944242+0000","last_fullsized":"2023-10-06T03:23:44.944242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:22.437514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.930421+0000","last_change":"2023-10-06T03:23:40.667283+0000","last_active":"2023-10-06T03:23:44.930421+0000","last_peered":"2023-10-06T03:23:44.930421+0000","last_clean":"2023-10-06T03:23:44.930421+0000","last_became_active":"2023-10-06T03:23:40.667036+0000","last_became_peered":"2023-10-06T03:23:40.667036+0000","last_unstale":"2023-10-06T03:23:44.930421+0000","last_undegraded":"2023-10-06T03:23:44.930421+0000","last_fullsized":"2023-10-06T03:23:44.930421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:54:33.855202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936441+0000","last_change":"2023-10-06T03:23:40.672592+0000","last_active":"2023-10-06T03:23:44.936441+0000","last_peered":"2023-10-06T03:23:44.936441+0000","last_clean":"2023-10-06T03:23:44.936441+0000","last_became_active":"2023-10-06T03:23:40.668259+0000","last_became_peered":"2023-10-06T03:23:40.668259+0000","last_unstale":"2023-10-06T03:23:44.936441+0000","last_undegraded":"2023-10-06T03:23:44.936441+0000","last_fullsized":"2023-10-06T03:23:44.936441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:42:53.927175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.930385+0000","last_change":"2023-10-06T03:23:40.668141+0000","last_active":"2023-10-06T03:23:44.930385+0000","last_peered":"2023-10-06T03:23:44.930385+0000","last_clean":"2023-10-06T03:23:44.930385+0000","last_became_active":"2023-10-06T03:23:40.667709+0000","last_became_peered":"2023-10-06T03:23:40.667709+0000","last_unstale":"2023-10-06T03:23:44.930385+0000","last_undegraded":"2023-10-06T03:23:44.930385+0000","last_fullsized":"2023-10-06T03:23:44.930385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:43:56.448825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:23:44.936286+0000","last_change":"2023-10-06T03:23:40.662860+0000","last_active":"2023-10-06T03:23:44.936286+0000","last_peered":"2023-10-06T03:23:44.936286+0000","last_clean":"2023-10-06T03:23:44.936286+0000","last_became_active":"2023-10-06T03:23:40.662635+0000","last_became_peered":"2023-10-06T03:23:40.662635+0000","last_unstale":"2023-10-06T03:23:44.936286+0000","last_undegraded":"2023-10-06T03:23:44.936286+0000","last_fullsized":"2023-10-06T03:23:44.936286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:39.890638+0000","last_clean_scrub_stamp":"2023-10-06T03:23:39.890638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:58.012559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4484,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298144,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073696,"statfs":{"total":96636764160,"available":96331464704,"internally_reserved":0,"allocated":876544,"data_stored":698736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297532,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074308,"statfs":{"total":96636764160,"available":96332091392,"internally_reserved":0,"allocated":249856,"data_stored":103085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298116,"kb_used_data":828,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073724,"statfs":{"total":96636764160,"available":96331493376,"internally_reserved":0,"allocated":847872,"data_stored":694806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297540,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074300,"statfs":{"total":96636764160,"available":96332083200,"internally_reserved":0,"allocated":258048,"data_stored":104992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":253952,"data_stored":104438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297540,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074300,"statfs":{"total":96636764160,"available":96332083200,"internally_reserved":0,"allocated":258048,"data_stored":104528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297556,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074284,"statfs":{"total":96636764160,"available":96332066816,"internally_reserved":0,"allocated":274432,"data_stored":108208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297544,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074296,"statfs":{"total":96636764160,"available":96332079104,"internally_reserved":0,"allocated":262144,"data_stored":105062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:24:03.877 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-06T03:24:03.877 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-06T03:24:03.877 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-06T03:24:03.878 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-06T03:24:04.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.086+0000 7f626e9ff700 1 Processor -- start 2023-10-06T03:24:04.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.086+0000 7f626e9ff700 1 -- start start 2023-10-06T03:24:04.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.087+0000 7f626e9ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6268153a90 0x7f626815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:04.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.087+0000 7f626e9ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f62680b23b0 0x7f62680cb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:04.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.087+0000 7f626e9ff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62680b2830 con 0x7f6268153e60 2023-10-06T03:24:04.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.087+0000 7f626e9ff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6268067cf0 con 0x7f62680b23b0 2023-10-06T03:24:04.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.087+0000 7f626e9ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62680c9f50 con 0x7f6268153a90 2023-10-06T03:24:04.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.088+0000 7f626cf9c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f62680b23b0 0x7f62680cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:04.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.088+0000 7f6267fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6268153a90 0x7f626815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:04.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.088+0000 7f626cf9c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f62680b23b0 0x7f62680cb860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:51110/0 (socket says 172.21.15.81:51110) 2023-10-06T03:24:04.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.088+0000 7f626cf9c700 1 -- 172.21.15.81:0/1694665358 learned_addr learned my addr 172.21.15.81:0/1694665358 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:04.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.088+0000 7f62677fe700 1 --1- 172.21.15.81:0/1694665358 >> v1:172.21.15.83:6789/0 conn(0x7f6268153e60 0x7f62680675e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:40176/0 (socket says 172.21.15.81:40176) 2023-10-06T03:24:04.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.088+0000 7f626cf9c700 1 -- 172.21.15.81:0/1694665358 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6268153a90 msgr2=0x7f626815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:04.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.088+0000 7f626cf9c700 1 --2- 172.21.15.81:0/1694665358 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6268153a90 0x7f626815a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:04.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.088+0000 7f626cf9c700 1 -- 172.21.15.81:0/1694665358 >> v1:172.21.15.83:6789/0 conn(0x7f6268153e60 legacy=0x7f62680675e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:04.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.088+0000 7f626cf9c700 1 -- 172.21.15.81:0/1694665358 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62680ca230 con 0x7f62680b23b0 2023-10-06T03:24:04.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.089+0000 7f626cf9c700 1 --2- 172.21.15.81:0/1694665358 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f62680b23b0 0x7f62680cb860 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6260009f20 tx=0x7f6260009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c59cb60e50934d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:04.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.089+0000 7f6266ffd700 1 -- 172.21.15.81:0/1694665358 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626000e070 con 0x7f62680b23b0 2023-10-06T03:24:04.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.089+0000 7f6266ffd700 1 -- 172.21.15.81:0/1694665358 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626000b9d0 con 0x7f62680b23b0 2023-10-06T03:24:04.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.089+0000 7f6266ffd700 1 -- 172.21.15.81:0/1694665358 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62600092e0 con 0x7f62680b23b0 2023-10-06T03:24:04.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.089+0000 7f626e9ff700 1 -- 172.21.15.81:0/1694665358 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f62680b23b0 msgr2=0x7f62680cb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:04.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.089+0000 7f626e9ff700 1 --2- 172.21.15.81:0/1694665358 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f62680b23b0 0x7f62680cb860 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6260009f20 tx=0x7f6260009840 comp rx=0 tx=0).stop 2023-10-06T03:24:04.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.089+0000 7f626e9ff700 1 -- 172.21.15.81:0/1694665358 shutdown_connections 2023-10-06T03:24:04.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.089+0000 7f626e9ff700 1 --2- 172.21.15.81:0/1694665358 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f62680b23b0 0x7f62680cb860 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:04.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.089+0000 7f626e9ff700 1 --2- 172.21.15.81:0/1694665358 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6268153a90 0x7f626815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:04.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.089+0000 7f626e9ff700 1 -- 172.21.15.81:0/1694665358 >> 172.21.15.81:0/1694665358 conn(0x7f62680cd3c0 msgr2=0x7f62680b1860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:04.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.090+0000 7f626e9ff700 1 -- 172.21.15.81:0/1694665358 shutdown_connections 2023-10-06T03:24:04.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.090+0000 7f626e9ff700 1 -- 172.21.15.81:0/1694665358 wait complete. 2023-10-06T03:24:04.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.091+0000 7f626e9ff700 1 Processor -- start 2023-10-06T03:24:04.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.091+0000 7f626e9ff700 1 -- start start 2023-10-06T03:24:04.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.092+0000 7f626e9ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f62680b23b0 0x7f6268159430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:04.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.092+0000 7f626e9ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6268153a90 0x7f626813cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:04.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.092+0000 7f626e9ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6268153e60 0x7f626813d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:04.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.092+0000 7f626e9ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626813d960 con 0x7f6268153a90 2023-10-06T03:24:04.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.092+0000 7f626e9ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6268159970 con 0x7f6268153e60 2023-10-06T03:24:04.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.092+0000 7f626e9ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62680c6150 con 0x7f62680b23b0 2023-10-06T03:24:04.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.092+0000 7f62677fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6268153a90 0x7f626813cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:04.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.092+0000 7f6267fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f62680b23b0 0x7f6268159430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:04.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.092+0000 7f62677fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6268153a90 0x7f626813cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56452/0 (socket says 172.21.15.81:56452) 2023-10-06T03:24:04.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.092+0000 7f62677fe700 1 -- 172.21.15.81:0/2766599135 learned_addr learned my addr 172.21.15.81:0/2766599135 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:04.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.092+0000 7f626cf9c700 1 --2- 172.21.15.81:0/2766599135 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6268153e60 0x7f626813d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:04.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.093+0000 7f62677fe700 1 -- 172.21.15.81:0/2766599135 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f62680b23b0 msgr2=0x7f6268159430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:04.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.093+0000 7f62677fe700 1 --2- 172.21.15.81:0/2766599135 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f62680b23b0 0x7f6268159430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:04.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.093+0000 7f62677fe700 1 -- 172.21.15.81:0/2766599135 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6268153e60 msgr2=0x7f626813d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:04.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.093+0000 7f62677fe700 1 --2- 172.21.15.81:0/2766599135 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6268153e60 0x7f626813d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:04.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.093+0000 7f62677fe700 1 -- 172.21.15.81:0/2766599135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6260009ae0 con 0x7f6268153a90 2023-10-06T03:24:04.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.093+0000 7f62677fe700 1 --2- 172.21.15.81:0/2766599135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6268153a90 0x7f626813cee0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f625c00c590 tx=0x7f625c007f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:04.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.093+0000 7f624ffff700 1 -- 172.21.15.81:0/2766599135 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625c005a70 con 0x7f6268153a90 2023-10-06T03:24:04.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.093+0000 7f624ffff700 1 -- 172.21.15.81:0/2766599135 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f625c005bf0 con 0x7f6268153a90 2023-10-06T03:24:04.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.093+0000 7f624ffff700 1 -- 172.21.15.81:0/2766599135 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625c0070d0 con 0x7f6268153a90 2023-10-06T03:24:04.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.093+0000 7f626e9ff700 1 -- 172.21.15.81:0/2766599135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62680c7280 con 0x7f6268153a90 2023-10-06T03:24:04.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.093+0000 7f626e9ff700 1 -- 172.21.15.81:0/2766599135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62680c7840 con 0x7f6268153a90 2023-10-06T03:24:04.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.094+0000 7f626e9ff700 1 -- 172.21.15.81:0/2766599135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62680c7a30 con 0x7f6268153a90 2023-10-06T03:24:04.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.095+0000 7f624ffff700 1 -- 172.21.15.81:0/2766599135 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f625c007480 con 0x7f6268153a90 2023-10-06T03:24:04.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.096+0000 7f624ffff700 1 --2- 172.21.15.81:0/2766599135 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f6254066f30 0x7f62540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:04.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.096+0000 7f624ffff700 1 -- 172.21.15.81:0/2766599135 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f625c083d30 con 0x7f6268153a90 2023-10-06T03:24:04.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.096+0000 7f6267fff700 1 --2- 172.21.15.81:0/2766599135 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f6254066f30 0x7f62540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:04.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.097+0000 7f6267fff700 1 --2- 172.21.15.81:0/2766599135 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f6254066f30 0x7f62540693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6258009db0 tx=0x7f62580091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:04.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.100+0000 7f624ffff700 1 -- 172.21.15.81:0/2766599135 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f625c050b50 con 0x7f6268153a90 2023-10-06T03:24:04.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.333+0000 7f626e9ff700 1 -- 172.21.15.81:0/2766599135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f626804c3c0 con 0x7f6268153a90 2023-10-06T03:24:04.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.333+0000 7f624ffff700 1 -- 172.21.15.81:0/2766599135 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f625c017080 con 0x7f6268153a90 2023-10-06T03:24:04.336 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:24:04.337 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-06T03:24:04.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.336+0000 7f626e9ff700 1 -- 172.21.15.81:0/2766599135 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f6254066f30 msgr2=0x7f62540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:04.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.336+0000 7f626e9ff700 1 --2- 172.21.15.81:0/2766599135 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f6254066f30 0x7f62540693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6258009db0 tx=0x7f62580091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:04.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.336+0000 7f626e9ff700 1 -- 172.21.15.81:0/2766599135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6268153a90 msgr2=0x7f626813cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:04.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.336+0000 7f626e9ff700 1 --2- 172.21.15.81:0/2766599135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6268153a90 0x7f626813cee0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f625c00c590 tx=0x7f625c007f10 comp rx=0 tx=0).stop 2023-10-06T03:24:04.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.336+0000 7f626e9ff700 1 -- 172.21.15.81:0/2766599135 shutdown_connections 2023-10-06T03:24:04.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.336+0000 7f626e9ff700 1 --2- 172.21.15.81:0/2766599135 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6268153e60 0x7f626813d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:04.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.336+0000 7f626e9ff700 1 --2- 172.21.15.81:0/2766599135 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f6254066f30 0x7f62540693e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:04.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.336+0000 7f626e9ff700 1 --2- 172.21.15.81:0/2766599135 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f62680b23b0 0x7f6268159430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:04.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.336+0000 7f626e9ff700 1 --2- 172.21.15.81:0/2766599135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6268153a90 0x7f626813cee0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:04.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.336+0000 7f626e9ff700 1 -- 172.21.15.81:0/2766599135 >> 172.21.15.81:0/2766599135 conn(0x7f62680cd3c0 msgr2=0x7f62680cb820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:04.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.336+0000 7f626e9ff700 1 -- 172.21.15.81:0/2766599135 shutdown_connections 2023-10-06T03:24:04.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.336+0000 7f626e9ff700 1 -- 172.21.15.81:0/2766599135 wait complete. 2023-10-06T03:24:04.356 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-06T03:24:04.357 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:24:04.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.539+0000 7f42e1d9d700 1 Processor -- start 2023-10-06T03:24:04.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.539+0000 7f42e1d9d700 1 -- start start 2023-10-06T03:24:04.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.540+0000 7f42e1d9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42dc156270 0x7f42dc0ad210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:04.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.540+0000 7f42e1d9d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42dc0ae480 con 0x7f42dc0b0750 2023-10-06T03:24:04.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.540+0000 7f42e1d9d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42dc0ad870 con 0x7f42dc155ea0 2023-10-06T03:24:04.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.540+0000 7f42e1d9d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42dc0adb50 con 0x7f42dc156270 2023-10-06T03:24:04.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.540+0000 7f42e159c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42dc156270 0x7f42dc0ad210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:04.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.540+0000 7f42dbfff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f42dc0b0750 0x7f42dc0acb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39484/0 (socket says 172.21.15.81:39484) 2023-10-06T03:24:04.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.540+0000 7f42dbfff700 1 -- 172.21.15.81:0/191275227 learned_addr learned my addr 172.21.15.81:0/191275227 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:24:04.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.540+0000 7f42e0d9b700 1 --1- 172.21.15.81:0/191275227 >> v1:172.21.15.83:6789/0 conn(0x7f42dc155ea0 0x7f42dc0b0040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:40182/0 (socket says 172.21.15.81:40182) 2023-10-06T03:24:04.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.541+0000 7f42db7fe700 1 -- 172.21.15.81:0/191275227 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3108297609 0 0) 0x7f42dc0ad870 con 0x7f42dc155ea0 2023-10-06T03:24:04.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.541+0000 7f42db7fe700 1 -- 172.21.15.81:0/191275227 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42cc003570 con 0x7f42dc155ea0 2023-10-06T03:24:04.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.541+0000 7f42db7fe700 1 -- 172.21.15.81:0/191275227 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1328045008 0 0) 0x7f42dc0ae480 con 0x7f42dc0b0750 2023-10-06T03:24:04.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.541+0000 7f42e159c700 1 -- 172.21.15.81:0/191275227 >> v1:172.21.15.83:6789/0 conn(0x7f42dc155ea0 legacy=0x7f42dc0b0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:04.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.541+0000 7f42e159c700 1 -- 172.21.15.81:0/191275227 >> v1:172.21.15.81:6789/0 conn(0x7f42dc0b0750 legacy=0x7f42dc0acb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:04.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.541+0000 7f42e159c700 1 -- 172.21.15.81:0/191275227 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42dc0ade30 con 0x7f42dc156270 2023-10-06T03:24:04.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.541+0000 7f42e159c700 1 --2- 172.21.15.81:0/191275227 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42dc156270 0x7f42dc0ad210 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f42d400d100 tx=0x7f42d400b990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e07ceec2d24e4420 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:04.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.541+0000 7f42db7fe700 1 -- 172.21.15.81:0/191275227 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d4010070 con 0x7f42dc156270 2023-10-06T03:24:04.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.542+0000 7f42db7fe700 1 -- 172.21.15.81:0/191275227 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42d400b2e0 con 0x7f42dc156270 2023-10-06T03:24:04.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.542+0000 7f42db7fe700 1 -- 172.21.15.81:0/191275227 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d400ddb0 con 0x7f42dc156270 2023-10-06T03:24:04.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.542+0000 7f42e1d9d700 1 -- 172.21.15.81:0/191275227 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42dc156270 msgr2=0x7f42dc0ad210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:04.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.542+0000 7f42e1d9d700 1 --2- 172.21.15.81:0/191275227 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42dc156270 0x7f42dc0ad210 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f42d400d100 tx=0x7f42d400b990 comp rx=0 tx=0).stop 2023-10-06T03:24:04.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.542+0000 7f42e1d9d700 1 -- 172.21.15.81:0/191275227 shutdown_connections 2023-10-06T03:24:04.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.542+0000 7f42e1d9d700 1 --2- 172.21.15.81:0/191275227 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42dc156270 0x7f42dc0ad210 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:04.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.542+0000 7f42e1d9d700 1 -- 172.21.15.81:0/191275227 >> 172.21.15.81:0/191275227 conn(0x7f42dc068060 msgr2=0x7f42dc0cbeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:04.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.542+0000 7f42e1d9d700 1 -- 172.21.15.81:0/191275227 shutdown_connections 2023-10-06T03:24:04.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.542+0000 7f42e1d9d700 1 -- 172.21.15.81:0/191275227 wait complete. 2023-10-06T03:24:04.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.544+0000 7f42e1d9d700 1 Processor -- start 2023-10-06T03:24:04.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.544+0000 7f42e1d9d700 1 -- start start 2023-10-06T03:24:04.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.545+0000 7f42e1d9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42dc0b0750 0x7f42dc141c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:04.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.545+0000 7f42e1d9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f42dc155ea0 0x7f42dc14d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:04.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.545+0000 7f42e1d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42dc156270 0x7f42dc0cab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:04.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.545+0000 7f42e1d9d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42dc14db50 con 0x7f42dc156270 2023-10-06T03:24:04.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.545+0000 7f42e1d9d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42dc0cb3a0 con 0x7f42dc155ea0 2023-10-06T03:24:04.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.545+0000 7f42e1d9d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42dc0cb680 con 0x7f42dc0b0750 2023-10-06T03:24:04.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.545+0000 7f42e159c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42dc156270 0x7f42dc0cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:04.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.545+0000 7f42e159c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42dc156270 0x7f42dc0cab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56456/0 (socket says 172.21.15.81:56456) 2023-10-06T03:24:04.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.545+0000 7f42e159c700 1 -- 172.21.15.81:0/4228846062 learned_addr learned my addr 172.21.15.81:0/4228846062 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:04.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.545+0000 7f42e0d9b700 1 --2- 172.21.15.81:0/4228846062 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42dc0b0750 0x7f42dc141c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:04.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.545+0000 7f42dbfff700 1 --2- 172.21.15.81:0/4228846062 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f42dc155ea0 0x7f42dc14d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:04.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.545+0000 7f42e159c700 1 -- 172.21.15.81:0/4228846062 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42dc0b0750 msgr2=0x7f42dc141c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:04.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.545+0000 7f42e159c700 1 --2- 172.21.15.81:0/4228846062 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42dc0b0750 0x7f42dc141c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:04.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.545+0000 7f42e159c700 1 -- 172.21.15.81:0/4228846062 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f42dc155ea0 msgr2=0x7f42dc14d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:04.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.545+0000 7f42e159c700 1 --2- 172.21.15.81:0/4228846062 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f42dc155ea0 0x7f42dc14d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:04.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.545+0000 7f42e159c700 1 -- 172.21.15.81:0/4228846062 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d400bc30 con 0x7f42dc156270 2023-10-06T03:24:04.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.546+0000 7f42e159c700 1 --2- 172.21.15.81:0/4228846062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42dc156270 0x7f42dc0cab40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f42d400bc00 tx=0x7f42d401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:04.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.546+0000 7f42d8ff9700 1 -- 172.21.15.81:0/4228846062 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d4009310 con 0x7f42dc156270 2023-10-06T03:24:04.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.546+0000 7f42d8ff9700 1 -- 172.21.15.81:0/4228846062 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42d401d430 con 0x7f42dc156270 2023-10-06T03:24:04.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.546+0000 7f42e1d9d700 1 -- 172.21.15.81:0/4228846062 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42dc145f60 con 0x7f42dc156270 2023-10-06T03:24:04.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.546+0000 7f42d8ff9700 1 -- 172.21.15.81:0/4228846062 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d401d7f0 con 0x7f42dc156270 2023-10-06T03:24:04.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.546+0000 7f42e1d9d700 1 -- 172.21.15.81:0/4228846062 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42dc146520 con 0x7f42dc156270 2023-10-06T03:24:04.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.547+0000 7f42e1d9d700 1 -- 172.21.15.81:0/4228846062 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42dc146710 con 0x7f42dc156270 2023-10-06T03:24:04.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.548+0000 7f42d8ff9700 1 -- 172.21.15.81:0/4228846062 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f42d401dc20 con 0x7f42dc156270 2023-10-06T03:24:04.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.549+0000 7f42d8ff9700 1 --2- 172.21.15.81:0/4228846062 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f42c0066f60 0x7f42c0069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:04.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.549+0000 7f42d8ff9700 1 -- 172.21.15.81:0/4228846062 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f42d4086380 con 0x7f42dc156270 2023-10-06T03:24:04.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.549+0000 7f42e0d9b700 1 --2- 172.21.15.81:0/4228846062 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f42c0066f60 0x7f42c0069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:04.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.550+0000 7f42e0d9b700 1 --2- 172.21.15.81:0/4228846062 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f42c0066f60 0x7f42c0069410 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f42d0005e30 tx=0x7f42d0007b90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:04.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.553+0000 7f42d8ff9700 1 -- 172.21.15.81:0/4228846062 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f42d40531a0 con 0x7f42dc156270 2023-10-06T03:24:04.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.752+0000 7f42e1d9d700 1 -- 172.21.15.81:0/4228846062 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42dc0ae110 con 0x7f42dc156270 2023-10-06T03:24:04.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.753+0000 7f42d8ff9700 1 -- 172.21.15.81:0/4228846062 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18659 (secure 0 0 0) 0x7f42d40567c0 con 0x7f42dc156270 2023-10-06T03:24:04.755 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:24:04.756 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"fsid":"1807b5d7-9be8-43ad-aaf8-99a4273430b3","created":"2023-10-06T03:23:20.805306+0000","modified":"2023-10-06T03:23:45.419616+0000","last_up_change":"2023-10-06T03:23:32.735796+0000","last_in_change":"2023-10-06T03:23:24.109024+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:33.198850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:33.606744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:23:38.742266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:23:39.347944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:23:42.959054+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"14fb667d-a677-4978-a477-80027f889d36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":85563},{"type":"v1","addr":"172.21.15.81:6818","nonce":85563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":85563},{"type":"v1","addr":"172.21.15.81:6822","nonce":85563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":85563},{"type":"v1","addr":"172.21.15.81:6830","nonce":85563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":85563},{"type":"v1","addr":"172.21.15.81:6826","nonce":85563}]},"public_addr":"172.21.15.81:6818/85563","cluster_addr":"172.21.15.81:6822/85563","heartbeat_back_addr":"172.21.15.81:6830/85563","heartbeat_front_addr":"172.21.15.81:6826/85563","state":["exists","up"]},{"osd":1,"uuid":"974d8a86-1829-4176-89ce-18e6038857f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":85561},{"type":"v1","addr":"172.21.15.81:6801","nonce":85561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":85561},{"type":"v1","addr":"172.21.15.81:6803","nonce":85561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":85561},{"type":"v1","addr":"172.21.15.81:6807","nonce":85561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":85561},{"type":"v1","addr":"172.21.15.81:6805","nonce":85561}]},"public_addr":"172.21.15.81:6801/85561","cluster_addr":"172.21.15.81:6803/85561","heartbeat_back_addr":"172.21.15.81:6807/85561","heartbeat_front_addr":"172.21.15.81:6805/85561","state":["exists","up"]},{"osd":2,"uuid":"ffbfe056-46bc-46e0-bf49-4d8f8650e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":85564},{"type":"v1","addr":"172.21.15.81:6809","nonce":85564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":85564},{"type":"v1","addr":"172.21.15.81:6811","nonce":85564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":85564},{"type":"v1","addr":"172.21.15.81:6815","nonce":85564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":85564},{"type":"v1","addr":"172.21.15.81:6813","nonce":85564}]},"public_addr":"172.21.15.81:6809/85564","cluster_addr":"172.21.15.81:6811/85564","heartbeat_back_addr":"172.21.15.81:6815/85564","heartbeat_front_addr":"172.21.15.81:6813/85564","state":["exists","up"]},{"osd":3,"uuid":"ef9a8314-3d37-4ea1-858a-e704d5695002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":85562},{"type":"v1","addr":"172.21.15.81:6819","nonce":85562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":85562},{"type":"v1","addr":"172.21.15.81:6823","nonce":85562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":85562},{"type":"v1","addr":"172.21.15.81:6831","nonce":85562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":85562},{"type":"v1","addr":"172.21.15.81:6827","nonce":85562}]},"public_addr":"172.21.15.81:6819/85562","cluster_addr":"172.21.15.81:6823/85562","heartbeat_back_addr":"172.21.15.81:6831/85562","heartbeat_front_addr":"172.21.15.81:6827/85562","state":["exists","up"]},{"osd":4,"uuid":"d83506a0-2c96-4bcb-a9fa-05e43dc329df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":85785},{"type":"v1","addr":"172.21.15.83:6801","nonce":85785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":85785},{"type":"v1","addr":"172.21.15.83:6803","nonce":85785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":85785},{"type":"v1","addr":"172.21.15.83:6807","nonce":85785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":85785},{"type":"v1","addr":"172.21.15.83:6805","nonce":85785}]},"public_addr":"172.21.15.83:6801/85785","cluster_addr":"172.21.15.83:6803/85785","heartbeat_back_addr":"172.21.15.83:6807/85785","heartbeat_front_addr":"172.21.15.83:6805/85785","state":["exists","up"]},{"osd":5,"uuid":"10687c63-a3d5-472f-acc0-4f61847b6e0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":85818},{"type":"v1","addr":"172.21.15.83:6825","nonce":85818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":85818},{"type":"v1","addr":"172.21.15.83:6827","nonce":85818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":85818},{"type":"v1","addr":"172.21.15.83:6831","nonce":85818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":85818},{"type":"v1","addr":"172.21.15.83:6829","nonce":85818}]},"public_addr":"172.21.15.83:6825/85818","cluster_addr":"172.21.15.83:6827/85818","heartbeat_back_addr":"172.21.15.83:6831/85818","heartbeat_front_addr":"172.21.15.83:6829/85818","state":["exists","up"]},{"osd":6,"uuid":"2e9daf76-5607-4a29-9a58-6e270700d223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":85787},{"type":"v1","addr":"172.21.15.83:6811","nonce":85787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":85787},{"type":"v1","addr":"172.21.15.83:6815","nonce":85787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":85787},{"type":"v1","addr":"172.21.15.83:6823","nonce":85787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6817","nonce":85787},{"type":"v1","addr":"172.21.15.83:6819","nonce":85787}]},"public_addr":"172.21.15.83:6811/85787","cluster_addr":"172.21.15.83:6815/85787","heartbeat_back_addr":"172.21.15.83:6823/85787","heartbeat_front_addr":"172.21.15.83:6819/85787","state":["exists","up"]},{"osd":7,"uuid":"5019e1ff-233a-4a5a-91ca-8afccb7ab6e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":85786},{"type":"v1","addr":"172.21.15.83:6810","nonce":85786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":85786},{"type":"v1","addr":"172.21.15.83:6814","nonce":85786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":85786},{"type":"v1","addr":"172.21.15.83:6822","nonce":85786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":85786},{"type":"v1","addr":"172.21.15.83:6818","nonce":85786}]},"public_addr":"172.21.15.83:6810/85786","cluster_addr":"172.21.15.83:6814/85786","heartbeat_back_addr":"172.21.15.83:6822/85786","heartbeat_front_addr":"172.21.15.83:6818/85786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.393431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.360031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.407428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.391613+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.403211+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.438142+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.496181+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.472323+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:24:04.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.755+0000 7f42e1d9d700 1 -- 172.21.15.81:0/4228846062 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f42c0066f60 msgr2=0x7f42c0069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:04.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.755+0000 7f42e1d9d700 1 --2- 172.21.15.81:0/4228846062 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f42c0066f60 0x7f42c0069410 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f42d0005e30 tx=0x7f42d0007b90 comp rx=0 tx=0).stop 2023-10-06T03:24:04.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.755+0000 7f42e1d9d700 1 -- 172.21.15.81:0/4228846062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42dc156270 msgr2=0x7f42dc0cab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:04.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.755+0000 7f42e1d9d700 1 --2- 172.21.15.81:0/4228846062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42dc156270 0x7f42dc0cab40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f42d400bc00 tx=0x7f42d401a000 comp rx=0 tx=0).stop 2023-10-06T03:24:04.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.756+0000 7f42e1d9d700 1 -- 172.21.15.81:0/4228846062 shutdown_connections 2023-10-06T03:24:04.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.756+0000 7f42e1d9d700 1 --2- 172.21.15.81:0/4228846062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42dc156270 0x7f42dc0cab40 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:04.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.756+0000 7f42e1d9d700 1 --2- 172.21.15.81:0/4228846062 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f42c0066f60 0x7f42c0069410 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:04.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.756+0000 7f42e1d9d700 1 --2- 172.21.15.81:0/4228846062 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42dc0b0750 0x7f42dc141c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:04.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.756+0000 7f42e1d9d700 1 --2- 172.21.15.81:0/4228846062 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f42dc155ea0 0x7f42dc14d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:04.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.756+0000 7f42e1d9d700 1 -- 172.21.15.81:0/4228846062 >> 172.21.15.81:0/4228846062 conn(0x7f42dc068060 msgr2=0x7f42dc14a290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:04.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.756+0000 7f42e1d9d700 1 -- 172.21.15.81:0/4228846062 shutdown_connections 2023-10-06T03:24:04.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.756+0000 7f42e1d9d700 1 -- 172.21.15.81:0/4228846062 wait complete. 2023-10-06T03:24:04.776 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:23:33.198850+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:23:33.606744+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:23:38.742266+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:23:39.347944+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T03:23:42.959054+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:24:04.776 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:24:04.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.958+0000 7f29275ff700 1 Processor -- start 2023-10-06T03:24:04.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.958+0000 7f29275ff700 1 -- start start 2023-10-06T03:24:04.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.959+0000 7f29275ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f29200ca640 0x7f292015a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:04.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.959+0000 7f29275ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f292015ad10 0x7f29200c6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:04.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.959+0000 7f29275ff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29200cb580 con 0x7f292013fd70 2023-10-06T03:24:04.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.959+0000 7f29275ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29200caac0 con 0x7f29200ca640 2023-10-06T03:24:04.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.959+0000 7f29275ff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29200c6800 con 0x7f292015ad10 2023-10-06T03:24:04.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.960+0000 7f2924b9a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f29200ca640 0x7f292015a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:04.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.960+0000 7f2924b9a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f29200ca640 0x7f292015a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56462/0 (socket says 172.21.15.81:56462) 2023-10-06T03:24:04.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.960+0000 7f2924b9a700 1 -- 172.21.15.81:0/1089838017 learned_addr learned my addr 172.21.15.81:0/1089838017 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:04.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.960+0000 7f2925b9c700 1 --2- 172.21.15.81:0/1089838017 >> v2:172.21.15.83:3300/0 conn(0x7f292015ad10 0x7f29200c6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:04.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.960+0000 7f2924b9a700 1 -- 172.21.15.81:0/1089838017 >> v2:172.21.15.83:3300/0 conn(0x7f292015ad10 msgr2=0x7f29200c6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:04.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.960+0000 7f2924b9a700 1 --2- 172.21.15.81:0/1089838017 >> v2:172.21.15.83:3300/0 conn(0x7f292015ad10 0x7f29200c6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:04.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.960+0000 7f2924b9a700 1 -- 172.21.15.81:0/1089838017 >> v1:172.21.15.83:6789/0 conn(0x7f292013fd70 legacy=0x7f292015a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:04.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.960+0000 7f2924b9a700 1 -- 172.21.15.81:0/1089838017 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2920069880 con 0x7f29200ca640 2023-10-06T03:24:04.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.961+0000 7f2924b9a700 1 --2- 172.21.15.81:0/1089838017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29200ca640 0x7f292015a7d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f29200cc040 tx=0x7f2910009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f635d2deb69e855 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:04.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.961+0000 7f2917fff700 1 -- 172.21.15.81:0/1089838017 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291000b820 con 0x7f29200ca640 2023-10-06T03:24:04.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.961+0000 7f2917fff700 1 -- 172.21.15.81:0/1089838017 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f291000b980 con 0x7f29200ca640 2023-10-06T03:24:04.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.961+0000 7f2917fff700 1 -- 172.21.15.81:0/1089838017 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291000bd20 con 0x7f29200ca640 2023-10-06T03:24:04.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.961+0000 7f29275ff700 1 -- 172.21.15.81:0/1089838017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29200ca640 msgr2=0x7f292015a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:04.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.961+0000 7f29275ff700 1 --2- 172.21.15.81:0/1089838017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29200ca640 0x7f292015a7d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f29200cc040 tx=0x7f2910009250 comp rx=0 tx=0).stop 2023-10-06T03:24:04.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.961+0000 7f29275ff700 1 -- 172.21.15.81:0/1089838017 shutdown_connections 2023-10-06T03:24:04.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.961+0000 7f29275ff700 1 --2- 172.21.15.81:0/1089838017 >> v2:172.21.15.83:3300/0 conn(0x7f292015ad10 0x7f29200c6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:04.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.961+0000 7f29275ff700 1 --2- 172.21.15.81:0/1089838017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29200ca640 0x7f292015a7d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:04.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.961+0000 7f29275ff700 1 -- 172.21.15.81:0/1089838017 >> 172.21.15.81:0/1089838017 conn(0x7f29200cc090 msgr2=0x7f29200cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:04.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.962+0000 7f29275ff700 1 -- 172.21.15.81:0/1089838017 shutdown_connections 2023-10-06T03:24:04.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.962+0000 7f29275ff700 1 -- 172.21.15.81:0/1089838017 wait complete. 2023-10-06T03:24:04.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.963+0000 7f29275ff700 1 Processor -- start 2023-10-06T03:24:04.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.963+0000 7f29275ff700 1 -- start start 2023-10-06T03:24:04.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.964+0000 7f29275ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29200ca640 0x7f2920130d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:04.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.964+0000 7f29275ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f292013fd70 0x7f29200aee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:04.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.964+0000 7f29275ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f292015ad10 0x7f2920158360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:04.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.964+0000 7f29275ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29200b0270 con 0x7f29200ca640 2023-10-06T03:24:04.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.964+0000 7f29275ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29200b0700 con 0x7f292013fd70 2023-10-06T03:24:04.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.964+0000 7f29275ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29200af660 con 0x7f292015ad10 2023-10-06T03:24:04.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.964+0000 7f292539b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29200ca640 0x7f2920130d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:04.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.964+0000 7f292539b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29200ca640 0x7f2920130d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56474/0 (socket says 172.21.15.81:56474) 2023-10-06T03:24:04.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.964+0000 7f292539b700 1 -- 172.21.15.81:0/901144011 learned_addr learned my addr 172.21.15.81:0/901144011 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:04.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.964+0000 7f2924b9a700 1 --2- 172.21.15.81:0/901144011 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f292013fd70 0x7f29200aee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:04.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.964+0000 7f2925b9c700 1 --2- 172.21.15.81:0/901144011 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f292015ad10 0x7f2920158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:04.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.965+0000 7f292539b700 1 -- 172.21.15.81:0/901144011 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f292015ad10 msgr2=0x7f2920158360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:04.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.965+0000 7f292539b700 1 --2- 172.21.15.81:0/901144011 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f292015ad10 0x7f2920158360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:04.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.965+0000 7f292539b700 1 -- 172.21.15.81:0/901144011 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f292013fd70 msgr2=0x7f29200aee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:04.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.965+0000 7f292539b700 1 --2- 172.21.15.81:0/901144011 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f292013fd70 0x7f29200aee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:04.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.965+0000 7f292539b700 1 -- 172.21.15.81:0/901144011 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29100094f0 con 0x7f29200ca640 2023-10-06T03:24:04.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.965+0000 7f292539b700 1 --2- 172.21.15.81:0/901144011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29200ca640 0x7f2920130d10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f291c00c5b0 tx=0x7f291c0020e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:04.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.965+0000 7f29157fa700 1 -- 172.21.15.81:0/901144011 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291c011590 con 0x7f29200ca640 2023-10-06T03:24:04.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.965+0000 7f29157fa700 1 -- 172.21.15.81:0/901144011 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f291c0116f0 con 0x7f29200ca640 2023-10-06T03:24:04.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.965+0000 7f29157fa700 1 -- 172.21.15.81:0/901144011 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291c011a90 con 0x7f29200ca640 2023-10-06T03:24:04.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.965+0000 7f29275ff700 1 -- 172.21.15.81:0/901144011 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29200af940 con 0x7f29200ca640 2023-10-06T03:24:04.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.965+0000 7f29275ff700 1 -- 172.21.15.81:0/901144011 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29200aff00 con 0x7f29200ca640 2023-10-06T03:24:04.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.966+0000 7f29275ff700 1 -- 172.21.15.81:0/901144011 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f292004c3c0 con 0x7f29200ca640 2023-10-06T03:24:04.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.967+0000 7f29157fa700 1 -- 172.21.15.81:0/901144011 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f291c012420 con 0x7f29200ca640 2023-10-06T03:24:04.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.968+0000 7f29157fa700 1 --2- 172.21.15.81:0/901144011 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2904066f30 0x7f29040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:04.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.968+0000 7f29157fa700 1 -- 172.21.15.81:0/901144011 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f291c0844d0 con 0x7f29200ca640 2023-10-06T03:24:04.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.968+0000 7f2924b9a700 1 --2- 172.21.15.81:0/901144011 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2904066f30 0x7f29040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:04.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.969+0000 7f2924b9a700 1 --2- 172.21.15.81:0/901144011 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2904066f30 0x7f29040693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f29200cc040 tx=0x7f2910016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:04.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:04.972+0000 7f29157fa700 1 -- 172.21.15.81:0/901144011 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f291c051250 con 0x7f29200ca640 2023-10-06T03:24:05.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.162+0000 7f29275ff700 1 -- 172.21.15.81:0/901144011 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f292013d180 con 0x7f29200ca640 2023-10-06T03:24:05.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.162+0000 7f29157fa700 1 -- 172.21.15.81:0/901144011 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f291c054870 con 0x7f29200ca640 2023-10-06T03:24:05.165 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-10-06T03:24:05.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.165+0000 7f29275ff700 1 -- 172.21.15.81:0/901144011 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2904066f30 msgr2=0x7f29040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:05.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.165+0000 7f29275ff700 1 --2- 172.21.15.81:0/901144011 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2904066f30 0x7f29040693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f29200cc040 tx=0x7f2910016000 comp rx=0 tx=0).stop 2023-10-06T03:24:05.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.165+0000 7f29275ff700 1 -- 172.21.15.81:0/901144011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29200ca640 msgr2=0x7f2920130d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:05.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.165+0000 7f29275ff700 1 --2- 172.21.15.81:0/901144011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29200ca640 0x7f2920130d10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f291c00c5b0 tx=0x7f291c0020e0 comp rx=0 tx=0).stop 2023-10-06T03:24:05.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.165+0000 7f29275ff700 1 -- 172.21.15.81:0/901144011 shutdown_connections 2023-10-06T03:24:05.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.165+0000 7f29275ff700 1 --2- 172.21.15.81:0/901144011 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2904066f30 0x7f29040693e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:05.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.165+0000 7f29275ff700 1 --2- 172.21.15.81:0/901144011 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f292015ad10 0x7f2920158360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:05.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.165+0000 7f29275ff700 1 --2- 172.21.15.81:0/901144011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29200ca640 0x7f2920130d10 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:05.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.165+0000 7f29275ff700 1 --2- 172.21.15.81:0/901144011 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f292013fd70 0x7f29200aee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:05.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.165+0000 7f29275ff700 1 -- 172.21.15.81:0/901144011 >> 172.21.15.81:0/901144011 conn(0x7f29200cc090 msgr2=0x7f292013eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:05.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.165+0000 7f29275ff700 1 -- 172.21.15.81:0/901144011 shutdown_connections 2023-10-06T03:24:05.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.165+0000 7f29275ff700 1 -- 172.21.15.81:0/901144011 wait complete. 2023-10-06T03:24:05.184 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:24:05.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.364+0000 7f06e6bff700 1 Processor -- start 2023-10-06T03:24:05.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.364+0000 7f06e6bff700 1 -- start start 2023-10-06T03:24:05.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.366+0000 7f06e6bff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f06e0159a60 0x7f06e006af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:05.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.366+0000 7f06e6bff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f06e0159e30 0x7f06e0155650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:05.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.366+0000 7f06e6bff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06e006ab00 con 0x7f06e006b4d0 2023-10-06T03:24:05.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.366+0000 7f06e6bff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06e0069ef0 con 0x7f06e0159a60 2023-10-06T03:24:05.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.366+0000 7f06e6bff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06e006a1d0 con 0x7f06e0159e30 2023-10-06T03:24:05.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.366+0000 7f06e499b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f06e0159a60 0x7f06e006af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:05.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.366+0000 7f06e499b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f06e0159a60 0x7f06e006af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56478/0 (socket says 172.21.15.81:56478) 2023-10-06T03:24:05.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.366+0000 7f06e499b700 1 -- 172.21.15.81:0/3136833461 learned_addr learned my addr 172.21.15.81:0/3136833461 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:05.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.366+0000 7f06e519c700 1 --2- 172.21.15.81:0/3136833461 >> v2:172.21.15.83:3300/0 conn(0x7f06e0159e30 0x7f06e0155650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:05.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.366+0000 7f06e499b700 1 -- 172.21.15.81:0/3136833461 >> v2:172.21.15.83:3300/0 conn(0x7f06e0159e30 msgr2=0x7f06e0155650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:05.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.366+0000 7f06e499b700 1 --2- 172.21.15.81:0/3136833461 >> v2:172.21.15.83:3300/0 conn(0x7f06e0159e30 0x7f06e0155650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:05.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.366+0000 7f06e499b700 1 -- 172.21.15.81:0/3136833461 >> v1:172.21.15.83:6789/0 conn(0x7f06e006b4d0 legacy=0x7f06e00ca520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:05.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.366+0000 7f06e499b700 1 -- 172.21.15.81:0/3136833461 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e006a4b0 con 0x7f06e0159a60 2023-10-06T03:24:05.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.367+0000 7f06e499b700 1 --2- 172.21.15.81:0/3136833461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06e0159a60 0x7f06e006af90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f06e00cd180 tx=0x7f06d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50da0f84f4fae4fa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:05.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.367+0000 7f06df7fe700 1 -- 172.21.15.81:0/3136833461 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d4009e60 con 0x7f06e0159a60 2023-10-06T03:24:05.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.367+0000 7f06df7fe700 1 -- 172.21.15.81:0/3136833461 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d400b860 con 0x7f06e0159a60 2023-10-06T03:24:05.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.367+0000 7f06df7fe700 1 -- 172.21.15.81:0/3136833461 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d400bc00 con 0x7f06e0159a60 2023-10-06T03:24:05.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.367+0000 7f06e6bff700 1 -- 172.21.15.81:0/3136833461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06e0159a60 msgr2=0x7f06e006af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:05.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.367+0000 7f06e6bff700 1 --2- 172.21.15.81:0/3136833461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06e0159a60 0x7f06e006af90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f06e00cd180 tx=0x7f06d4009250 comp rx=0 tx=0).stop 2023-10-06T03:24:05.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.367+0000 7f06e6bff700 1 -- 172.21.15.81:0/3136833461 shutdown_connections 2023-10-06T03:24:05.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.368+0000 7f06e6bff700 1 --2- 172.21.15.81:0/3136833461 >> v2:172.21.15.83:3300/0 conn(0x7f06e0159e30 0x7f06e0155650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:05.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.368+0000 7f06e6bff700 1 --2- 172.21.15.81:0/3136833461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06e0159a60 0x7f06e006af90 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:05.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.368+0000 7f06e6bff700 1 -- 172.21.15.81:0/3136833461 >> 172.21.15.81:0/3136833461 conn(0x7f06e00cc090 msgr2=0x7f06e00cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:05.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.368+0000 7f06e6bff700 1 -- 172.21.15.81:0/3136833461 shutdown_connections 2023-10-06T03:24:05.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.368+0000 7f06e6bff700 1 -- 172.21.15.81:0/3136833461 wait complete. 2023-10-06T03:24:05.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.369+0000 7f06e6bff700 1 Processor -- start 2023-10-06T03:24:05.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.369+0000 7f06e6bff700 1 -- start start 2023-10-06T03:24:05.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.370+0000 7f06e6bff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06e006b4d0 0x7f06e00adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:05.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.370+0000 7f06e6bff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06e0159a60 0x7f06e0154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:05.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.370+0000 7f06e6bff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06e0159e30 0x7f06e00b1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:05.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.370+0000 7f06e6bff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e016e240 con 0x7f06e0159a60 2023-10-06T03:24:05.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.370+0000 7f06e6bff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e016d630 con 0x7f06e0159e30 2023-10-06T03:24:05.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.370+0000 7f06e6bff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e016d910 con 0x7f06e006b4d0 2023-10-06T03:24:05.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.370+0000 7f06dffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06e0159a60 0x7f06e0154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:05.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.370+0000 7f06e499b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06e006b4d0 0x7f06e00adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:05.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.370+0000 7f06e499b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06e006b4d0 0x7f06e00adbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:51722/0 (socket says 172.21.15.81:51722) 2023-10-06T03:24:05.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.370+0000 7f06e499b700 1 -- 172.21.15.81:0/531534207 learned_addr learned my addr 172.21.15.81:0/531534207 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:05.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.370+0000 7f06e519c700 1 --2- 172.21.15.81:0/531534207 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06e0159e30 0x7f06e00b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:05.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.371+0000 7f06e499b700 1 -- 172.21.15.81:0/531534207 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06e0159e30 msgr2=0x7f06e00b1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:05.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.371+0000 7f06e499b700 1 --2- 172.21.15.81:0/531534207 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06e0159e30 0x7f06e00b1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:05.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.371+0000 7f06e499b700 1 -- 172.21.15.81:0/531534207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06e0159a60 msgr2=0x7f06e0154a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:05.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.371+0000 7f06e499b700 1 --2- 172.21.15.81:0/531534207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06e0159a60 0x7f06e0154a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:05.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.371+0000 7f06e499b700 1 -- 172.21.15.81:0/531534207 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d4009490 con 0x7f06e006b4d0 2023-10-06T03:24:05.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.371+0000 7f06dffff700 1 --2- 172.21.15.81:0/531534207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06e0159a60 0x7f06e0154a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:24:05.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.371+0000 7f06e499b700 1 --2- 172.21.15.81:0/531534207 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06e006b4d0 0x7f06e00adbb0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f06e006cd90 tx=0x7f06d4017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:05.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.371+0000 7f06dcff9700 1 -- 172.21.15.81:0/531534207 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d400bbe0 con 0x7f06e006b4d0 2023-10-06T03:24:05.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.371+0000 7f06dcff9700 1 -- 172.21.15.81:0/531534207 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d4000c90 con 0x7f06e006b4d0 2023-10-06T03:24:05.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.371+0000 7f06e6bff700 1 -- 172.21.15.81:0/531534207 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06e016dbf0 con 0x7f06e006b4d0 2023-10-06T03:24:05.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.371+0000 7f06dcff9700 1 -- 172.21.15.81:0/531534207 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d4011670 con 0x7f06e006b4d0 2023-10-06T03:24:05.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.371+0000 7f06e6bff700 1 -- 172.21.15.81:0/531534207 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06e00ae0f0 con 0x7f06e006b4d0 2023-10-06T03:24:05.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.372+0000 7f06e6bff700 1 -- 172.21.15.81:0/531534207 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06e004c3c0 con 0x7f06e006b4d0 2023-10-06T03:24:05.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.373+0000 7f06dcff9700 1 -- 172.21.15.81:0/531534207 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f06d4011a20 con 0x7f06e006b4d0 2023-10-06T03:24:05.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.374+0000 7f06dcff9700 1 --2- 172.21.15.81:0/531534207 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f06c4066f30 0x7f06c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:05.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.374+0000 7f06dcff9700 1 -- 172.21.15.81:0/531534207 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f06d4085e60 con 0x7f06e006b4d0 2023-10-06T03:24:05.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.374+0000 7f06dffff700 1 --2- 172.21.15.81:0/531534207 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f06c4066f30 0x7f06c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:05.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.375+0000 7f06dffff700 1 --2- 172.21.15.81:0/531534207 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f06c4066f30 0x7f06c40693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f06e00c72b0 tx=0x7f06cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:05.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.378+0000 7f06dcff9700 1 -- 172.21.15.81:0/531534207 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f06d4052c60 con 0x7f06e006b4d0 2023-10-06T03:24:05.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.568+0000 7f06e6bff700 1 -- 172.21.15.81:0/531534207 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f06e01594f0 con 0x7f06e006b4d0 2023-10-06T03:24:05.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.569+0000 7f06dcff9700 1 -- 172.21.15.81:0/531534207 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f06d4015020 con 0x7f06e006b4d0 2023-10-06T03:24:05.571 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-06T03:24:05.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.571+0000 7f06e6bff700 1 -- 172.21.15.81:0/531534207 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f06c4066f30 msgr2=0x7f06c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:05.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.571+0000 7f06e6bff700 1 --2- 172.21.15.81:0/531534207 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f06c4066f30 0x7f06c40693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f06e00c72b0 tx=0x7f06cc009040 comp rx=0 tx=0).stop 2023-10-06T03:24:05.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.571+0000 7f06e6bff700 1 -- 172.21.15.81:0/531534207 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06e006b4d0 msgr2=0x7f06e00adbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:05.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.571+0000 7f06e6bff700 1 --2- 172.21.15.81:0/531534207 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06e006b4d0 0x7f06e00adbb0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f06e006cd90 tx=0x7f06d4017000 comp rx=0 tx=0).stop 2023-10-06T03:24:05.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.571+0000 7f06e6bff700 1 -- 172.21.15.81:0/531534207 shutdown_connections 2023-10-06T03:24:05.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.571+0000 7f06e6bff700 1 --2- 172.21.15.81:0/531534207 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06e0159e30 0x7f06e00b1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:05.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.571+0000 7f06e6bff700 1 --2- 172.21.15.81:0/531534207 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f06c4066f30 0x7f06c40693e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:05.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.571+0000 7f06e6bff700 1 --2- 172.21.15.81:0/531534207 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06e006b4d0 0x7f06e00adbb0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:05.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.571+0000 7f06e6bff700 1 --2- 172.21.15.81:0/531534207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06e0159a60 0x7f06e0154a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:05.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.571+0000 7f06e6bff700 1 -- 172.21.15.81:0/531534207 >> 172.21.15.81:0/531534207 conn(0x7f06e00cc090 msgr2=0x7f06e0151090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:05.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.571+0000 7f06e6bff700 1 -- 172.21.15.81:0/531534207 shutdown_connections 2023-10-06T03:24:05.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.571+0000 7f06e6bff700 1 -- 172.21.15.81:0/531534207 wait complete. 2023-10-06T03:24:05.591 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:24:05.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.774+0000 7f3fd759e700 1 Processor -- start 2023-10-06T03:24:05.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.774+0000 7f3fd759e700 1 -- start start 2023-10-06T03:24:05.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.775+0000 7f3fd759e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3fd815ac00 0x7f3fd815a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:05.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.775+0000 7f3fd759e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3fd8157670 0x7f3fd80b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:05.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.775+0000 7f3fd759e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fd815bef0 con 0x7f3fd81535a0 2023-10-06T03:24:05.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.775+0000 7f3fd759e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fd815aaa0 con 0x7f3fd8157670 2023-10-06T03:24:05.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.775+0000 7f3fd759e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd80d1160 con 0x7f3fd815ac00 2023-10-06T03:24:05.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.776+0000 7f3fd6d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3fd8157670 0x7f3fd80b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:05.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.776+0000 7f3fd6d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3fd8157670 0x7f3fd80b1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56492/0 (socket says 172.21.15.81:56492) 2023-10-06T03:24:05.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.776+0000 7f3fd6d9d700 1 -- 172.21.15.81:0/2587116451 learned_addr learned my addr 172.21.15.81:0/2587116451 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:05.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.776+0000 7f3fd659c700 1 --1- 172.21.15.81:0/2587116451 >> v1:172.21.15.81:6789/0 conn(0x7f3fd81535a0 0x7f3fd8153970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39490/0 (socket says 172.21.15.81:39490) 2023-10-06T03:24:05.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.776+0000 7f3fd5d9b700 1 --2- 172.21.15.81:0/2587116451 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3fd815ac00 0x7f3fd815a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:05.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.776+0000 7f3fd6d9d700 1 -- 172.21.15.81:0/2587116451 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3fd815ac00 msgr2=0x7f3fd815a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:05.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.776+0000 7f3fd6d9d700 1 --2- 172.21.15.81:0/2587116451 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3fd815ac00 0x7f3fd815a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:05.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.776+0000 7f3fd6d9d700 1 -- 172.21.15.81:0/2587116451 >> v1:172.21.15.81:6789/0 conn(0x7f3fd81535a0 legacy=0x7f3fd8153970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:05.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.776+0000 7f3fd6d9d700 1 -- 172.21.15.81:0/2587116451 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd815b050 con 0x7f3fd8157670 2023-10-06T03:24:05.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.776+0000 7f3fd6d9d700 1 --2- 172.21.15.81:0/2587116451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fd8157670 0x7f3fd80b1cf0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0009f20 tx=0x7f3fd0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf5b22c2f3252a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:05.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.776+0000 7f3fd559a700 1 -- 172.21.15.81:0/2587116451 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd000e070 con 0x7f3fd8157670 2023-10-06T03:24:05.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.777+0000 7f3fd559a700 1 -- 172.21.15.81:0/2587116451 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd000ba80 con 0x7f3fd8157670 2023-10-06T03:24:05.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.777+0000 7f3fd559a700 1 -- 172.21.15.81:0/2587116451 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd00092e0 con 0x7f3fd8157670 2023-10-06T03:24:05.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.777+0000 7f3fd759e700 1 -- 172.21.15.81:0/2587116451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fd8157670 msgr2=0x7f3fd80b1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:05.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.777+0000 7f3fd759e700 1 --2- 172.21.15.81:0/2587116451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fd8157670 0x7f3fd80b1cf0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0009f20 tx=0x7f3fd0009840 comp rx=0 tx=0).stop 2023-10-06T03:24:05.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.777+0000 7f3fd759e700 1 -- 172.21.15.81:0/2587116451 shutdown_connections 2023-10-06T03:24:05.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.777+0000 7f3fd759e700 1 --2- 172.21.15.81:0/2587116451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fd8157670 0x7f3fd80b1cf0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:05.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.777+0000 7f3fd759e700 1 --2- 172.21.15.81:0/2587116451 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3fd815ac00 0x7f3fd815a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:05.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.777+0000 7f3fd759e700 1 -- 172.21.15.81:0/2587116451 >> 172.21.15.81:0/2587116451 conn(0x7f3fd8068230 msgr2=0x7f3fd8068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:05.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.777+0000 7f3fd759e700 1 -- 172.21.15.81:0/2587116451 shutdown_connections 2023-10-06T03:24:05.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.777+0000 7f3fd759e700 1 -- 172.21.15.81:0/2587116451 wait complete. 2023-10-06T03:24:05.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.779+0000 7f3fd759e700 1 Processor -- start 2023-10-06T03:24:05.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.779+0000 7f3fd759e700 1 -- start start 2023-10-06T03:24:05.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.780+0000 7f3fd759e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3fd81535a0 0x7f3fd8141dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:05.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.780+0000 7f3fd759e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3fd8157670 0x7f3fd815eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:05.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.780+0000 7f3fd759e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fd815ac00 0x7f3fd815f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:05.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.780+0000 7f3fd759e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd8142310 con 0x7f3fd815ac00 2023-10-06T03:24:05.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.780+0000 7f3fd759e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd8156010 con 0x7f3fd8157670 2023-10-06T03:24:05.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.780+0000 7f3fd759e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd81562f0 con 0x7f3fd81535a0 2023-10-06T03:24:05.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.780+0000 7f3fd6d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fd815ac00 0x7f3fd815f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:05.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.780+0000 7f3fd659c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3fd81535a0 0x7f3fd8141dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:05.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.780+0000 7f3fd6d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fd815ac00 0x7f3fd815f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56506/0 (socket says 172.21.15.81:56506) 2023-10-06T03:24:05.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.780+0000 7f3fd6d9d700 1 -- 172.21.15.81:0/4252648909 learned_addr learned my addr 172.21.15.81:0/4252648909 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:05.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.780+0000 7f3fd5d9b700 1 --2- 172.21.15.81:0/4252648909 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3fd8157670 0x7f3fd815eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:05.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.780+0000 7f3fd6d9d700 1 -- 172.21.15.81:0/4252648909 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3fd81535a0 msgr2=0x7f3fd8141dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:05.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.780+0000 7f3fd6d9d700 1 --2- 172.21.15.81:0/4252648909 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3fd81535a0 0x7f3fd8141dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:05.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.780+0000 7f3fd6d9d700 1 -- 172.21.15.81:0/4252648909 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3fd8157670 msgr2=0x7f3fd815eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:05.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.780+0000 7f3fd6d9d700 1 --2- 172.21.15.81:0/4252648909 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3fd8157670 0x7f3fd815eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:05.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.780+0000 7f3fd6d9d700 1 -- 172.21.15.81:0/4252648909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd0009ae0 con 0x7f3fd815ac00 2023-10-06T03:24:05.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.781+0000 7f3fd6d9d700 1 --2- 172.21.15.81:0/4252648909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fd815ac00 0x7f3fd815f3e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3fd000b6c0 tx=0x7f3fd0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:05.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.781+0000 7f3fc67fc700 1 -- 172.21.15.81:0/4252648909 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd00032f0 con 0x7f3fd815ac00 2023-10-06T03:24:05.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.781+0000 7f3fc67fc700 1 -- 172.21.15.81:0/4252648909 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd0008d20 con 0x7f3fd815ac00 2023-10-06T03:24:05.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.781+0000 7f3fc67fc700 1 -- 172.21.15.81:0/4252648909 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd0026670 con 0x7f3fd815ac00 2023-10-06T03:24:05.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.781+0000 7f3fd759e700 1 -- 172.21.15.81:0/4252648909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fd81565d0 con 0x7f3fd815ac00 2023-10-06T03:24:05.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.781+0000 7f3fd759e700 1 -- 172.21.15.81:0/4252648909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fd81552b0 con 0x7f3fd815ac00 2023-10-06T03:24:05.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.782+0000 7f3fd759e700 1 -- 172.21.15.81:0/4252648909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fd804c3c0 con 0x7f3fd815ac00 2023-10-06T03:24:05.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.783+0000 7f3fc67fc700 1 -- 172.21.15.81:0/4252648909 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3fd0003040 con 0x7f3fd815ac00 2023-10-06T03:24:05.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.784+0000 7f3fc67fc700 1 --2- 172.21.15.81:0/4252648909 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f3fb8066f30 0x7f3fb80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:05.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.784+0000 7f3fc67fc700 1 -- 172.21.15.81:0/4252648909 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f3fd0086950 con 0x7f3fd815ac00 2023-10-06T03:24:05.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.784+0000 7f3fd659c700 1 --2- 172.21.15.81:0/4252648909 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f3fb8066f30 0x7f3fb80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:05.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.785+0000 7f3fd659c700 1 --2- 172.21.15.81:0/4252648909 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f3fb8066f30 0x7f3fb80693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3fc8004fd0 tx=0x7f3fc8007eb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:05.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.788+0000 7f3fc67fc700 1 -- 172.21.15.81:0/4252648909 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3fd00536d0 con 0x7f3fd815ac00 2023-10-06T03:24:05.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.979+0000 7f3fd759e700 1 -- 172.21.15.81:0/4252648909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3fd815b2e0 con 0x7f3fd815ac00 2023-10-06T03:24:05.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.979+0000 7f3fc67fc700 1 -- 172.21.15.81:0/4252648909 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3fd0056cf0 con 0x7f3fd815ac00 2023-10-06T03:24:05.981 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-10-06T03:24:05.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.981+0000 7f3fd759e700 1 -- 172.21.15.81:0/4252648909 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f3fb8066f30 msgr2=0x7f3fb80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:05.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.981+0000 7f3fd759e700 1 --2- 172.21.15.81:0/4252648909 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f3fb8066f30 0x7f3fb80693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3fc8004fd0 tx=0x7f3fc8007eb0 comp rx=0 tx=0).stop 2023-10-06T03:24:05.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.981+0000 7f3fd759e700 1 -- 172.21.15.81:0/4252648909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fd815ac00 msgr2=0x7f3fd815f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:05.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.981+0000 7f3fd759e700 1 --2- 172.21.15.81:0/4252648909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fd815ac00 0x7f3fd815f3e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3fd000b6c0 tx=0x7f3fd0018000 comp rx=0 tx=0).stop 2023-10-06T03:24:05.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.982+0000 7f3fd759e700 1 -- 172.21.15.81:0/4252648909 shutdown_connections 2023-10-06T03:24:05.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.982+0000 7f3fd759e700 1 --2- 172.21.15.81:0/4252648909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fd815ac00 0x7f3fd815f3e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:05.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.982+0000 7f3fd759e700 1 --2- 172.21.15.81:0/4252648909 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f3fb8066f30 0x7f3fb80693e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:05.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.982+0000 7f3fd759e700 1 --2- 172.21.15.81:0/4252648909 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3fd81535a0 0x7f3fd8141dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:05.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.982+0000 7f3fd759e700 1 --2- 172.21.15.81:0/4252648909 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3fd8157670 0x7f3fd815eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:05.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.982+0000 7f3fd759e700 1 -- 172.21.15.81:0/4252648909 >> 172.21.15.81:0/4252648909 conn(0x7f3fd8068230 msgr2=0x7f3fd81591b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:05.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.982+0000 7f3fd759e700 1 -- 172.21.15.81:0/4252648909 shutdown_connections 2023-10-06T03:24:05.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:05.982+0000 7f3fd759e700 1 -- 172.21.15.81:0/4252648909 wait complete. 2023-10-06T03:24:06.001 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:24:06.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.182+0000 7f0bd15ff700 1 Processor -- start 2023-10-06T03:24:06.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.182+0000 7f0bd15ff700 1 -- start start 2023-10-06T03:24:06.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.183+0000 7f0bd15ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0bcc159a60 0x7f0bcc06af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.183+0000 7f0bd15ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0bcc159e30 0x7f0bcc155650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.183+0000 7f0bd15ff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bcc06ab00 con 0x7f0bcc06b4d0 2023-10-06T03:24:06.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.183+0000 7f0bd15ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bcc069ef0 con 0x7f0bcc159a60 2023-10-06T03:24:06.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.183+0000 7f0bd15ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc06a1d0 con 0x7f0bcc159e30 2023-10-06T03:24:06.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.183+0000 7f0bcaffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0bcc159a60 0x7f0bcc06af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.184+0000 7f0bcaffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0bcc159a60 0x7f0bcc06af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56514/0 (socket says 172.21.15.81:56514) 2023-10-06T03:24:06.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.184+0000 7f0bcaffd700 1 -- 172.21.15.81:0/3639631392 learned_addr learned my addr 172.21.15.81:0/3639631392 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:06.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.184+0000 7f0bcb7fe700 1 --2- 172.21.15.81:0/3639631392 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0bcc159e30 0x7f0bcc155650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.184+0000 7f0bcaffd700 1 -- 172.21.15.81:0/3639631392 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0bcc159e30 msgr2=0x7f0bcc155650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:06.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.184+0000 7f0bcaffd700 1 --2- 172.21.15.81:0/3639631392 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0bcc159e30 0x7f0bcc155650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.184+0000 7f0bcaffd700 1 -- 172.21.15.81:0/3639631392 >> v1:172.21.15.83:6789/0 conn(0x7f0bcc06b4d0 legacy=0x7f0bcc0ca520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.184+0000 7f0bcaffd700 1 -- 172.21.15.81:0/3639631392 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bcc06a4b0 con 0x7f0bcc159a60 2023-10-06T03:24:06.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.184+0000 7f0bcaffd700 1 --2- 172.21.15.81:0/3639631392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bcc159a60 0x7f0bcc06af90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc009990 tx=0x7f0bbc009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f5ad74b8c6f8861 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.184+0000 7f0bc9ffb700 1 -- 172.21.15.81:0/3639631392 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc009e80 con 0x7f0bcc159a60 2023-10-06T03:24:06.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.184+0000 7f0bc9ffb700 1 -- 172.21.15.81:0/3639631392 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bbc005c10 con 0x7f0bcc159a60 2023-10-06T03:24:06.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.184+0000 7f0bc9ffb700 1 -- 172.21.15.81:0/3639631392 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc00b650 con 0x7f0bcc159a60 2023-10-06T03:24:06.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.185+0000 7f0bd15ff700 1 -- 172.21.15.81:0/3639631392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bcc159a60 msgr2=0x7f0bcc06af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.185+0000 7f0bd15ff700 1 --2- 172.21.15.81:0/3639631392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bcc159a60 0x7f0bcc06af90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc009990 tx=0x7f0bbc009220 comp rx=0 tx=0).stop 2023-10-06T03:24:06.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.185+0000 7f0bd15ff700 1 -- 172.21.15.81:0/3639631392 shutdown_connections 2023-10-06T03:24:06.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.185+0000 7f0bd15ff700 1 --2- 172.21.15.81:0/3639631392 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0bcc159e30 0x7f0bcc155650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.185+0000 7f0bd15ff700 1 --2- 172.21.15.81:0/3639631392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bcc159a60 0x7f0bcc06af90 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.185+0000 7f0bd15ff700 1 -- 172.21.15.81:0/3639631392 >> 172.21.15.81:0/3639631392 conn(0x7f0bcc0cc090 msgr2=0x7f0bcc0cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:06.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.185+0000 7f0bd15ff700 1 -- 172.21.15.81:0/3639631392 shutdown_connections 2023-10-06T03:24:06.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.185+0000 7f0bd15ff700 1 -- 172.21.15.81:0/3639631392 wait complete. 2023-10-06T03:24:06.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.186+0000 7f0bd15ff700 1 Processor -- start 2023-10-06T03:24:06.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.187+0000 7f0bd15ff700 1 -- start start 2023-10-06T03:24:06.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.187+0000 7f0bd15ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0bcc06b4d0 0x7f0bcc0c2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.187+0000 7f0bd15ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bcc159a60 0x7f0bcc154140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.187+0000 7f0bd15ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0bcc159e30 0x7f0bcc16d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.187+0000 7f0bd15ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc0c1d90 con 0x7f0bcc159a60 2023-10-06T03:24:06.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.187+0000 7f0bd15ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc0c1180 con 0x7f0bcc159e30 2023-10-06T03:24:06.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.187+0000 7f0bd15ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc0c1460 con 0x7f0bcc06b4d0 2023-10-06T03:24:06.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.188+0000 7f0bca7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bcc159a60 0x7f0bcc154140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.188+0000 7f0bca7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bcc159a60 0x7f0bcc154140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56530/0 (socket says 172.21.15.81:56530) 2023-10-06T03:24:06.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.188+0000 7f0bca7fc700 1 -- 172.21.15.81:0/837888290 learned_addr learned my addr 172.21.15.81:0/837888290 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:06.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.188+0000 7f0bcaffd700 1 --2- 172.21.15.81:0/837888290 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0bcc06b4d0 0x7f0bcc0c2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.188+0000 7f0bcb7fe700 1 --2- 172.21.15.81:0/837888290 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0bcc159e30 0x7f0bcc16d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.188+0000 7f0bca7fc700 1 -- 172.21.15.81:0/837888290 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0bcc06b4d0 msgr2=0x7f0bcc0c2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.188+0000 7f0bca7fc700 1 --2- 172.21.15.81:0/837888290 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0bcc06b4d0 0x7f0bcc0c2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.188+0000 7f0bca7fc700 1 -- 172.21.15.81:0/837888290 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0bcc159e30 msgr2=0x7f0bcc16d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.188+0000 7f0bca7fc700 1 --2- 172.21.15.81:0/837888290 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0bcc159e30 0x7f0bcc16d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.188+0000 7f0bca7fc700 1 -- 172.21.15.81:0/837888290 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bbc009480 con 0x7f0bcc159a60 2023-10-06T03:24:06.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.188+0000 7f0bcaffd700 1 --2- 172.21.15.81:0/837888290 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0bcc06b4d0 0x7f0bcc0c2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:06.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.188+0000 7f0bcb7fe700 1 --2- 172.21.15.81:0/837888290 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0bcc159e30 0x7f0bcc16d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:06.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.188+0000 7f0bca7fc700 1 --2- 172.21.15.81:0/837888290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bcc159a60 0x7f0bcc154140 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0bc000c590 tx=0x7f0bc000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.189+0000 7f0bb2ffd700 1 -- 172.21.15.81:0/837888290 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc0011590 con 0x7f0bcc159a60 2023-10-06T03:24:06.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.189+0000 7f0bb2ffd700 1 -- 172.21.15.81:0/837888290 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc00116f0 con 0x7f0bcc159a60 2023-10-06T03:24:06.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.189+0000 7f0bd15ff700 1 -- 172.21.15.81:0/837888290 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bcc0c1740 con 0x7f0bcc159a60 2023-10-06T03:24:06.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.189+0000 7f0bb2ffd700 1 -- 172.21.15.81:0/837888290 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc0011ab0 con 0x7f0bcc159a60 2023-10-06T03:24:06.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.189+0000 7f0bd15ff700 1 -- 172.21.15.81:0/837888290 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bcc151b40 con 0x7f0bcc159a60 2023-10-06T03:24:06.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.190+0000 7f0bd15ff700 1 -- 172.21.15.81:0/837888290 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bcc0c1f00 con 0x7f0bcc159a60 2023-10-06T03:24:06.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.191+0000 7f0bb2ffd700 1 -- 172.21.15.81:0/837888290 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0bc001b3b0 con 0x7f0bcc159a60 2023-10-06T03:24:06.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.191+0000 7f0bb2ffd700 1 --2- 172.21.15.81:0/837888290 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0bb8066f30 0x7f0bb80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.191+0000 7f0bb2ffd700 1 -- 172.21.15.81:0/837888290 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f0bc0083ee0 con 0x7f0bcc159a60 2023-10-06T03:24:06.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.192+0000 7f0bcaffd700 1 --2- 172.21.15.81:0/837888290 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0bb8066f30 0x7f0bb80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.192+0000 7f0bcaffd700 1 --2- 172.21.15.81:0/837888290 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0bb8066f30 0x7f0bb80693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc0b1ec0 tx=0x7f0bbc016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.195+0000 7f0bb2ffd700 1 -- 172.21.15.81:0/837888290 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0bc0050d00 con 0x7f0bcc159a60 2023-10-06T03:24:06.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.385+0000 7f0bd15ff700 1 -- 172.21.15.81:0/837888290 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0bcc04c3c0 con 0x7f0bcc159a60 2023-10-06T03:24:06.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.385+0000 7f0bb2ffd700 1 -- 172.21.15.81:0/837888290 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0bc0017070 con 0x7f0bcc159a60 2023-10-06T03:24:06.387 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-10-06T03:24:06.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.387+0000 7f0bd15ff700 1 -- 172.21.15.81:0/837888290 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0bb8066f30 msgr2=0x7f0bb80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.387+0000 7f0bd15ff700 1 --2- 172.21.15.81:0/837888290 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0bb8066f30 0x7f0bb80693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc0b1ec0 tx=0x7f0bbc016000 comp rx=0 tx=0).stop 2023-10-06T03:24:06.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.388+0000 7f0bd15ff700 1 -- 172.21.15.81:0/837888290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bcc159a60 msgr2=0x7f0bcc154140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.388+0000 7f0bd15ff700 1 --2- 172.21.15.81:0/837888290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bcc159a60 0x7f0bcc154140 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0bc000c590 tx=0x7f0bc000c950 comp rx=0 tx=0).stop 2023-10-06T03:24:06.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.388+0000 7f0bd15ff700 1 -- 172.21.15.81:0/837888290 shutdown_connections 2023-10-06T03:24:06.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.388+0000 7f0bd15ff700 1 --2- 172.21.15.81:0/837888290 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0bcc159e30 0x7f0bcc16d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.388+0000 7f0bd15ff700 1 --2- 172.21.15.81:0/837888290 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0bb8066f30 0x7f0bb80693e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.388+0000 7f0bd15ff700 1 --2- 172.21.15.81:0/837888290 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0bcc06b4d0 0x7f0bcc0c2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.388+0000 7f0bd15ff700 1 --2- 172.21.15.81:0/837888290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bcc159a60 0x7f0bcc154140 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.388+0000 7f0bd15ff700 1 -- 172.21.15.81:0/837888290 >> 172.21.15.81:0/837888290 conn(0x7f0bcc0cc090 msgr2=0x7f0bcc150dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:06.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.388+0000 7f0bd15ff700 1 -- 172.21.15.81:0/837888290 shutdown_connections 2023-10-06T03:24:06.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.388+0000 7f0bd15ff700 1 -- 172.21.15.81:0/837888290 wait complete. 2023-10-06T03:24:06.407 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T03:24:06.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.590+0000 7fd968bff700 1 Processor -- start 2023-10-06T03:24:06.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.590+0000 7fd968bff700 1 -- start start 2023-10-06T03:24:06.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.591+0000 7fd968bff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd9640cf180 0x7fd9640c6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.591+0000 7fd968bff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9640cf7d0 con 0x7fd9640b29d0 2023-10-06T03:24:06.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.591+0000 7fd968bff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd964159b10 con 0x7fd9640ae590 2023-10-06T03:24:06.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.591+0000 7fd968bff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9640c70d0 con 0x7fd9640cf180 2023-10-06T03:24:06.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.591+0000 7fd96259c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd9640b29d0 0x7fd9640cea70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39504/0 (socket says 172.21.15.81:39504) 2023-10-06T03:24:06.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.592+0000 7fd96259c700 1 -- 172.21.15.81:0/507653569 learned_addr learned my addr 172.21.15.81:0/507653569 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:24:06.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.592+0000 7fd961d9b700 1 --2- 172.21.15.81:0/507653569 >> v2:172.21.15.83:3300/0 conn(0x7fd9640cf180 0x7fd9640c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.592+0000 7fd96159a700 1 -- 172.21.15.81:0/507653569 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1768113983 0 0) 0x7fd9640cf7d0 con 0x7fd9640b29d0 2023-10-06T03:24:06.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.592+0000 7fd96159a700 1 -- 172.21.15.81:0/507653569 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd94c003570 con 0x7fd9640b29d0 2023-10-06T03:24:06.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.592+0000 7fd96159a700 1 -- 172.21.15.81:0/507653569 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3886840746 0 0) 0x7fd94c003570 con 0x7fd9640b29d0 2023-10-06T03:24:06.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.592+0000 7fd96159a700 1 -- 172.21.15.81:0/507653569 >> v2:172.21.15.83:3300/0 conn(0x7fd9640cf180 msgr2=0x7fd9640c6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:06.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.592+0000 7fd96159a700 1 --2- 172.21.15.81:0/507653569 >> v2:172.21.15.83:3300/0 conn(0x7fd9640cf180 0x7fd9640c6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.592+0000 7fd96159a700 1 -- 172.21.15.81:0/507653569 >> v1:172.21.15.83:6789/0 conn(0x7fd9640ae590 legacy=0x7fd964163270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.592+0000 7fd96159a700 1 -- 172.21.15.81:0/507653569 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9640c6830 con 0x7fd9640b29d0 2023-10-06T03:24:06.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.592+0000 7fd96159a700 1 -- 172.21.15.81:0/507653569 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2513016936 0 0) 0x7fd9540015f0 con 0x7fd9640b29d0 2023-10-06T03:24:06.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.592+0000 7fd96159a700 1 -- 172.21.15.81:0/507653569 >> v1:172.21.15.81:6789/0 conn(0x7fd9640b29d0 legacy=0x7fd9640cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.592+0000 7fd96159a700 1 --2- 172.21.15.81:0/507653569 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd94c003a60 0x7fd94c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.592+0000 7fd96159a700 1 --2- 172.21.15.81:0/507653569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd94c004810 0x7fd94c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.592+0000 7fd96159a700 1 --2- 172.21.15.81:0/507653569 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd94c0051c0 0x7fd94c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.592+0000 7fd96159a700 1 -- 172.21.15.81:0/507653569 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9640c70d0 con 0x7fd94c004810 2023-10-06T03:24:06.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.592+0000 7fd96159a700 1 -- 172.21.15.81:0/507653569 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c00c0d0 con 0x7fd94c003a60 2023-10-06T03:24:06.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.592+0000 7fd96159a700 1 -- 172.21.15.81:0/507653569 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c00c290 con 0x7fd94c0051c0 2023-10-06T03:24:06.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.593+0000 7fd96259c700 1 --2- 172.21.15.81:0/507653569 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd94c003a60 0x7fd94c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.593+0000 7fd961d9b700 1 --2- 172.21.15.81:0/507653569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd94c004810 0x7fd94c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.593+0000 7fd962d9d700 1 --2- 172.21.15.81:0/507653569 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd94c0051c0 0x7fd94c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.593+0000 7fd961d9b700 1 -- 172.21.15.81:0/507653569 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd94c0051c0 msgr2=0x7fd94c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:06.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.593+0000 7fd961d9b700 1 --2- 172.21.15.81:0/507653569 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd94c0051c0 0x7fd94c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.593+0000 7fd961d9b700 1 -- 172.21.15.81:0/507653569 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd94c003a60 msgr2=0x7fd94c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:06.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.593+0000 7fd961d9b700 1 --2- 172.21.15.81:0/507653569 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd94c003a60 0x7fd94c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.593+0000 7fd961d9b700 1 -- 172.21.15.81:0/507653569 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd94c003570 con 0x7fd94c004810 2023-10-06T03:24:06.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.593+0000 7fd962d9d700 1 --2- 172.21.15.81:0/507653569 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd94c0051c0 0x7fd94c00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:06.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.593+0000 7fd962d9d700 1 -- 172.21.15.81:0/507653569 reap_dead start 2023-10-06T03:24:06.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.593+0000 7fd961d9b700 1 --2- 172.21.15.81:0/507653569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd94c004810 0x7fd94c004c80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd958009c00 tx=0x7fd9580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81e6df1cb0ea6487 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.594+0000 7fd96159a700 1 -- 172.21.15.81:0/507653569 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95800e710 con 0x7fd94c004810 2023-10-06T03:24:06.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.594+0000 7fd96159a700 1 -- 172.21.15.81:0/507653569 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd95800e870 con 0x7fd94c004810 2023-10-06T03:24:06.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.594+0000 7fd96159a700 1 -- 172.21.15.81:0/507653569 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95800ec30 con 0x7fd94c004810 2023-10-06T03:24:06.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.594+0000 7fd968bff700 1 -- 172.21.15.81:0/507653569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd94c004810 msgr2=0x7fd94c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.594+0000 7fd968bff700 1 --2- 172.21.15.81:0/507653569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd94c004810 0x7fd94c004c80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd958009c00 tx=0x7fd9580091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.594+0000 7fd968bff700 1 -- 172.21.15.81:0/507653569 shutdown_connections 2023-10-06T03:24:06.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.594+0000 7fd968bff700 1 --2- 172.21.15.81:0/507653569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd94c004810 0x7fd94c004c80 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.594+0000 7fd968bff700 1 -- 172.21.15.81:0/507653569 >> 172.21.15.81:0/507653569 conn(0x7fd9640997d0 msgr2=0x7fd96406f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:06.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.594+0000 7fd968bff700 1 -- 172.21.15.81:0/507653569 shutdown_connections 2023-10-06T03:24:06.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.594+0000 7fd968bff700 1 -- 172.21.15.81:0/507653569 wait complete. 2023-10-06T03:24:06.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.596+0000 7fd968bff700 1 Processor -- start 2023-10-06T03:24:06.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.596+0000 7fd968bff700 1 -- start start 2023-10-06T03:24:06.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.597+0000 7fd968bff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd94c004810 0x7fd9640c9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.597+0000 7fd968bff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd964154880 0x7fd964150080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.597+0000 7fd968bff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9641579f0 0x7fd964157e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.597+0000 7fd968bff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9641583d0 con 0x7fd9641579f0 2023-10-06T03:24:06.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.597+0000 7fd968bff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd964155ce0 con 0x7fd94c004810 2023-10-06T03:24:06.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.597+0000 7fd968bff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9641550d0 con 0x7fd964154880 2023-10-06T03:24:06.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.597+0000 7fd962d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9641579f0 0x7fd964157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.597+0000 7fd962d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9641579f0 0x7fd964157e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56544/0 (socket says 172.21.15.81:56544) 2023-10-06T03:24:06.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.597+0000 7fd962d9d700 1 -- 172.21.15.81:0/1647668938 learned_addr learned my addr 172.21.15.81:0/1647668938 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:06.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.597+0000 7fd96259c700 1 --2- 172.21.15.81:0/1647668938 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd94c004810 0x7fd9640c9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.597+0000 7fd961d9b700 1 --2- 172.21.15.81:0/1647668938 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd964154880 0x7fd964150080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.597+0000 7fd962d9d700 1 -- 172.21.15.81:0/1647668938 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd964154880 msgr2=0x7fd964150080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.597+0000 7fd962d9d700 1 --2- 172.21.15.81:0/1647668938 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd964154880 0x7fd964150080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.597+0000 7fd962d9d700 1 -- 172.21.15.81:0/1647668938 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd94c004810 msgr2=0x7fd9640c9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.597+0000 7fd962d9d700 1 --2- 172.21.15.81:0/1647668938 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd94c004810 0x7fd9640c9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.597+0000 7fd962d9d700 1 -- 172.21.15.81:0/1647668938 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9641553b0 con 0x7fd9641579f0 2023-10-06T03:24:06.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.597+0000 7fd96259c700 1 --2- 172.21.15.81:0/1647668938 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd94c004810 0x7fd9640c9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:06.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.597+0000 7fd961d9b700 1 --2- 172.21.15.81:0/1647668938 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd964154880 0x7fd964150080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:06.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.597+0000 7fd962d9d700 1 --2- 172.21.15.81:0/1647668938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9641579f0 0x7fd964157e90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd96415d1a0 tx=0x7fd95c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.598+0000 7fd9527fc700 1 -- 172.21.15.81:0/1647668938 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c013630 con 0x7fd9641579f0 2023-10-06T03:24:06.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.598+0000 7fd9527fc700 1 -- 172.21.15.81:0/1647668938 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd95c013790 con 0x7fd9641579f0 2023-10-06T03:24:06.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.598+0000 7fd9527fc700 1 -- 172.21.15.81:0/1647668938 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c013b50 con 0x7fd9641579f0 2023-10-06T03:24:06.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.598+0000 7fd968bff700 1 -- 172.21.15.81:0/1647668938 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd964155690 con 0x7fd9641579f0 2023-10-06T03:24:06.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.598+0000 7fd968bff700 1 -- 172.21.15.81:0/1647668938 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd964154cf0 con 0x7fd9641579f0 2023-10-06T03:24:06.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.599+0000 7fd968bff700 1 -- 172.21.15.81:0/1647668938 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd964155e70 con 0x7fd9641579f0 2023-10-06T03:24:06.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.600+0000 7fd9527fc700 1 -- 172.21.15.81:0/1647668938 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd95c003030 con 0x7fd9641579f0 2023-10-06T03:24:06.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.601+0000 7fd9527fc700 1 --2- 172.21.15.81:0/1647668938 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fd944066f30 0x7fd9440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:06.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.601+0000 7fd9527fc700 1 -- 172.21.15.81:0/1647668938 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fd95c0847b0 con 0x7fd9641579f0 2023-10-06T03:24:06.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.601+0000 7fd96259c700 1 --2- 172.21.15.81:0/1647668938 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fd944066f30 0x7fd9440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:06.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.601+0000 7fd96259c700 1 --2- 172.21.15.81:0/1647668938 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fd944066f30 0x7fd9440693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd954000e10 tx=0x7fd954009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:06.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.604+0000 7fd9527fc700 1 -- 172.21.15.81:0/1647668938 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd95c054fc0 con 0x7fd9641579f0 2023-10-06T03:24:06.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.796+0000 7fd968bff700 1 -- 172.21.15.81:0/1647668938 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd96404c3c0 con 0x7fd9641579f0 2023-10-06T03:24:06.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.796+0000 7fd9527fc700 1 -- 172.21.15.81:0/1647668938 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd95c054b50 con 0x7fd9641579f0 2023-10-06T03:24:06.798 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-10-06T03:24:06.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.798+0000 7fd968bff700 1 -- 172.21.15.81:0/1647668938 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fd944066f30 msgr2=0x7fd9440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.798+0000 7fd968bff700 1 --2- 172.21.15.81:0/1647668938 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fd944066f30 0x7fd9440693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd954000e10 tx=0x7fd954009040 comp rx=0 tx=0).stop 2023-10-06T03:24:06.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.798+0000 7fd968bff700 1 -- 172.21.15.81:0/1647668938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9641579f0 msgr2=0x7fd964157e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:06.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.798+0000 7fd968bff700 1 --2- 172.21.15.81:0/1647668938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9641579f0 0x7fd964157e90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd96415d1a0 tx=0x7fd95c009040 comp rx=0 tx=0).stop 2023-10-06T03:24:06.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.798+0000 7fd968bff700 1 -- 172.21.15.81:0/1647668938 shutdown_connections 2023-10-06T03:24:06.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.798+0000 7fd968bff700 1 --2- 172.21.15.81:0/1647668938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9641579f0 0x7fd964157e90 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.798+0000 7fd968bff700 1 --2- 172.21.15.81:0/1647668938 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd94c004810 0x7fd9640c9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.798+0000 7fd968bff700 1 --2- 172.21.15.81:0/1647668938 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fd944066f30 0x7fd9440693e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.798+0000 7fd968bff700 1 --2- 172.21.15.81:0/1647668938 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd964154880 0x7fd964150080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:06.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.798+0000 7fd968bff700 1 -- 172.21.15.81:0/1647668938 >> 172.21.15.81:0/1647668938 conn(0x7fd9640997d0 msgr2=0x7fd964068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:06.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.799+0000 7fd968bff700 1 -- 172.21.15.81:0/1647668938 shutdown_connections 2023-10-06T03:24:06.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.799+0000 7fd968bff700 1 -- 172.21.15.81:0/1647668938 wait complete. 2023-10-06T03:24:06.818 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:24:06.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.997+0000 7fb31b7ff700 1 Processor -- start 2023-10-06T03:24:06.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.997+0000 7fb31b7ff700 1 -- start start 2023-10-06T03:24:07.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.998+0000 7fb31b7ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb3141557f0 0x7fb314156c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:07.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.999+0000 7fb31b7ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb314069ee0 0x7fb31406a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:07.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.999+0000 7fb31b7ff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3140c9c60 con 0x7fb314155bc0 2023-10-06T03:24:07.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.999+0000 7fb31b7ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb31406df20 con 0x7fb3141557f0 2023-10-06T03:24:07.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.999+0000 7fb31b7ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb31406a8a0 con 0x7fb314069ee0 2023-10-06T03:24:07.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.999+0000 7fb31959b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb3141557f0 0x7fb314156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:07.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.999+0000 7fb318d9a700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb314155bc0 0x7fb3140c6cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39512/0 (socket says 172.21.15.81:39512) 2023-10-06T03:24:07.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.999+0000 7fb318d9a700 1 -- 172.21.15.81:0/3794227441 learned_addr learned my addr 172.21.15.81:0/3794227441 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:24:07.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.999+0000 7fb31959b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb3141557f0 0x7fb314156c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56548/0 (socket says 172.21.15.81:56548) 2023-10-06T03:24:07.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.999+0000 7fb319d9c700 1 --2- 172.21.15.81:0/3794227441 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb314069ee0 0x7fb31406a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:07.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.999+0000 7fb31959b700 1 -- 172.21.15.81:0/3794227441 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb314069ee0 msgr2=0x7fb31406a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:07.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.999+0000 7fb31959b700 1 --2- 172.21.15.81:0/3794227441 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb314069ee0 0x7fb31406a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.999+0000 7fb31959b700 1 -- 172.21.15.81:0/3794227441 >> v1:172.21.15.81:6789/0 conn(0x7fb314155bc0 legacy=0x7fb3140c6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:07.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.999+0000 7fb31959b700 1 -- 172.21.15.81:0/3794227441 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb31406dc60 con 0x7fb3141557f0 2023-10-06T03:24:07.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.999+0000 7fb319d9c700 1 --2- 172.21.15.81:0/3794227441 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb314069ee0 0x7fb31406a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:07.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:06.999+0000 7fb30bfff700 1 -- 172.21.15.81:0/3794227441 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 675961083 0 0) 0x7fb3140c9c60 con 0x7fb314155bc0 2023-10-06T03:24:07.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.000+0000 7fb31959b700 1 --2- 172.21.15.81:0/3794227441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3141557f0 0x7fb314156c90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb31000aa90 tx=0x7fb31000a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=296efd5bc5bbbcbf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:07.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.000+0000 7fb30bfff700 1 -- 172.21.15.81:0/3794227441 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31000ca40 con 0x7fb3141557f0 2023-10-06T03:24:07.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.000+0000 7fb30bfff700 1 -- 172.21.15.81:0/3794227441 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb31000cba0 con 0x7fb3141557f0 2023-10-06T03:24:07.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.000+0000 7fb30bfff700 1 -- 172.21.15.81:0/3794227441 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb310018400 con 0x7fb3141557f0 2023-10-06T03:24:07.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.000+0000 7fb31b7ff700 1 -- 172.21.15.81:0/3794227441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3141557f0 msgr2=0x7fb314156c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:07.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.000+0000 7fb31b7ff700 1 --2- 172.21.15.81:0/3794227441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3141557f0 0x7fb314156c90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb31000aa90 tx=0x7fb31000a330 comp rx=0 tx=0).stop 2023-10-06T03:24:07.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.000+0000 7fb31b7ff700 1 -- 172.21.15.81:0/3794227441 shutdown_connections 2023-10-06T03:24:07.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.000+0000 7fb31b7ff700 1 --2- 172.21.15.81:0/3794227441 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb314069ee0 0x7fb31406a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.000+0000 7fb31b7ff700 1 --2- 172.21.15.81:0/3794227441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3141557f0 0x7fb314156c90 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.000+0000 7fb31b7ff700 1 -- 172.21.15.81:0/3794227441 >> 172.21.15.81:0/3794227441 conn(0x7fb3140cc090 msgr2=0x7fb3140cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:07.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.000+0000 7fb31b7ff700 1 -- 172.21.15.81:0/3794227441 shutdown_connections 2023-10-06T03:24:07.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.001+0000 7fb31b7ff700 1 -- 172.21.15.81:0/3794227441 wait complete. 2023-10-06T03:24:07.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.002+0000 7fb31b7ff700 1 Processor -- start 2023-10-06T03:24:07.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.002+0000 7fb31b7ff700 1 -- start start 2023-10-06T03:24:07.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.003+0000 7fb31b7ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb314069ee0 0x7fb31414d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:07.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.003+0000 7fb31b7ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb3141557f0 0x7fb3140b0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:07.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.003+0000 7fb31b7ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb314155bc0 0x7fb31415d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:07.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.003+0000 7fb31b7ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3141524d0 con 0x7fb314069ee0 2023-10-06T03:24:07.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.003+0000 7fb31b7ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3140b1ef0 con 0x7fb314155bc0 2023-10-06T03:24:07.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.003+0000 7fb31b7ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3140b1370 con 0x7fb3141557f0 2023-10-06T03:24:07.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.003+0000 7fb31959b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb314069ee0 0x7fb31414d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:07.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.003+0000 7fb31959b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb314069ee0 0x7fb31414d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56558/0 (socket says 172.21.15.81:56558) 2023-10-06T03:24:07.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.003+0000 7fb31959b700 1 -- 172.21.15.81:0/1132458131 learned_addr learned my addr 172.21.15.81:0/1132458131 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:07.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.003+0000 7fb319d9c700 1 --2- 172.21.15.81:0/1132458131 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb314155bc0 0x7fb31415d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:07.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.003+0000 7fb318d9a700 1 --2- 172.21.15.81:0/1132458131 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb3141557f0 0x7fb3140b0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:07.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.004+0000 7fb31959b700 1 -- 172.21.15.81:0/1132458131 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb3141557f0 msgr2=0x7fb3140b0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:07.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.004+0000 7fb31959b700 1 --2- 172.21.15.81:0/1132458131 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb3141557f0 0x7fb3140b0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.004+0000 7fb31959b700 1 -- 172.21.15.81:0/1132458131 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb314155bc0 msgr2=0x7fb31415d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:07.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.004+0000 7fb31959b700 1 --2- 172.21.15.81:0/1132458131 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb314155bc0 0x7fb31415d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.004+0000 7fb31959b700 1 -- 172.21.15.81:0/1132458131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb31000a5d0 con 0x7fb314069ee0 2023-10-06T03:24:07.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.004+0000 7fb31959b700 1 --2- 172.21.15.81:0/1132458131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb314069ee0 0x7fb31414d3e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb31000a5a0 tx=0x7fb31001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:07.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.004+0000 7fb3097fa700 1 -- 172.21.15.81:0/1132458131 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3100106d0 con 0x7fb314069ee0 2023-10-06T03:24:07.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.004+0000 7fb3097fa700 1 -- 172.21.15.81:0/1132458131 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb310010830 con 0x7fb314069ee0 2023-10-06T03:24:07.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.004+0000 7fb3097fa700 1 -- 172.21.15.81:0/1132458131 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb310010bd0 con 0x7fb314069ee0 2023-10-06T03:24:07.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.004+0000 7fb31b7ff700 1 -- 172.21.15.81:0/1132458131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3140b1650 con 0x7fb314069ee0 2023-10-06T03:24:07.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.004+0000 7fb31b7ff700 1 -- 172.21.15.81:0/1132458131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3140b1c90 con 0x7fb314069ee0 2023-10-06T03:24:07.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.005+0000 7fb31b7ff700 1 -- 172.21.15.81:0/1132458131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb31414da40 con 0x7fb314069ee0 2023-10-06T03:24:07.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.006+0000 7fb3097fa700 1 -- 172.21.15.81:0/1132458131 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb31002c3b0 con 0x7fb314069ee0 2023-10-06T03:24:07.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.007+0000 7fb3097fa700 1 --2- 172.21.15.81:0/1132458131 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb2f8066f30 0x7fb2f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:07.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.007+0000 7fb3097fa700 1 -- 172.21.15.81:0/1132458131 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fb310086660 con 0x7fb314069ee0 2023-10-06T03:24:07.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.007+0000 7fb318d9a700 1 --2- 172.21.15.81:0/1132458131 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb2f8066f30 0x7fb2f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:07.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.008+0000 7fb318d9a700 1 --2- 172.21.15.81:0/1132458131 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb2f8066f30 0x7fb2f80693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb3140ae7c0 tx=0x7fb304009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:07.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.011+0000 7fb3097fa700 1 -- 172.21.15.81:0/1132458131 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb310053480 con 0x7fb314069ee0 2023-10-06T03:24:07.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.248+0000 7fb31b7ff700 1 -- 172.21.15.81:0/1132458131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb31404c3c0 con 0x7fb314069ee0 2023-10-06T03:24:07.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.249+0000 7fb3097fa700 1 -- 172.21.15.81:0/1132458131 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4590 (secure 0 0 0) 0x7fb310056aa0 con 0x7fb314069ee0 2023-10-06T03:24:07.251 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:24:07.251 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1255569320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1255569320},{"type":"v1","addr":"172.21.15.83:6835","nonce":1255569320}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1673166762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1673166762},{"type":"v1","addr":"172.21.15.81:6835","nonce":1673166762}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3689326153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3689326153},{"type":"v1","addr":"172.21.15.81:6837","nonce":3689326153}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:23:40.376852+0000","modified":"2023-10-06T03:23:56.657619+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6833/745669616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":745669616},{"type":"v1","addr":"172.21.15.83:6833","nonce":745669616}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T03:24:07.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.251+0000 7fb31b7ff700 1 -- 172.21.15.81:0/1132458131 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb2f8066f30 msgr2=0x7fb2f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:07.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.251+0000 7fb31b7ff700 1 --2- 172.21.15.81:0/1132458131 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb2f8066f30 0x7fb2f80693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb3140ae7c0 tx=0x7fb304009040 comp rx=0 tx=0).stop 2023-10-06T03:24:07.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.251+0000 7fb31b7ff700 1 -- 172.21.15.81:0/1132458131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb314069ee0 msgr2=0x7fb31414d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:07.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.251+0000 7fb31b7ff700 1 --2- 172.21.15.81:0/1132458131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb314069ee0 0x7fb31414d3e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb31000a5a0 tx=0x7fb31001a000 comp rx=0 tx=0).stop 2023-10-06T03:24:07.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.251+0000 7fb31b7ff700 1 -- 172.21.15.81:0/1132458131 shutdown_connections 2023-10-06T03:24:07.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.251+0000 7fb31b7ff700 1 --2- 172.21.15.81:0/1132458131 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb314155bc0 0x7fb31415d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.251+0000 7fb31b7ff700 1 --2- 172.21.15.81:0/1132458131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb314069ee0 0x7fb31414d3e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.251+0000 7fb31b7ff700 1 --2- 172.21.15.81:0/1132458131 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb2f8066f30 0x7fb2f80693e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.251+0000 7fb31b7ff700 1 --2- 172.21.15.81:0/1132458131 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb3141557f0 0x7fb3140b0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.251+0000 7fb31b7ff700 1 -- 172.21.15.81:0/1132458131 >> 172.21.15.81:0/1132458131 conn(0x7fb3140cc090 msgr2=0x7fb314157030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:07.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.251+0000 7fb31b7ff700 1 -- 172.21.15.81:0/1132458131 shutdown_connections 2023-10-06T03:24:07.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.251+0000 7fb31b7ff700 1 -- 172.21.15.81:0/1132458131 wait complete. 2023-10-06T03:24:07.255 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2023-10-06T03:24:07.270 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:24:07.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.448+0000 7f69dc7ff700 1 Processor -- start 2023-10-06T03:24:07.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.448+0000 7f69dc7ff700 1 -- start start 2023-10-06T03:24:07.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.449+0000 7f69dc7ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f69d41595b0 0x7f69d40af020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:07.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.449+0000 7f69dc7ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f69d4068bc0 0x7f69d40ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:07.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.449+0000 7f69dc7ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f69d40cd300 0x7f69d40cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:07.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.449+0000 7f69dc7ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69d40ce720 con 0x7f69d40cd300 2023-10-06T03:24:07.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.449+0000 7f69dc7ff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69d40ce110 con 0x7f69d41595b0 2023-10-06T03:24:07.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.449+0000 7f69dc7ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69d40af990 con 0x7f69d4068bc0 2023-10-06T03:24:07.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.450+0000 7f69dad9c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f69d40cd300 0x7f69d40cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:07.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.450+0000 7f69dad9c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f69d40cd300 0x7f69d40cebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56564/0 (socket says 172.21.15.81:56564) 2023-10-06T03:24:07.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.450+0000 7f69dad9c700 1 -- 172.21.15.81:0/530467400 learned_addr learned my addr 172.21.15.81:0/530467400 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:07.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.450+0000 7f69d9d9a700 1 --2- 172.21.15.81:0/530467400 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f69d4068bc0 0x7f69d40ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:07.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.450+0000 7f69da59b700 1 --2- 172.21.15.81:0/530467400 >> v2:172.21.15.83:3300/0 conn(0x7f69d41595b0 0x7f69d40af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:07.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.450+0000 7f69dad9c700 1 -- 172.21.15.81:0/530467400 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f69d4068bc0 msgr2=0x7f69d40ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:07.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.450+0000 7f69dad9c700 1 --2- 172.21.15.81:0/530467400 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f69d4068bc0 0x7f69d40ccdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.450+0000 7f69dad9c700 1 -- 172.21.15.81:0/530467400 >> v2:172.21.15.83:3300/0 conn(0x7f69d41595b0 msgr2=0x7f69d40af020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:07.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.450+0000 7f69dad9c700 1 --2- 172.21.15.81:0/530467400 >> v2:172.21.15.83:3300/0 conn(0x7f69d41595b0 0x7f69d40af020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.450+0000 7f69dad9c700 1 -- 172.21.15.81:0/530467400 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d40ce3b0 con 0x7f69d40cd300 2023-10-06T03:24:07.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.450+0000 7f69da59b700 1 --2- 172.21.15.81:0/530467400 >> v2:172.21.15.83:3300/0 conn(0x7f69d41595b0 0x7f69d40af020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:07.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.450+0000 7f69dad9c700 1 --2- 172.21.15.81:0/530467400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69d40cd300 0x7f69d40cebb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f69d4067650 tx=0x7f69cc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6d738affc3c4235 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:07.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.451+0000 7f69d9599700 1 -- 172.21.15.81:0/530467400 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69cc00e070 con 0x7f69d40cd300 2023-10-06T03:24:07.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.451+0000 7f69d9599700 1 -- 172.21.15.81:0/530467400 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69cc00ba20 con 0x7f69d40cd300 2023-10-06T03:24:07.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.451+0000 7f69d9599700 1 -- 172.21.15.81:0/530467400 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69cc0092e0 con 0x7f69d40cd300 2023-10-06T03:24:07.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.451+0000 7f69dc7ff700 1 -- 172.21.15.81:0/530467400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69d40cd300 msgr2=0x7f69d40cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:07.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.451+0000 7f69dc7ff700 1 --2- 172.21.15.81:0/530467400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69d40cd300 0x7f69d40cebb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f69d4067650 tx=0x7f69cc009840 comp rx=0 tx=0).stop 2023-10-06T03:24:07.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.451+0000 7f69dc7ff700 1 -- 172.21.15.81:0/530467400 shutdown_connections 2023-10-06T03:24:07.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.451+0000 7f69dc7ff700 1 --2- 172.21.15.81:0/530467400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69d40cd300 0x7f69d40cebb0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.451+0000 7f69dc7ff700 1 --2- 172.21.15.81:0/530467400 >> v2:172.21.15.83:3300/0 conn(0x7f69d41595b0 0x7f69d40af020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.451+0000 7f69dc7ff700 1 --2- 172.21.15.81:0/530467400 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f69d4068bc0 0x7f69d40ccdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.451+0000 7f69dc7ff700 1 -- 172.21.15.81:0/530467400 >> 172.21.15.81:0/530467400 conn(0x7f69d406f7e0 msgr2=0x7f69d40682b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:07.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.451+0000 7f69dc7ff700 1 -- 172.21.15.81:0/530467400 shutdown_connections 2023-10-06T03:24:07.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.451+0000 7f69dc7ff700 1 -- 172.21.15.81:0/530467400 wait complete. 2023-10-06T03:24:07.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.453+0000 7f69dc7ff700 1 Processor -- start 2023-10-06T03:24:07.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.453+0000 7f69dc7ff700 1 -- start start 2023-10-06T03:24:07.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.454+0000 7f69dc7ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69d4068bc0 0x7f69d40b5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:07.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.454+0000 7f69dc7ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f69d40cd300 0x7f69d414d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:07.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.454+0000 7f69dc7ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69d41595b0 0x7f69d415b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:07.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.454+0000 7f69dc7ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d40b4df0 con 0x7f69d4068bc0 2023-10-06T03:24:07.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.454+0000 7f69dc7ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d40b41e0 con 0x7f69d41595b0 2023-10-06T03:24:07.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.454+0000 7f69dc7ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69d40b44c0 con 0x7f69d40cd300 2023-10-06T03:24:07.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.454+0000 7f69da59b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69d4068bc0 0x7f69d40b5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:07.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.454+0000 7f69da59b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69d4068bc0 0x7f69d40b5280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56580/0 (socket says 172.21.15.81:56580) 2023-10-06T03:24:07.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.454+0000 7f69da59b700 1 -- 172.21.15.81:0/1960512907 learned_addr learned my addr 172.21.15.81:0/1960512907 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:07.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.454+0000 7f69d9d9a700 1 --2- 172.21.15.81:0/1960512907 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f69d40cd300 0x7f69d414d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:07.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.454+0000 7f69dad9c700 1 --2- 172.21.15.81:0/1960512907 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69d41595b0 0x7f69d415b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:07.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.454+0000 7f69da59b700 1 -- 172.21.15.81:0/1960512907 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f69d40cd300 msgr2=0x7f69d414d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:07.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.454+0000 7f69da59b700 1 --2- 172.21.15.81:0/1960512907 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f69d40cd300 0x7f69d414d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.454+0000 7f69da59b700 1 -- 172.21.15.81:0/1960512907 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69d41595b0 msgr2=0x7f69d415b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:07.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.454+0000 7f69da59b700 1 --2- 172.21.15.81:0/1960512907 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69d41595b0 0x7f69d415b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.454+0000 7f69da59b700 1 -- 172.21.15.81:0/1960512907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69cc009ae0 con 0x7f69d4068bc0 2023-10-06T03:24:07.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.455+0000 7f69da59b700 1 --2- 172.21.15.81:0/1960512907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69d4068bc0 0x7f69d40b5280 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f69d000e8d0 tx=0x7f69d0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:07.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.455+0000 7f69ca7fc700 1 -- 172.21.15.81:0/1960512907 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d0013410 con 0x7f69d4068bc0 2023-10-06T03:24:07.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.455+0000 7f69ca7fc700 1 -- 172.21.15.81:0/1960512907 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d0013570 con 0x7f69d4068bc0 2023-10-06T03:24:07.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.455+0000 7f69ca7fc700 1 -- 172.21.15.81:0/1960512907 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d0013910 con 0x7f69d4068bc0 2023-10-06T03:24:07.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.455+0000 7f69dc7ff700 1 -- 172.21.15.81:0/1960512907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69d40b47a0 con 0x7f69d4068bc0 2023-10-06T03:24:07.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.455+0000 7f69dc7ff700 1 -- 172.21.15.81:0/1960512907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69d414d540 con 0x7f69d4068bc0 2023-10-06T03:24:07.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.456+0000 7f69dc7ff700 1 -- 172.21.15.81:0/1960512907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69d404c3c0 con 0x7f69d4068bc0 2023-10-06T03:24:07.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.457+0000 7f69ca7fc700 1 -- 172.21.15.81:0/1960512907 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f69d0013d40 con 0x7f69d4068bc0 2023-10-06T03:24:07.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.458+0000 7f69ca7fc700 1 --2- 172.21.15.81:0/1960512907 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f69b8066f30 0x7f69b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:07.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.458+0000 7f69ca7fc700 1 -- 172.21.15.81:0/1960512907 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f69d0084770 con 0x7f69d4068bc0 2023-10-06T03:24:07.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.458+0000 7f69d9d9a700 1 --2- 172.21.15.81:0/1960512907 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f69b8066f30 0x7f69b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:07.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.458+0000 7f69d9d9a700 1 --2- 172.21.15.81:0/1960512907 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f69b8066f30 0x7f69b80693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f69d40b57c0 tx=0x7f69c40091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:07.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.462+0000 7f69ca7fc700 1 -- 172.21.15.81:0/1960512907 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f69d00514f0 con 0x7f69d4068bc0 2023-10-06T03:24:07.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.657+0000 7f69dc7ff700 1 -- 172.21.15.81:0/1960512907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f69d40893a0 con 0x7f69d4068bc0 2023-10-06T03:24:07.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.658+0000 7f69ca7fc700 1 -- 172.21.15.81:0/1960512907 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18659 (secure 0 0 0) 0x7f69d0054b10 con 0x7f69d4068bc0 2023-10-06T03:24:07.660 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:24:07.661 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"fsid":"1807b5d7-9be8-43ad-aaf8-99a4273430b3","created":"2023-10-06T03:23:20.805306+0000","modified":"2023-10-06T03:23:45.419616+0000","last_up_change":"2023-10-06T03:23:32.735796+0000","last_in_change":"2023-10-06T03:23:24.109024+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:33.198850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:33.606744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:23:38.742266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:23:39.347944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:23:42.959054+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"14fb667d-a677-4978-a477-80027f889d36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":85563},{"type":"v1","addr":"172.21.15.81:6818","nonce":85563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":85563},{"type":"v1","addr":"172.21.15.81:6822","nonce":85563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":85563},{"type":"v1","addr":"172.21.15.81:6830","nonce":85563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":85563},{"type":"v1","addr":"172.21.15.81:6826","nonce":85563}]},"public_addr":"172.21.15.81:6818/85563","cluster_addr":"172.21.15.81:6822/85563","heartbeat_back_addr":"172.21.15.81:6830/85563","heartbeat_front_addr":"172.21.15.81:6826/85563","state":["exists","up"]},{"osd":1,"uuid":"974d8a86-1829-4176-89ce-18e6038857f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":85561},{"type":"v1","addr":"172.21.15.81:6801","nonce":85561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":85561},{"type":"v1","addr":"172.21.15.81:6803","nonce":85561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":85561},{"type":"v1","addr":"172.21.15.81:6807","nonce":85561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":85561},{"type":"v1","addr":"172.21.15.81:6805","nonce":85561}]},"public_addr":"172.21.15.81:6801/85561","cluster_addr":"172.21.15.81:6803/85561","heartbeat_back_addr":"172.21.15.81:6807/85561","heartbeat_front_addr":"172.21.15.81:6805/85561","state":["exists","up"]},{"osd":2,"uuid":"ffbfe056-46bc-46e0-bf49-4d8f8650e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":85564},{"type":"v1","addr":"172.21.15.81:6809","nonce":85564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":85564},{"type":"v1","addr":"172.21.15.81:6811","nonce":85564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":85564},{"type":"v1","addr":"172.21.15.81:6815","nonce":85564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":85564},{"type":"v1","addr":"172.21.15.81:6813","nonce":85564}]},"public_addr":"172.21.15.81:6809/85564","cluster_addr":"172.21.15.81:6811/85564","heartbeat_back_addr":"172.21.15.81:6815/85564","heartbeat_front_addr":"172.21.15.81:6813/85564","state":["exists","up"]},{"osd":3,"uuid":"ef9a8314-3d37-4ea1-858a-e704d5695002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":85562},{"type":"v1","addr":"172.21.15.81:6819","nonce":85562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":85562},{"type":"v1","addr":"172.21.15.81:6823","nonce":85562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":85562},{"type":"v1","addr":"172.21.15.81:6831","nonce":85562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":85562},{"type":"v1","addr":"172.21.15.81:6827","nonce":85562}]},"public_addr":"172.21.15.81:6819/85562","cluster_addr":"172.21.15.81:6823/85562","heartbeat_back_addr":"172.21.15.81:6831/85562","heartbeat_front_addr":"172.21.15.81:6827/85562","state":["exists","up"]},{"osd":4,"uuid":"d83506a0-2c96-4bcb-a9fa-05e43dc329df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":85785},{"type":"v1","addr":"172.21.15.83:6801","nonce":85785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":85785},{"type":"v1","addr":"172.21.15.83:6803","nonce":85785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":85785},{"type":"v1","addr":"172.21.15.83:6807","nonce":85785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":85785},{"type":"v1","addr":"172.21.15.83:6805","nonce":85785}]},"public_addr":"172.21.15.83:6801/85785","cluster_addr":"172.21.15.83:6803/85785","heartbeat_back_addr":"172.21.15.83:6807/85785","heartbeat_front_addr":"172.21.15.83:6805/85785","state":["exists","up"]},{"osd":5,"uuid":"10687c63-a3d5-472f-acc0-4f61847b6e0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":85818},{"type":"v1","addr":"172.21.15.83:6825","nonce":85818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":85818},{"type":"v1","addr":"172.21.15.83:6827","nonce":85818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":85818},{"type":"v1","addr":"172.21.15.83:6831","nonce":85818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":85818},{"type":"v1","addr":"172.21.15.83:6829","nonce":85818}]},"public_addr":"172.21.15.83:6825/85818","cluster_addr":"172.21.15.83:6827/85818","heartbeat_back_addr":"172.21.15.83:6831/85818","heartbeat_front_addr":"172.21.15.83:6829/85818","state":["exists","up"]},{"osd":6,"uuid":"2e9daf76-5607-4a29-9a58-6e270700d223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":85787},{"type":"v1","addr":"172.21.15.83:6811","nonce":85787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":85787},{"type":"v1","addr":"172.21.15.83:6815","nonce":85787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":85787},{"type":"v1","addr":"172.21.15.83:6823","nonce":85787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6817","nonce":85787},{"type":"v1","addr":"172.21.15.83:6819","nonce":85787}]},"public_addr":"172.21.15.83:6811/85787","cluster_addr":"172.21.15.83:6815/85787","heartbeat_back_addr":"172.21.15.83:6823/85787","heartbeat_front_addr":"172.21.15.83:6819/85787","state":["exists","up"]},{"osd":7,"uuid":"5019e1ff-233a-4a5a-91ca-8afccb7ab6e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":85786},{"type":"v1","addr":"172.21.15.83:6810","nonce":85786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":85786},{"type":"v1","addr":"172.21.15.83:6814","nonce":85786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":85786},{"type":"v1","addr":"172.21.15.83:6822","nonce":85786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":85786},{"type":"v1","addr":"172.21.15.83:6818","nonce":85786}]},"public_addr":"172.21.15.83:6810/85786","cluster_addr":"172.21.15.83:6814/85786","heartbeat_back_addr":"172.21.15.83:6822/85786","heartbeat_front_addr":"172.21.15.83:6818/85786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.393431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.360031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.407428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.391613+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.403211+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.438142+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.496181+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.472323+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:24:07.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.661+0000 7f69dc7ff700 1 -- 172.21.15.81:0/1960512907 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f69b8066f30 msgr2=0x7f69b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:07.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.661+0000 7f69dc7ff700 1 --2- 172.21.15.81:0/1960512907 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f69b8066f30 0x7f69b80693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f69d40b57c0 tx=0x7f69c40091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.661+0000 7f69dc7ff700 1 -- 172.21.15.81:0/1960512907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69d4068bc0 msgr2=0x7f69d40b5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:07.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.661+0000 7f69dc7ff700 1 --2- 172.21.15.81:0/1960512907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69d4068bc0 0x7f69d40b5280 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f69d000e8d0 tx=0x7f69d0008040 comp rx=0 tx=0).stop 2023-10-06T03:24:07.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.661+0000 7f69dc7ff700 1 -- 172.21.15.81:0/1960512907 shutdown_connections 2023-10-06T03:24:07.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.661+0000 7f69dc7ff700 1 --2- 172.21.15.81:0/1960512907 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69d41595b0 0x7f69d415b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.661+0000 7f69dc7ff700 1 --2- 172.21.15.81:0/1960512907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69d4068bc0 0x7f69d40b5280 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.661+0000 7f69dc7ff700 1 --2- 172.21.15.81:0/1960512907 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f69b8066f30 0x7f69b80693e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.661+0000 7f69dc7ff700 1 --2- 172.21.15.81:0/1960512907 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f69d40cd300 0x7f69d414d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.661+0000 7f69dc7ff700 1 -- 172.21.15.81:0/1960512907 >> 172.21.15.81:0/1960512907 conn(0x7f69d406f7e0 msgr2=0x7f69d40cacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:07.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.661+0000 7f69dc7ff700 1 -- 172.21.15.81:0/1960512907 shutdown_connections 2023-10-06T03:24:07.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.661+0000 7f69dc7ff700 1 -- 172.21.15.81:0/1960512907 wait complete. 2023-10-06T03:24:07.680 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:23:33.198850+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:23:33.606744+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:23:38.742266+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:23:39.347944+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T03:23:42.959054+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:24:07.681 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:24:07.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.863+0000 7f230359e700 1 Processor -- start 2023-10-06T03:24:07.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.863+0000 7f230359e700 1 -- start start 2023-10-06T03:24:07.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.864+0000 7f230359e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f230415b0b0 0x7f230406ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:07.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.864+0000 7f230359e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2304157460 0x7f2304069d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:07.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.864+0000 7f230359e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23040aec80 con 0x7f23040adf40 2023-10-06T03:24:07.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.864+0000 7f230359e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23040692b0 con 0x7f230415b0b0 2023-10-06T03:24:07.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.864+0000 7f230359e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2304069870 con 0x7f2304157460 2023-10-06T03:24:07.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.864+0000 7f22fbfff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f23040adf40 0x7f2304156d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39522/0 (socket says 172.21.15.81:39522) 2023-10-06T03:24:07.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.864+0000 7f22fbfff700 1 -- 172.21.15.81:0/914964742 learned_addr learned my addr 172.21.15.81:0/914964742 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:24:07.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.865+0000 7f2302d9d700 1 --2- 172.21.15.81:0/914964742 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2304157460 0x7f2304069d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:07.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.865+0000 7f230259c700 1 --2- 172.21.15.81:0/914964742 >> v2:172.21.15.83:3300/0 conn(0x7f230415b0b0 0x7f230406ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:07.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.865+0000 7f2301d9b700 1 -- 172.21.15.81:0/914964742 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2009408028 0 0) 0x7f23040aec80 con 0x7f23040adf40 2023-10-06T03:24:07.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.865+0000 7f2301d9b700 1 -- 172.21.15.81:0/914964742 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22f0003570 con 0x7f23040adf40 2023-10-06T03:24:07.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.865+0000 7f2301d9b700 1 -- 172.21.15.81:0/914964742 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1804620822 0 0) 0x7f22f0003570 con 0x7f23040adf40 2023-10-06T03:24:07.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.865+0000 7f2301d9b700 1 -- 172.21.15.81:0/914964742 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2304157460 msgr2=0x7f2304069d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:07.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.865+0000 7f2301d9b700 1 --2- 172.21.15.81:0/914964742 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2304157460 0x7f2304069d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.865+0000 7f2301d9b700 1 -- 172.21.15.81:0/914964742 >> v2:172.21.15.83:3300/0 conn(0x7f230415b0b0 msgr2=0x7f230406ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:07.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.865+0000 7f2301d9b700 1 --2- 172.21.15.81:0/914964742 >> v2:172.21.15.83:3300/0 conn(0x7f230415b0b0 0x7f230406ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.865+0000 7f2301d9b700 1 -- 172.21.15.81:0/914964742 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23040ae400 con 0x7f23040adf40 2023-10-06T03:24:07.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.865+0000 7f2301d9b700 1 -- 172.21.15.81:0/914964742 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2513016936 0 0) 0x7f22ec001470 con 0x7f23040adf40 2023-10-06T03:24:07.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.865+0000 7f2301d9b700 1 -- 172.21.15.81:0/914964742 >> v1:172.21.15.81:6789/0 conn(0x7f23040adf40 legacy=0x7f2304156d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:07.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.865+0000 7f2301d9b700 1 --2- 172.21.15.81:0/914964742 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2304157460 0x7f22f0003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:07.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.865+0000 7f2301d9b700 1 --2- 172.21.15.81:0/914964742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22f0003fe0 0x7f22f0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:07.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.865+0000 7f2301d9b700 1 --2- 172.21.15.81:0/914964742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22f0004d50 0x7f22f00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:07.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.865+0000 7f2301d9b700 1 -- 172.21.15.81:0/914964742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23040692b0 con 0x7f22f0003fe0 2023-10-06T03:24:07.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.865+0000 7f2301d9b700 1 -- 172.21.15.81:0/914964742 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2304069870 con 0x7f22f0004d50 2023-10-06T03:24:07.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.865+0000 7f2301d9b700 1 -- 172.21.15.81:0/914964742 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22f000ba90 con 0x7f2304157460 2023-10-06T03:24:07.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.866+0000 7f22fbfff700 1 --2- 172.21.15.81:0/914964742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22f0003fe0 0x7f22f0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:07.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.866+0000 7f2302d9d700 1 --2- 172.21.15.81:0/914964742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22f0004d50 0x7f22f00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:07.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.866+0000 7f230259c700 1 --2- 172.21.15.81:0/914964742 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2304157460 0x7f22f0003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:07.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.866+0000 7f22fbfff700 1 -- 172.21.15.81:0/914964742 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2304157460 msgr2=0x7f22f0003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:07.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.866+0000 7f22fbfff700 1 --2- 172.21.15.81:0/914964742 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2304157460 0x7f22f0003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.866+0000 7f22fbfff700 1 -- 172.21.15.81:0/914964742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22f0004d50 msgr2=0x7f22f00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:07.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.866+0000 7f22fbfff700 1 --2- 172.21.15.81:0/914964742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22f0004d50 0x7f22f00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.866+0000 7f22fbfff700 1 -- 172.21.15.81:0/914964742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f0003570 con 0x7f22f0003fe0 2023-10-06T03:24:07.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.866+0000 7f22fbfff700 1 --2- 172.21.15.81:0/914964742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22f0003fe0 0x7f22f0004810 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f22ec00c390 tx=0x7f23040cbbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd9d1f7136860197 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:07.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.866+0000 7f2301d9b700 1 -- 172.21.15.81:0/914964742 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ec00cc00 con 0x7f22f0003fe0 2023-10-06T03:24:07.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.866+0000 7f2301d9b700 1 -- 172.21.15.81:0/914964742 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22ec00cda0 con 0x7f22f0003fe0 2023-10-06T03:24:07.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.866+0000 7f2301d9b700 1 -- 172.21.15.81:0/914964742 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ec005b70 con 0x7f22f0003fe0 2023-10-06T03:24:07.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.867+0000 7f230359e700 1 -- 172.21.15.81:0/914964742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22f0003fe0 msgr2=0x7f22f0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:07.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.867+0000 7f230359e700 1 --2- 172.21.15.81:0/914964742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22f0003fe0 0x7f22f0004810 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f22ec00c390 tx=0x7f23040cbbf0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.867+0000 7f2302d9d700 1 -- 172.21.15.81:0/914964742 reap_dead start 2023-10-06T03:24:07.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.867+0000 7f230359e700 1 -- 172.21.15.81:0/914964742 shutdown_connections 2023-10-06T03:24:07.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.867+0000 7f230359e700 1 -- 172.21.15.81:0/914964742 >> 172.21.15.81:0/914964742 conn(0x7f23040680b0 msgr2=0x7f23040cbeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:07.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.867+0000 7f230359e700 1 -- 172.21.15.81:0/914964742 shutdown_connections 2023-10-06T03:24:07.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.867+0000 7f230359e700 1 -- 172.21.15.81:0/914964742 wait complete. 2023-10-06T03:24:07.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.868+0000 7f230359e700 1 Processor -- start 2023-10-06T03:24:07.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.868+0000 7f230359e700 1 -- start start 2023-10-06T03:24:07.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.869+0000 7f230359e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22f0003fe0 0x7f23040aa490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:07.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.869+0000 7f230359e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2304157930 0x7f23040b02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:07.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.869+0000 7f230359e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2304153020 0x7f2304153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:07.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.869+0000 7f230359e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2304158c90 con 0x7f22f0003fe0 2023-10-06T03:24:07.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.869+0000 7f230359e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23041539d0 con 0x7f2304157930 2023-10-06T03:24:07.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.869+0000 7f230359e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2304158110 con 0x7f2304153020 2023-10-06T03:24:07.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.870+0000 7f230259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22f0003fe0 0x7f23040aa490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:07.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.870+0000 7f230259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22f0003fe0 0x7f23040aa490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56612/0 (socket says 172.21.15.81:56612) 2023-10-06T03:24:07.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.870+0000 7f230259c700 1 -- 172.21.15.81:0/1832096177 learned_addr learned my addr 172.21.15.81:0/1832096177 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:07.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.870+0000 7f22fbfff700 1 --2- 172.21.15.81:0/1832096177 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2304157930 0x7f23040b02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:07.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.870+0000 7f2302d9d700 1 --2- 172.21.15.81:0/1832096177 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2304153020 0x7f2304153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:07.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.870+0000 7f230259c700 1 -- 172.21.15.81:0/1832096177 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2304153020 msgr2=0x7f2304153490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:07.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.870+0000 7f230259c700 1 --2- 172.21.15.81:0/1832096177 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2304153020 0x7f2304153490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.870+0000 7f230259c700 1 -- 172.21.15.81:0/1832096177 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2304157930 msgr2=0x7f23040b02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:07.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.870+0000 7f230259c700 1 --2- 172.21.15.81:0/1832096177 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2304157930 0x7f23040b02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:07.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.870+0000 7f230259c700 1 -- 172.21.15.81:0/1832096177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23041583f0 con 0x7f22f0003fe0 2023-10-06T03:24:07.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.870+0000 7f22fbfff700 1 --2- 172.21.15.81:0/1832096177 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2304157930 0x7f23040b02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:07.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.870+0000 7f230259c700 1 --2- 172.21.15.81:0/1832096177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22f0003fe0 0x7f23040aa490 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f22f4011d40 tx=0x7f22f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:07.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.870+0000 7f22fa7fc700 1 -- 172.21.15.81:0/1832096177 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f400fa40 con 0x7f22f0003fe0 2023-10-06T03:24:07.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.870+0000 7f22fa7fc700 1 -- 172.21.15.81:0/1832096177 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f400fba0 con 0x7f22f0003fe0 2023-10-06T03:24:07.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.870+0000 7f230359e700 1 -- 172.21.15.81:0/1832096177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23041586d0 con 0x7f22f0003fe0 2023-10-06T03:24:07.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.870+0000 7f22fa7fc700 1 -- 172.21.15.81:0/1832096177 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f4014440 con 0x7f22f0003fe0 2023-10-06T03:24:07.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.871+0000 7f230359e700 1 -- 172.21.15.81:0/1832096177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23040c0a30 con 0x7f22f0003fe0 2023-10-06T03:24:07.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.871+0000 7f230359e700 1 -- 172.21.15.81:0/1832096177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f230404c3c0 con 0x7f22f0003fe0 2023-10-06T03:24:07.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.872+0000 7f22fa7fc700 1 -- 172.21.15.81:0/1832096177 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f22f4014870 con 0x7f22f0003fe0 2023-10-06T03:24:07.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.873+0000 7f22fa7fc700 1 --2- 172.21.15.81:0/1832096177 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f22e4066f30 0x7f22e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:07.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.873+0000 7f22fa7fc700 1 -- 172.21.15.81:0/1832096177 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f22f4018030 con 0x7f22f0003fe0 2023-10-06T03:24:07.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.873+0000 7f22fbfff700 1 --2- 172.21.15.81:0/1832096177 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f22e4066f30 0x7f22e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:07.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.874+0000 7f22fbfff700 1 --2- 172.21.15.81:0/1832096177 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f22e4066f30 0x7f22e40693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f22ec00c390 tx=0x7f22ec015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:07.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:07.877+0000 7f22fa7fc700 1 -- 172.21.15.81:0/1832096177 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f22f4052250 con 0x7f22f0003fe0 2023-10-06T03:24:08.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.067+0000 7f230359e700 1 -- 172.21.15.81:0/1832096177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f23040ae6e0 con 0x7f22f0003fe0 2023-10-06T03:24:08.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.067+0000 7f22fa7fc700 1 -- 172.21.15.81:0/1832096177 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f22f4055870 con 0x7f22f0003fe0 2023-10-06T03:24:08.069 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-10-06T03:24:08.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.069+0000 7f230359e700 1 -- 172.21.15.81:0/1832096177 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f22e4066f30 msgr2=0x7f22e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.069+0000 7f230359e700 1 --2- 172.21.15.81:0/1832096177 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f22e4066f30 0x7f22e40693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f22ec00c390 tx=0x7f22ec015000 comp rx=0 tx=0).stop 2023-10-06T03:24:08.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.069+0000 7f230359e700 1 -- 172.21.15.81:0/1832096177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22f0003fe0 msgr2=0x7f23040aa490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.069+0000 7f230359e700 1 --2- 172.21.15.81:0/1832096177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22f0003fe0 0x7f23040aa490 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f22f4011d40 tx=0x7f22f40091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.070+0000 7f230359e700 1 -- 172.21.15.81:0/1832096177 shutdown_connections 2023-10-06T03:24:08.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.070+0000 7f230359e700 1 --2- 172.21.15.81:0/1832096177 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f22e4066f30 0x7f22e40693e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.070+0000 7f230359e700 1 --2- 172.21.15.81:0/1832096177 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2304153020 0x7f2304153490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.070+0000 7f230359e700 1 --2- 172.21.15.81:0/1832096177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22f0003fe0 0x7f23040aa490 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.070+0000 7f230359e700 1 --2- 172.21.15.81:0/1832096177 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2304157930 0x7f23040b02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.070+0000 7f230359e700 1 -- 172.21.15.81:0/1832096177 >> 172.21.15.81:0/1832096177 conn(0x7f23040680b0 msgr2=0x7f23040cc150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:08.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.070+0000 7f230359e700 1 -- 172.21.15.81:0/1832096177 shutdown_connections 2023-10-06T03:24:08.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.070+0000 7f230359e700 1 -- 172.21.15.81:0/1832096177 wait complete. 2023-10-06T03:24:08.089 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:24:08.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.269+0000 7f9c1f59e700 1 Processor -- start 2023-10-06T03:24:08.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.269+0000 7f9c1f59e700 1 -- start start 2023-10-06T03:24:08.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.270+0000 7f9c1f59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9c201594a0 0x7f9c2006b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.270+0000 7f9c1f59e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c20159870 0x7f9c200c7570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.270+0000 7f9c1f59e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c2006acb0 con 0x7f9c2015ded0 2023-10-06T03:24:08.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.270+0000 7f9c1f59e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c2006b680 con 0x7f9c201594a0 2023-10-06T03:24:08.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.270+0000 7f9c1f59e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c200ca0e0 con 0x7f9c20159870 2023-10-06T03:24:08.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.270+0000 7f9c1e59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9c201594a0 0x7f9c2006b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.270+0000 7f9c1e59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9c201594a0 0x7f9c2006b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56620/0 (socket says 172.21.15.81:56620) 2023-10-06T03:24:08.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.270+0000 7f9c1e59c700 1 -- 172.21.15.81:0/3004601726 learned_addr learned my addr 172.21.15.81:0/3004601726 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:08.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.271+0000 7f9c1e59c700 1 -- 172.21.15.81:0/3004601726 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c20159870 msgr2=0x7f9c200c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:08.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.271+0000 7f9c1ed9d700 1 --2- 172.21.15.81:0/3004601726 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c20159870 0x7f9c200c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.271+0000 7f9c1e59c700 1 --2- 172.21.15.81:0/3004601726 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c20159870 0x7f9c200c7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.271+0000 7f9c1e59c700 1 -- 172.21.15.81:0/3004601726 >> v1:172.21.15.83:6789/0 conn(0x7f9c2015ded0 legacy=0x7f9c200c99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:08.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.271+0000 7f9c1e59c700 1 -- 172.21.15.81:0/3004601726 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c2006a3c0 con 0x7f9c201594a0 2023-10-06T03:24:08.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.271+0000 7f9c1ed9d700 1 --2- 172.21.15.81:0/3004601726 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c20159870 0x7f9c200c7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:08.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.271+0000 7f9c1e59c700 1 --2- 172.21.15.81:0/3004601726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c201594a0 0x7f9c2006b140 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9c100099b0 tx=0x7f9c10009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be4d81f0abea3d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:08.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.271+0000 7f9c1dd9b700 1 -- 172.21.15.81:0/3004601726 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1000b820 con 0x7f9c201594a0 2023-10-06T03:24:08.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.271+0000 7f9c1dd9b700 1 -- 172.21.15.81:0/3004601726 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c1000b980 con 0x7f9c201594a0 2023-10-06T03:24:08.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.271+0000 7f9c1dd9b700 1 -- 172.21.15.81:0/3004601726 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1000bd20 con 0x7f9c201594a0 2023-10-06T03:24:08.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.272+0000 7f9c1f59e700 1 -- 172.21.15.81:0/3004601726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c201594a0 msgr2=0x7f9c2006b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.272+0000 7f9c1f59e700 1 --2- 172.21.15.81:0/3004601726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c201594a0 0x7f9c2006b140 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9c100099b0 tx=0x7f9c10009250 comp rx=0 tx=0).stop 2023-10-06T03:24:08.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.272+0000 7f9c1f59e700 1 -- 172.21.15.81:0/3004601726 shutdown_connections 2023-10-06T03:24:08.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.272+0000 7f9c1f59e700 1 --2- 172.21.15.81:0/3004601726 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c20159870 0x7f9c200c7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.272+0000 7f9c1f59e700 1 --2- 172.21.15.81:0/3004601726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c201594a0 0x7f9c2006b140 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.272+0000 7f9c1f59e700 1 -- 172.21.15.81:0/3004601726 >> 172.21.15.81:0/3004601726 conn(0x7f9c200686f0 msgr2=0x7f9c20068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:08.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.272+0000 7f9c1f59e700 1 -- 172.21.15.81:0/3004601726 shutdown_connections 2023-10-06T03:24:08.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.272+0000 7f9c1f59e700 1 -- 172.21.15.81:0/3004601726 wait complete. 2023-10-06T03:24:08.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.273+0000 7f9c1f59e700 1 Processor -- start 2023-10-06T03:24:08.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.273+0000 7f9c1f59e700 1 -- start start 2023-10-06T03:24:08.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.274+0000 7f9c1f59e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c201594a0 0x7f9c20157260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.274+0000 7f9c1f59e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c20159870 0x7f9c200b2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.274+0000 7f9c1f59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c2015ded0 0x7f9c200b2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.274+0000 7f9c1f59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c200c4080 con 0x7f9c2015ded0 2023-10-06T03:24:08.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.274+0000 7f9c1f59e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c200c4360 con 0x7f9c201594a0 2023-10-06T03:24:08.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.274+0000 7f9c1f59e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c200c4640 con 0x7f9c20159870 2023-10-06T03:24:08.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.275+0000 7f9c1ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c2015ded0 0x7f9c200b2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.275+0000 7f9c1ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c2015ded0 0x7f9c200b2890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56624/0 (socket says 172.21.15.81:56624) 2023-10-06T03:24:08.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.275+0000 7f9c1ed9d700 1 -- 172.21.15.81:0/4241638790 learned_addr learned my addr 172.21.15.81:0/4241638790 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:08.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.275+0000 7f9c1e59c700 1 --2- 172.21.15.81:0/4241638790 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c201594a0 0x7f9c20157260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.275+0000 7f9c17fff700 1 --2- 172.21.15.81:0/4241638790 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c20159870 0x7f9c200b2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.275+0000 7f9c1ed9d700 1 -- 172.21.15.81:0/4241638790 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c20159870 msgr2=0x7f9c200b2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.275+0000 7f9c1ed9d700 1 --2- 172.21.15.81:0/4241638790 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c20159870 0x7f9c200b2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.275+0000 7f9c1ed9d700 1 -- 172.21.15.81:0/4241638790 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c201594a0 msgr2=0x7f9c20157260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.275+0000 7f9c1ed9d700 1 --2- 172.21.15.81:0/4241638790 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c201594a0 0x7f9c20157260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.275+0000 7f9c1ed9d700 1 -- 172.21.15.81:0/4241638790 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c100094f0 con 0x7f9c2015ded0 2023-10-06T03:24:08.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.275+0000 7f9c1ed9d700 1 --2- 172.21.15.81:0/4241638790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c2015ded0 0x7f9c200b2890 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9c1800a380 tx=0x7f9c18007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:08.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.275+0000 7f9c167fc700 1 -- 172.21.15.81:0/4241638790 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c18015440 con 0x7f9c2015ded0 2023-10-06T03:24:08.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.276+0000 7f9c167fc700 1 -- 172.21.15.81:0/4241638790 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c180155a0 con 0x7f9c2015ded0 2023-10-06T03:24:08.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.276+0000 7f9c167fc700 1 -- 172.21.15.81:0/4241638790 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c18015960 con 0x7f9c2015ded0 2023-10-06T03:24:08.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.276+0000 7f9c1f59e700 1 -- 172.21.15.81:0/4241638790 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c200c4920 con 0x7f9c2015ded0 2023-10-06T03:24:08.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.276+0000 7f9c1f59e700 1 -- 172.21.15.81:0/4241638790 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c201577a0 con 0x7f9c2015ded0 2023-10-06T03:24:08.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.277+0000 7f9c1f59e700 1 -- 172.21.15.81:0/4241638790 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c200c4e40 con 0x7f9c2015ded0 2023-10-06T03:24:08.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.278+0000 7f9c167fc700 1 -- 172.21.15.81:0/4241638790 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9c1800d440 con 0x7f9c2015ded0 2023-10-06T03:24:08.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.279+0000 7f9c167fc700 1 --2- 172.21.15.81:0/4241638790 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f9c00066f30 0x7f9c000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.279+0000 7f9c167fc700 1 -- 172.21.15.81:0/4241638790 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f9c18085520 con 0x7f9c2015ded0 2023-10-06T03:24:08.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.279+0000 7f9c1e59c700 1 --2- 172.21.15.81:0/4241638790 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f9c00066f30 0x7f9c000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.280+0000 7f9c1e59c700 1 --2- 172.21.15.81:0/4241638790 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f9c00066f30 0x7f9c000693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9c100099b0 tx=0x7f9c10016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:08.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.283+0000 7f9c167fc700 1 -- 172.21.15.81:0/4241638790 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9c180522a0 con 0x7f9c2015ded0 2023-10-06T03:24:08.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.472+0000 7f9c1f59e700 1 -- 172.21.15.81:0/4241638790 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9c2004c3c0 con 0x7f9c2015ded0 2023-10-06T03:24:08.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.473+0000 7f9c167fc700 1 -- 172.21.15.81:0/4241638790 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9c180558c0 con 0x7f9c2015ded0 2023-10-06T03:24:08.475 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-06T03:24:08.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.475+0000 7f9c1f59e700 1 -- 172.21.15.81:0/4241638790 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f9c00066f30 msgr2=0x7f9c000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.475+0000 7f9c1f59e700 1 --2- 172.21.15.81:0/4241638790 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f9c00066f30 0x7f9c000693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9c100099b0 tx=0x7f9c10016000 comp rx=0 tx=0).stop 2023-10-06T03:24:08.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.475+0000 7f9c1f59e700 1 -- 172.21.15.81:0/4241638790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c2015ded0 msgr2=0x7f9c200b2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.475+0000 7f9c1f59e700 1 --2- 172.21.15.81:0/4241638790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c2015ded0 0x7f9c200b2890 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9c1800a380 tx=0x7f9c18007900 comp rx=0 tx=0).stop 2023-10-06T03:24:08.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.475+0000 7f9c1f59e700 1 -- 172.21.15.81:0/4241638790 shutdown_connections 2023-10-06T03:24:08.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.475+0000 7f9c1f59e700 1 --2- 172.21.15.81:0/4241638790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c2015ded0 0x7f9c200b2890 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.475+0000 7f9c1f59e700 1 --2- 172.21.15.81:0/4241638790 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c201594a0 0x7f9c20157260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.475+0000 7f9c1f59e700 1 --2- 172.21.15.81:0/4241638790 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f9c00066f30 0x7f9c000693e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.475+0000 7f9c1f59e700 1 --2- 172.21.15.81:0/4241638790 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c20159870 0x7f9c200b2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.475+0000 7f9c1f59e700 1 -- 172.21.15.81:0/4241638790 >> 172.21.15.81:0/4241638790 conn(0x7f9c200686f0 msgr2=0x7f9c200c9470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:08.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.476+0000 7f9c1f59e700 1 -- 172.21.15.81:0/4241638790 shutdown_connections 2023-10-06T03:24:08.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.476+0000 7f9c1f59e700 1 -- 172.21.15.81:0/4241638790 wait complete. 2023-10-06T03:24:08.495 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:24:08.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.675+0000 7f5ada7ff700 1 Processor -- start 2023-10-06T03:24:08.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.675+0000 7f5ada7ff700 1 -- start start 2023-10-06T03:24:08.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.677+0000 7f5ada7ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5ad40c7ca0 0x7f5ad4161190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.677+0000 7f5ada7ff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ad40cb580 con 0x7f5ad40ca640 2023-10-06T03:24:08.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.677+0000 7f5ada7ff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ad40c6800 con 0x7f5ad413fd70 2023-10-06T03:24:08.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.677+0000 7f5ada7ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ad40caac0 con 0x7f5ad40c7ca0 2023-10-06T03:24:08.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.677+0000 7f5ad8d9c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5ad40c7ca0 0x7f5ad4161190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.677+0000 7f5ad37fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5ad40ca640 0x7f5ad415a7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39534/0 (socket says 172.21.15.81:39534) 2023-10-06T03:24:08.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.677+0000 7f5ad37fe700 1 -- 172.21.15.81:0/3458536974 learned_addr learned my addr 172.21.15.81:0/3458536974 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:24:08.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.677+0000 7f5ad2ffd700 1 -- 172.21.15.81:0/3458536974 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4161803822 0 0) 0x7f5ad40cb580 con 0x7f5ad40ca640 2023-10-06T03:24:08.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.677+0000 7f5ad8d9c700 1 -- 172.21.15.81:0/3458536974 >> v1:172.21.15.83:6789/0 conn(0x7f5ad413fd70 legacy=0x7f5ad415a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.677+0000 7f5ad8d9c700 1 -- 172.21.15.81:0/3458536974 >> v1:172.21.15.81:6789/0 conn(0x7f5ad40ca640 legacy=0x7f5ad415a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.677+0000 7f5ad8d9c700 1 -- 172.21.15.81:0/3458536974 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad4069880 con 0x7f5ad40c7ca0 2023-10-06T03:24:08.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.678+0000 7f5ad8d9c700 1 --2- 172.21.15.81:0/3458536974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad40c7ca0 0x7f5ad4161190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5acc009e60 tx=0x7f5acc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7be4fbba7d02fabd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:08.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.678+0000 7f5ad2ffd700 1 -- 172.21.15.81:0/3458536974 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5acc00e070 con 0x7f5ad40c7ca0 2023-10-06T03:24:08.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.678+0000 7f5ad2ffd700 1 -- 172.21.15.81:0/3458536974 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5acc00bc30 con 0x7f5ad40c7ca0 2023-10-06T03:24:08.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.678+0000 7f5ad2ffd700 1 -- 172.21.15.81:0/3458536974 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5acc012430 con 0x7f5ad40c7ca0 2023-10-06T03:24:08.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.678+0000 7f5ada7ff700 1 -- 172.21.15.81:0/3458536974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad40c7ca0 msgr2=0x7f5ad4161190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.678+0000 7f5ada7ff700 1 --2- 172.21.15.81:0/3458536974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad40c7ca0 0x7f5ad4161190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5acc009e60 tx=0x7f5acc009780 comp rx=0 tx=0).stop 2023-10-06T03:24:08.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.678+0000 7f5ada7ff700 1 -- 172.21.15.81:0/3458536974 shutdown_connections 2023-10-06T03:24:08.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.678+0000 7f5ada7ff700 1 --2- 172.21.15.81:0/3458536974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad40c7ca0 0x7f5ad4161190 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.678+0000 7f5ada7ff700 1 -- 172.21.15.81:0/3458536974 >> 172.21.15.81:0/3458536974 conn(0x7f5ad40cc090 msgr2=0x7f5ad40cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:08.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.679+0000 7f5ada7ff700 1 -- 172.21.15.81:0/3458536974 shutdown_connections 2023-10-06T03:24:08.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.679+0000 7f5ada7ff700 1 -- 172.21.15.81:0/3458536974 wait complete. 2023-10-06T03:24:08.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.680+0000 7f5ada7ff700 1 Processor -- start 2023-10-06T03:24:08.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.680+0000 7f5ada7ff700 1 -- start start 2023-10-06T03:24:08.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.681+0000 7f5ada7ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ad40c7ca0 0x7f5ad4155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.681+0000 7f5ada7ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad40ca640 0x7f5ad40c3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.681+0000 7f5ada7ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ad413fd70 0x7f5ad415f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.681+0000 7f5ada7ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad413c3f0 con 0x7f5ad40ca640 2023-10-06T03:24:08.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.681+0000 7f5ada7ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad413c0c0 con 0x7f5ad40c7ca0 2023-10-06T03:24:08.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.681+0000 7f5ada7ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad40c3990 con 0x7f5ad413fd70 2023-10-06T03:24:08.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.681+0000 7f5ad37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad40ca640 0x7f5ad40c3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.681+0000 7f5ad37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad40ca640 0x7f5ad40c3140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56638/0 (socket says 172.21.15.81:56638) 2023-10-06T03:24:08.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.681+0000 7f5ad37fe700 1 -- 172.21.15.81:0/635417411 learned_addr learned my addr 172.21.15.81:0/635417411 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:08.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.681+0000 7f5ad3fff700 1 --2- 172.21.15.81:0/635417411 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ad40c7ca0 0x7f5ad4155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.681+0000 7f5ad8d9c700 1 --2- 172.21.15.81:0/635417411 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ad413fd70 0x7f5ad415f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.682+0000 7f5ad37fe700 1 -- 172.21.15.81:0/635417411 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ad413fd70 msgr2=0x7f5ad415f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.682+0000 7f5ad37fe700 1 --2- 172.21.15.81:0/635417411 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ad413fd70 0x7f5ad415f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.682+0000 7f5ad37fe700 1 -- 172.21.15.81:0/635417411 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ad40c7ca0 msgr2=0x7f5ad4155ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.682+0000 7f5ad37fe700 1 --2- 172.21.15.81:0/635417411 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ad40c7ca0 0x7f5ad4155ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.682+0000 7f5ad37fe700 1 -- 172.21.15.81:0/635417411 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5acc009a20 con 0x7f5ad40ca640 2023-10-06T03:24:08.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.682+0000 7f5ad37fe700 1 --2- 172.21.15.81:0/635417411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad40ca640 0x7f5ad40c3140 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5ac800c7e0 tx=0x7f5ac8007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:08.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.682+0000 7f5abbfff700 1 -- 172.21.15.81:0/635417411 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac8005b30 con 0x7f5ad40ca640 2023-10-06T03:24:08.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.682+0000 7f5abbfff700 1 -- 172.21.15.81:0/635417411 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac8005c90 con 0x7f5ad40ca640 2023-10-06T03:24:08.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.682+0000 7f5abbfff700 1 -- 172.21.15.81:0/635417411 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac8007300 con 0x7f5ad40ca640 2023-10-06T03:24:08.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.682+0000 7f5ada7ff700 1 -- 172.21.15.81:0/635417411 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ad40c3c70 con 0x7f5ad40ca640 2023-10-06T03:24:08.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.682+0000 7f5ada7ff700 1 -- 172.21.15.81:0/635417411 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ad41561e0 con 0x7f5ad40ca640 2023-10-06T03:24:08.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.683+0000 7f5ada7ff700 1 -- 172.21.15.81:0/635417411 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ad40c4170 con 0x7f5ad40ca640 2023-10-06T03:24:08.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.684+0000 7f5abbfff700 1 -- 172.21.15.81:0/635417411 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5ac801b400 con 0x7f5ad40ca640 2023-10-06T03:24:08.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.685+0000 7f5abbfff700 1 --2- 172.21.15.81:0/635417411 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f5ac0066f30 0x7f5ac00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:08.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.686+0000 7f5abbfff700 1 -- 172.21.15.81:0/635417411 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f5ac8084520 con 0x7f5ad40ca640 2023-10-06T03:24:08.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.686+0000 7f5ad3fff700 1 --2- 172.21.15.81:0/635417411 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f5ac0066f30 0x7f5ac00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:08.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.686+0000 7f5ad3fff700 1 --2- 172.21.15.81:0/635417411 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f5ac0066f30 0x7f5ac00693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5ac40037f0 tx=0x7f5ac4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:08.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.690+0000 7f5abbfff700 1 -- 172.21.15.81:0/635417411 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ac8051320 con 0x7f5ad40ca640 2023-10-06T03:24:08.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.879+0000 7f5ada7ff700 1 -- 172.21.15.81:0/635417411 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5ad404c3c0 con 0x7f5ad40ca640 2023-10-06T03:24:08.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.879+0000 7f5abbfff700 1 -- 172.21.15.81:0/635417411 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5ac8054940 con 0x7f5ad40ca640 2023-10-06T03:24:08.881 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-10-06T03:24:08.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.882+0000 7f5ada7ff700 1 -- 172.21.15.81:0/635417411 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f5ac0066f30 msgr2=0x7f5ac00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.882+0000 7f5ada7ff700 1 --2- 172.21.15.81:0/635417411 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f5ac0066f30 0x7f5ac00693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5ac40037f0 tx=0x7f5ac4009040 comp rx=0 tx=0).stop 2023-10-06T03:24:08.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.882+0000 7f5ada7ff700 1 -- 172.21.15.81:0/635417411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad40ca640 msgr2=0x7f5ad40c3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:08.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.882+0000 7f5ada7ff700 1 --2- 172.21.15.81:0/635417411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad40ca640 0x7f5ad40c3140 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5ac800c7e0 tx=0x7f5ac8007df0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.882+0000 7f5ada7ff700 1 -- 172.21.15.81:0/635417411 shutdown_connections 2023-10-06T03:24:08.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.882+0000 7f5ada7ff700 1 --2- 172.21.15.81:0/635417411 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f5ac0066f30 0x7f5ac00693e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.882+0000 7f5ada7ff700 1 --2- 172.21.15.81:0/635417411 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ad413fd70 0x7f5ad415f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.882+0000 7f5ada7ff700 1 --2- 172.21.15.81:0/635417411 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ad40c7ca0 0x7f5ad4155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.882+0000 7f5ada7ff700 1 --2- 172.21.15.81:0/635417411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad40ca640 0x7f5ad40c3140 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:08.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.882+0000 7f5ada7ff700 1 -- 172.21.15.81:0/635417411 >> 172.21.15.81:0/635417411 conn(0x7f5ad40cc090 msgr2=0x7f5ad40c24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:08.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.882+0000 7f5ada7ff700 1 -- 172.21.15.81:0/635417411 shutdown_connections 2023-10-06T03:24:08.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:08.882+0000 7f5ada7ff700 1 -- 172.21.15.81:0/635417411 wait complete. 2023-10-06T03:24:08.901 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:24:09.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.086+0000 7f54983ff700 1 Processor -- start 2023-10-06T03:24:09.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.086+0000 7f54983ff700 1 -- start start 2023-10-06T03:24:09.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.087+0000 7f54983ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f549013fd70 0x7f54900ca640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:09.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.087+0000 7f54983ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f549015a0c0 0x7f549015a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:09.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.087+0000 7f54983ff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54900cb580 con 0x7f549015aa80 2023-10-06T03:24:09.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.087+0000 7f54983ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54900c6800 con 0x7f549013fd70 2023-10-06T03:24:09.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.087+0000 7f54983ff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5490069880 con 0x7f549015a0c0 2023-10-06T03:24:09.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.087+0000 7f549619b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f549013fd70 0x7f54900ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:09.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.087+0000 7f549619b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f549013fd70 0x7f54900ca640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56640/0 (socket says 172.21.15.81:56640) 2023-10-06T03:24:09.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.087+0000 7f549619b700 1 -- 172.21.15.81:0/2631746088 learned_addr learned my addr 172.21.15.81:0/2631746088 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:09.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.088+0000 7f549599a700 1 --2- 172.21.15.81:0/2631746088 >> v2:172.21.15.83:3300/0 conn(0x7f549015a0c0 0x7f549015a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:09.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.088+0000 7f549619b700 1 -- 172.21.15.81:0/2631746088 >> v2:172.21.15.83:3300/0 conn(0x7f549015a0c0 msgr2=0x7f549015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:09.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.088+0000 7f549619b700 1 --2- 172.21.15.81:0/2631746088 >> v2:172.21.15.83:3300/0 conn(0x7f549015a0c0 0x7f549015a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:09.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.088+0000 7f549619b700 1 -- 172.21.15.81:0/2631746088 >> v1:172.21.15.83:6789/0 conn(0x7f549015aa80 legacy=0x7f549006e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:09.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.088+0000 7f549619b700 1 -- 172.21.15.81:0/2631746088 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f549015aee0 con 0x7f549013fd70 2023-10-06T03:24:09.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.088+0000 7f549619b700 1 --2- 172.21.15.81:0/2631746088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f549013fd70 0x7f54900ca640 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5490069360 tx=0x7f548c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78e4cce006fe6f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:09.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.088+0000 7f5495199700 1 -- 172.21.15.81:0/2631746088 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c00e070 con 0x7f549013fd70 2023-10-06T03:24:09.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.088+0000 7f5495199700 1 -- 172.21.15.81:0/2631746088 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f548c00ba90 con 0x7f549013fd70 2023-10-06T03:24:09.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.088+0000 7f5495199700 1 -- 172.21.15.81:0/2631746088 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c0092e0 con 0x7f549013fd70 2023-10-06T03:24:09.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.089+0000 7f54983ff700 1 -- 172.21.15.81:0/2631746088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f549013fd70 msgr2=0x7f54900ca640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:09.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.089+0000 7f54983ff700 1 --2- 172.21.15.81:0/2631746088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f549013fd70 0x7f54900ca640 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5490069360 tx=0x7f548c009840 comp rx=0 tx=0).stop 2023-10-06T03:24:09.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.089+0000 7f54983ff700 1 -- 172.21.15.81:0/2631746088 shutdown_connections 2023-10-06T03:24:09.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.089+0000 7f54983ff700 1 --2- 172.21.15.81:0/2631746088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f549013fd70 0x7f54900ca640 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:09.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.089+0000 7f54983ff700 1 --2- 172.21.15.81:0/2631746088 >> v2:172.21.15.83:3300/0 conn(0x7f549015a0c0 0x7f549015a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:09.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.089+0000 7f54983ff700 1 -- 172.21.15.81:0/2631746088 >> 172.21.15.81:0/2631746088 conn(0x7f54900cc090 msgr2=0x7f54900cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:09.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.089+0000 7f54983ff700 1 -- 172.21.15.81:0/2631746088 shutdown_connections 2023-10-06T03:24:09.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.089+0000 7f54983ff700 1 -- 172.21.15.81:0/2631746088 wait complete. 2023-10-06T03:24:09.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.090+0000 7f54983ff700 1 Processor -- start 2023-10-06T03:24:09.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.091+0000 7f54983ff700 1 -- start start 2023-10-06T03:24:09.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.091+0000 7f54983ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f549013fd70 0x7f549016db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:09.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.091+0000 7f54983ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f549015a0c0 0x7f54900c1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:09.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.091+0000 7f54983ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f549015aa80 0x7f54900b0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:09.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.091+0000 7f54983ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54900aee30 con 0x7f549013fd70 2023-10-06T03:24:09.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.091+0000 7f54983ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f549016e090 con 0x7f549015a0c0 2023-10-06T03:24:09.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.091+0000 7f54983ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5490157de0 con 0x7f549015aa80 2023-10-06T03:24:09.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.092+0000 7f549619b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f549013fd70 0x7f549016db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:09.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.092+0000 7f549619b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f549013fd70 0x7f549016db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56648/0 (socket says 172.21.15.81:56648) 2023-10-06T03:24:09.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.092+0000 7f549619b700 1 -- 172.21.15.81:0/1533122274 learned_addr learned my addr 172.21.15.81:0/1533122274 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:09.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.092+0000 7f549599a700 1 --2- 172.21.15.81:0/1533122274 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f549015a0c0 0x7f54900c1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:09.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.092+0000 7f549699c700 1 --2- 172.21.15.81:0/1533122274 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f549015aa80 0x7f54900b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:09.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.092+0000 7f549619b700 1 -- 172.21.15.81:0/1533122274 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f549015aa80 msgr2=0x7f54900b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:09.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.092+0000 7f549619b700 1 --2- 172.21.15.81:0/1533122274 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f549015aa80 0x7f54900b0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:09.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.092+0000 7f549619b700 1 -- 172.21.15.81:0/1533122274 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f549015a0c0 msgr2=0x7f54900c1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:09.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.092+0000 7f549619b700 1 --2- 172.21.15.81:0/1533122274 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f549015a0c0 0x7f54900c1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:09.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.092+0000 7f549619b700 1 -- 172.21.15.81:0/1533122274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f548c009ae0 con 0x7f549013fd70 2023-10-06T03:24:09.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.092+0000 7f549599a700 1 --2- 172.21.15.81:0/1533122274 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f549015a0c0 0x7f54900c1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:09.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.092+0000 7f549619b700 1 --2- 172.21.15.81:0/1533122274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f549013fd70 0x7f549016db50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f548c009880 tx=0x7f548c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:09.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.092+0000 7f54867fc700 1 -- 172.21.15.81:0/1533122274 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c012ac0 con 0x7f549013fd70 2023-10-06T03:24:09.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.092+0000 7f54867fc700 1 -- 172.21.15.81:0/1533122274 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f548c012c40 con 0x7f549013fd70 2023-10-06T03:24:09.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.093+0000 7f54983ff700 1 -- 172.21.15.81:0/1533122274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54901580c0 con 0x7f549013fd70 2023-10-06T03:24:09.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.093+0000 7f54867fc700 1 -- 172.21.15.81:0/1533122274 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c01e430 con 0x7f549013fd70 2023-10-06T03:24:09.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.093+0000 7f54983ff700 1 -- 172.21.15.81:0/1533122274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54900af080 con 0x7f549013fd70 2023-10-06T03:24:09.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.094+0000 7f54983ff700 1 -- 172.21.15.81:0/1533122274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f549004c3c0 con 0x7f549013fd70 2023-10-06T03:24:09.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.094+0000 7f54867fc700 1 -- 172.21.15.81:0/1533122274 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f548c01e860 con 0x7f549013fd70 2023-10-06T03:24:09.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.095+0000 7f54867fc700 1 --2- 172.21.15.81:0/1533122274 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f5474066f30 0x7f54740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:09.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.095+0000 7f54867fc700 1 -- 172.21.15.81:0/1533122274 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f548c086470 con 0x7f549013fd70 2023-10-06T03:24:09.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.095+0000 7f549599a700 1 --2- 172.21.15.81:0/1533122274 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f5474066f30 0x7f54740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:09.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.096+0000 7f549599a700 1 --2- 172.21.15.81:0/1533122274 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f5474066f30 0x7f54740693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f549013e880 tx=0x7f5480008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:09.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.099+0000 7f54867fc700 1 -- 172.21.15.81:0/1533122274 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f548c0531f0 con 0x7f549013fd70 2023-10-06T03:24:09.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.288+0000 7f54983ff700 1 -- 172.21.15.81:0/1533122274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f54900c8380 con 0x7f549013fd70 2023-10-06T03:24:09.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.288+0000 7f54867fc700 1 -- 172.21.15.81:0/1533122274 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f548c056810 con 0x7f549013fd70 2023-10-06T03:24:09.290 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-10-06T03:24:09.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.291+0000 7f54983ff700 1 -- 172.21.15.81:0/1533122274 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f5474066f30 msgr2=0x7f54740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:09.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.291+0000 7f54983ff700 1 --2- 172.21.15.81:0/1533122274 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f5474066f30 0x7f54740693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f549013e880 tx=0x7f5480008040 comp rx=0 tx=0).stop 2023-10-06T03:24:09.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.291+0000 7f54983ff700 1 -- 172.21.15.81:0/1533122274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f549013fd70 msgr2=0x7f549016db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:09.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.291+0000 7f54983ff700 1 --2- 172.21.15.81:0/1533122274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f549013fd70 0x7f549016db50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f548c009880 tx=0x7f548c017000 comp rx=0 tx=0).stop 2023-10-06T03:24:09.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.291+0000 7f54983ff700 1 -- 172.21.15.81:0/1533122274 shutdown_connections 2023-10-06T03:24:09.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.291+0000 7f54983ff700 1 --2- 172.21.15.81:0/1533122274 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f5474066f30 0x7f54740693e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:09.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.291+0000 7f54983ff700 1 --2- 172.21.15.81:0/1533122274 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f549015aa80 0x7f54900b0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:09.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.291+0000 7f54983ff700 1 --2- 172.21.15.81:0/1533122274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f549013fd70 0x7f549016db50 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:09.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.291+0000 7f54983ff700 1 --2- 172.21.15.81:0/1533122274 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f549015a0c0 0x7f54900c1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:09.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.291+0000 7f54983ff700 1 -- 172.21.15.81:0/1533122274 >> 172.21.15.81:0/1533122274 conn(0x7f54900cc090 msgr2=0x7f54900cb830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:09.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.291+0000 7f54983ff700 1 -- 172.21.15.81:0/1533122274 shutdown_connections 2023-10-06T03:24:09.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.291+0000 7f54983ff700 1 -- 172.21.15.81:0/1533122274 wait complete. 2023-10-06T03:24:09.310 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T03:24:09.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.492+0000 7f00363ff700 1 Processor -- start 2023-10-06T03:24:09.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.492+0000 7f00363ff700 1 -- start start 2023-10-06T03:24:09.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.494+0000 7f00363ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f0030159e30 0x7f00300ca520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:09.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.494+0000 7f00363ff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f003006ab00 con 0x7f00300caa60 2023-10-06T03:24:09.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.494+0000 7f00363ff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0030069ef0 con 0x7f0030159a60 2023-10-06T03:24:09.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.494+0000 7f00363ff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f003006a1d0 con 0x7f0030159e30 2023-10-06T03:24:09.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.494+0000 7f003499c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f00300caa60 0x7f0030155650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39546/0 (socket says 172.21.15.81:39546) 2023-10-06T03:24:09.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.494+0000 7f003499c700 1 -- 172.21.15.81:0/451518391 learned_addr learned my addr 172.21.15.81:0/451518391 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:24:09.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.494+0000 7f0027fff700 1 --2- 172.21.15.81:0/451518391 >> v2:172.21.15.83:3300/0 conn(0x7f0030159e30 0x7f00300ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:09.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.494+0000 7f002f7fe700 1 -- 172.21.15.81:0/451518391 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3101730299 0 0) 0x7f003006ab00 con 0x7f00300caa60 2023-10-06T03:24:09.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.494+0000 7f002f7fe700 1 -- 172.21.15.81:0/451518391 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f001c003570 con 0x7f00300caa60 2023-10-06T03:24:09.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.495+0000 7f0027fff700 1 -- 172.21.15.81:0/451518391 >> v1:172.21.15.83:6789/0 conn(0x7f0030159a60 legacy=0x7f003006af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:09.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.495+0000 7f0027fff700 1 -- 172.21.15.81:0/451518391 >> v1:172.21.15.81:6789/0 conn(0x7f00300caa60 legacy=0x7f0030155650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:09.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.495+0000 7f0027fff700 1 -- 172.21.15.81:0/451518391 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f003006a4b0 con 0x7f0030159e30 2023-10-06T03:24:09.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.495+0000 7f0027fff700 1 --2- 172.21.15.81:0/451518391 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0030159e30 0x7f00300ca520 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f00180098e0 tx=0x7f00180091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4a6a7141faee1fc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:09.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.495+0000 7f002f7fe700 1 -- 172.21.15.81:0/451518391 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001800f6b0 con 0x7f0030159e30 2023-10-06T03:24:09.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.495+0000 7f002f7fe700 1 -- 172.21.15.81:0/451518391 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f001800f810 con 0x7f0030159e30 2023-10-06T03:24:09.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.495+0000 7f002f7fe700 1 -- 172.21.15.81:0/451518391 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001800fbb0 con 0x7f0030159e30 2023-10-06T03:24:09.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.496+0000 7f00363ff700 1 -- 172.21.15.81:0/451518391 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0030159e30 msgr2=0x7f00300ca520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:09.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.496+0000 7f00363ff700 1 --2- 172.21.15.81:0/451518391 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0030159e30 0x7f00300ca520 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f00180098e0 tx=0x7f00180091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:09.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.496+0000 7f00363ff700 1 -- 172.21.15.81:0/451518391 shutdown_connections 2023-10-06T03:24:09.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.496+0000 7f00363ff700 1 --2- 172.21.15.81:0/451518391 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0030159e30 0x7f00300ca520 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:09.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.496+0000 7f00363ff700 1 -- 172.21.15.81:0/451518391 >> 172.21.15.81:0/451518391 conn(0x7f00300cc090 msgr2=0x7f00300cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:09.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.496+0000 7f00363ff700 1 -- 172.21.15.81:0/451518391 shutdown_connections 2023-10-06T03:24:09.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.496+0000 7f00363ff700 1 -- 172.21.15.81:0/451518391 wait complete. 2023-10-06T03:24:09.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.497+0000 7f00363ff700 1 Processor -- start 2023-10-06T03:24:09.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.498+0000 7f00363ff700 1 -- start start 2023-10-06T03:24:09.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.498+0000 7f00363ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f00300caa60 0x7f00300ae140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:09.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.498+0000 7f00363ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0030159a60 0x7f00300c3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:09.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.499+0000 7f00363ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0030159e30 0x7f003013de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:09.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.499+0000 7f00363ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00300c4530 con 0x7f0030159a60 2023-10-06T03:24:09.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.499+0000 7f00363ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00300c3680 con 0x7f00300caa60 2023-10-06T03:24:09.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.499+0000 7f00363ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00300c3920 con 0x7f0030159e30 2023-10-06T03:24:09.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.499+0000 7f0027fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0030159a60 0x7f00300c3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:09.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.499+0000 7f0027fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0030159a60 0x7f00300c3140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56664/0 (socket says 172.21.15.81:56664) 2023-10-06T03:24:09.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.499+0000 7f0027fff700 1 -- 172.21.15.81:0/3763432391 learned_addr learned my addr 172.21.15.81:0/3763432391 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:09.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.499+0000 7f002ffff700 1 --2- 172.21.15.81:0/3763432391 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f00300caa60 0x7f00300ae140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:09.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.499+0000 7f003499c700 1 --2- 172.21.15.81:0/3763432391 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0030159e30 0x7f003013de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:09.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.499+0000 7f0027fff700 1 -- 172.21.15.81:0/3763432391 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0030159e30 msgr2=0x7f003013de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:09.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.499+0000 7f0027fff700 1 --2- 172.21.15.81:0/3763432391 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0030159e30 0x7f003013de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:09.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.499+0000 7f0027fff700 1 -- 172.21.15.81:0/3763432391 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f00300caa60 msgr2=0x7f00300ae140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:09.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.499+0000 7f0027fff700 1 --2- 172.21.15.81:0/3763432391 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f00300caa60 0x7f00300ae140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:09.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.499+0000 7f0027fff700 1 -- 172.21.15.81:0/3763432391 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0018009420 con 0x7f0030159a60 2023-10-06T03:24:09.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.499+0000 7f002ffff700 1 --2- 172.21.15.81:0/3763432391 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f00300caa60 0x7f00300ae140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:09.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.499+0000 7f0027fff700 1 --2- 172.21.15.81:0/3763432391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0030159a60 0x7f00300c3140 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f003006cd90 tx=0x7f0018019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:09.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.500+0000 7f002cff9700 1 -- 172.21.15.81:0/3763432391 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0018000d10 con 0x7f0030159a60 2023-10-06T03:24:09.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.500+0000 7f002cff9700 1 -- 172.21.15.81:0/3763432391 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f001800fb90 con 0x7f0030159a60 2023-10-06T03:24:09.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.500+0000 7f00363ff700 1 -- 172.21.15.81:0/3763432391 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00300c3c00 con 0x7f0030159a60 2023-10-06T03:24:09.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.500+0000 7f002cff9700 1 -- 172.21.15.81:0/3763432391 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00180106c0 con 0x7f0030159a60 2023-10-06T03:24:09.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.500+0000 7f00363ff700 1 -- 172.21.15.81:0/3763432391 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00300c41c0 con 0x7f0030159a60 2023-10-06T03:24:09.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.501+0000 7f00363ff700 1 -- 172.21.15.81:0/3763432391 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00300c46a0 con 0x7f0030159a60 2023-10-06T03:24:09.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.502+0000 7f002cff9700 1 -- 172.21.15.81:0/3763432391 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f00180243f0 con 0x7f0030159a60 2023-10-06T03:24:09.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.503+0000 7f002cff9700 1 --2- 172.21.15.81:0/3763432391 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0010066f30 0x7f00100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:09.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.503+0000 7f002cff9700 1 -- 172.21.15.81:0/3763432391 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f0018014070 con 0x7f0030159a60 2023-10-06T03:24:09.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.503+0000 7f002ffff700 1 --2- 172.21.15.81:0/3763432391 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0010066f30 0x7f00100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:09.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.503+0000 7f002ffff700 1 --2- 172.21.15.81:0/3763432391 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0010066f30 0x7f00100693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f00200018f0 tx=0x7f0020009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:09.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.507+0000 7f002cff9700 1 -- 172.21.15.81:0/3763432391 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0018053390 con 0x7f0030159a60 2023-10-06T03:24:09.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.698+0000 7f00363ff700 1 -- 172.21.15.81:0/3763432391 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f003004c3c0 con 0x7f0030159a60 2023-10-06T03:24:09.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.699+0000 7f002cff9700 1 -- 172.21.15.81:0/3763432391 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f00180569b0 con 0x7f0030159a60 2023-10-06T03:24:09.701 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-10-06T03:24:09.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.701+0000 7f00363ff700 1 -- 172.21.15.81:0/3763432391 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0010066f30 msgr2=0x7f00100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:09.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.701+0000 7f00363ff700 1 --2- 172.21.15.81:0/3763432391 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0010066f30 0x7f00100693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f00200018f0 tx=0x7f0020009040 comp rx=0 tx=0).stop 2023-10-06T03:24:09.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.701+0000 7f00363ff700 1 -- 172.21.15.81:0/3763432391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0030159a60 msgr2=0x7f00300c3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:09.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.701+0000 7f00363ff700 1 --2- 172.21.15.81:0/3763432391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0030159a60 0x7f00300c3140 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f003006cd90 tx=0x7f0018019000 comp rx=0 tx=0).stop 2023-10-06T03:24:09.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.701+0000 7f00363ff700 1 -- 172.21.15.81:0/3763432391 shutdown_connections 2023-10-06T03:24:09.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.701+0000 7f00363ff700 1 --2- 172.21.15.81:0/3763432391 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0010066f30 0x7f00100693e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:09.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.701+0000 7f00363ff700 1 --2- 172.21.15.81:0/3763432391 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0030159e30 0x7f003013de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:09.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.701+0000 7f00363ff700 1 --2- 172.21.15.81:0/3763432391 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f00300caa60 0x7f00300ae140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:09.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.701+0000 7f00363ff700 1 --2- 172.21.15.81:0/3763432391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0030159a60 0x7f00300c3140 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:09.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.701+0000 7f00363ff700 1 -- 172.21.15.81:0/3763432391 >> 172.21.15.81:0/3763432391 conn(0x7f00300cc090 msgr2=0x7f003006e600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:09.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.701+0000 7f00363ff700 1 -- 172.21.15.81:0/3763432391 shutdown_connections 2023-10-06T03:24:09.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.701+0000 7f00363ff700 1 -- 172.21.15.81:0/3763432391 wait complete. 2023-10-06T03:24:09.721 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:24:09.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.900+0000 7f3c505ff700 1 Processor -- start 2023-10-06T03:24:09.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.900+0000 7f3c505ff700 1 -- start start 2023-10-06T03:24:09.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.901+0000 7f3c505ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3c4813f9c0 0x7f3c480ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:09.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.901+0000 7f3c505ff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c480cafe0 con 0x7f3c480cab60 2023-10-06T03:24:09.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.901+0000 7f3c505ff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c480cb2c0 con 0x7f3c4815a5c0 2023-10-06T03:24:09.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.901+0000 7f3c505ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c480cb5a0 con 0x7f3c4813f9c0 2023-10-06T03:24:09.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.901+0000 7f3c4e39b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3c4813f9c0 0x7f3c480ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:09.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.901+0000 7f3c4e39b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3c4813f9c0 0x7f3c480ca620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54464/0 (socket says 172.21.15.81:54464) 2023-10-06T03:24:09.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.901+0000 7f3c4e39b700 1 -- 172.21.15.81:0/656592809 learned_addr learned my addr 172.21.15.81:0/656592809 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:09.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.901+0000 7f3c4db9a700 1 --1- 172.21.15.81:0/656592809 >> v1:172.21.15.81:6789/0 conn(0x7f3c480cab60 0x7f3c48159eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59448/0 (socket says 172.21.15.81:59448) 2023-10-06T03:24:09.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.902+0000 7f3c4e39b700 1 -- 172.21.15.81:0/656592809 >> v1:172.21.15.83:6789/0 conn(0x7f3c4815a5c0 legacy=0x7f3c480c6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:09.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.902+0000 7f3c4e39b700 1 -- 172.21.15.81:0/656592809 >> v1:172.21.15.81:6789/0 conn(0x7f3c480cab60 legacy=0x7f3c48159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:09.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.902+0000 7f3c4e39b700 1 -- 172.21.15.81:0/656592809 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c480cb880 con 0x7f3c4813f9c0 2023-10-06T03:24:09.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.902+0000 7f3c4d399700 1 -- 172.21.15.81:0/656592809 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2609042996 0 0) 0x7f3c480cafe0 con 0x7f3c480cab60 2023-10-06T03:24:09.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.902+0000 7f3c4e39b700 1 --2- 172.21.15.81:0/656592809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c4813f9c0 0x7f3c480ca620 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3c4400bc50 tx=0x7f3c4400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6324fc2e95be5ee2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:09.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.902+0000 7f3c4d399700 1 -- 172.21.15.81:0/656592809 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4400be60 con 0x7f3c4813f9c0 2023-10-06T03:24:09.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.902+0000 7f3c4d399700 1 -- 172.21.15.81:0/656592809 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4400ddc0 con 0x7f3c4813f9c0 2023-10-06T03:24:09.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.902+0000 7f3c4d399700 1 -- 172.21.15.81:0/656592809 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c440106a0 con 0x7f3c4813f9c0 2023-10-06T03:24:09.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.903+0000 7f3c505ff700 1 -- 172.21.15.81:0/656592809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c4813f9c0 msgr2=0x7f3c480ca620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:09.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.903+0000 7f3c505ff700 1 --2- 172.21.15.81:0/656592809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c4813f9c0 0x7f3c480ca620 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3c4400bc50 tx=0x7f3c4400b4f0 comp rx=0 tx=0).stop 2023-10-06T03:24:09.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.903+0000 7f3c505ff700 1 -- 172.21.15.81:0/656592809 shutdown_connections 2023-10-06T03:24:09.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.903+0000 7f3c505ff700 1 --2- 172.21.15.81:0/656592809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c4813f9c0 0x7f3c480ca620 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:09.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.903+0000 7f3c505ff700 1 -- 172.21.15.81:0/656592809 >> 172.21.15.81:0/656592809 conn(0x7f3c480cc090 msgr2=0x7f3c480cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:09.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.903+0000 7f3c505ff700 1 -- 172.21.15.81:0/656592809 shutdown_connections 2023-10-06T03:24:09.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.903+0000 7f3c505ff700 1 -- 172.21.15.81:0/656592809 wait complete. 2023-10-06T03:24:09.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.904+0000 7f3c505ff700 1 Processor -- start 2023-10-06T03:24:09.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.904+0000 7f3c505ff700 1 -- start start 2023-10-06T03:24:09.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.905+0000 7f3c505ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3c4813f9c0 0x7f3c480c5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:09.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.905+0000 7f3c505ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c4815a5c0 0x7f3c480ac790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:09.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.905+0000 7f3c505ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c480c5bc0 0x7f3c480accd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:09.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.905+0000 7f3c505ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c480c4760 con 0x7f3c480c5bc0 2023-10-06T03:24:09.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.905+0000 7f3c505ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c480c3b50 con 0x7f3c4815a5c0 2023-10-06T03:24:09.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.905+0000 7f3c505ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c480c3e30 con 0x7f3c4813f9c0 2023-10-06T03:24:09.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.906+0000 7f3c4eb9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c480c5bc0 0x7f3c480accd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:09.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.906+0000 7f3c4eb9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c480c5bc0 0x7f3c480accd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54472/0 (socket says 172.21.15.81:54472) 2023-10-06T03:24:09.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.906+0000 7f3c4eb9c700 1 -- 172.21.15.81:0/3139094929 learned_addr learned my addr 172.21.15.81:0/3139094929 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:09.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.906+0000 7f3c4db9a700 1 --2- 172.21.15.81:0/3139094929 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c4815a5c0 0x7f3c480ac790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:09.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.906+0000 7f3c4e39b700 1 --2- 172.21.15.81:0/3139094929 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3c4813f9c0 0x7f3c480c5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:09.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.906+0000 7f3c4eb9c700 1 -- 172.21.15.81:0/3139094929 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3c4813f9c0 msgr2=0x7f3c480c5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:09.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.906+0000 7f3c4eb9c700 1 --2- 172.21.15.81:0/3139094929 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3c4813f9c0 0x7f3c480c5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:09.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.906+0000 7f3c4eb9c700 1 -- 172.21.15.81:0/3139094929 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c4815a5c0 msgr2=0x7f3c480ac790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:09.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.906+0000 7f3c4eb9c700 1 --2- 172.21.15.81:0/3139094929 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c4815a5c0 0x7f3c480ac790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:09.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.906+0000 7f3c4eb9c700 1 -- 172.21.15.81:0/3139094929 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c4400b790 con 0x7f3c480c5bc0 2023-10-06T03:24:09.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.906+0000 7f3c4eb9c700 1 --2- 172.21.15.81:0/3139094929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c480c5bc0 0x7f3c480accd0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3c4000bb60 tx=0x7f3c400097f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:09.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.907+0000 7f3c3e7fc700 1 -- 172.21.15.81:0/3139094929 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4000c7e0 con 0x7f3c480c5bc0 2023-10-06T03:24:09.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.907+0000 7f3c3e7fc700 1 -- 172.21.15.81:0/3139094929 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4000c940 con 0x7f3c480c5bc0 2023-10-06T03:24:09.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.907+0000 7f3c3e7fc700 1 -- 172.21.15.81:0/3139094929 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4000cd00 con 0x7f3c480c5bc0 2023-10-06T03:24:09.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.907+0000 7f3c505ff700 1 -- 172.21.15.81:0/3139094929 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c480c4110 con 0x7f3c480c5bc0 2023-10-06T03:24:09.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.907+0000 7f3c505ff700 1 -- 172.21.15.81:0/3139094929 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c480adac0 con 0x7f3c480c5bc0 2023-10-06T03:24:09.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.908+0000 7f3c505ff700 1 -- 172.21.15.81:0/3139094929 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c4804c3c0 con 0x7f3c480c5bc0 2023-10-06T03:24:09.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.909+0000 7f3c3e7fc700 1 -- 172.21.15.81:0/3139094929 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3c40014620 con 0x7f3c480c5bc0 2023-10-06T03:24:09.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.909+0000 7f3c3e7fc700 1 --2- 172.21.15.81:0/3139094929 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f3c2c066f30 0x7f3c2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:09.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.909+0000 7f3c3e7fc700 1 -- 172.21.15.81:0/3139094929 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f3c40084970 con 0x7f3c480c5bc0 2023-10-06T03:24:09.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.910+0000 7f3c4e39b700 1 --2- 172.21.15.81:0/3139094929 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f3c2c066f30 0x7f3c2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:09.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.910+0000 7f3c4e39b700 1 --2- 172.21.15.81:0/3139094929 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f3c2c066f30 0x7f3c2c0693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3c4400bc50 tx=0x7f3c4401a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:09.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:09.913+0000 7f3c3e7fc700 1 -- 172.21.15.81:0/3139094929 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3c400516f0 con 0x7f3c480c5bc0 2023-10-06T03:24:10.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.159+0000 7f3c505ff700 1 -- 172.21.15.81:0/3139094929 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3c4806f720 con 0x7f3c480c5bc0 2023-10-06T03:24:10.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.159+0000 7f3c3e7fc700 1 -- 172.21.15.81:0/3139094929 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4590 (secure 0 0 0) 0x7f3c4000ce60 con 0x7f3c480c5bc0 2023-10-06T03:24:10.161 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:24:10.161 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1255569320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1255569320},{"type":"v1","addr":"172.21.15.83:6835","nonce":1255569320}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1673166762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1673166762},{"type":"v1","addr":"172.21.15.81:6835","nonce":1673166762}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3689326153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3689326153},{"type":"v1","addr":"172.21.15.81:6837","nonce":3689326153}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:23:40.376852+0000","modified":"2023-10-06T03:23:56.657619+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6833/745669616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":745669616},{"type":"v1","addr":"172.21.15.83:6833","nonce":745669616}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T03:24:10.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.162+0000 7f3c505ff700 1 -- 172.21.15.81:0/3139094929 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f3c2c066f30 msgr2=0x7f3c2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:10.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.162+0000 7f3c505ff700 1 --2- 172.21.15.81:0/3139094929 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f3c2c066f30 0x7f3c2c0693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3c4400bc50 tx=0x7f3c4401a000 comp rx=0 tx=0).stop 2023-10-06T03:24:10.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.162+0000 7f3c505ff700 1 -- 172.21.15.81:0/3139094929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c480c5bc0 msgr2=0x7f3c480accd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:10.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.162+0000 7f3c505ff700 1 --2- 172.21.15.81:0/3139094929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c480c5bc0 0x7f3c480accd0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3c4000bb60 tx=0x7f3c400097f0 comp rx=0 tx=0).stop 2023-10-06T03:24:10.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.162+0000 7f3c505ff700 1 -- 172.21.15.81:0/3139094929 shutdown_connections 2023-10-06T03:24:10.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.162+0000 7f3c505ff700 1 --2- 172.21.15.81:0/3139094929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c480c5bc0 0x7f3c480accd0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:10.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.162+0000 7f3c505ff700 1 --2- 172.21.15.81:0/3139094929 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f3c2c066f30 0x7f3c2c0693e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:10.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.162+0000 7f3c505ff700 1 --2- 172.21.15.81:0/3139094929 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3c4813f9c0 0x7f3c480c5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:10.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.162+0000 7f3c505ff700 1 --2- 172.21.15.81:0/3139094929 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c4815a5c0 0x7f3c480ac790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:10.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.162+0000 7f3c505ff700 1 -- 172.21.15.81:0/3139094929 >> 172.21.15.81:0/3139094929 conn(0x7f3c480cc090 msgr2=0x7f3c48063710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:10.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.162+0000 7f3c505ff700 1 -- 172.21.15.81:0/3139094929 shutdown_connections 2023-10-06T03:24:10.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.162+0000 7f3c505ff700 1 -- 172.21.15.81:0/3139094929 wait complete. 2023-10-06T03:24:10.165 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2023-10-06T03:24:10.182 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:24:10.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.361+0000 7f1fa8fff700 1 Processor -- start 2023-10-06T03:24:10.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.361+0000 7f1fa8fff700 1 -- start start 2023-10-06T03:24:10.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.362+0000 7f1fa8fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1fa40cbe60 0x7f1fa40cc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:10.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.362+0000 7f1fa8fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1fa40c8e90 0x7f1fa40c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:10.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.362+0000 7f1fa8fff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fa40cc810 con 0x7f1fa4142d70 2023-10-06T03:24:10.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.362+0000 7f1fa8fff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fa40c8a00 con 0x7f1fa40cbe60 2023-10-06T03:24:10.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.362+0000 7f1fa8fff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa406bbc0 con 0x7f1fa40c8e90 2023-10-06T03:24:10.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.363+0000 7f1fa259c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1fa4142d70 0x7f1fa4069730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59464/0 (socket says 172.21.15.81:59464) 2023-10-06T03:24:10.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.363+0000 7f1fa1d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1fa40cbe60 0x7f1fa40cc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:10.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.363+0000 7f1fa259c700 1 -- 172.21.15.81:0/2653616433 learned_addr learned my addr 172.21.15.81:0/2653616433 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:24:10.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.363+0000 7f1fa2d9d700 1 --2- 172.21.15.81:0/2653616433 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1fa40c8e90 0x7f1fa40c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:10.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.363+0000 7f1fa159a700 1 -- 172.21.15.81:0/2653616433 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1918814003 0 0) 0x7f1fa40cc810 con 0x7f1fa4142d70 2023-10-06T03:24:10.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.363+0000 7f1fa1d9b700 1 -- 172.21.15.81:0/2653616433 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1fa40c8e90 msgr2=0x7f1fa40c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:10.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.363+0000 7f1fa1d9b700 1 --2- 172.21.15.81:0/2653616433 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1fa40c8e90 0x7f1fa40c92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:10.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.363+0000 7f1fa1d9b700 1 -- 172.21.15.81:0/2653616433 >> v1:172.21.15.81:6789/0 conn(0x7f1fa4142d70 legacy=0x7f1fa4069730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:10.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.363+0000 7f1fa1d9b700 1 -- 172.21.15.81:0/2653616433 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa406bea0 con 0x7f1fa40cbe60 2023-10-06T03:24:10.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.363+0000 7f1fa1d9b700 1 --2- 172.21.15.81:0/2653616433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa40cbe60 0x7f1fa40cc2d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1f980098e0 tx=0x7f1f980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65db91ffcd2fa314 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:10.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.364+0000 7f1fa159a700 1 -- 172.21.15.81:0/2653616433 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9800b640 con 0x7f1fa40cbe60 2023-10-06T03:24:10.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.364+0000 7f1fa159a700 1 -- 172.21.15.81:0/2653616433 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f9800b7a0 con 0x7f1fa40cbe60 2023-10-06T03:24:10.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.364+0000 7f1fa159a700 1 -- 172.21.15.81:0/2653616433 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9800bb40 con 0x7f1fa40cbe60 2023-10-06T03:24:10.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.364+0000 7f1fa8fff700 1 -- 172.21.15.81:0/2653616433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa40cbe60 msgr2=0x7f1fa40cc2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:10.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.364+0000 7f1fa8fff700 1 --2- 172.21.15.81:0/2653616433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa40cbe60 0x7f1fa40cc2d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1f980098e0 tx=0x7f1f980091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:10.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.364+0000 7f1fa8fff700 1 -- 172.21.15.81:0/2653616433 shutdown_connections 2023-10-06T03:24:10.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.364+0000 7f1fa8fff700 1 --2- 172.21.15.81:0/2653616433 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1fa40c8e90 0x7f1fa40c92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:10.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.364+0000 7f1fa8fff700 1 --2- 172.21.15.81:0/2653616433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa40cbe60 0x7f1fa40cc2d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:10.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.364+0000 7f1fa8fff700 1 -- 172.21.15.81:0/2653616433 >> 172.21.15.81:0/2653616433 conn(0x7f1fa40ce290 msgr2=0x7f1fa40ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:10.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.364+0000 7f1fa8fff700 1 -- 172.21.15.81:0/2653616433 shutdown_connections 2023-10-06T03:24:10.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.364+0000 7f1fa8fff700 1 -- 172.21.15.81:0/2653616433 wait complete. 2023-10-06T03:24:10.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.366+0000 7f1fa8fff700 1 Processor -- start 2023-10-06T03:24:10.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.366+0000 7f1fa8fff700 1 -- start start 2023-10-06T03:24:10.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.367+0000 7f1fa8fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1fa40c8e90 0x7f1fa413cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:10.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.367+0000 7f1fa8fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa40cbe60 0x7f1fa413d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:10.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.367+0000 7f1fa8fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1fa4142d70 0x7f1fa415d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:10.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.367+0000 7f1fa8fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa415bdb0 con 0x7f1fa40cbe60 2023-10-06T03:24:10.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.367+0000 7f1fa8fff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa415bfa0 con 0x7f1fa4142d70 2023-10-06T03:24:10.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.367+0000 7f1fa8fff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa415c280 con 0x7f1fa40c8e90 2023-10-06T03:24:10.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.367+0000 7f1fa1d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa40cbe60 0x7f1fa413d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:10.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.367+0000 7f1fa1d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa40cbe60 0x7f1fa413d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54484/0 (socket says 172.21.15.81:54484) 2023-10-06T03:24:10.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.367+0000 7f1fa1d9b700 1 -- 172.21.15.81:0/3376239080 learned_addr learned my addr 172.21.15.81:0/3376239080 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:10.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.367+0000 7f1fa259c700 1 --2- 172.21.15.81:0/3376239080 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1fa40c8e90 0x7f1fa413cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:10.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.367+0000 7f1fa2d9d700 1 --2- 172.21.15.81:0/3376239080 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1fa4142d70 0x7f1fa415d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:10.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.368+0000 7f1fa1d9b700 1 -- 172.21.15.81:0/3376239080 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1fa40c8e90 msgr2=0x7f1fa413cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:10.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.368+0000 7f1fa1d9b700 1 --2- 172.21.15.81:0/3376239080 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1fa40c8e90 0x7f1fa413cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:10.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.368+0000 7f1fa1d9b700 1 -- 172.21.15.81:0/3376239080 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1fa4142d70 msgr2=0x7f1fa415d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:10.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.368+0000 7f1fa1d9b700 1 --2- 172.21.15.81:0/3376239080 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1fa4142d70 0x7f1fa415d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:10.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.368+0000 7f1fa1d9b700 1 -- 172.21.15.81:0/3376239080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f98009420 con 0x7f1fa40cbe60 2023-10-06T03:24:10.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.368+0000 7f1fa259c700 1 --2- 172.21.15.81:0/3376239080 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1fa40c8e90 0x7f1fa413cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:10.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.368+0000 7f1fa1d9b700 1 --2- 172.21.15.81:0/3376239080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa40cbe60 0x7f1fa413d330 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1fa40cf3a0 tx=0x7f1f98017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:10.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.368+0000 7f1f927fc700 1 -- 172.21.15.81:0/3376239080 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f98000d10 con 0x7f1fa40cbe60 2023-10-06T03:24:10.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.368+0000 7f1f927fc700 1 -- 172.21.15.81:0/3376239080 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f9800bb20 con 0x7f1fa40cbe60 2023-10-06T03:24:10.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.368+0000 7f1fa8fff700 1 -- 172.21.15.81:0/3376239080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fa415c560 con 0x7f1fa40cbe60 2023-10-06T03:24:10.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.368+0000 7f1f927fc700 1 -- 172.21.15.81:0/3376239080 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f98011650 con 0x7f1fa40cbe60 2023-10-06T03:24:10.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.368+0000 7f1fa8fff700 1 -- 172.21.15.81:0/3376239080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fa415d220 con 0x7f1fa40cbe60 2023-10-06T03:24:10.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.369+0000 7f1fa8fff700 1 -- 172.21.15.81:0/3376239080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fa415ca80 con 0x7f1fa40cbe60 2023-10-06T03:24:10.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.370+0000 7f1f927fc700 1 -- 172.21.15.81:0/3376239080 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1f98011a00 con 0x7f1fa40cbe60 2023-10-06T03:24:10.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.371+0000 7f1f927fc700 1 --2- 172.21.15.81:0/3376239080 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f1f84066f30 0x7f1f840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:10.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.371+0000 7f1f927fc700 1 -- 172.21.15.81:0/3376239080 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f1f98086260 con 0x7f1fa40cbe60 2023-10-06T03:24:10.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.371+0000 7f1fa259c700 1 --2- 172.21.15.81:0/3376239080 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f1f84066f30 0x7f1f840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:10.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.372+0000 7f1fa259c700 1 --2- 172.21.15.81:0/3376239080 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f1f84066f30 0x7f1f840693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1f94001890 tx=0x7f1f94009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:10.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.375+0000 7f1f927fc700 1 -- 172.21.15.81:0/3376239080 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1fa415ca80 con 0x7f1fa40cbe60 2023-10-06T03:24:10.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.569+0000 7f1fa8fff700 1 -- 172.21.15.81:0/3376239080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1fa415ca80 con 0x7f1fa40cbe60 2023-10-06T03:24:10.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.570+0000 7f1f927fc700 1 -- 172.21.15.81:0/3376239080 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18659 (secure 0 0 0) 0x7f1fa415ca80 con 0x7f1fa40cbe60 2023-10-06T03:24:10.573 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:24:10.573 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"fsid":"1807b5d7-9be8-43ad-aaf8-99a4273430b3","created":"2023-10-06T03:23:20.805306+0000","modified":"2023-10-06T03:23:45.419616+0000","last_up_change":"2023-10-06T03:23:32.735796+0000","last_in_change":"2023-10-06T03:23:24.109024+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:33.198850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:33.606744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:23:38.742266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:23:39.347944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:23:42.959054+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"14fb667d-a677-4978-a477-80027f889d36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":85563},{"type":"v1","addr":"172.21.15.81:6818","nonce":85563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":85563},{"type":"v1","addr":"172.21.15.81:6822","nonce":85563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":85563},{"type":"v1","addr":"172.21.15.81:6830","nonce":85563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":85563},{"type":"v1","addr":"172.21.15.81:6826","nonce":85563}]},"public_addr":"172.21.15.81:6818/85563","cluster_addr":"172.21.15.81:6822/85563","heartbeat_back_addr":"172.21.15.81:6830/85563","heartbeat_front_addr":"172.21.15.81:6826/85563","state":["exists","up"]},{"osd":1,"uuid":"974d8a86-1829-4176-89ce-18e6038857f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":85561},{"type":"v1","addr":"172.21.15.81:6801","nonce":85561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":85561},{"type":"v1","addr":"172.21.15.81:6803","nonce":85561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":85561},{"type":"v1","addr":"172.21.15.81:6807","nonce":85561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":85561},{"type":"v1","addr":"172.21.15.81:6805","nonce":85561}]},"public_addr":"172.21.15.81:6801/85561","cluster_addr":"172.21.15.81:6803/85561","heartbeat_back_addr":"172.21.15.81:6807/85561","heartbeat_front_addr":"172.21.15.81:6805/85561","state":["exists","up"]},{"osd":2,"uuid":"ffbfe056-46bc-46e0-bf49-4d8f8650e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":85564},{"type":"v1","addr":"172.21.15.81:6809","nonce":85564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":85564},{"type":"v1","addr":"172.21.15.81:6811","nonce":85564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":85564},{"type":"v1","addr":"172.21.15.81:6815","nonce":85564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":85564},{"type":"v1","addr":"172.21.15.81:6813","nonce":85564}]},"public_addr":"172.21.15.81:6809/85564","cluster_addr":"172.21.15.81:6811/85564","heartbeat_back_addr":"172.21.15.81:6815/85564","heartbeat_front_addr":"172.21.15.81:6813/85564","state":["exists","up"]},{"osd":3,"uuid":"ef9a8314-3d37-4ea1-858a-e704d5695002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":85562},{"type":"v1","addr":"172.21.15.81:6819","nonce":85562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":85562},{"type":"v1","addr":"172.21.15.81:6823","nonce":85562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":85562},{"type":"v1","addr":"172.21.15.81:6831","nonce":85562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":85562},{"type":"v1","addr":"172.21.15.81:6827","nonce":85562}]},"public_addr":"172.21.15.81:6819/85562","cluster_addr":"172.21.15.81:6823/85562","heartbeat_back_addr":"172.21.15.81:6831/85562","heartbeat_front_addr":"172.21.15.81:6827/85562","state":["exists","up"]},{"osd":4,"uuid":"d83506a0-2c96-4bcb-a9fa-05e43dc329df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":85785},{"type":"v1","addr":"172.21.15.83:6801","nonce":85785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":85785},{"type":"v1","addr":"172.21.15.83:6803","nonce":85785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":85785},{"type":"v1","addr":"172.21.15.83:6807","nonce":85785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":85785},{"type":"v1","addr":"172.21.15.83:6805","nonce":85785}]},"public_addr":"172.21.15.83:6801/85785","cluster_addr":"172.21.15.83:6803/85785","heartbeat_back_addr":"172.21.15.83:6807/85785","heartbeat_front_addr":"172.21.15.83:6805/85785","state":["exists","up"]},{"osd":5,"uuid":"10687c63-a3d5-472f-acc0-4f61847b6e0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":85818},{"type":"v1","addr":"172.21.15.83:6825","nonce":85818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":85818},{"type":"v1","addr":"172.21.15.83:6827","nonce":85818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":85818},{"type":"v1","addr":"172.21.15.83:6831","nonce":85818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":85818},{"type":"v1","addr":"172.21.15.83:6829","nonce":85818}]},"public_addr":"172.21.15.83:6825/85818","cluster_addr":"172.21.15.83:6827/85818","heartbeat_back_addr":"172.21.15.83:6831/85818","heartbeat_front_addr":"172.21.15.83:6829/85818","state":["exists","up"]},{"osd":6,"uuid":"2e9daf76-5607-4a29-9a58-6e270700d223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":85787},{"type":"v1","addr":"172.21.15.83:6811","nonce":85787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":85787},{"type":"v1","addr":"172.21.15.83:6815","nonce":85787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":85787},{"type":"v1","addr":"172.21.15.83:6823","nonce":85787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6817","nonce":85787},{"type":"v1","addr":"172.21.15.83:6819","nonce":85787}]},"public_addr":"172.21.15.83:6811/85787","cluster_addr":"172.21.15.83:6815/85787","heartbeat_back_addr":"172.21.15.83:6823/85787","heartbeat_front_addr":"172.21.15.83:6819/85787","state":["exists","up"]},{"osd":7,"uuid":"5019e1ff-233a-4a5a-91ca-8afccb7ab6e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":85786},{"type":"v1","addr":"172.21.15.83:6810","nonce":85786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":85786},{"type":"v1","addr":"172.21.15.83:6814","nonce":85786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":85786},{"type":"v1","addr":"172.21.15.83:6822","nonce":85786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":85786},{"type":"v1","addr":"172.21.15.83:6818","nonce":85786}]},"public_addr":"172.21.15.83:6810/85786","cluster_addr":"172.21.15.83:6814/85786","heartbeat_back_addr":"172.21.15.83:6822/85786","heartbeat_front_addr":"172.21.15.83:6818/85786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.393431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.360031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.407428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.391613+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.403211+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.438142+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.496181+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.472323+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:24:10.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.573+0000 7f1fa8fff700 1 -- 172.21.15.81:0/3376239080 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f1f84066f30 msgr2=0x7f1f840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:10.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.573+0000 7f1fa8fff700 1 --2- 172.21.15.81:0/3376239080 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f1f84066f30 0x7f1f840693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1f94001890 tx=0x7f1f94009040 comp rx=0 tx=0).stop 2023-10-06T03:24:10.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.573+0000 7f1fa8fff700 1 -- 172.21.15.81:0/3376239080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa40cbe60 msgr2=0x7f1fa413d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:10.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.573+0000 7f1fa8fff700 1 --2- 172.21.15.81:0/3376239080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa40cbe60 0x7f1fa413d330 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1fa40cf3a0 tx=0x7f1f98017000 comp rx=0 tx=0).stop 2023-10-06T03:24:10.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.573+0000 7f1fa8fff700 1 -- 172.21.15.81:0/3376239080 shutdown_connections 2023-10-06T03:24:10.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.573+0000 7f1fa8fff700 1 --2- 172.21.15.81:0/3376239080 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1fa4142d70 0x7f1fa415d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:10.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.573+0000 7f1fa8fff700 1 --2- 172.21.15.81:0/3376239080 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f1f84066f30 0x7f1f840693e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:10.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.573+0000 7f1fa8fff700 1 --2- 172.21.15.81:0/3376239080 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1fa40c8e90 0x7f1fa413cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:10.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.573+0000 7f1fa8fff700 1 --2- 172.21.15.81:0/3376239080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa40cbe60 0x7f1fa413d330 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:10.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.573+0000 7f1fa8fff700 1 -- 172.21.15.81:0/3376239080 >> 172.21.15.81:0/3376239080 conn(0x7f1fa40ce290 msgr2=0x7f1fa40c4090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:10.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.573+0000 7f1fa8fff700 1 -- 172.21.15.81:0/3376239080 shutdown_connections 2023-10-06T03:24:10.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.573+0000 7f1fa8fff700 1 -- 172.21.15.81:0/3376239080 wait complete. 2023-10-06T03:24:10.593 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:24:10.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.772+0000 7fde80fff700 1 Processor -- start 2023-10-06T03:24:10.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.772+0000 7fde80fff700 1 -- start start 2023-10-06T03:24:10.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.774+0000 7fde80fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fde7c13fd90 0x7fde7c159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:10.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.774+0000 7fde80fff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fde7c15a3f0 0x7fde7c0c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:10.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.774+0000 7fde80fff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde7c0cad30 con 0x7fde7c13f9c0 2023-10-06T03:24:10.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.774+0000 7fde80fff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde7c15a870 con 0x7fde7c15a3f0 2023-10-06T03:24:10.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.774+0000 7fde80fff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c0cafe0 con 0x7fde7c13fd90 2023-10-06T03:24:10.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.774+0000 7fde7ad9d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fde7c15a3f0 0x7fde7c0c6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:10.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.774+0000 7fde79d9b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fde7c13fd90 0x7fde7c159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:10.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.774+0000 7fde7ad9d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fde7c15a3f0 0x7fde7c0c6ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:56294/0 (socket says 172.21.15.81:56294) 2023-10-06T03:24:10.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.774+0000 7fde7a59c700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fde7c13f9c0 0x7fde7c0ca620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:59924/0 (socket says 172.21.15.81:59924) 2023-10-06T03:24:10.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.774+0000 7fde7ad9d700 1 -- 172.21.15.81:0/2098927279 learned_addr learned my addr 172.21.15.81:0/2098927279 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:10.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.775+0000 7fde7ad9d700 1 -- 172.21.15.81:0/2098927279 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fde7c13fd90 msgr2=0x7fde7c159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:10.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.775+0000 7fde7ad9d700 1 --2- 172.21.15.81:0/2098927279 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fde7c13fd90 0x7fde7c159eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:10.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.775+0000 7fde7ad9d700 1 -- 172.21.15.81:0/2098927279 >> v1:172.21.15.83:6789/0 conn(0x7fde7c13f9c0 legacy=0x7fde7c0ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:10.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.775+0000 7fde7ad9d700 1 -- 172.21.15.81:0/2098927279 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde7c0cb2c0 con 0x7fde7c15a3f0 2023-10-06T03:24:10.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.775+0000 7fde7ad9d700 1 --2- 172.21.15.81:0/2098927279 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fde7c15a3f0 0x7fde7c0c6ab0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fde74009f20 tx=0x7fde74009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d85e55bfd12977ee server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:10.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.775+0000 7fde7959a700 1 -- 172.21.15.81:0/2098927279 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7400e070 con 0x7fde7c15a3f0 2023-10-06T03:24:10.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.775+0000 7fde7959a700 1 -- 172.21.15.81:0/2098927279 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde7400b9d0 con 0x7fde7c15a3f0 2023-10-06T03:24:10.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.775+0000 7fde7959a700 1 -- 172.21.15.81:0/2098927279 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde740092e0 con 0x7fde7c15a3f0 2023-10-06T03:24:10.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.776+0000 7fde80fff700 1 -- 172.21.15.81:0/2098927279 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fde7c15a3f0 msgr2=0x7fde7c0c6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:10.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.776+0000 7fde80fff700 1 --2- 172.21.15.81:0/2098927279 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fde7c15a3f0 0x7fde7c0c6ab0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fde74009f20 tx=0x7fde74009840 comp rx=0 tx=0).stop 2023-10-06T03:24:10.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.776+0000 7fde80fff700 1 -- 172.21.15.81:0/2098927279 shutdown_connections 2023-10-06T03:24:10.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.776+0000 7fde80fff700 1 --2- 172.21.15.81:0/2098927279 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fde7c15a3f0 0x7fde7c0c6ab0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:10.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.776+0000 7fde80fff700 1 --2- 172.21.15.81:0/2098927279 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fde7c13fd90 0x7fde7c159eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:10.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.776+0000 7fde80fff700 1 -- 172.21.15.81:0/2098927279 >> 172.21.15.81:0/2098927279 conn(0x7fde7c0cc090 msgr2=0x7fde7c0cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:10.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.776+0000 7fde80fff700 1 -- 172.21.15.81:0/2098927279 shutdown_connections 2023-10-06T03:24:10.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.776+0000 7fde80fff700 1 -- 172.21.15.81:0/2098927279 wait complete. 2023-10-06T03:24:10.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.777+0000 7fde80fff700 1 Processor -- start 2023-10-06T03:24:10.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.778+0000 7fde80fff700 1 -- start start 2023-10-06T03:24:10.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.778+0000 7fde80fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fde7c13f9c0 0x7fde7c1661d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:10.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.778+0000 7fde80fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fde7c13fd90 0x7fde7c0ad620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:10.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.778+0000 7fde80fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde7c15a3f0 0x7fde7c0c5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:10.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.778+0000 7fde80fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c0adb60 con 0x7fde7c15a3f0 2023-10-06T03:24:10.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.778+0000 7fde80fff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c0ade10 con 0x7fde7c13f9c0 2023-10-06T03:24:10.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.778+0000 7fde80fff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c0ae0f0 con 0x7fde7c13fd90 2023-10-06T03:24:10.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.779+0000 7fde7ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde7c15a3f0 0x7fde7c0c5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:10.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.779+0000 7fde7ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde7c15a3f0 0x7fde7c0c5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54490/0 (socket says 172.21.15.81:54490) 2023-10-06T03:24:10.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.779+0000 7fde7ad9d700 1 -- 172.21.15.81:0/1338960671 learned_addr learned my addr 172.21.15.81:0/1338960671 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:10.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.779+0000 7fde79d9b700 1 --2- 172.21.15.81:0/1338960671 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fde7c13fd90 0x7fde7c0ad620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:10.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.779+0000 7fde7a59c700 1 --2- 172.21.15.81:0/1338960671 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fde7c13f9c0 0x7fde7c1661d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:10.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.779+0000 7fde7ad9d700 1 -- 172.21.15.81:0/1338960671 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fde7c13fd90 msgr2=0x7fde7c0ad620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:10.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.779+0000 7fde7ad9d700 1 --2- 172.21.15.81:0/1338960671 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fde7c13fd90 0x7fde7c0ad620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:10.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.779+0000 7fde7ad9d700 1 -- 172.21.15.81:0/1338960671 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fde7c13f9c0 msgr2=0x7fde7c1661d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:10.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.779+0000 7fde7ad9d700 1 --2- 172.21.15.81:0/1338960671 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fde7c13f9c0 0x7fde7c1661d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:10.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.779+0000 7fde7ad9d700 1 -- 172.21.15.81:0/1338960671 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde74009ae0 con 0x7fde7c15a3f0 2023-10-06T03:24:10.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.779+0000 7fde7ad9d700 1 --2- 172.21.15.81:0/1338960671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde7c15a3f0 0x7fde7c0c5800 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fde7400b610 tx=0x7fde74018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:10.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.780+0000 7fde6a7fc700 1 -- 172.21.15.81:0/1338960671 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde74007ac0 con 0x7fde7c15a3f0 2023-10-06T03:24:10.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.780+0000 7fde6a7fc700 1 -- 172.21.15.81:0/1338960671 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde74007c20 con 0x7fde7c15a3f0 2023-10-06T03:24:10.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.780+0000 7fde6a7fc700 1 -- 172.21.15.81:0/1338960671 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7401d420 con 0x7fde7c15a3f0 2023-10-06T03:24:10.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.780+0000 7fde80fff700 1 -- 172.21.15.81:0/1338960671 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde7c0afee0 con 0x7fde7c15a3f0 2023-10-06T03:24:10.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.780+0000 7fde80fff700 1 -- 172.21.15.81:0/1338960671 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde7c0afb90 con 0x7fde7c15a3f0 2023-10-06T03:24:10.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.781+0000 7fde80fff700 1 -- 172.21.15.81:0/1338960671 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde7c0b0400 con 0x7fde7c15a3f0 2023-10-06T03:24:10.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.782+0000 7fde6a7fc700 1 -- 172.21.15.81:0/1338960671 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fde74003040 con 0x7fde7c15a3f0 2023-10-06T03:24:10.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.783+0000 7fde6a7fc700 1 --2- 172.21.15.81:0/1338960671 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fde5c066f30 0x7fde5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:10.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.784+0000 7fde6a7fc700 1 -- 172.21.15.81:0/1338960671 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fde740860c0 con 0x7fde7c15a3f0 2023-10-06T03:24:10.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.784+0000 7fde7a59c700 1 --2- 172.21.15.81:0/1338960671 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fde5c066f30 0x7fde5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:10.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.784+0000 7fde7a59c700 1 --2- 172.21.15.81:0/1338960671 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fde5c066f30 0x7fde5c0693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fde6c004fd0 tx=0x7fde6c007eb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:10.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:10.788+0000 7fde6a7fc700 1 -- 172.21.15.81:0/1338960671 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fde7c0b0400 con 0x7fde7c15a3f0 2023-10-06T03:24:11.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.021+0000 7fde80fff700 1 -- 172.21.15.81:0/1338960671 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde7c0b0400 con 0x7fde7c15a3f0 2023-10-06T03:24:11.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.022+0000 7fde6a7fc700 1 -- 172.21.15.81:0/1338960671 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4590 (secure 0 0 0) 0x7fde7c0b0400 con 0x7fde7c15a3f0 2023-10-06T03:24:11.024 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:24:11.024 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1255569320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1255569320},{"type":"v1","addr":"172.21.15.83:6835","nonce":1255569320}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1673166762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1673166762},{"type":"v1","addr":"172.21.15.81:6835","nonce":1673166762}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3689326153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3689326153},{"type":"v1","addr":"172.21.15.81:6837","nonce":3689326153}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:23:40.376852+0000","modified":"2023-10-06T03:23:56.657619+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6833/745669616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":745669616},{"type":"v1","addr":"172.21.15.83:6833","nonce":745669616}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T03:24:11.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.024+0000 7fde80fff700 1 -- 172.21.15.81:0/1338960671 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fde5c066f30 msgr2=0x7fde5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:11.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.024+0000 7fde80fff700 1 --2- 172.21.15.81:0/1338960671 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fde5c066f30 0x7fde5c0693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fde6c004fd0 tx=0x7fde6c007eb0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.024+0000 7fde80fff700 1 -- 172.21.15.81:0/1338960671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde7c15a3f0 msgr2=0x7fde7c0c5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:11.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.024+0000 7fde80fff700 1 --2- 172.21.15.81:0/1338960671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde7c15a3f0 0x7fde7c0c5800 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fde7400b610 tx=0x7fde74018000 comp rx=0 tx=0).stop 2023-10-06T03:24:11.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.024+0000 7fde80fff700 1 -- 172.21.15.81:0/1338960671 shutdown_connections 2023-10-06T03:24:11.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.024+0000 7fde80fff700 1 --2- 172.21.15.81:0/1338960671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde7c15a3f0 0x7fde7c0c5800 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.024+0000 7fde80fff700 1 --2- 172.21.15.81:0/1338960671 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fde7c13f9c0 0x7fde7c1661d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.024+0000 7fde80fff700 1 --2- 172.21.15.81:0/1338960671 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fde5c066f30 0x7fde5c0693e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.024+0000 7fde80fff700 1 --2- 172.21.15.81:0/1338960671 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fde7c13fd90 0x7fde7c0ad620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.024+0000 7fde80fff700 1 -- 172.21.15.81:0/1338960671 >> 172.21.15.81:0/1338960671 conn(0x7fde7c0cc090 msgr2=0x7fde7c0c7610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:11.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.025+0000 7fde80fff700 1 -- 172.21.15.81:0/1338960671 shutdown_connections 2023-10-06T03:24:11.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.025+0000 7fde80fff700 1 -- 172.21.15.81:0/1338960671 wait complete. 2023-10-06T03:24:11.028 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2023-10-06T03:24:11.151 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:24:11.156 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:24:11.447 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T03:23:40.376852+0000', 'modified': '2023-10-06T03:23:56.657619+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4291}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4291': {'gid': 4291, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.83:6833/745669616', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.83:6832', 'nonce': 745669616}, {'type': 'v1', 'addr': '172.21.15.83:6833', 'nonce': 745669616}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T03:24:11.448 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T03:24:11.448 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-06T03:24:11.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.629+0000 7fe0f9dff700 1 Processor -- start 2023-10-06T03:24:11.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.629+0000 7fe0f9dff700 1 -- start start 2023-10-06T03:24:11.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.630+0000 7fe0f9dff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe0f4156c90 0x7fe0f40c6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:11.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.630+0000 7fe0f9dff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0f4155c90 0x7fe0f4159d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:11.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.630+0000 7fe0f9dff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0f40c9c60 con 0x7fe0f41557f0 2023-10-06T03:24:11.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.630+0000 7fe0f9dff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0f406df20 con 0x7fe0f4156c90 2023-10-06T03:24:11.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.630+0000 7fe0f9dff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f4157060 con 0x7fe0f4155c90 2023-10-06T03:24:11.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.631+0000 7fe0f37fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe0f4156c90 0x7fe0f40c6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:11.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.631+0000 7fe0f3fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0f4155c90 0x7fe0f4159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:11.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.631+0000 7fe0f37fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe0f4156c90 0x7fe0f40c6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:56318/0 (socket says 172.21.15.81:56318) 2023-10-06T03:24:11.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.631+0000 7fe0f37fe700 1 -- 172.21.15.81:0/2243205643 learned_addr learned my addr 172.21.15.81:0/2243205643 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:11.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.631+0000 7fe0ebfff700 1 --1- 172.21.15.81:0/2243205643 >> v1:172.21.15.83:6789/0 conn(0x7fe0f41557f0 0x7fe0f4159630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:59940/0 (socket says 172.21.15.81:59940) 2023-10-06T03:24:11.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.631+0000 7fe0f2ffd700 1 -- 172.21.15.81:0/2243205643 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3173693089 0 0) 0x7fe0f40c9c60 con 0x7fe0f41557f0 2023-10-06T03:24:11.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.631+0000 7fe0f2ffd700 1 -- 172.21.15.81:0/2243205643 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0e0003570 con 0x7fe0f41557f0 2023-10-06T03:24:11.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.631+0000 7fe0f37fe700 1 -- 172.21.15.81:0/2243205643 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0f4155c90 msgr2=0x7fe0f4159d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:11.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.631+0000 7fe0f37fe700 1 --2- 172.21.15.81:0/2243205643 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0f4155c90 0x7fe0f4159d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.631+0000 7fe0f37fe700 1 -- 172.21.15.81:0/2243205643 >> v1:172.21.15.83:6789/0 conn(0x7fe0f41557f0 legacy=0x7fe0f4159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:11.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.631+0000 7fe0f37fe700 1 -- 172.21.15.81:0/2243205643 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0f406dc60 con 0x7fe0f4156c90 2023-10-06T03:24:11.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.631+0000 7fe0f3fff700 1 --2- 172.21.15.81:0/2243205643 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0f4155c90 0x7fe0f4159d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:24:11.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.632+0000 7fe0f37fe700 1 --2- 172.21.15.81:0/2243205643 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0f4156c90 0x7fe0f40c6cb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe0e40099b0 tx=0x7fe0e4009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c5dddd2dba5c8cd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:11.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.632+0000 7fe0f2ffd700 1 -- 172.21.15.81:0/2243205643 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e400b680 con 0x7fe0f4156c90 2023-10-06T03:24:11.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.632+0000 7fe0f2ffd700 1 -- 172.21.15.81:0/2243205643 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0e400b7e0 con 0x7fe0f4156c90 2023-10-06T03:24:11.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.632+0000 7fe0f2ffd700 1 -- 172.21.15.81:0/2243205643 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e400bb60 con 0x7fe0f4156c90 2023-10-06T03:24:11.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.633+0000 7fe0f9dff700 1 -- 172.21.15.81:0/2243205643 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0f4156c90 msgr2=0x7fe0f40c6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:11.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.633+0000 7fe0f9dff700 1 --2- 172.21.15.81:0/2243205643 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0f4156c90 0x7fe0f40c6cb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe0e40099b0 tx=0x7fe0e4009250 comp rx=0 tx=0).stop 2023-10-06T03:24:11.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.633+0000 7fe0f9dff700 1 -- 172.21.15.81:0/2243205643 shutdown_connections 2023-10-06T03:24:11.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.633+0000 7fe0f9dff700 1 --2- 172.21.15.81:0/2243205643 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0f4155c90 0x7fe0f4159d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.633+0000 7fe0f9dff700 1 --2- 172.21.15.81:0/2243205643 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0f4156c90 0x7fe0f40c6cb0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.633+0000 7fe0f9dff700 1 -- 172.21.15.81:0/2243205643 >> 172.21.15.81:0/2243205643 conn(0x7fe0f40cc090 msgr2=0x7fe0f40cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:11.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.633+0000 7fe0f9dff700 1 -- 172.21.15.81:0/2243205643 shutdown_connections 2023-10-06T03:24:11.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.633+0000 7fe0f9dff700 1 -- 172.21.15.81:0/2243205643 wait complete. 2023-10-06T03:24:11.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.634+0000 7fe0f9dff700 1 Processor -- start 2023-10-06T03:24:11.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.634+0000 7fe0f9dff700 1 -- start start 2023-10-06T03:24:11.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.635+0000 7fe0f9dff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0f41557f0 0x7fe0f4140220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:11.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.635+0000 7fe0f9dff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0f4155c90 0x7fe0f4140b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:11.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.635+0000 7fe0f9dff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0f4156c90 0x7fe0f415b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:11.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.635+0000 7fe0f9dff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f415ad70 con 0x7fe0f41557f0 2023-10-06T03:24:11.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.635+0000 7fe0f9dff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f415a160 con 0x7fe0f4156c90 2023-10-06T03:24:11.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.635+0000 7fe0f9dff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f415a440 con 0x7fe0f4155c90 2023-10-06T03:24:11.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.635+0000 7fe0f37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0f41557f0 0x7fe0f4140220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:11.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.635+0000 7fe0f37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0f41557f0 0x7fe0f4140220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54500/0 (socket says 172.21.15.81:54500) 2023-10-06T03:24:11.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.635+0000 7fe0f37fe700 1 -- 172.21.15.81:0/2828393028 learned_addr learned my addr 172.21.15.81:0/2828393028 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:11.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.636+0000 7fe0f3fff700 1 --2- 172.21.15.81:0/2828393028 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0f4156c90 0x7fe0f415b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:11.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.636+0000 7fe0ebfff700 1 --2- 172.21.15.81:0/2828393028 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0f4155c90 0x7fe0f4140b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:11.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.636+0000 7fe0f37fe700 1 -- 172.21.15.81:0/2828393028 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0f4155c90 msgr2=0x7fe0f4140b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:11.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.636+0000 7fe0f37fe700 1 --2- 172.21.15.81:0/2828393028 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0f4155c90 0x7fe0f4140b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.636+0000 7fe0f37fe700 1 -- 172.21.15.81:0/2828393028 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0f4156c90 msgr2=0x7fe0f415b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:11.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.636+0000 7fe0f37fe700 1 --2- 172.21.15.81:0/2828393028 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0f4156c90 0x7fe0f415b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.636+0000 7fe0f37fe700 1 -- 172.21.15.81:0/2828393028 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0ec009a20 con 0x7fe0f41557f0 2023-10-06T03:24:11.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.636+0000 7fe0ebfff700 1 --2- 172.21.15.81:0/2828393028 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0f4155c90 0x7fe0f4140b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:11.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.636+0000 7fe0f37fe700 1 --2- 172.21.15.81:0/2828393028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0f41557f0 0x7fe0f4140220 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4009290 tx=0x7fe0e4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:11.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.636+0000 7fe0eb7fe700 1 -- 172.21.15.81:0/2828393028 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e400bb60 con 0x7fe0f41557f0 2023-10-06T03:24:11.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.636+0000 7fe0eb7fe700 1 -- 172.21.15.81:0/2828393028 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0e4000c90 con 0x7fe0f41557f0 2023-10-06T03:24:11.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.636+0000 7fe0f9dff700 1 -- 172.21.15.81:0/2828393028 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0e40094f0 con 0x7fe0f41557f0 2023-10-06T03:24:11.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.636+0000 7fe0eb7fe700 1 -- 172.21.15.81:0/2828393028 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e401a660 con 0x7fe0f41557f0 2023-10-06T03:24:11.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.636+0000 7fe0f9dff700 1 -- 172.21.15.81:0/2828393028 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0f415aa00 con 0x7fe0f41557f0 2023-10-06T03:24:11.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.638+0000 7fe0eb7fe700 1 -- 172.21.15.81:0/2828393028 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe0e401aa50 con 0x7fe0f41557f0 2023-10-06T03:24:11.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.640+0000 7fe0eb7fe700 1 --2- 172.21.15.81:0/2828393028 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fe0d4066f30 0x7fe0d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:11.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.640+0000 7fe0eb7fe700 1 -- 172.21.15.81:0/2828393028 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fe0e40865e0 con 0x7fe0f41557f0 2023-10-06T03:24:11.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.640+0000 7fe0ebfff700 1 --2- 172.21.15.81:0/2828393028 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fe0d4066f30 0x7fe0d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:11.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.640+0000 7fe0ebfff700 1 --2- 172.21.15.81:0/2828393028 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fe0d4066f30 0x7fe0d40693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc007fd0 tx=0x7fe0dc000bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:11.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.642+0000 7fe108471b80 1 Processor -- start 2023-10-06T03:24:11.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.642+0000 7fe108471b80 1 -- start start 2023-10-06T03:24:11.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.643+0000 7fe108471b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3c6486220 0x55c3c64865f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:11.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.643+0000 7fe108471b80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55c3c64a3af0 0x55c3c6459670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:11.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.643+0000 7fe108471b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c3c6459bb0 0x55c3c64a0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:11.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.643+0000 7fe108471b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3c63b0a70 con 0x55c3c6486220 2023-10-06T03:24:11.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.643+0000 7fe108471b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3c63ae270 con 0x55c3c6459bb0 2023-10-06T03:24:11.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.643+0000 7fe108471b80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c3c63aa060 con 0x55c3c64a3af0 2023-10-06T03:24:11.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.643+0000 7fe0f37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3c6486220 0x55c3c64865f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:11.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.643+0000 7fe0f37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3c6486220 0x55c3c64865f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54508/0 (socket says 172.21.15.81:54508) 2023-10-06T03:24:11.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.643+0000 7fe0f37fe700 1 -- 172.21.15.81:0/4268491815 learned_addr learned my addr 172.21.15.81:0/4268491815 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:11.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.643+0000 7fe0f37fe700 1 -- 172.21.15.81:0/4268491815 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55c3c64a3af0 msgr2=0x55c3c6459670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:11.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.643+0000 7fe0f37fe700 1 --2- 172.21.15.81:0/4268491815 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55c3c64a3af0 0x55c3c6459670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.643+0000 7fe0f37fe700 1 -- 172.21.15.81:0/4268491815 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c3c6459bb0 msgr2=0x55c3c64a0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:11.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.643+0000 7fe0f37fe700 1 --2- 172.21.15.81:0/4268491815 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c3c6459bb0 0x55c3c64a0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.643+0000 7fe0f37fe700 1 -- 172.21.15.81:0/4268491815 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c3c6244270 con 0x55c3c6486220 2023-10-06T03:24:11.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.643+0000 7fe0f37fe700 1 --2- 172.21.15.81:0/4268491815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3c6486220 0x55c3c64865f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe0e40845e0 tx=0x7fe0e405c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88ad59cd371233ff server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:11.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.643+0000 7fe0e8ff9700 1 -- 172.21.15.81:0/4268491815 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e405a270 con 0x55c3c6486220 2023-10-06T03:24:11.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.644+0000 7fe0e8ff9700 1 -- 172.21.15.81:0/4268491815 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0e405dfc0 con 0x55c3c6486220 2023-10-06T03:24:11.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.644+0000 7fe0e8ff9700 1 -- 172.21.15.81:0/4268491815 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e40553c0 con 0x55c3c6486220 2023-10-06T03:24:11.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.644+0000 7fe108471b80 1 -- 172.21.15.81:0/4268491815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3c6486220 msgr2=0x55c3c64865f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:11.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.644+0000 7fe108471b80 1 --2- 172.21.15.81:0/4268491815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3c6486220 0x55c3c64865f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe0e40845e0 tx=0x7fe0e405c040 comp rx=0 tx=0).stop 2023-10-06T03:24:11.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.644+0000 7fe108471b80 1 -- 172.21.15.81:0/4268491815 shutdown_connections 2023-10-06T03:24:11.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.644+0000 7fe108471b80 1 --2- 172.21.15.81:0/4268491815 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c3c6459bb0 0x55c3c64a0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.644+0000 7fe108471b80 1 --2- 172.21.15.81:0/4268491815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3c6486220 0x55c3c64865f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.644+0000 7fe108471b80 1 --2- 172.21.15.81:0/4268491815 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55c3c64a3af0 0x55c3c6459670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.644+0000 7fe108471b80 1 -- 172.21.15.81:0/4268491815 >> 172.21.15.81:0/4268491815 conn(0x55c3c645b160 msgr2=0x55c3c645b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:11.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.644+0000 7fe108471b80 1 -- 172.21.15.81:0/4268491815 shutdown_connections 2023-10-06T03:24:11.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.644+0000 7fe108471b80 1 -- 172.21.15.81:0/4268491815 wait complete. 2023-10-06T03:24:11.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.645+0000 7fe108471b80 1 -- start start 2023-10-06T03:24:11.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.645+0000 7fe108471b80 1 Processor -- start 2023-10-06T03:24:11.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.646+0000 7fe108471b80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55c3c6459bb0 0x55c3c64865f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:11.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.646+0000 7fe108471b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3c6486220 0x55c3c64851e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:11.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.646+0000 7fe108471b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c3c64a3af0 0x55c3c64a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:11.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.646+0000 7fe108471b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3c6355890 con 0x55c3c6486220 2023-10-06T03:24:11.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.646+0000 7fe108471b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3c6370ea0 con 0x55c3c64a3af0 2023-10-06T03:24:11.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.646+0000 7fe108471b80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c3c622ce30 con 0x55c3c6459bb0 2023-10-06T03:24:11.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.646+0000 7fe108471b80 10 client.0 _ll_register_callbacks cb 0x55c3c641ce70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:24:11.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.646+0000 7fe0ebfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3c6486220 0x55c3c64851e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:11.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.646+0000 7fe0ebfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3c6486220 0x55c3c64851e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54510/0 (socket says 172.21.15.81:54510) 2023-10-06T03:24:11.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.646+0000 7fe0ebfff700 1 -- 172.21.15.81:0/2863812232 learned_addr learned my addr 172.21.15.81:0/2863812232 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:11.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.646+0000 7fe0f3fff700 1 --2- 172.21.15.81:0/2863812232 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c3c64a3af0 0x55c3c64a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:11.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.646+0000 7fe0f37fe700 1 --2- 172.21.15.81:0/2863812232 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55c3c6459bb0 0x55c3c64865f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:11.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.647+0000 7fe0ebfff700 1 -- 172.21.15.81:0/2863812232 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55c3c6459bb0 msgr2=0x55c3c64865f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:11.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.647+0000 7fe0ebfff700 1 --2- 172.21.15.81:0/2863812232 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55c3c6459bb0 0x55c3c64865f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.647+0000 7fe0ebfff700 1 -- 172.21.15.81:0/2863812232 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c3c64a3af0 msgr2=0x55c3c64a2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:11.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.647+0000 7fe0ebfff700 1 --2- 172.21.15.81:0/2863812232 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c3c64a3af0 0x55c3c64a2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.647+0000 7fe0ebfff700 1 -- 172.21.15.81:0/2863812232 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0f415aa00 con 0x55c3c6486220 2023-10-06T03:24:11.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.647+0000 7fe0ebfff700 1 --2- 172.21.15.81:0/2863812232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3c6486220 0x55c3c64851e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc015dd0 tx=0x7fe0dc013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=951b0febf2fac2b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:11.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.647+0000 7fe0d1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-06T03:24:11.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.647+0000 7fe0d1ffb700 1 -- 172.21.15.81:0/2863812232 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc015e00 con 0x55c3c6486220 2023-10-06T03:24:11.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.647+0000 7fe108471b80 1 -- 172.21.15.81:0/2863812232 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c3c644e940 con 0x55c3c6486220 2023-10-06T03:24:11.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.647+0000 7fe0d1ffb700 1 -- 172.21.15.81:0/2863812232 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fe0dc001c30 con 0x55c3c6486220 2023-10-06T03:24:11.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.647+0000 7fe0d1ffb700 1 -- 172.21.15.81:0/2863812232 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe0dc0152e0 con 0x55c3c6486220 2023-10-06T03:24:11.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.648+0000 7fe108471b80 10 client.4788 fetch_fsmap learned FSMap version 9 2023-10-06T03:24:11.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.648+0000 7fe108471b80 1 -- 172.21.15.81:0/2863812232 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55c3c61e6fe0 con 0x55c3c6486220 2023-10-06T03:24:11.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.648+0000 7fe0d1ffb700 1 -- 172.21.15.81:0/2863812232 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c3c644e940 con 0x55c3c6486220 2023-10-06T03:24:11.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.648+0000 7fe0d1ffb700 1 -- 172.21.15.81:0/2863812232 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) v1 ==== 3108+0+0 (secure 0 0 0) 0x7fe0dc004830 con 0x55c3c6486220 2023-10-06T03:24:11.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.648+0000 7fe108471b80 10 client.4788 fetch_fsmap finished waiting for FSMap version 9 2023-10-06T03:24:11.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.648+0000 7fe108471b80 10 client.4788 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T03:24:11.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.648+0000 7fe108471b80 20 client.4788 populate_metadata read hostname 'smithi081' 2023-10-06T03:24:11.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.648+0000 7fe108471b80 1 --2- 172.21.15.81:0/2863812232 >> [v2:172.21.15.83:6832/745669616,v1:172.21.15.83:6833/745669616] conn(0x55c3c64b7af0 0x55c3c64b7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:11.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.648+0000 7fe108471b80 4 client.4788 mds_command: new command op to 4291 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:24:11.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.648+0000 7fe108471b80 1 -- 172.21.15.81:0/2863812232 --> [v2:172.21.15.83:6832/745669616,v1:172.21.15.83:6833/745669616] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c3c642b870 con 0x55c3c64b7af0 2023-10-06T03:24:11.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.648+0000 7fe0f37fe700 1 --2- 172.21.15.81:0/2863812232 >> [v2:172.21.15.83:6832/745669616,v1:172.21.15.83:6833/745669616] conn(0x55c3c64b7af0 0x55c3c64b7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:11.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.649+0000 7fe0d1ffb700 10 client.4788 ms_handle_connect on v2:172.21.15.83:6832/745669616 2023-10-06T03:24:11.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.649+0000 7fe0f37fe700 1 --2- 172.21.15.81:0/2863812232 >> [v2:172.21.15.83:6832/745669616,v1:172.21.15.83:6833/745669616] conn(0x55c3c64b7af0 0x55c3c64b7ec0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ecb9f53f964427d0 server_cookie=75ac6a58be4409ad in_seq=0 out_seq=0 2023-10-06T03:24:11.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.650+0000 7fe0d1ffb700 1 -- 172.21.15.81:0/2863812232 <== mds.0 v2:172.21.15.83:6832/745669616 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55c3c642b870 con 0x55c3c64b7af0 2023-10-06T03:24:11.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.650+0000 7fe0d1ffb700 10 client.4788 handle_command_reply: tid=0 2023-10-06T03:24:11.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.650+0000 7fe108471b80 1 client.4788 shutdown 2023-10-06T03:24:11.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.650+0000 7fe108471b80 1 -- 172.21.15.81:0/2863812232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3c6486220 msgr2=0x55c3c64851e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:11.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.650+0000 7fe108471b80 1 --2- 172.21.15.81:0/2863812232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3c6486220 0x55c3c64851e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc015dd0 tx=0x7fe0dc013000 comp rx=0 tx=0).stop 2023-10-06T03:24:11.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.650+0000 7fe108471b80 1 -- 172.21.15.81:0/2863812232 shutdown_connections 2023-10-06T03:24:11.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.650+0000 7fe108471b80 1 --2- 172.21.15.81:0/2863812232 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c3c64a3af0 0x55c3c64a2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.650+0000 7fe108471b80 1 --2- 172.21.15.81:0/2863812232 >> [v2:172.21.15.83:6832/745669616,v1:172.21.15.83:6833/745669616] conn(0x55c3c64b7af0 0x55c3c64b7ec0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.650+0000 7fe108471b80 1 --2- 172.21.15.81:0/2863812232 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55c3c6459bb0 0x55c3c64865f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.650+0000 7fe0d1ffb700 0 client.4788 ms_handle_reset on v2:172.21.15.83:6832/745669616 2023-10-06T03:24:11.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.650+0000 7fe108471b80 1 --2- 172.21.15.81:0/2863812232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3c6486220 0x55c3c64851e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.650+0000 7fe108471b80 1 -- 172.21.15.81:0/2863812232 >> 172.21.15.81:0/2863812232 conn(0x55c3c645b160 msgr2=0x55c3c645a070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:11.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.650+0000 7fe108471b80 1 -- 172.21.15.81:0/2863812232 shutdown_connections 2023-10-06T03:24:11.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.650+0000 7fe108471b80 1 -- 172.21.15.81:0/2863812232 wait complete. 2023-10-06T03:24:11.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.650+0000 7fe108471b80 20 client.4788 trim_cache size 0 max 16384 2023-10-06T03:24:11.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.667+0000 7fe108471b80 1 Processor -- start 2023-10-06T03:24:11.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.667+0000 7fe108471b80 1 -- start start 2023-10-06T03:24:11.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.668+0000 7fe108471b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3c6459bb0 0x55c3c6485810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:11.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.668+0000 7fe108471b80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55c3c6486220 0x55c3c64a2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:11.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.668+0000 7fe108471b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c3c64a3af0 0x55c3c649cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:11.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.668+0000 7fe108471b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3c64a15b0 con 0x55c3c6459bb0 2023-10-06T03:24:11.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.668+0000 7fe108471b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3c6485630 con 0x55c3c64a3af0 2023-10-06T03:24:11.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.668+0000 7fe108471b80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c3c64a34e0 con 0x55c3c6486220 2023-10-06T03:24:11.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.668+0000 7fe0f37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3c6459bb0 0x55c3c6485810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:11.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.668+0000 7fe0f37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3c6459bb0 0x55c3c6485810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54516/0 (socket says 172.21.15.81:54516) 2023-10-06T03:24:11.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.668+0000 7fe0f37fe700 1 -- 172.21.15.81:0/4246004653 learned_addr learned my addr 172.21.15.81:0/4246004653 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:11.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.669+0000 7fe0ebfff700 1 --2- 172.21.15.81:0/4246004653 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55c3c6486220 0x55c3c64a2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:11.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.669+0000 7fe0f3fff700 1 --2- 172.21.15.81:0/4246004653 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c3c64a3af0 0x55c3c649cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:11.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.669+0000 7fe0f37fe700 1 -- 172.21.15.81:0/4246004653 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55c3c6486220 msgr2=0x55c3c64a2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:11.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.669+0000 7fe0f37fe700 1 --2- 172.21.15.81:0/4246004653 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55c3c6486220 0x55c3c64a2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.669+0000 7fe0f37fe700 1 -- 172.21.15.81:0/4246004653 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c3c64a3af0 msgr2=0x55c3c649cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:11.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.669+0000 7fe0f37fe700 1 --2- 172.21.15.81:0/4246004653 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c3c64a3af0 0x55c3c649cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.669+0000 7fe0f37fe700 1 -- 172.21.15.81:0/4246004653 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0f40c2eb0 con 0x55c3c6459bb0 2023-10-06T03:24:11.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.669+0000 7fe0f37fe700 1 --2- 172.21.15.81:0/4246004653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3c6459bb0 0x55c3c6485810 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4056fb0 tx=0x7fe0e405c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f8e4f6a71c7dce6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:11.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.669+0000 7fe0e97fa700 1 -- 172.21.15.81:0/4246004653 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e405a270 con 0x55c3c6459bb0 2023-10-06T03:24:11.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.669+0000 7fe0e97fa700 1 -- 172.21.15.81:0/4246004653 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0e4057490 con 0x55c3c6459bb0 2023-10-06T03:24:11.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.669+0000 7fe0e97fa700 1 -- 172.21.15.81:0/4246004653 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e4055160 con 0x55c3c6459bb0 2023-10-06T03:24:11.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.670+0000 7fe108471b80 1 -- 172.21.15.81:0/4246004653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3c6459bb0 msgr2=0x55c3c6485810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:11.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.670+0000 7fe108471b80 1 --2- 172.21.15.81:0/4246004653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3c6459bb0 0x55c3c6485810 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4056fb0 tx=0x7fe0e405c040 comp rx=0 tx=0).stop 2023-10-06T03:24:11.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.670+0000 7fe108471b80 1 -- 172.21.15.81:0/4246004653 shutdown_connections 2023-10-06T03:24:11.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.670+0000 7fe108471b80 1 --2- 172.21.15.81:0/4246004653 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c3c64a3af0 0x55c3c649cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.670+0000 7fe108471b80 1 --2- 172.21.15.81:0/4246004653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3c6459bb0 0x55c3c6485810 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.670+0000 7fe108471b80 1 --2- 172.21.15.81:0/4246004653 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55c3c6486220 0x55c3c64a2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.670+0000 7fe108471b80 1 -- 172.21.15.81:0/4246004653 >> 172.21.15.81:0/4246004653 conn(0x55c3c645b160 msgr2=0x55c3c64b7ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:11.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.670+0000 7fe108471b80 1 -- 172.21.15.81:0/4246004653 shutdown_connections 2023-10-06T03:24:11.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.670+0000 7fe108471b80 1 -- 172.21.15.81:0/4246004653 wait complete. 2023-10-06T03:24:11.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.670+0000 7fe108471b80 1 -- start start 2023-10-06T03:24:11.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.671+0000 7fe108471b80 1 Processor -- start 2023-10-06T03:24:11.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.671+0000 7fe108471b80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55c3c6459bb0 0x55c3c64a0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:11.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.671+0000 7fe108471b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3c6486220 0x55c3c6487d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:11.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.672+0000 7fe108471b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c3c64a3af0 0x55c3c6488240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:11.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.672+0000 7fe108471b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3c64a97a0 con 0x55c3c6486220 2023-10-06T03:24:11.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.672+0000 7fe108471b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3c64a72e0 con 0x55c3c64a3af0 2023-10-06T03:24:11.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.672+0000 7fe108471b80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c3c64a1310 con 0x55c3c6459bb0 2023-10-06T03:24:11.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.672+0000 7fe108471b80 10 client.0 _ll_register_callbacks cb 0x55c3c64874f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:24:11.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.672+0000 7fe0ebfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3c6486220 0x55c3c6487d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:11.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.672+0000 7fe0ebfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3c6486220 0x55c3c6487d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54528/0 (socket says 172.21.15.81:54528) 2023-10-06T03:24:11.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.672+0000 7fe0ebfff700 1 -- 172.21.15.81:0/1250776092 learned_addr learned my addr 172.21.15.81:0/1250776092 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:11.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.672+0000 7fe0f3fff700 1 --2- 172.21.15.81:0/1250776092 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c3c64a3af0 0x55c3c6488240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:11.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.672+0000 7fe0f37fe700 1 --2- 172.21.15.81:0/1250776092 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55c3c6459bb0 0x55c3c64a0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:11.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.672+0000 7fe0ebfff700 1 -- 172.21.15.81:0/1250776092 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55c3c6459bb0 msgr2=0x55c3c64a0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:11.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.672+0000 7fe0ebfff700 1 --2- 172.21.15.81:0/1250776092 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55c3c6459bb0 0x55c3c64a0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.672+0000 7fe0ebfff700 1 -- 172.21.15.81:0/1250776092 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c3c64a3af0 msgr2=0x55c3c6488240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:11.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.672+0000 7fe0ebfff700 1 --2- 172.21.15.81:0/1250776092 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c3c64a3af0 0x55c3c6488240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.672+0000 7fe0ebfff700 1 -- 172.21.15.81:0/1250776092 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c3c6244270 con 0x55c3c6486220 2023-10-06T03:24:11.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.672+0000 7fe0f37fe700 1 --2- 172.21.15.81:0/1250776092 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55c3c6459bb0 0x55c3c64a0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:11.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.673+0000 7fe0ebfff700 1 --2- 172.21.15.81:0/1250776092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3c6486220 0x55c3c6487d00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc007850 tx=0x7fe0dc01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3af94db69ed5dbb1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:11.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.673+0000 7fe0d1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-06T03:24:11.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.673+0000 7fe0d1ffb700 1 -- 172.21.15.81:0/1250776092 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc004d40 con 0x55c3c6486220 2023-10-06T03:24:11.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.673+0000 7fe108471b80 1 -- 172.21.15.81:0/1250776092 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe0e405dfc0 con 0x55c3c6486220 2023-10-06T03:24:11.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.673+0000 7fe0d1ffb700 1 -- 172.21.15.81:0/1250776092 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fe0dc005bf0 con 0x55c3c6486220 2023-10-06T03:24:11.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.673+0000 7fe0d1ffb700 1 -- 172.21.15.81:0/1250776092 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe0dc004830 con 0x55c3c6486220 2023-10-06T03:24:11.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.673+0000 7fe108471b80 10 client.4794 fetch_fsmap learned FSMap version 9 2023-10-06T03:24:11.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.673+0000 7fe108471b80 1 -- 172.21.15.81:0/1250776092 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55c3c6378780 con 0x55c3c6486220 2023-10-06T03:24:11.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.673+0000 7fe0d1ffb700 1 -- 172.21.15.81:0/1250776092 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0e405dfc0 con 0x55c3c6486220 2023-10-06T03:24:11.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.673+0000 7fe0d1ffb700 1 -- 172.21.15.81:0/1250776092 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) v1 ==== 3108+0+0 (secure 0 0 0) 0x7fe0dc0054c0 con 0x55c3c6486220 2023-10-06T03:24:11.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.673+0000 7fe108471b80 10 client.4794 fetch_fsmap finished waiting for FSMap version 9 2023-10-06T03:24:11.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.673+0000 7fe108471b80 10 client.4794 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T03:24:11.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.673+0000 7fe108471b80 20 client.4794 populate_metadata read hostname 'smithi081' 2023-10-06T03:24:11.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.673+0000 7fe108471b80 1 --2- 172.21.15.81:0/1250776092 >> [v2:172.21.15.83:6832/745669616,v1:172.21.15.83:6833/745669616] conn(0x55c3c64b6a20 0x55c3c64b6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:11.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.673+0000 7fe108471b80 4 client.4794 mds_command: new command op to 4291 tid=0[{"prefix": "status"}] 2023-10-06T03:24:11.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.673+0000 7fe108471b80 1 -- 172.21.15.81:0/1250776092 --> [v2:172.21.15.83:6832/745669616,v1:172.21.15.83:6833/745669616] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c3c634ce00 con 0x55c3c64b6a20 2023-10-06T03:24:11.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.674+0000 7fe0f37fe700 1 --2- 172.21.15.81:0/1250776092 >> [v2:172.21.15.83:6832/745669616,v1:172.21.15.83:6833/745669616] conn(0x55c3c64b6a20 0x55c3c64b6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:11.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.674+0000 7fe0f37fe700 1 --2- 172.21.15.81:0/1250776092 >> [v2:172.21.15.83:6832/745669616,v1:172.21.15.83:6833/745669616] conn(0x55c3c64b6a20 0x55c3c64b6df0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbc1930214323821 server_cookie=6ee4cbb72266976 in_seq=0 out_seq=0 2023-10-06T03:24:11.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.674+0000 7fe0d1ffb700 10 client.4794 ms_handle_connect on v2:172.21.15.83:6832/745669616 2023-10-06T03:24:11.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.674+0000 7fe0d1ffb700 1 -- 172.21.15.81:0/1250776092 <== mds.0 v2:172.21.15.83:6832/745669616 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55c3c634ce00 con 0x55c3c64b6a20 2023-10-06T03:24:11.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.674+0000 7fe0d1ffb700 10 client.4794 handle_command_reply: tid=0 2023-10-06T03:24:11.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.674+0000 7fe108471b80 1 client.4794 shutdown 2023-10-06T03:24:11.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.675+0000 7fe108471b80 1 -- 172.21.15.81:0/1250776092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3c6486220 msgr2=0x55c3c6487d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:11.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.675+0000 7fe108471b80 1 --2- 172.21.15.81:0/1250776092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3c6486220 0x55c3c6487d00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc007850 tx=0x7fe0dc01a000 comp rx=0 tx=0).stop 2023-10-06T03:24:11.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.675+0000 7fe108471b80 1 -- 172.21.15.81:0/1250776092 shutdown_connections 2023-10-06T03:24:11.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.675+0000 7fe108471b80 1 --2- 172.21.15.81:0/1250776092 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c3c64a3af0 0x55c3c6488240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.675+0000 7fe108471b80 1 --2- 172.21.15.81:0/1250776092 >> [v2:172.21.15.83:6832/745669616,v1:172.21.15.83:6833/745669616] conn(0x55c3c64b6a20 0x55c3c64b6df0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.675+0000 7fe108471b80 1 --2- 172.21.15.81:0/1250776092 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55c3c6459bb0 0x55c3c64a0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.675+0000 7fe108471b80 1 --2- 172.21.15.81:0/1250776092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3c6486220 0x55c3c6487d00 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.675+0000 7fe0d1ffb700 0 client.4794 ms_handle_reset on v2:172.21.15.83:6832/745669616 2023-10-06T03:24:11.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.675+0000 7fe108471b80 1 -- 172.21.15.81:0/1250776092 >> 172.21.15.81:0/1250776092 conn(0x55c3c645b160 msgr2=0x55c3c64865f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:11.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.675+0000 7fe108471b80 1 -- 172.21.15.81:0/1250776092 shutdown_connections 2023-10-06T03:24:11.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.675+0000 7fe108471b80 1 -- 172.21.15.81:0/1250776092 wait complete. 2023-10-06T03:24:11.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.675+0000 7fe108471b80 20 client.4794 trim_cache size 0 max 16384 2023-10-06T03:24:11.684 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T03:24:11.684 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "1807b5d7-9be8-43ad-aaf8-99a4273430b3", 2023-10-06T03:24:11.684 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2023-10-06T03:24:11.684 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 4291, 2023-10-06T03:24:11.684 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2023-10-06T03:24:11.684 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2023-10-06T03:24:11.684 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2023-10-06T03:24:11.684 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 30.775381369000002, 2023-10-06T03:24:11.685 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 9, 2023-10-06T03:24:11.685 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 24, 2023-10-06T03:24:11.685 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 24, 2023-10-06T03:24:11.685 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 36.628537784999999 2023-10-06T03:24:11.685 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T03:24:11.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.675+0000 7fe0f9dff700 1 -- 172.21.15.81:0/2828393028 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fe0d4066f30 msgr2=0x7fe0d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:11.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.675+0000 7fe0f9dff700 1 --2- 172.21.15.81:0/2828393028 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fe0d4066f30 0x7fe0d40693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc007fd0 tx=0x7fe0dc000bc0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.675+0000 7fe0f9dff700 1 -- 172.21.15.81:0/2828393028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0f41557f0 msgr2=0x7fe0f4140220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:11.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.675+0000 7fe0f9dff700 1 --2- 172.21.15.81:0/2828393028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0f41557f0 0x7fe0f4140220 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4009290 tx=0x7fe0e4017000 comp rx=0 tx=0).stop 2023-10-06T03:24:11.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.676+0000 7fe0f9dff700 1 -- 172.21.15.81:0/2828393028 shutdown_connections 2023-10-06T03:24:11.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.676+0000 7fe0f9dff700 1 --2- 172.21.15.81:0/2828393028 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0f4156c90 0x7fe0f415b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.676+0000 7fe0f9dff700 1 --2- 172.21.15.81:0/2828393028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0f41557f0 0x7fe0f4140220 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.676+0000 7fe0f9dff700 1 --2- 172.21.15.81:0/2828393028 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fe0d4066f30 0x7fe0d40693e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.676+0000 7fe0f9dff700 1 --2- 172.21.15.81:0/2828393028 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0f4155c90 0x7fe0f4140b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:11.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.676+0000 7fe0f9dff700 1 -- 172.21.15.81:0/2828393028 >> 172.21.15.81:0/2828393028 conn(0x7fe0f40cc090 msgr2=0x7fe0f4156060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:11.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.676+0000 7fe0f9dff700 1 -- 172.21.15.81:0/2828393028 shutdown_connections 2023-10-06T03:24:11.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:11.676+0000 7fe0f9dff700 1 -- 172.21.15.81:0/2828393028 wait complete. 2023-10-06T03:24:11.694 INFO:teuthology.run_tasks:Running task kclient... 2023-10-06T03:24:11.707 INFO:tasks.kclient:Mounting kernel clients... 2023-10-06T03:24:11.707 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-06T03:24:11.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:11.707 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-10-06T03:24:11.744 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-10-06T03:24:11.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:11.745 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-06T03:24:11.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:11.847 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2023-10-06T03:24:11.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:11.955 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-10-06T03:24:11.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:11.992 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2023-10-06T03:24:12.097 INFO:teuthology.orchestra.run.smithi081.stderr:Cannot find device "ceph-brx" 2023-10-06T03:24:12.100 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:24:12.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:12.101 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2023-10-06T03:24:12.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:12.142 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link delete ceph-brx 2023-10-06T03:24:12.250 INFO:teuthology.orchestra.run.smithi083.stderr:Cannot find device "ceph-brx" 2023-10-06T03:24:12.253 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:24:12.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:12.254 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2023-10-06T03:24:12.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:12.291 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link delete ceph-brx 2023-10-06T03:24:12.393 INFO:teuthology.orchestra.run.smithi083.stderr:Cannot find device "ceph-brx" 2023-10-06T03:24:12.395 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:24:12.396 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-10-06T03:24:12.396 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:24:12.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.575+0000 7f88c339d700 1 Processor -- start 2023-10-06T03:24:12.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.575+0000 7f88c339d700 1 -- start start 2023-10-06T03:24:12.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.576+0000 7f88c339d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f88bc0ace00 0x7f88bc0abb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:12.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.576+0000 7f88c339d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88bc0ac5f0 con 0x7f88bc06d2d0 2023-10-06T03:24:12.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.576+0000 7f88c339d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88bc0ac0c0 con 0x7f88bc0ab7b0 2023-10-06T03:24:12.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.576+0000 7f88c339d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88bc0ae330 con 0x7f88bc0ace00 2023-10-06T03:24:12.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.576+0000 7f88c2b9c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f88bc06d2d0 0x7f88bc06d730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59466/0 (socket says 172.21.15.81:59466) 2023-10-06T03:24:12.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.576+0000 7f88c2b9c700 1 -- 172.21.15.81:0/4020975247 learned_addr learned my addr 172.21.15.81:0/4020975247 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:24:12.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.577+0000 7f88c1b9a700 1 --2- 172.21.15.81:0/4020975247 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f88bc0ace00 0x7f88bc0abb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:12.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.577+0000 7f88c1399700 1 -- 172.21.15.81:0/4020975247 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3373040327 0 0) 0x7f88bc0ac5f0 con 0x7f88bc06d2d0 2023-10-06T03:24:12.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.577+0000 7f88c1399700 1 -- 172.21.15.81:0/4020975247 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88a8003570 con 0x7f88bc06d2d0 2023-10-06T03:24:12.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.577+0000 7f88c1399700 1 -- 172.21.15.81:0/4020975247 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2338787884 0 0) 0x7f88bc0ac0c0 con 0x7f88bc0ab7b0 2023-10-06T03:24:12.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.577+0000 7f88c1399700 1 -- 172.21.15.81:0/4020975247 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88bc0ac5f0 con 0x7f88bc0ab7b0 2023-10-06T03:24:12.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.577+0000 7f88c1399700 1 -- 172.21.15.81:0/4020975247 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3342550066 0 0) 0x7f88a8003570 con 0x7f88bc06d2d0 2023-10-06T03:24:12.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.577+0000 7f88c1b9a700 1 -- 172.21.15.81:0/4020975247 >> v1:172.21.15.83:6789/0 conn(0x7f88bc0ab7b0 legacy=0x7f88bc156910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:12.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.577+0000 7f88c1b9a700 1 -- 172.21.15.81:0/4020975247 >> v1:172.21.15.81:6789/0 conn(0x7f88bc06d2d0 legacy=0x7f88bc06d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:12.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.577+0000 7f88c1b9a700 1 -- 172.21.15.81:0/4020975247 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88bc0ad290 con 0x7f88bc0ace00 2023-10-06T03:24:12.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.577+0000 7f88c1b9a700 1 --2- 172.21.15.81:0/4020975247 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f88bc0ace00 0x7f88bc0abb80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f88ac009910 tx=0x7f88ac0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65757fd7f4642cc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:12.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.578+0000 7f88c1399700 1 -- 172.21.15.81:0/4020975247 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b40017f0 con 0x7f88bc0ace00 2023-10-06T03:24:12.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.578+0000 7f88c1399700 1 -- 172.21.15.81:0/4020975247 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88ac011420 con 0x7f88bc0ace00 2023-10-06T03:24:12.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.578+0000 7f88c1399700 1 -- 172.21.15.81:0/4020975247 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ac0117c0 con 0x7f88bc0ace00 2023-10-06T03:24:12.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.578+0000 7f88c339d700 1 -- 172.21.15.81:0/4020975247 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f88bc0ace00 msgr2=0x7f88bc0abb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:12.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.578+0000 7f88c339d700 1 --2- 172.21.15.81:0/4020975247 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f88bc0ace00 0x7f88bc0abb80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f88ac009910 tx=0x7f88ac0091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:12.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.578+0000 7f88c339d700 1 -- 172.21.15.81:0/4020975247 shutdown_connections 2023-10-06T03:24:12.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.578+0000 7f88c339d700 1 --2- 172.21.15.81:0/4020975247 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f88bc0ace00 0x7f88bc0abb80 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:12.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.578+0000 7f88c339d700 1 -- 172.21.15.81:0/4020975247 >> 172.21.15.81:0/4020975247 conn(0x7f88bc0cbef0 msgr2=0x7f88bc0cc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:12.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.578+0000 7f88c339d700 1 -- 172.21.15.81:0/4020975247 shutdown_connections 2023-10-06T03:24:12.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.578+0000 7f88c339d700 1 -- 172.21.15.81:0/4020975247 wait complete. 2023-10-06T03:24:12.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.580+0000 7f88c339d700 1 Processor -- start 2023-10-06T03:24:12.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.580+0000 7f88c339d700 1 -- start start 2023-10-06T03:24:12.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.581+0000 7f88c339d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88bc06d2d0 0x7f88bc0cb410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:12.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.581+0000 7f88c339d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88bc0ab7b0 0x7f88bc0c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:12.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.581+0000 7f88c339d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f88bc0ace00 0x7f88bc142850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:12.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.581+0000 7f88c339d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88bc15f710 con 0x7f88bc0ab7b0 2023-10-06T03:24:12.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.581+0000 7f88c339d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88bc15c9d0 con 0x7f88bc06d2d0 2023-10-06T03:24:12.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.581+0000 7f88c339d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88bc15c410 con 0x7f88bc0ace00 2023-10-06T03:24:12.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.581+0000 7f88c1b9a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88bc0ab7b0 0x7f88bc0c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:12.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.581+0000 7f88c1b9a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88bc0ab7b0 0x7f88bc0c8ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54534/0 (socket says 172.21.15.81:54534) 2023-10-06T03:24:12.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.581+0000 7f88c1b9a700 1 -- 172.21.15.81:0/1532462550 learned_addr learned my addr 172.21.15.81:0/1532462550 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:12.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.581+0000 7f88c239b700 1 --2- 172.21.15.81:0/1532462550 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88bc06d2d0 0x7f88bc0cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:12.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.581+0000 7f88c2b9c700 1 --2- 172.21.15.81:0/1532462550 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f88bc0ace00 0x7f88bc142850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:12.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.581+0000 7f88c1b9a700 1 -- 172.21.15.81:0/1532462550 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f88bc0ace00 msgr2=0x7f88bc142850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:12.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.581+0000 7f88c1b9a700 1 --2- 172.21.15.81:0/1532462550 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f88bc0ace00 0x7f88bc142850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:12.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.581+0000 7f88c1b9a700 1 -- 172.21.15.81:0/1532462550 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88bc06d2d0 msgr2=0x7f88bc0cb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:12.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.581+0000 7f88c1b9a700 1 --2- 172.21.15.81:0/1532462550 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88bc06d2d0 0x7f88bc0cb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:12.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.581+0000 7f88c1b9a700 1 -- 172.21.15.81:0/1532462550 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ac009420 con 0x7f88bc0ab7b0 2023-10-06T03:24:12.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.582+0000 7f88c1b9a700 1 --2- 172.21.15.81:0/1532462550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88bc0ab7b0 0x7f88bc0c8ac0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f88ac0091e0 tx=0x7f88ac016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:12.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.582+0000 7f88b27fc700 1 -- 172.21.15.81:0/1532462550 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ac01cb30 con 0x7f88bc0ab7b0 2023-10-06T03:24:12.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.582+0000 7f88b27fc700 1 -- 172.21.15.81:0/1532462550 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88ac01cc90 con 0x7f88bc0ab7b0 2023-10-06T03:24:12.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.582+0000 7f88c339d700 1 -- 172.21.15.81:0/1532462550 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88bc15c6f0 con 0x7f88bc0ab7b0 2023-10-06T03:24:12.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.582+0000 7f88b27fc700 1 -- 172.21.15.81:0/1532462550 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ac01a6a0 con 0x7f88bc0ab7b0 2023-10-06T03:24:12.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.582+0000 7f88c339d700 1 -- 172.21.15.81:0/1532462550 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88bc15f3a0 con 0x7f88bc0ab7b0 2023-10-06T03:24:12.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.583+0000 7f88c339d700 1 -- 172.21.15.81:0/1532462550 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88bc0ad570 con 0x7f88bc0ab7b0 2023-10-06T03:24:12.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.584+0000 7f88b27fc700 1 -- 172.21.15.81:0/1532462550 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f88ac01aad0 con 0x7f88bc0ab7b0 2023-10-06T03:24:12.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.585+0000 7f88b27fc700 1 --2- 172.21.15.81:0/1532462550 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f88a0066f30 0x7f88a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:12.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.585+0000 7f88b27fc700 1 -- 172.21.15.81:0/1532462550 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f88ac086770 con 0x7f88bc0ab7b0 2023-10-06T03:24:12.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.585+0000 7f88c239b700 1 --2- 172.21.15.81:0/1532462550 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f88a0066f30 0x7f88a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:12.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.586+0000 7f88c239b700 1 --2- 172.21.15.81:0/1532462550 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f88a0066f30 0x7f88a00693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f88b8007fd0 tx=0x7f88b8007d50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:12.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.589+0000 7f88b27fc700 1 -- 172.21.15.81:0/1532462550 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f88ac0534f0 con 0x7f88bc0ab7b0 2023-10-06T03:24:12.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.831+0000 7f88c339d700 1 -- 172.21.15.81:0/1532462550 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f88bc0ac030 con 0x7f88bc0ab7b0 2023-10-06T03:24:12.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.831+0000 7f88b27fc700 1 -- 172.21.15.81:0/1532462550 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f88ac056b10 con 0x7f88bc0ab7b0 2023-10-06T03:24:12.833 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T03:24:12.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.833+0000 7f88c339d700 1 -- 172.21.15.81:0/1532462550 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f88a0066f30 msgr2=0x7f88a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:12.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.833+0000 7f88c339d700 1 --2- 172.21.15.81:0/1532462550 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f88a0066f30 0x7f88a00693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f88b8007fd0 tx=0x7f88b8007d50 comp rx=0 tx=0).stop 2023-10-06T03:24:12.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.833+0000 7f88c339d700 1 -- 172.21.15.81:0/1532462550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88bc0ab7b0 msgr2=0x7f88bc0c8ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:12.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.833+0000 7f88c339d700 1 --2- 172.21.15.81:0/1532462550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88bc0ab7b0 0x7f88bc0c8ac0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f88ac0091e0 tx=0x7f88ac016000 comp rx=0 tx=0).stop 2023-10-06T03:24:12.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.834+0000 7f88c339d700 1 -- 172.21.15.81:0/1532462550 shutdown_connections 2023-10-06T03:24:12.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.834+0000 7f88c339d700 1 --2- 172.21.15.81:0/1532462550 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f88a0066f30 0x7f88a00693e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:12.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.834+0000 7f88c339d700 1 --2- 172.21.15.81:0/1532462550 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f88bc0ace00 0x7f88bc142850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:12.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.834+0000 7f88c339d700 1 --2- 172.21.15.81:0/1532462550 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88bc06d2d0 0x7f88bc0cb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:12.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.834+0000 7f88c339d700 1 --2- 172.21.15.81:0/1532462550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88bc0ab7b0 0x7f88bc0c8ac0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:12.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.834+0000 7f88c339d700 1 -- 172.21.15.81:0/1532462550 >> 172.21.15.81:0/1532462550 conn(0x7f88bc0cbef0 msgr2=0x7f88bc0afba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:12.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.834+0000 7f88c339d700 1 -- 172.21.15.81:0/1532462550 shutdown_connections 2023-10-06T03:24:12.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:12.834+0000 7f88c339d700 1 -- 172.21.15.81:0/1532462550 wait complete. 2023-10-06T03:24:12.853 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T03:24:12.853 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:24:12.853 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2023-10-06T03:24:12.853 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T03:24:12.854 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T03:24:12.854 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T03:24:12.854 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T03:24:12.854 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:24:12.854 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:24:12.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:12.854 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2023-10-06T03:24:12.890 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:24:12.890 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:24:12.891 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:24:12.891 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:12.891 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-10-06T03:24:12.891 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:12.891 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:24:12.891 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:24:12.891 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2023-10-06T03:24:12.891 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:24:12.891 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:24:12.891 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2023-10-06T03:24:12.891 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:24:12.892 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:24:12.892 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:24:12.892 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:24:12.892 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T03:24:12.892 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42245sec preferred_lft 42245sec 2023-10-06T03:24:12.892 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2023-10-06T03:24:12.892 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:12.892 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T03:24:12.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:12.893 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-06T03:24:12.893 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-06T03:24:12.893 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add name ceph-brx type bridge 2023-10-06T03:24:12.893 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr flush dev ceph-brx 2023-10-06T03:24:12.893 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set ceph-brx up 2023-10-06T03:24:12.893 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T03:24:12.893 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-06T03:24:13.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:13.111 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:24:13.170 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-10-06T03:24:13.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:13.173 DEBUG:teuthology.orchestra.run.smithi081:> route 2023-10-06T03:24:13.211 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2023-10-06T03:24:13.211 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:24:13.211 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:24:13.211 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T03:24:13.211 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:24:13.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:13.212 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-06T03:24:13.212 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-06T03:24:13.213 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:24:13.213 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:24:13.213 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:24:13.213 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-06T03:24:13.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:13.407 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-10-06T03:24:13.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:13.443 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list-id 2023-10-06T03:24:13.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:13.519 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-06T03:24:13.519 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-06T03:24:13.519 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T03:24:13.519 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-06T03:24:13.519 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-06T03:24:13.686 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-06T03:24:13.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:13.686 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-06T03:24:13.687 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-06T03:24:13.687 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-06T03:24:13.687 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T03:24:13.687 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-06T03:24:13.687 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-06T03:24:13.687 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-06T03:24:13.687 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-06T03:24:13.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:13.913 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-06T03:24:13.913 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-06T03:24:13.913 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2023-10-06T03:24:13.913 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T03:24:13.913 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-06T03:24:14.067 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:24:14.067 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T03:24:14.103 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:24:14.104 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:24:14.104 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:24:14.179 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-06T03:24:14.180 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:24:14.180 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:24:14.309 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:24:14.309 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:24:14.781 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:24:14.781 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:24:14.781 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T03:24:14.781 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with new device syntax: 0@1807b5d7-9be8-43ad-aaf8-99a4273430b3.cephfs=/ 2023-10-06T03:24:14.781 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T03:24:14.786 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T03:24:14.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:14.786 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:24:14.852 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-10-06T03:24:14.852 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:24:15.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.037+0000 7fab9559d700 1 Processor -- start 2023-10-06T03:24:15.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.037+0000 7fab9559d700 1 -- start start 2023-10-06T03:24:15.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.037+0000 7fab9559d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fab900cc670 0x7fab900ccd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:15.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.037+0000 7fab9559d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fab900b2420 0x7fab9015a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:15.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.037+0000 7fab9559d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab900b4760 con 0x7fab9015a450 2023-10-06T03:24:15.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.037+0000 7fab9559d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab900b60f0 con 0x7fab900b2420 2023-10-06T03:24:15.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.037+0000 7fab9559d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab900cd320 con 0x7fab900cc670 2023-10-06T03:24:15.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.037+0000 7fab94d9c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fab900b2420 0x7fab9015a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:15.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.038+0000 7fab94d9c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fab900b2420 0x7fab9015a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54542/0 (socket says 172.21.15.81:54542) 2023-10-06T03:24:15.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.038+0000 7fab94d9c700 1 -- 172.21.15.81:0/3775783679 learned_addr learned my addr 172.21.15.81:0/3775783679 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:15.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.038+0000 7fab8f7fe700 1 --1- 172.21.15.81:0/3775783679 >> v1:172.21.15.81:6789/0 conn(0x7fab9015a450 0x7fab900b1d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59476/0 (socket says 172.21.15.81:59476) 2023-10-06T03:24:15.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.038+0000 7fab8ffff700 1 --2- 172.21.15.81:0/3775783679 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fab900cc670 0x7fab900ccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:15.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.038+0000 7fab94d9c700 1 -- 172.21.15.81:0/3775783679 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fab900cc670 msgr2=0x7fab900ccd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:15.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.038+0000 7fab94d9c700 1 --2- 172.21.15.81:0/3775783679 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fab900cc670 0x7fab900ccd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:15.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.038+0000 7fab94d9c700 1 -- 172.21.15.81:0/3775783679 >> v1:172.21.15.81:6789/0 conn(0x7fab9015a450 legacy=0x7fab900b1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:15.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.038+0000 7fab94d9c700 1 -- 172.21.15.81:0/3775783679 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab900b3e30 con 0x7fab900b2420 2023-10-06T03:24:15.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.038+0000 7fab8effd700 1 -- 172.21.15.81:0/3775783679 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1592180113 0 0) 0x7fab900b4760 con 0x7fab9015a450 2023-10-06T03:24:15.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.038+0000 7fab94d9c700 1 --2- 172.21.15.81:0/3775783679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab900b2420 0x7fab9015a8c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fab88009f20 tx=0x7fab88009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fec3cc10d6098760 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:15.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.038+0000 7fab8effd700 1 -- 172.21.15.81:0/3775783679 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8800e070 con 0x7fab900b2420 2023-10-06T03:24:15.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.039+0000 7fab8effd700 1 -- 172.21.15.81:0/3775783679 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab8800b9d0 con 0x7fab900b2420 2023-10-06T03:24:15.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.039+0000 7fab8effd700 1 -- 172.21.15.81:0/3775783679 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab880092e0 con 0x7fab900b2420 2023-10-06T03:24:15.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.039+0000 7fab9559d700 1 -- 172.21.15.81:0/3775783679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab900b2420 msgr2=0x7fab9015a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:15.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.039+0000 7fab9559d700 1 --2- 172.21.15.81:0/3775783679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab900b2420 0x7fab9015a8c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fab88009f20 tx=0x7fab88009840 comp rx=0 tx=0).stop 2023-10-06T03:24:15.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.039+0000 7fab9559d700 1 -- 172.21.15.81:0/3775783679 shutdown_connections 2023-10-06T03:24:15.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.039+0000 7fab9559d700 1 --2- 172.21.15.81:0/3775783679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab900b2420 0x7fab9015a8c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:15.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.039+0000 7fab9559d700 1 --2- 172.21.15.81:0/3775783679 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fab900cc670 0x7fab900ccd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:15.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.039+0000 7fab9559d700 1 -- 172.21.15.81:0/3775783679 >> 172.21.15.81:0/3775783679 conn(0x7fab9006ed10 msgr2=0x7fab9006f110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:15.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.039+0000 7fab9559d700 1 -- 172.21.15.81:0/3775783679 shutdown_connections 2023-10-06T03:24:15.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.039+0000 7fab9559d700 1 -- 172.21.15.81:0/3775783679 wait complete. 2023-10-06T03:24:15.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.041+0000 7fab9559d700 1 Processor -- start 2023-10-06T03:24:15.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.041+0000 7fab9559d700 1 -- start start 2023-10-06T03:24:15.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.042+0000 7fab9559d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fab900b2420 0x7fab90158690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:15.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.042+0000 7fab9559d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab900cc670 0x7fab901569e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:15.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.042+0000 7fab9559d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fab9015a450 0x7fab90156f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:15.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.042+0000 7fab9559d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab900c5490 con 0x7fab900cc670 2023-10-06T03:24:15.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.042+0000 7fab9559d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab90158200 con 0x7fab9015a450 2023-10-06T03:24:15.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.042+0000 7fab9559d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab901575f0 con 0x7fab900b2420 2023-10-06T03:24:15.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.042+0000 7fab8f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab900cc670 0x7fab901569e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:15.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.042+0000 7fab8f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab900cc670 0x7fab901569e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54550/0 (socket says 172.21.15.81:54550) 2023-10-06T03:24:15.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.042+0000 7fab8f7fe700 1 -- 172.21.15.81:0/2239239075 learned_addr learned my addr 172.21.15.81:0/2239239075 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:15.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.042+0000 7fab8ffff700 1 --2- 172.21.15.81:0/2239239075 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fab900b2420 0x7fab90158690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:15.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.042+0000 7fab94d9c700 1 --2- 172.21.15.81:0/2239239075 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fab9015a450 0x7fab90156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:15.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.042+0000 7fab8f7fe700 1 -- 172.21.15.81:0/2239239075 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fab900b2420 msgr2=0x7fab90158690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:15.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.042+0000 7fab8f7fe700 1 --2- 172.21.15.81:0/2239239075 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fab900b2420 0x7fab90158690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:15.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.042+0000 7fab8f7fe700 1 -- 172.21.15.81:0/2239239075 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fab9015a450 msgr2=0x7fab90156f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:15.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.042+0000 7fab8f7fe700 1 --2- 172.21.15.81:0/2239239075 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fab9015a450 0x7fab90156f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:15.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.042+0000 7fab8f7fe700 1 -- 172.21.15.81:0/2239239075 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab88009ae0 con 0x7fab900cc670 2023-10-06T03:24:15.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.043+0000 7fab8f7fe700 1 --2- 172.21.15.81:0/2239239075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab900cc670 0x7fab901569e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fab8400c5b0 tx=0x7fab84001040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:15.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.043+0000 7fab77fff700 1 -- 172.21.15.81:0/2239239075 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab84005a70 con 0x7fab900cc670 2023-10-06T03:24:15.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.043+0000 7fab77fff700 1 -- 172.21.15.81:0/2239239075 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab84005bd0 con 0x7fab900cc670 2023-10-06T03:24:15.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.043+0000 7fab9559d700 1 -- 172.21.15.81:0/2239239075 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab901578d0 con 0x7fab900cc670 2023-10-06T03:24:15.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.043+0000 7fab77fff700 1 -- 172.21.15.81:0/2239239075 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab840070d0 con 0x7fab900cc670 2023-10-06T03:24:15.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.043+0000 7fab9559d700 1 -- 172.21.15.81:0/2239239075 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab90157e90 con 0x7fab900cc670 2023-10-06T03:24:15.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.044+0000 7fab9559d700 1 -- 172.21.15.81:0/2239239075 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab901583b0 con 0x7fab900cc670 2023-10-06T03:24:15.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.045+0000 7fab77fff700 1 -- 172.21.15.81:0/2239239075 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fab84007480 con 0x7fab900cc670 2023-10-06T03:24:15.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.046+0000 7fab77fff700 1 --2- 172.21.15.81:0/2239239075 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fab7c066f30 0x7fab7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:15.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.046+0000 7fab77fff700 1 -- 172.21.15.81:0/2239239075 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fab84083f20 con 0x7fab900cc670 2023-10-06T03:24:15.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.046+0000 7fab8ffff700 1 --2- 172.21.15.81:0/2239239075 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fab7c066f30 0x7fab7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:15.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.047+0000 7fab8ffff700 1 --2- 172.21.15.81:0/2239239075 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fab7c066f30 0x7fab7c0693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fab80009d40 tx=0x7fab80008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:15.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.050+0000 7fab77fff700 1 -- 172.21.15.81:0/2239239075 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fab901583b0 con 0x7fab900cc670 2023-10-06T03:24:15.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.285+0000 7fab9559d700 1 -- 172.21.15.81:0/2239239075 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fab90158370 con 0x7fab900cc670 2023-10-06T03:24:15.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.285+0000 7fab77fff700 1 -- 172.21.15.81:0/2239239075 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fab84017020 con 0x7fab900cc670 2023-10-06T03:24:15.288 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T03:24:15.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.288+0000 7fab9559d700 1 -- 172.21.15.81:0/2239239075 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fab7c066f30 msgr2=0x7fab7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:15.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.288+0000 7fab9559d700 1 --2- 172.21.15.81:0/2239239075 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fab7c066f30 0x7fab7c0693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fab80009d40 tx=0x7fab80008040 comp rx=0 tx=0).stop 2023-10-06T03:24:15.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.288+0000 7fab9559d700 1 -- 172.21.15.81:0/2239239075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab900cc670 msgr2=0x7fab901569e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:15.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.288+0000 7fab9559d700 1 --2- 172.21.15.81:0/2239239075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab900cc670 0x7fab901569e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fab8400c5b0 tx=0x7fab84001040 comp rx=0 tx=0).stop 2023-10-06T03:24:15.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.288+0000 7fab9559d700 1 -- 172.21.15.81:0/2239239075 shutdown_connections 2023-10-06T03:24:15.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.288+0000 7fab9559d700 1 --2- 172.21.15.81:0/2239239075 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fab9015a450 0x7fab90156f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:15.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.288+0000 7fab9559d700 1 --2- 172.21.15.81:0/2239239075 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fab7c066f30 0x7fab7c0693e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:15.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.288+0000 7fab9559d700 1 --2- 172.21.15.81:0/2239239075 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fab900b2420 0x7fab90158690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:15.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.288+0000 7fab9559d700 1 --2- 172.21.15.81:0/2239239075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab900cc670 0x7fab901569e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:15.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.288+0000 7fab9559d700 1 -- 172.21.15.81:0/2239239075 >> 172.21.15.81:0/2239239075 conn(0x7fab9006ed10 msgr2=0x7fab900b4bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:15.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.288+0000 7fab9559d700 1 -- 172.21.15.81:0/2239239075 shutdown_connections 2023-10-06T03:24:15.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:15.288+0000 7fab9559d700 1 -- 172.21.15.81:0/2239239075 wait complete. 2023-10-06T03:24:15.307 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T03:24:15.308 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:24:15.308 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2023-10-06T03:24:15.308 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-06T03:24:15.308 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-06T03:24:15.308 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T03:24:15.308 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T03:24:15.308 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:24:15.308 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-06T03:24:15.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:15.308 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2023-10-06T03:24:15.347 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:24:15.347 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:24:15.347 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:24:15.347 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:15.347 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-10-06T03:24:15.347 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:15.347 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:24:15.348 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:24:15.348 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2023-10-06T03:24:15.348 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:24:15.348 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:24:15.348 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2023-10-06T03:24:15.348 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:24:15.348 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:24:15.348 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:24:15.348 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:24:15.348 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T03:24:15.348 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42243sec preferred_lft 42243sec 2023-10-06T03:24:15.348 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2023-10-06T03:24:15.349 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:15.349 INFO:teuthology.orchestra.run.smithi081.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:24:15.349 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 66:05:4b:05:47:f7 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:24:15.349 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T03:24:15.349 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:15.349 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::e80b:69ff:fe9b:cd37/64 scope link 2023-10-06T03:24:15.349 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:15.349 INFO:teuthology.orchestra.run.smithi081.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:24:15.349 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 66:05:4b:05:47:f7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T03:24:15.349 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::6405:4bff:fe05:47f7/64 scope link tentative 2023-10-06T03:24:15.349 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:15.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:15.350 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:24:15.448 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-10-06T03:24:15.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:15.451 DEBUG:teuthology.orchestra.run.smithi081:> route 2023-10-06T03:24:15.492 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2023-10-06T03:24:15.492 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:24:15.492 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:24:15.492 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T03:24:15.492 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:24:15.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:15.492 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-06T03:24:15.493 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-06T03:24:15.493 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:24:15.493 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:24:15.493 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:24:15.493 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-06T03:24:15.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:15.689 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-10-06T03:24:15.728 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T03:24:15.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:15.728 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list-id 2023-10-06T03:24:15.806 INFO:teuthology.orchestra.run.smithi081.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-06T03:24:15.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:15.807 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-06T03:24:15.807 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-06T03:24:15.808 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T03:24:15.808 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-06T03:24:15.808 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-06T03:24:15.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:15.975 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-06T03:24:16.035 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:24:16.036 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:24:16.036 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:24:16.036 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:16.036 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-10-06T03:24:16.036 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:16.036 INFO:teuthology.orchestra.run.smithi081.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:24:16.036 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 36:ac:80:8c:6d:39 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T03:24:16.036 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T03:24:16.036 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:16.036 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::34ac:80ff:fe8c:6d39/64 scope link 2023-10-06T03:24:16.037 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:16.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:16.039 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-06T03:24:16.101 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:24:16.101 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:24:16.101 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:24:16.101 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:16.101 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-10-06T03:24:16.102 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:16.102 INFO:teuthology.orchestra.run.smithi081.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:24:16.102 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 36:ac:80:8c:6d:39 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T03:24:16.102 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T03:24:16.102 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:16.102 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::34ac:80ff:fe8c:6d39/64 scope link 2023-10-06T03:24:16.102 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:16.104 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-06T03:24:16.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:16.104 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-06T03:24:16.104 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-06T03:24:16.104 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-06T03:24:16.104 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-06T03:24:16.105 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-06T03:24:16.105 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-06T03:24:16.105 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-06T03:24:16.105 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-06T03:24:16.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:16.337 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-06T03:24:16.337 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-06T03:24:16.337 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.1 up 2023-10-06T03:24:16.338 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set dev brx.1 master ceph-brx 2023-10-06T03:24:16.338 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-06T03:24:16.492 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:24:16.493 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-06T03:24:16.528 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-06T03:24:16.529 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:24:16.529 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-06T03:24:16.603 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-10-06T03:24:16.604 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:24:16.604 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:24:16.733 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:24:16.733 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:24:16.763 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:24:16.763 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:24:16.763 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T03:24:16.763 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with new device syntax: 2@1807b5d7-9be8-43ad-aaf8-99a4273430b3.cephfs=/ 2023-10-06T03:24:16.763 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T03:24:16.768 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T03:24:16.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:16.768 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-06T03:24:16.828 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-10-06T03:24:16.829 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:24:17.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.010+0000 7f69d1f9d700 1 Processor -- start 2023-10-06T03:24:17.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.010+0000 7f69d1f9d700 1 -- start start 2023-10-06T03:24:17.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.011+0000 7f69d1f9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f69cc0af1a0 0x7f69cc0b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:17.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.011+0000 7f69d1f9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f69cc0af570 0x7f69cc0affe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:17.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.012+0000 7f69d1f9d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69cc0b2d80 con 0x7f69cc0675e0 2023-10-06T03:24:17.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.012+0000 7f69d1f9d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69cc0b1f60 con 0x7f69cc0af570 2023-10-06T03:24:17.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.012+0000 7f69d1f9d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69cc0b2170 con 0x7f69cc0af1a0 2023-10-06T03:24:17.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.012+0000 7f69cbfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f69cc0af570 0x7f69cc0affe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:17.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.012+0000 7f69cbfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f69cc0af570 0x7f69cc0affe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54560/0 (socket says 172.21.15.81:54560) 2023-10-06T03:24:17.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.012+0000 7f69cbfff700 1 -- 172.21.15.81:0/1819461612 learned_addr learned my addr 172.21.15.81:0/1819461612 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:17.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.012+0000 7f69d0f9b700 1 --2- 172.21.15.81:0/1819461612 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f69cc0af1a0 0x7f69cc0b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:17.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.012+0000 7f69cbfff700 1 -- 172.21.15.81:0/1819461612 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f69cc0af1a0 msgr2=0x7f69cc0b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:17.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.012+0000 7f69cbfff700 1 --2- 172.21.15.81:0/1819461612 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f69cc0af1a0 0x7f69cc0b1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:17.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.012+0000 7f69cbfff700 1 -- 172.21.15.81:0/1819461612 >> v1:172.21.15.83:6789/0 conn(0x7f69cc0675e0 legacy=0x7f69cc158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:17.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.012+0000 7f69cbfff700 1 -- 172.21.15.81:0/1819461612 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69cc0b2450 con 0x7f69cc0af570 2023-10-06T03:24:17.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.013+0000 7f69cbfff700 1 --2- 172.21.15.81:0/1819461612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69cc0af570 0x7f69cc0affe0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f69b80099b0 tx=0x7f69b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3bb7b6b645d7bb8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:17.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.013+0000 7f69cb7fe700 1 -- 172.21.15.81:0/1819461612 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b8009ea0 con 0x7f69cc0af570 2023-10-06T03:24:17.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.013+0000 7f69cb7fe700 1 -- 172.21.15.81:0/1819461612 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69b800b860 con 0x7f69cc0af570 2023-10-06T03:24:17.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.013+0000 7f69cb7fe700 1 -- 172.21.15.81:0/1819461612 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b800bc00 con 0x7f69cc0af570 2023-10-06T03:24:17.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.013+0000 7f69d1f9d700 1 -- 172.21.15.81:0/1819461612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69cc0af570 msgr2=0x7f69cc0affe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:17.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.013+0000 7f69d1f9d700 1 --2- 172.21.15.81:0/1819461612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69cc0af570 0x7f69cc0affe0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f69b80099b0 tx=0x7f69b8009250 comp rx=0 tx=0).stop 2023-10-06T03:24:17.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.013+0000 7f69d1f9d700 1 -- 172.21.15.81:0/1819461612 shutdown_connections 2023-10-06T03:24:17.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.013+0000 7f69d1f9d700 1 --2- 172.21.15.81:0/1819461612 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f69cc0af1a0 0x7f69cc0b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:17.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.013+0000 7f69d1f9d700 1 --2- 172.21.15.81:0/1819461612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69cc0af570 0x7f69cc0affe0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:17.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.013+0000 7f69d1f9d700 1 -- 172.21.15.81:0/1819461612 >> 172.21.15.81:0/1819461612 conn(0x7f69cc0cdad0 msgr2=0x7f69cc06c430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:17.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.014+0000 7f69d1f9d700 1 -- 172.21.15.81:0/1819461612 shutdown_connections 2023-10-06T03:24:17.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.014+0000 7f69d1f9d700 1 -- 172.21.15.81:0/1819461612 wait complete. 2023-10-06T03:24:17.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.015+0000 7f69d1f9d700 1 Processor -- start 2023-10-06T03:24:17.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.015+0000 7f69d1f9d700 1 -- start start 2023-10-06T03:24:17.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.016+0000 7f69d1f9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f69cc0675e0 0x7f69cc0c5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:17.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.016+0000 7f69d1f9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69cc0af1a0 0x7f69cc0c6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:17.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.016+0000 7f69d1f9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69cc0af570 0x7f69cc16d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:17.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.016+0000 7f69d1f9d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69cc0c8700 con 0x7f69cc0af1a0 2023-10-06T03:24:17.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.016+0000 7f69d1f9d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69cc0c7b30 con 0x7f69cc0af570 2023-10-06T03:24:17.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.016+0000 7f69d1f9d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69cc0c7dd0 con 0x7f69cc0675e0 2023-10-06T03:24:17.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.016+0000 7f69cbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69cc0af1a0 0x7f69cc0c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:17.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.016+0000 7f69cbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69cc0af1a0 0x7f69cc0c6970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54576/0 (socket says 172.21.15.81:54576) 2023-10-06T03:24:17.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.016+0000 7f69cbfff700 1 -- 172.21.15.81:0/1875529453 learned_addr learned my addr 172.21.15.81:0/1875529453 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:17.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.017+0000 7f69d0f9b700 1 --2- 172.21.15.81:0/1875529453 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f69cc0675e0 0x7f69cc0c5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:17.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.017+0000 7f69cbfff700 1 -- 172.21.15.81:0/1875529453 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f69cc0675e0 msgr2=0x7f69cc0c5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:17.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.017+0000 7f69d179c700 1 --2- 172.21.15.81:0/1875529453 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69cc0af570 0x7f69cc16d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:17.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.017+0000 7f69cbfff700 1 --2- 172.21.15.81:0/1875529453 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f69cc0675e0 0x7f69cc0c5720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:17.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.017+0000 7f69cbfff700 1 -- 172.21.15.81:0/1875529453 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69cc0af570 msgr2=0x7f69cc16d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:17.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.017+0000 7f69cbfff700 1 --2- 172.21.15.81:0/1875529453 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69cc0af570 0x7f69cc16d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:17.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.017+0000 7f69cbfff700 1 -- 172.21.15.81:0/1875529453 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b80094f0 con 0x7f69cc0af1a0 2023-10-06T03:24:17.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.017+0000 7f69d179c700 1 --2- 172.21.15.81:0/1875529453 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69cc0af570 0x7f69cc16d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:17.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.017+0000 7f69d0f9b700 1 --2- 172.21.15.81:0/1875529453 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f69cc0675e0 0x7f69cc0c5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:17.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.017+0000 7f69cbfff700 1 --2- 172.21.15.81:0/1875529453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69cc0af1a0 0x7f69cc0c6970 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f69cc0ac4c0 tx=0x7f69b8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:17.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.017+0000 7f69c8ff9700 1 -- 172.21.15.81:0/1875529453 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b800bbe0 con 0x7f69cc0af1a0 2023-10-06T03:24:17.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.017+0000 7f69c8ff9700 1 -- 172.21.15.81:0/1875529453 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69b8011420 con 0x7f69cc0af1a0 2023-10-06T03:24:17.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.017+0000 7f69c8ff9700 1 -- 172.21.15.81:0/1875529453 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b80117c0 con 0x7f69cc0af1a0 2023-10-06T03:24:17.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.017+0000 7f69d1f9d700 1 -- 172.21.15.81:0/1875529453 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69cc0c80b0 con 0x7f69cc0af1a0 2023-10-06T03:24:17.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.018+0000 7f69d1f9d700 1 -- 172.21.15.81:0/1875529453 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69cc0c8b90 con 0x7f69cc0af1a0 2023-10-06T03:24:17.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.018+0000 7f69d1f9d700 1 -- 172.21.15.81:0/1875529453 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69cc04c3c0 con 0x7f69cc0af1a0 2023-10-06T03:24:17.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.019+0000 7f69c8ff9700 1 -- 172.21.15.81:0/1875529453 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f69b8011bf0 con 0x7f69cc0af1a0 2023-10-06T03:24:17.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.020+0000 7f69c8ff9700 1 --2- 172.21.15.81:0/1875529453 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f69b0066f30 0x7f69b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:17.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.020+0000 7f69c8ff9700 1 -- 172.21.15.81:0/1875529453 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f69b80862a0 con 0x7f69cc0af1a0 2023-10-06T03:24:17.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.020+0000 7f69d0f9b700 1 --2- 172.21.15.81:0/1875529453 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f69b0066f30 0x7f69b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:17.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.021+0000 7f69d0f9b700 1 --2- 172.21.15.81:0/1875529453 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f69b0066f30 0x7f69b00693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f69c0006f00 tx=0x7f69c0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:17.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.025+0000 7f69c8ff9700 1 -- 172.21.15.81:0/1875529453 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f69b8053020 con 0x7f69cc0af1a0 2023-10-06T03:24:17.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.256+0000 7f69d1f9d700 1 -- 172.21.15.81:0/1875529453 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f69cc0c8840 con 0x7f69cc0af1a0 2023-10-06T03:24:17.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.256+0000 7f69c8ff9700 1 -- 172.21.15.81:0/1875529453 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f69b8056640 con 0x7f69cc0af1a0 2023-10-06T03:24:17.257 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T03:24:17.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.258+0000 7f69d1f9d700 1 -- 172.21.15.81:0/1875529453 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f69b0066f30 msgr2=0x7f69b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:17.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.258+0000 7f69d1f9d700 1 --2- 172.21.15.81:0/1875529453 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f69b0066f30 0x7f69b00693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f69c0006f00 tx=0x7f69c0008040 comp rx=0 tx=0).stop 2023-10-06T03:24:17.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.259+0000 7f69d1f9d700 1 -- 172.21.15.81:0/1875529453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69cc0af1a0 msgr2=0x7f69cc0c6970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:17.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.259+0000 7f69d1f9d700 1 --2- 172.21.15.81:0/1875529453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69cc0af1a0 0x7f69cc0c6970 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f69cc0ac4c0 tx=0x7f69b8017000 comp rx=0 tx=0).stop 2023-10-06T03:24:17.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.259+0000 7f69d1f9d700 1 -- 172.21.15.81:0/1875529453 shutdown_connections 2023-10-06T03:24:17.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.259+0000 7f69d1f9d700 1 --2- 172.21.15.81:0/1875529453 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69cc0af570 0x7f69cc16d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:17.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.259+0000 7f69d1f9d700 1 --2- 172.21.15.81:0/1875529453 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f69b0066f30 0x7f69b00693e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:17.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.259+0000 7f69d1f9d700 1 --2- 172.21.15.81:0/1875529453 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f69cc0675e0 0x7f69cc0c5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:17.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.259+0000 7f69d1f9d700 1 --2- 172.21.15.81:0/1875529453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69cc0af1a0 0x7f69cc0c6970 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:17.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.259+0000 7f69d1f9d700 1 -- 172.21.15.81:0/1875529453 >> 172.21.15.81:0/1875529453 conn(0x7f69cc0cdad0 msgr2=0x7f69cc06c360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:17.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.259+0000 7f69d1f9d700 1 -- 172.21.15.81:0/1875529453 shutdown_connections 2023-10-06T03:24:17.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:17.259+0000 7f69d1f9d700 1 -- 172.21.15.81:0/1875529453 wait complete. 2023-10-06T03:24:17.277 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T03:24:17.277 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:24:17.277 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi083.front.sepia.ceph.com 2023-10-06T03:24:17.277 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T03:24:17.277 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T03:24:17.277 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T03:24:17.277 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T03:24:17.277 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:24:17.277 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T03:24:17.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:17.278 DEBUG:teuthology.orchestra.run.smithi083:> ip addr 2023-10-06T03:24:17.318 INFO:teuthology.orchestra.run.smithi083.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:24:17.318 INFO:teuthology.orchestra.run.smithi083.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:24:17.318 INFO:teuthology.orchestra.run.smithi083.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:24:17.318 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:17.318 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 ::1/128 scope host 2023-10-06T03:24:17.319 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:17.319 INFO:teuthology.orchestra.run.smithi083.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:24:17.319 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1e brd ff:ff:ff:ff:ff:ff 2023-10-06T03:24:17.319 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f0 2023-10-06T03:24:17.319 INFO:teuthology.orchestra.run.smithi083.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:24:17.319 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1f brd ff:ff:ff:ff:ff:ff 2023-10-06T03:24:17.319 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f1 2023-10-06T03:24:17.319 INFO:teuthology.orchestra.run.smithi083.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:24:17.319 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:90 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:24:17.320 INFO:teuthology.orchestra.run.smithi083.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:24:17.320 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:91 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:24:17.320 INFO:teuthology.orchestra.run.smithi083.stdout: inet 172.21.15.83/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T03:24:17.320 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft 42293sec preferred_lft 42293sec 2023-10-06T03:24:17.320 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::ec4:7aff:fe8f:ce91/64 scope link 2023-10-06T03:24:17.320 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:17.320 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T03:24:17.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:17.321 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-10-06T03:24:17.321 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-10-06T03:24:17.321 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link add name ceph-brx type bridge 2023-10-06T03:24:17.321 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip addr flush dev ceph-brx 2023-10-06T03:24:17.322 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set ceph-brx up 2023-10-06T03:24:17.322 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T03:24:17.322 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-10-06T03:24:17.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:17.769 DEBUG:teuthology.orchestra.run.smithi083:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:24:17.833 INFO:teuthology.orchestra.run.smithi083.stdout:1 2023-10-06T03:24:17.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:17.836 DEBUG:teuthology.orchestra.run.smithi083:> route 2023-10-06T03:24:17.887 INFO:teuthology.orchestra.run.smithi083.stdout:Kernel IP routing table 2023-10-06T03:24:17.887 INFO:teuthology.orchestra.run.smithi083.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:24:17.887 INFO:teuthology.orchestra.run.smithi083.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:24:17.887 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T03:24:17.887 INFO:teuthology.orchestra.run.smithi083.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:24:17.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:17.888 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-10-06T03:24:17.889 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-10-06T03:24:17.889 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:24:17.889 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:24:17.889 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:24:17.889 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-10-06T03:24:18.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:18.627 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2023-10-06T03:24:18.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:18.663 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list-id 2023-10-06T03:24:18.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:18.739 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-10-06T03:24:18.739 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-10-06T03:24:18.739 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T03:24:18.739 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-06T03:24:18.739 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-10-06T03:24:18.906 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-06T03:24:18.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:18.906 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-10-06T03:24:18.906 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-10-06T03:24:18.906 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-06T03:24:18.907 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T03:24:18.907 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-06T03:24:18.907 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-06T03:24:18.907 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-06T03:24:18.907 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-10-06T03:24:19.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:19.152 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-10-06T03:24:19.152 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-10-06T03:24:19.152 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set brx.0 up 2023-10-06T03:24:19.152 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T03:24:19.152 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-10-06T03:24:19.309 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:24:19.309 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T03:24:19.345 INFO:teuthology.orchestra.run.smithi083.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T03:24:19.345 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:24:19.345 DEBUG:teuthology.orchestra.run.smithi083:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T03:24:19.420 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-06T03:24:19.420 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:24:19.421 DEBUG:teuthology.orchestra.run.smithi083:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:24:19.556 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:24:19.556 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:24:20.006 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:24:20.007 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:24:20.007 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T03:24:20.007 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: trying mount with new device syntax: 1@1807b5d7-9be8-43ad-aaf8-99a4273430b3.cephfs=/ 2023-10-06T03:24:20.007 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T03:24:20.011 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T03:24:20.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:20.011 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T03:24:20.071 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-10-06T03:24:20.072 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:24:20.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.262+0000 7f53eb9ff700 1 Processor -- start 2023-10-06T03:24:20.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.262+0000 7f53eb9ff700 1 -- start start 2023-10-06T03:24:20.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.264+0000 7f53eb9ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f53e40c6b10 0x7f53e4140710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:20.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.264+0000 7f53eb9ff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53e406a190 con 0x7f53e406d680 2023-10-06T03:24:20.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.264+0000 7f53eb9ff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53e40af560 con 0x7f53e406da50 2023-10-06T03:24:20.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.264+0000 7f53eb9ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53e4069650 con 0x7f53e40c6b10 2023-10-06T03:24:20.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.264+0000 7f53e9f9c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f53e40c6b10 0x7f53e4140710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:20.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.264+0000 7f53e979b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f53e406d680 0x7f53e40c7aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33156/0 (socket says 172.21.15.81:33156) 2023-10-06T03:24:20.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.264+0000 7f53e979b700 1 -- 172.21.15.81:0/3905629403 learned_addr learned my addr 172.21.15.81:0/3905629403 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:24:20.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.264+0000 7f53dbfff700 1 -- 172.21.15.81:0/3905629403 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1191914321 0 0) 0x7f53e406a190 con 0x7f53e406d680 2023-10-06T03:24:20.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.264+0000 7f53dbfff700 1 -- 172.21.15.81:0/3905629403 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53d0003570 con 0x7f53e406d680 2023-10-06T03:24:20.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.264+0000 7f53e9f9c700 1 -- 172.21.15.81:0/3905629403 >> v1:172.21.15.83:6789/0 conn(0x7f53e406da50 legacy=0x7f53e40aee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:20.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.264+0000 7f53e9f9c700 1 -- 172.21.15.81:0/3905629403 >> v1:172.21.15.81:6789/0 conn(0x7f53e406d680 legacy=0x7f53e40c7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:20.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.264+0000 7f53e9f9c700 1 -- 172.21.15.81:0/3905629403 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e4069860 con 0x7f53e40c6b10 2023-10-06T03:24:20.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.265+0000 7f53e9f9c700 1 --2- 172.21.15.81:0/3905629403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53e40c6b10 0x7f53e4140710 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f53dc009e60 tx=0x7f53dc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4b0943cd6e97b4a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:20.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.265+0000 7f53dbfff700 1 -- 172.21.15.81:0/3905629403 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53dc00e070 con 0x7f53e40c6b10 2023-10-06T03:24:20.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.265+0000 7f53dbfff700 1 -- 172.21.15.81:0/3905629403 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53dc00bb60 con 0x7f53e40c6b10 2023-10-06T03:24:20.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.265+0000 7f53dbfff700 1 -- 172.21.15.81:0/3905629403 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53dc012430 con 0x7f53e40c6b10 2023-10-06T03:24:20.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.265+0000 7f53eb9ff700 1 -- 172.21.15.81:0/3905629403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53e40c6b10 msgr2=0x7f53e4140710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:20.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.265+0000 7f53eb9ff700 1 --2- 172.21.15.81:0/3905629403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53e40c6b10 0x7f53e4140710 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f53dc009e60 tx=0x7f53dc009780 comp rx=0 tx=0).stop 2023-10-06T03:24:20.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.266+0000 7f53eb9ff700 1 -- 172.21.15.81:0/3905629403 shutdown_connections 2023-10-06T03:24:20.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.266+0000 7f53eb9ff700 1 --2- 172.21.15.81:0/3905629403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53e40c6b10 0x7f53e4140710 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:20.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.266+0000 7f53eb9ff700 1 -- 172.21.15.81:0/3905629403 >> 172.21.15.81:0/3905629403 conn(0x7f53e40cc090 msgr2=0x7f53e40cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:20.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.266+0000 7f53eb9ff700 1 -- 172.21.15.81:0/3905629403 shutdown_connections 2023-10-06T03:24:20.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.266+0000 7f53eb9ff700 1 -- 172.21.15.81:0/3905629403 wait complete. 2023-10-06T03:24:20.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.267+0000 7f53eb9ff700 1 Processor -- start 2023-10-06T03:24:20.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.267+0000 7f53eb9ff700 1 -- start start 2023-10-06T03:24:20.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.268+0000 7f53eb9ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f53e406d680 0x7f53e4158d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:20.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.268+0000 7f53eb9ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53e406da50 0x7f53e4156e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:20.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.268+0000 7f53eb9ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f53e40c6b10 0x7f53e415a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:20.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.268+0000 7f53eb9ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e416b650 con 0x7f53e406da50 2023-10-06T03:24:20.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.268+0000 7f53eb9ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e416aa40 con 0x7f53e40c6b10 2023-10-06T03:24:20.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.268+0000 7f53eb9ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53e416ad20 con 0x7f53e406d680 2023-10-06T03:24:20.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.268+0000 7f53e8f9a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53e406da50 0x7f53e4156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:20.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.268+0000 7f53e8f9a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53e406da50 0x7f53e4156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55166/0 (socket says 172.21.15.81:55166) 2023-10-06T03:24:20.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.268+0000 7f53e8f9a700 1 -- 172.21.15.81:0/2874460816 learned_addr learned my addr 172.21.15.81:0/2874460816 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:20.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.268+0000 7f53e9f9c700 1 --2- 172.21.15.81:0/2874460816 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f53e40c6b10 0x7f53e415a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:20.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.269+0000 7f53e979b700 1 --2- 172.21.15.81:0/2874460816 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f53e406d680 0x7f53e4158d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:20.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.269+0000 7f53e8f9a700 1 -- 172.21.15.81:0/2874460816 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f53e406d680 msgr2=0x7f53e4158d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:20.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.269+0000 7f53e8f9a700 1 --2- 172.21.15.81:0/2874460816 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f53e406d680 0x7f53e4158d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:20.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.269+0000 7f53e8f9a700 1 -- 172.21.15.81:0/2874460816 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f53e40c6b10 msgr2=0x7f53e415a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:20.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.269+0000 7f53e8f9a700 1 --2- 172.21.15.81:0/2874460816 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f53e40c6b10 0x7f53e415a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:20.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.269+0000 7f53e8f9a700 1 -- 172.21.15.81:0/2874460816 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53dc009a20 con 0x7f53e406da50 2023-10-06T03:24:20.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.269+0000 7f53e979b700 1 --2- 172.21.15.81:0/2874460816 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f53e406d680 0x7f53e4158d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:20.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.269+0000 7f53e8f9a700 1 --2- 172.21.15.81:0/2874460816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53e406da50 0x7f53e4156e90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f53d400c4e0 tx=0x7f53d400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:20.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.269+0000 7f53d97fa700 1 -- 172.21.15.81:0/2874460816 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d4011590 con 0x7f53e406da50 2023-10-06T03:24:20.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.269+0000 7f53d97fa700 1 -- 172.21.15.81:0/2874460816 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d4011710 con 0x7f53e406da50 2023-10-06T03:24:20.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.269+0000 7f53eb9ff700 1 -- 172.21.15.81:0/2874460816 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53e416b000 con 0x7f53e406da50 2023-10-06T03:24:20.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.269+0000 7f53d97fa700 1 -- 172.21.15.81:0/2874460816 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d4011ad0 con 0x7f53e406da50 2023-10-06T03:24:20.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.269+0000 7f53eb9ff700 1 -- 172.21.15.81:0/2874460816 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53e41573d0 con 0x7f53e406da50 2023-10-06T03:24:20.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.270+0000 7f53eb9ff700 1 -- 172.21.15.81:0/2874460816 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53e404c3c0 con 0x7f53e406da50 2023-10-06T03:24:20.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.271+0000 7f53d97fa700 1 -- 172.21.15.81:0/2874460816 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f53d401b3b0 con 0x7f53e406da50 2023-10-06T03:24:20.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.272+0000 7f53d97fa700 1 --2- 172.21.15.81:0/2874460816 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f53c8066f30 0x7f53c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:20.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.272+0000 7f53d97fa700 1 -- 172.21.15.81:0/2874460816 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f53d4083e30 con 0x7f53e406da50 2023-10-06T03:24:20.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.272+0000 7f53e979b700 1 --2- 172.21.15.81:0/2874460816 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f53c8066f30 0x7f53c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:20.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.273+0000 7f53e979b700 1 --2- 172.21.15.81:0/2874460816 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f53c8066f30 0x7f53c80693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f53e00058d0 tx=0x7f53e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:20.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.276+0000 7f53d97fa700 1 -- 172.21.15.81:0/2874460816 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f53d4050bb0 con 0x7f53e406da50 2023-10-06T03:24:20.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.510+0000 7f53eb9ff700 1 -- 172.21.15.81:0/2874460816 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f53e40ccfb0 con 0x7f53e406da50 2023-10-06T03:24:20.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.510+0000 7f53d97fa700 1 -- 172.21.15.81:0/2874460816 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f53d4017070 con 0x7f53e406da50 2023-10-06T03:24:20.512 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T03:24:20.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.512+0000 7f53eb9ff700 1 -- 172.21.15.81:0/2874460816 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f53c8066f30 msgr2=0x7f53c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:20.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.512+0000 7f53eb9ff700 1 --2- 172.21.15.81:0/2874460816 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f53c8066f30 0x7f53c80693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f53e00058d0 tx=0x7f53e0009040 comp rx=0 tx=0).stop 2023-10-06T03:24:20.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.512+0000 7f53eb9ff700 1 -- 172.21.15.81:0/2874460816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53e406da50 msgr2=0x7f53e4156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:20.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.512+0000 7f53eb9ff700 1 --2- 172.21.15.81:0/2874460816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53e406da50 0x7f53e4156e90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f53d400c4e0 tx=0x7f53d400c7f0 comp rx=0 tx=0).stop 2023-10-06T03:24:20.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.513+0000 7f53eb9ff700 1 -- 172.21.15.81:0/2874460816 shutdown_connections 2023-10-06T03:24:20.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.513+0000 7f53eb9ff700 1 --2- 172.21.15.81:0/2874460816 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f53e40c6b10 0x7f53e415a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:20.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.513+0000 7f53eb9ff700 1 --2- 172.21.15.81:0/2874460816 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f53c8066f30 0x7f53c80693e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:20.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.513+0000 7f53eb9ff700 1 --2- 172.21.15.81:0/2874460816 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f53e406d680 0x7f53e4158d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:20.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.513+0000 7f53eb9ff700 1 --2- 172.21.15.81:0/2874460816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53e406da50 0x7f53e4156e90 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:20.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.513+0000 7f53eb9ff700 1 -- 172.21.15.81:0/2874460816 >> 172.21.15.81:0/2874460816 conn(0x7f53e40cc090 msgr2=0x7f53e40c92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:20.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.513+0000 7f53eb9ff700 1 -- 172.21.15.81:0/2874460816 shutdown_connections 2023-10-06T03:24:20.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:20.513+0000 7f53eb9ff700 1 -- 172.21.15.81:0/2874460816 wait complete. 2023-10-06T03:24:20.531 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T03:24:20.531 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:24:20.531 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi083.front.sepia.ceph.com 2023-10-06T03:24:20.531 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-06T03:24:20.531 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-06T03:24:20.532 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T03:24:20.532 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T03:24:20.532 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:24:20.532 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-06T03:24:20.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:20.532 DEBUG:teuthology.orchestra.run.smithi083:> ip addr 2023-10-06T03:24:20.570 INFO:teuthology.orchestra.run.smithi083.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:24:20.570 INFO:teuthology.orchestra.run.smithi083.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:24:20.570 INFO:teuthology.orchestra.run.smithi083.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:24:20.570 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:20.570 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 ::1/128 scope host 2023-10-06T03:24:20.570 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:20.570 INFO:teuthology.orchestra.run.smithi083.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:24:20.571 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1e brd ff:ff:ff:ff:ff:ff 2023-10-06T03:24:20.571 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f0 2023-10-06T03:24:20.571 INFO:teuthology.orchestra.run.smithi083.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:24:20.571 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1f brd ff:ff:ff:ff:ff:ff 2023-10-06T03:24:20.571 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f1 2023-10-06T03:24:20.571 INFO:teuthology.orchestra.run.smithi083.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:24:20.571 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:90 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:24:20.571 INFO:teuthology.orchestra.run.smithi083.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:24:20.571 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:91 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:24:20.571 INFO:teuthology.orchestra.run.smithi083.stdout: inet 172.21.15.83/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T03:24:20.571 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft 42289sec preferred_lft 42289sec 2023-10-06T03:24:20.572 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::ec4:7aff:fe8f:ce91/64 scope link 2023-10-06T03:24:20.572 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:20.572 INFO:teuthology.orchestra.run.smithi083.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:24:20.572 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 46:88:aa:87:38:ff brd ff:ff:ff:ff:ff:ff 2023-10-06T03:24:20.572 INFO:teuthology.orchestra.run.smithi083.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T03:24:20.572 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:20.572 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::f009:c8ff:fe81:b914/64 scope link 2023-10-06T03:24:20.572 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:20.572 INFO:teuthology.orchestra.run.smithi083.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:24:20.572 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 46:88:aa:87:38:ff brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T03:24:20.572 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::4488:aaff:fe87:38ff/64 scope link tentative 2023-10-06T03:24:20.573 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:20.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:20.573 DEBUG:teuthology.orchestra.run.smithi083:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:24:20.670 INFO:teuthology.orchestra.run.smithi083.stdout:1 2023-10-06T03:24:20.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:20.673 DEBUG:teuthology.orchestra.run.smithi083:> route 2023-10-06T03:24:20.711 INFO:teuthology.orchestra.run.smithi083.stdout:Kernel IP routing table 2023-10-06T03:24:20.712 INFO:teuthology.orchestra.run.smithi083.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:24:20.712 INFO:teuthology.orchestra.run.smithi083.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:24:20.712 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T03:24:20.712 INFO:teuthology.orchestra.run.smithi083.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:24:20.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:20.713 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-10-06T03:24:20.713 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-10-06T03:24:20.713 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:24:20.713 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:24:20.713 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:24:20.714 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-10-06T03:24:20.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:20.908 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2023-10-06T03:24:20.945 INFO:teuthology.orchestra.run.smithi083.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T03:24:20.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:20.945 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list-id 2023-10-06T03:24:21.020 INFO:teuthology.orchestra.run.smithi083.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-06T03:24:21.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:21.021 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-10-06T03:24:21.021 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-10-06T03:24:21.021 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T03:24:21.021 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-06T03:24:21.021 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-10-06T03:24:21.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:21.186 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-06T03:24:21.247 INFO:teuthology.orchestra.run.smithi083.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:24:21.247 INFO:teuthology.orchestra.run.smithi083.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:24:21.247 INFO:teuthology.orchestra.run.smithi083.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:24:21.247 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:21.248 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 ::1/128 scope host 2023-10-06T03:24:21.248 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:21.248 INFO:teuthology.orchestra.run.smithi083.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:24:21.248 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 16:d7:59:28:72:07 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T03:24:21.248 INFO:teuthology.orchestra.run.smithi083.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T03:24:21.248 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:21.248 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::14d7:59ff:fe28:7207/64 scope link 2023-10-06T03:24:21.248 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:21.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:21.250 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-06T03:24:21.310 INFO:teuthology.orchestra.run.smithi083.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:24:21.310 INFO:teuthology.orchestra.run.smithi083.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:24:21.310 INFO:teuthology.orchestra.run.smithi083.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:24:21.310 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:21.310 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 ::1/128 scope host 2023-10-06T03:24:21.310 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:21.311 INFO:teuthology.orchestra.run.smithi083.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:24:21.311 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 16:d7:59:28:72:07 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T03:24:21.311 INFO:teuthology.orchestra.run.smithi083.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T03:24:21.311 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:21.311 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::14d7:59ff:fe28:7207/64 scope link 2023-10-06T03:24:21.311 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:21.313 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-06T03:24:21.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:21.313 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-10-06T03:24:21.313 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-10-06T03:24:21.313 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-06T03:24:21.313 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-06T03:24:21.313 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-06T03:24:21.314 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-06T03:24:21.314 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-06T03:24:21.314 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-10-06T03:24:21.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:21.533 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-10-06T03:24:21.533 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-10-06T03:24:21.533 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set brx.1 up 2023-10-06T03:24:21.533 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set dev brx.1 master ceph-brx 2023-10-06T03:24:21.533 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-10-06T03:24:21.688 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:24:21.688 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-06T03:24:21.724 INFO:teuthology.orchestra.run.smithi083.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-06T03:24:21.725 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:24:21.725 DEBUG:teuthology.orchestra.run.smithi083:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-06T03:24:21.801 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-10-06T03:24:21.801 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:24:21.801 DEBUG:teuthology.orchestra.run.smithi083:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:24:21.930 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:24:21.930 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:24:21.961 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:24:21.961 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:24:21.961 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T03:24:21.961 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: trying mount with new device syntax: 3@1807b5d7-9be8-43ad-aaf8-99a4273430b3.cephfs=/ 2023-10-06T03:24:21.961 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T03:24:21.965 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T03:24:21.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:21.965 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-06T03:24:22.025 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-06T03:24:22.048 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:24:22.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.238+0000 7f4267bff700 1 Processor -- start 2023-10-06T03:24:22.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.238+0000 7f4267bff700 1 -- start start 2023-10-06T03:24:22.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.239+0000 7f4267bff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f426014fe10 0x7f426006db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:22.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.239+0000 7f4267bff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f42601501e0 0x7f426006e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:22.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.239+0000 7f4267bff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42601595b0 0x7f4260159a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:22.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.239+0000 7f4267bff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4260159f90 con 0x7f42601501e0 2023-10-06T03:24:22.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.239+0000 7f4267bff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f426006f290 con 0x7f426014fe10 2023-10-06T03:24:22.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.239+0000 7f4267bff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f426006e680 con 0x7f42601595b0 2023-10-06T03:24:22.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.240+0000 7f426519a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f42601501e0 0x7f426006e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:22.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.240+0000 7f426599b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f426014fe10 0x7f426006db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:22.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.240+0000 7f426619c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42601595b0 0x7f4260159a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:22.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.240+0000 7f426599b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f426014fe10 0x7f426006db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:53164/0 (socket says 172.21.15.81:53164) 2023-10-06T03:24:22.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.240+0000 7f426599b700 1 -- 172.21.15.81:0/65911321 learned_addr learned my addr 172.21.15.81:0/65911321 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:22.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.240+0000 7f426599b700 1 -- 172.21.15.81:0/65911321 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42601595b0 msgr2=0x7f4260159a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:22.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.240+0000 7f426599b700 1 --2- 172.21.15.81:0/65911321 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42601595b0 0x7f4260159a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:22.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.240+0000 7f426599b700 1 -- 172.21.15.81:0/65911321 >> v2:172.21.15.81:3300/0 conn(0x7f42601501e0 msgr2=0x7f426006e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:22.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.240+0000 7f426599b700 1 --2- 172.21.15.81:0/65911321 >> v2:172.21.15.81:3300/0 conn(0x7f42601501e0 0x7f426006e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:22.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.240+0000 7f426599b700 1 -- 172.21.15.81:0/65911321 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f426006e960 con 0x7f426014fe10 2023-10-06T03:24:22.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.240+0000 7f426599b700 1 --2- 172.21.15.81:0/65911321 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f426014fe10 0x7f426006db30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f42600c89e0 tx=0x7f425c009220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b9d64c2861112e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:22.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.241+0000 7f4264999700 1 -- 172.21.15.81:0/65911321 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425c005c10 con 0x7f426014fe10 2023-10-06T03:24:22.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.241+0000 7f4264999700 1 -- 172.21.15.81:0/65911321 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f425c005d70 con 0x7f426014fe10 2023-10-06T03:24:22.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.241+0000 7f4264999700 1 -- 172.21.15.81:0/65911321 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425c006260 con 0x7f426014fe10 2023-10-06T03:24:22.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.241+0000 7f4267bff700 1 -- 172.21.15.81:0/65911321 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f426014fe10 msgr2=0x7f426006db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:22.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.241+0000 7f4267bff700 1 --2- 172.21.15.81:0/65911321 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f426014fe10 0x7f426006db30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f42600c89e0 tx=0x7f425c009220 comp rx=0 tx=0).stop 2023-10-06T03:24:22.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.241+0000 7f4267bff700 1 -- 172.21.15.81:0/65911321 shutdown_connections 2023-10-06T03:24:22.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.241+0000 7f4267bff700 1 --2- 172.21.15.81:0/65911321 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42601595b0 0x7f4260159a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:22.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.241+0000 7f4267bff700 1 --2- 172.21.15.81:0/65911321 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f426014fe10 0x7f426006db30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:22.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.241+0000 7f4267bff700 1 --2- 172.21.15.81:0/65911321 >> v2:172.21.15.81:3300/0 conn(0x7f42601501e0 0x7f426006e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:22.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.241+0000 7f4267bff700 1 -- 172.21.15.81:0/65911321 >> 172.21.15.81:0/65911321 conn(0x7f42600cc010 msgr2=0x7f42600cc410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:22.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.241+0000 7f4267bff700 1 -- 172.21.15.81:0/65911321 shutdown_connections 2023-10-06T03:24:22.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.241+0000 7f4267bff700 1 -- 172.21.15.81:0/65911321 wait complete. 2023-10-06T03:24:22.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.243+0000 7f4267bff700 1 Processor -- start 2023-10-06T03:24:22.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.243+0000 7f4267bff700 1 -- start start 2023-10-06T03:24:22.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.244+0000 7f4267bff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f426014fe10 0x7f42601695b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:22.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.244+0000 7f4267bff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42601501e0 0x7f4260166a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:22.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.244+0000 7f4267bff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f42601595b0 0x7f426015c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:22.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.244+0000 7f4267bff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4260166fc0 con 0x7f426014fe10 2023-10-06T03:24:22.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.244+0000 7f4267bff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f426014d870 con 0x7f42601595b0 2023-10-06T03:24:22.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.244+0000 7f4267bff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4260169b90 con 0x7f42601501e0 2023-10-06T03:24:22.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.244+0000 7f426599b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f426014fe10 0x7f42601695b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:22.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.244+0000 7f426599b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f426014fe10 0x7f42601695b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55184/0 (socket says 172.21.15.81:55184) 2023-10-06T03:24:22.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.244+0000 7f426599b700 1 -- 172.21.15.81:0/300770899 learned_addr learned my addr 172.21.15.81:0/300770899 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:22.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.244+0000 7f426519a700 1 --2- 172.21.15.81:0/300770899 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42601501e0 0x7f4260166a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:22.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.244+0000 7f426619c700 1 --2- 172.21.15.81:0/300770899 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f42601595b0 0x7f426015c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:22.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.244+0000 7f426599b700 1 -- 172.21.15.81:0/300770899 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42601501e0 msgr2=0x7f4260166a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:22.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.244+0000 7f426599b700 1 --2- 172.21.15.81:0/300770899 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42601501e0 0x7f4260166a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:22.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.244+0000 7f426599b700 1 -- 172.21.15.81:0/300770899 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f42601595b0 msgr2=0x7f426015c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:22.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.244+0000 7f426599b700 1 --2- 172.21.15.81:0/300770899 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f42601595b0 0x7f426015c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:22.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.244+0000 7f426599b700 1 -- 172.21.15.81:0/300770899 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f425c009480 con 0x7f426014fe10 2023-10-06T03:24:22.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.245+0000 7f426599b700 1 --2- 172.21.15.81:0/300770899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f426014fe10 0x7f42601695b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f42600cd080 tx=0x7f425c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:22.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.245+0000 7f4255ffb700 1 -- 172.21.15.81:0/300770899 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425c01e070 con 0x7f426014fe10 2023-10-06T03:24:22.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.245+0000 7f4255ffb700 1 -- 172.21.15.81:0/300770899 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f425c00f780 con 0x7f426014fe10 2023-10-06T03:24:22.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.245+0000 7f4267bff700 1 -- 172.21.15.81:0/300770899 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4260169e70 con 0x7f426014fe10 2023-10-06T03:24:22.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.245+0000 7f4255ffb700 1 -- 172.21.15.81:0/300770899 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425c00fb60 con 0x7f426014fe10 2023-10-06T03:24:22.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.245+0000 7f4267bff700 1 -- 172.21.15.81:0/300770899 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f426016a430 con 0x7f426014fe10 2023-10-06T03:24:22.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.246+0000 7f4267bff700 1 -- 172.21.15.81:0/300770899 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f426004c3c0 con 0x7f426014fe10 2023-10-06T03:24:22.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.247+0000 7f4255ffb700 1 -- 172.21.15.81:0/300770899 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f425c019430 con 0x7f426014fe10 2023-10-06T03:24:22.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.248+0000 7f4255ffb700 1 --2- 172.21.15.81:0/300770899 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f4244066f30 0x7f42440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:22.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.248+0000 7f4255ffb700 1 -- 172.21.15.81:0/300770899 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f425c014030 con 0x7f426014fe10 2023-10-06T03:24:22.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.248+0000 7f426519a700 1 --2- 172.21.15.81:0/300770899 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f4244066f30 0x7f42440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:22.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.248+0000 7f426519a700 1 --2- 172.21.15.81:0/300770899 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f4244066f30 0x7f42440693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f42600aac30 tx=0x7f42500091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:22.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.253+0000 7f4255ffb700 1 -- 172.21.15.81:0/300770899 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f425c0527d0 con 0x7f426014fe10 2023-10-06T03:24:22.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.447+0000 7f4267bff700 1 -- 172.21.15.81:0/300770899 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f426006ec40 con 0x7f426014fe10 2023-10-06T03:24:22.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.448+0000 7f4255ffb700 1 -- 172.21.15.81:0/300770899 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18659 (secure 0 0 0) 0x7f425c055df0 con 0x7f426014fe10 2023-10-06T03:24:22.450 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:24:22.450 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"fsid":"1807b5d7-9be8-43ad-aaf8-99a4273430b3","created":"2023-10-06T03:23:20.805306+0000","modified":"2023-10-06T03:23:45.419616+0000","last_up_change":"2023-10-06T03:23:32.735796+0000","last_in_change":"2023-10-06T03:23:24.109024+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:33.198850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:33.606744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:23:38.742266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:23:39.347944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:23:42.959054+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"14fb667d-a677-4978-a477-80027f889d36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":85563},{"type":"v1","addr":"172.21.15.81:6818","nonce":85563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":85563},{"type":"v1","addr":"172.21.15.81:6822","nonce":85563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":85563},{"type":"v1","addr":"172.21.15.81:6830","nonce":85563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":85563},{"type":"v1","addr":"172.21.15.81:6826","nonce":85563}]},"public_addr":"172.21.15.81:6818/85563","cluster_addr":"172.21.15.81:6822/85563","heartbeat_back_addr":"172.21.15.81:6830/85563","heartbeat_front_addr":"172.21.15.81:6826/85563","state":["exists","up"]},{"osd":1,"uuid":"974d8a86-1829-4176-89ce-18e6038857f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":85561},{"type":"v1","addr":"172.21.15.81:6801","nonce":85561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":85561},{"type":"v1","addr":"172.21.15.81:6803","nonce":85561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":85561},{"type":"v1","addr":"172.21.15.81:6807","nonce":85561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":85561},{"type":"v1","addr":"172.21.15.81:6805","nonce":85561}]},"public_addr":"172.21.15.81:6801/85561","cluster_addr":"172.21.15.81:6803/85561","heartbeat_back_addr":"172.21.15.81:6807/85561","heartbeat_front_addr":"172.21.15.81:6805/85561","state":["exists","up"]},{"osd":2,"uuid":"ffbfe056-46bc-46e0-bf49-4d8f8650e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":85564},{"type":"v1","addr":"172.21.15.81:6809","nonce":85564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":85564},{"type":"v1","addr":"172.21.15.81:6811","nonce":85564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":85564},{"type":"v1","addr":"172.21.15.81:6815","nonce":85564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":85564},{"type":"v1","addr":"172.21.15.81:6813","nonce":85564}]},"public_addr":"172.21.15.81:6809/85564","cluster_addr":"172.21.15.81:6811/85564","heartbeat_back_addr":"172.21.15.81:6815/85564","heartbeat_front_addr":"172.21.15.81:6813/85564","state":["exists","up"]},{"osd":3,"uuid":"ef9a8314-3d37-4ea1-858a-e704d5695002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":85562},{"type":"v1","addr":"172.21.15.81:6819","nonce":85562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":85562},{"type":"v1","addr":"172.21.15.81:6823","nonce":85562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":85562},{"type":"v1","addr":"172.21.15.81:6831","nonce":85562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":85562},{"type":"v1","addr":"172.21.15.81:6827","nonce":85562}]},"public_addr":"172.21.15.81:6819/85562","cluster_addr":"172.21.15.81:6823/85562","heartbeat_back_addr":"172.21.15.81:6831/85562","heartbeat_front_addr":"172.21.15.81:6827/85562","state":["exists","up"]},{"osd":4,"uuid":"d83506a0-2c96-4bcb-a9fa-05e43dc329df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":85785},{"type":"v1","addr":"172.21.15.83:6801","nonce":85785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":85785},{"type":"v1","addr":"172.21.15.83:6803","nonce":85785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":85785},{"type":"v1","addr":"172.21.15.83:6807","nonce":85785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":85785},{"type":"v1","addr":"172.21.15.83:6805","nonce":85785}]},"public_addr":"172.21.15.83:6801/85785","cluster_addr":"172.21.15.83:6803/85785","heartbeat_back_addr":"172.21.15.83:6807/85785","heartbeat_front_addr":"172.21.15.83:6805/85785","state":["exists","up"]},{"osd":5,"uuid":"10687c63-a3d5-472f-acc0-4f61847b6e0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":85818},{"type":"v1","addr":"172.21.15.83:6825","nonce":85818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":85818},{"type":"v1","addr":"172.21.15.83:6827","nonce":85818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":85818},{"type":"v1","addr":"172.21.15.83:6831","nonce":85818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":85818},{"type":"v1","addr":"172.21.15.83:6829","nonce":85818}]},"public_addr":"172.21.15.83:6825/85818","cluster_addr":"172.21.15.83:6827/85818","heartbeat_back_addr":"172.21.15.83:6831/85818","heartbeat_front_addr":"172.21.15.83:6829/85818","state":["exists","up"]},{"osd":6,"uuid":"2e9daf76-5607-4a29-9a58-6e270700d223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":85787},{"type":"v1","addr":"172.21.15.83:6811","nonce":85787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":85787},{"type":"v1","addr":"172.21.15.83:6815","nonce":85787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":85787},{"type":"v1","addr":"172.21.15.83:6823","nonce":85787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6817","nonce":85787},{"type":"v1","addr":"172.21.15.83:6819","nonce":85787}]},"public_addr":"172.21.15.83:6811/85787","cluster_addr":"172.21.15.83:6815/85787","heartbeat_back_addr":"172.21.15.83:6823/85787","heartbeat_front_addr":"172.21.15.83:6819/85787","state":["exists","up"]},{"osd":7,"uuid":"5019e1ff-233a-4a5a-91ca-8afccb7ab6e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":85786},{"type":"v1","addr":"172.21.15.83:6810","nonce":85786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":85786},{"type":"v1","addr":"172.21.15.83:6814","nonce":85786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":85786},{"type":"v1","addr":"172.21.15.83:6822","nonce":85786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":85786},{"type":"v1","addr":"172.21.15.83:6818","nonce":85786}]},"public_addr":"172.21.15.83:6810/85786","cluster_addr":"172.21.15.83:6814/85786","heartbeat_back_addr":"172.21.15.83:6822/85786","heartbeat_front_addr":"172.21.15.83:6818/85786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.393431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.360031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.407428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.391613+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.403211+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.438142+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.496181+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.472323+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:24:22.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.451+0000 7f4267bff700 1 -- 172.21.15.81:0/300770899 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f4244066f30 msgr2=0x7f42440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:22.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.451+0000 7f4267bff700 1 --2- 172.21.15.81:0/300770899 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f4244066f30 0x7f42440693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f42600aac30 tx=0x7f42500091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:22.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.451+0000 7f4267bff700 1 -- 172.21.15.81:0/300770899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f426014fe10 msgr2=0x7f42601695b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:22.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.451+0000 7f4267bff700 1 --2- 172.21.15.81:0/300770899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f426014fe10 0x7f42601695b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f42600cd080 tx=0x7f425c018000 comp rx=0 tx=0).stop 2023-10-06T03:24:22.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.451+0000 7f4267bff700 1 -- 172.21.15.81:0/300770899 shutdown_connections 2023-10-06T03:24:22.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.451+0000 7f4267bff700 1 --2- 172.21.15.81:0/300770899 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f42601595b0 0x7f426015c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:22.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.451+0000 7f4267bff700 1 --2- 172.21.15.81:0/300770899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f426014fe10 0x7f42601695b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:22.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.451+0000 7f4267bff700 1 --2- 172.21.15.81:0/300770899 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f4244066f30 0x7f42440693e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:22.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.451+0000 7f4267bff700 1 --2- 172.21.15.81:0/300770899 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42601501e0 0x7f4260166a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:22.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.451+0000 7f4267bff700 1 -- 172.21.15.81:0/300770899 >> 172.21.15.81:0/300770899 conn(0x7f42600cc010 msgr2=0x7f426006b070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:22.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.451+0000 7f4267bff700 1 -- 172.21.15.81:0/300770899 shutdown_connections 2023-10-06T03:24:22.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.451+0000 7f4267bff700 1 -- 172.21.15.81:0/300770899 wait complete. 2023-10-06T03:24:22.470 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:23:33.198850+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:23:33.606744+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:23:38.742266+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:23:39.347944+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T03:23:42.959054+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:24:22.470 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:24:22.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.652+0000 7fa57b59d700 1 Processor -- start 2023-10-06T03:24:22.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.652+0000 7fa57b59d700 1 -- start start 2023-10-06T03:24:22.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.653+0000 7fa57b59d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa574159350 0x7fa5740c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:22.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.653+0000 7fa57b59d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa574069430 con 0x7fa57406bc40 2023-10-06T03:24:22.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.653+0000 7fa57b59d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa574068820 con 0x7fa57413ccb0 2023-10-06T03:24:22.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.653+0000 7fa57b59d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa574068b00 con 0x7fa574159350 2023-10-06T03:24:22.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.653+0000 7fa57ad9c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa57406bc40 0x7fa5740698c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33158/0 (socket says 172.21.15.81:33158) 2023-10-06T03:24:22.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.653+0000 7fa57ad9c700 1 -- 172.21.15.81:0/605259804 learned_addr learned my addr 172.21.15.81:0/605259804 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:24:22.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.654+0000 7fa57a59b700 1 --2- 172.21.15.81:0/605259804 >> v2:172.21.15.83:3300/0 conn(0x7fa574159350 0x7fa5740c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:22.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.654+0000 7fa579599700 1 -- 172.21.15.81:0/605259804 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3584115940 0 0) 0x7fa574069430 con 0x7fa57406bc40 2023-10-06T03:24:22.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.654+0000 7fa579599700 1 -- 172.21.15.81:0/605259804 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa560003570 con 0x7fa57406bc40 2023-10-06T03:24:22.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.654+0000 7fa579599700 1 -- 172.21.15.81:0/605259804 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1562032371 0 0) 0x7fa560003570 con 0x7fa57406bc40 2023-10-06T03:24:22.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.654+0000 7fa579599700 1 -- 172.21.15.81:0/605259804 >> v2:172.21.15.83:3300/0 conn(0x7fa574159350 msgr2=0x7fa5740c87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:22.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.654+0000 7fa579599700 1 --2- 172.21.15.81:0/605259804 >> v2:172.21.15.83:3300/0 conn(0x7fa574159350 0x7fa5740c87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:22.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.654+0000 7fa579599700 1 -- 172.21.15.81:0/605259804 >> v1:172.21.15.83:6789/0 conn(0x7fa57413ccb0 legacy=0x7fa57406b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:22.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.654+0000 7fa579599700 1 -- 172.21.15.81:0/605259804 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa574068de0 con 0x7fa57406bc40 2023-10-06T03:24:22.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.654+0000 7fa579599700 1 -- 172.21.15.81:0/605259804 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2513016936 0 0) 0x7fa56c001470 con 0x7fa57406bc40 2023-10-06T03:24:22.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.654+0000 7fa579599700 1 -- 172.21.15.81:0/605259804 >> v1:172.21.15.81:6789/0 conn(0x7fa57406bc40 legacy=0x7fa5740698c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:22.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.654+0000 7fa579599700 1 --2- 172.21.15.81:0/605259804 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa560003a60 0x7fa560003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:22.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.654+0000 7fa579599700 1 --2- 172.21.15.81:0/605259804 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa560004810 0x7fa560004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:22.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.654+0000 7fa579599700 1 --2- 172.21.15.81:0/605259804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5600051c0 0x7fa56000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:22.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.654+0000 7fa579599700 1 -- 172.21.15.81:0/605259804 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa574068b00 con 0x7fa5600051c0 2023-10-06T03:24:22.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.654+0000 7fa579599700 1 -- 172.21.15.81:0/605259804 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56000c160 con 0x7fa560003a60 2023-10-06T03:24:22.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.654+0000 7fa579599700 1 -- 172.21.15.81:0/605259804 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa56000c320 con 0x7fa560004810 2023-10-06T03:24:22.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.655+0000 7fa57a59b700 1 --2- 172.21.15.81:0/605259804 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa560003a60 0x7fa560003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:22.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.655+0000 7fa57ad9c700 1 --2- 172.21.15.81:0/605259804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5600051c0 0x7fa56000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:22.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.655+0000 7fa579d9a700 1 --2- 172.21.15.81:0/605259804 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa560004810 0x7fa560004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:22.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.655+0000 7fa57a59b700 1 -- 172.21.15.81:0/605259804 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa560004810 msgr2=0x7fa560004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:22.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.655+0000 7fa57a59b700 1 --2- 172.21.15.81:0/605259804 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa560004810 0x7fa560004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:22.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.655+0000 7fa57a59b700 1 -- 172.21.15.81:0/605259804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5600051c0 msgr2=0x7fa56000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:22.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.655+0000 7fa57a59b700 1 --2- 172.21.15.81:0/605259804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5600051c0 0x7fa56000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:22.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.655+0000 7fa57ad9c700 1 -- 172.21.15.81:0/605259804 reap_dead start 2023-10-06T03:24:22.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.655+0000 7fa57a59b700 1 -- 172.21.15.81:0/605259804 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa560003570 con 0x7fa560003a60 2023-10-06T03:24:22.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.655+0000 7fa57a59b700 1 --2- 172.21.15.81:0/605259804 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa560003a60 0x7fa560003e70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa57000e210 tx=0x7fa57000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95d8042bda961df7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:22.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.655+0000 7fa579599700 1 -- 172.21.15.81:0/605259804 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57000eac0 con 0x7fa560003a60 2023-10-06T03:24:22.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.655+0000 7fa579599700 1 -- 172.21.15.81:0/605259804 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa57000f040 con 0x7fa560003a60 2023-10-06T03:24:22.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.655+0000 7fa579599700 1 -- 172.21.15.81:0/605259804 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57000ee70 con 0x7fa560003a60 2023-10-06T03:24:22.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.656+0000 7fa57b59d700 1 -- 172.21.15.81:0/605259804 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa560003a60 msgr2=0x7fa560003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:22.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.656+0000 7fa57b59d700 1 --2- 172.21.15.81:0/605259804 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa560003a60 0x7fa560003e70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa57000e210 tx=0x7fa57000b040 comp rx=0 tx=0).stop 2023-10-06T03:24:22.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.656+0000 7fa57b59d700 1 -- 172.21.15.81:0/605259804 shutdown_connections 2023-10-06T03:24:22.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.656+0000 7fa57b59d700 1 --2- 172.21.15.81:0/605259804 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa560003a60 0x7fa560003e70 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:22.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.656+0000 7fa57b59d700 1 -- 172.21.15.81:0/605259804 >> 172.21.15.81:0/605259804 conn(0x7fa5740ce100 msgr2=0x7fa5740ce500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:22.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.656+0000 7fa57b59d700 1 -- 172.21.15.81:0/605259804 shutdown_connections 2023-10-06T03:24:22.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.656+0000 7fa57b59d700 1 -- 172.21.15.81:0/605259804 wait complete. 2023-10-06T03:24:22.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.657+0000 7fa57b59d700 1 Processor -- start 2023-10-06T03:24:22.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.657+0000 7fa57b59d700 1 -- start start 2023-10-06T03:24:22.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.658+0000 7fa57b59d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa560003a60 0x7fa574155690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:22.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.658+0000 7fa57b59d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa57416d170 0x7fa5740b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:22.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.658+0000 7fa57b59d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa5740b2d10 0x7fa574154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:22.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.658+0000 7fa57b59d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa574156c10 con 0x7fa57416d170 2023-10-06T03:24:22.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.658+0000 7fa57b59d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa574156000 con 0x7fa560003a60 2023-10-06T03:24:22.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.658+0000 7fa57b59d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5741562e0 con 0x7fa5740b2d10 2023-10-06T03:24:22.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.659+0000 7fa579d9a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa57416d170 0x7fa5740b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:22.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.659+0000 7fa579d9a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa57416d170 0x7fa5740b27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55204/0 (socket says 172.21.15.81:55204) 2023-10-06T03:24:22.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.659+0000 7fa579d9a700 1 -- 172.21.15.81:0/934361658 learned_addr learned my addr 172.21.15.81:0/934361658 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:22.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.659+0000 7fa57a59b700 1 --2- 172.21.15.81:0/934361658 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa560003a60 0x7fa574155690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:22.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.659+0000 7fa57ad9c700 1 --2- 172.21.15.81:0/934361658 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa5740b2d10 0x7fa574154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:22.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.659+0000 7fa579d9a700 1 -- 172.21.15.81:0/934361658 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa5740b2d10 msgr2=0x7fa574154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:22.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.659+0000 7fa579d9a700 1 --2- 172.21.15.81:0/934361658 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa5740b2d10 0x7fa574154940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:22.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.659+0000 7fa579d9a700 1 -- 172.21.15.81:0/934361658 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa560003a60 msgr2=0x7fa574155690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:22.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.659+0000 7fa579d9a700 1 --2- 172.21.15.81:0/934361658 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa560003a60 0x7fa574155690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:22.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.659+0000 7fa579d9a700 1 -- 172.21.15.81:0/934361658 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5741565c0 con 0x7fa57416d170 2023-10-06T03:24:22.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.659+0000 7fa579d9a700 1 --2- 172.21.15.81:0/934361658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa57416d170 0x7fa5740b27d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa564002950 tx=0x7fa564007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:22.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.659+0000 7fa56a7fc700 1 -- 172.21.15.81:0/934361658 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa564006820 con 0x7fa57416d170 2023-10-06T03:24:22.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.659+0000 7fa56a7fc700 1 -- 172.21.15.81:0/934361658 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa564006980 con 0x7fa57416d170 2023-10-06T03:24:22.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.659+0000 7fa57b59d700 1 -- 172.21.15.81:0/934361658 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5741568a0 con 0x7fa57416d170 2023-10-06T03:24:22.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.660+0000 7fa56a7fc700 1 -- 172.21.15.81:0/934361658 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa564006d20 con 0x7fa57416d170 2023-10-06T03:24:22.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.660+0000 7fa57b59d700 1 -- 172.21.15.81:0/934361658 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa574154e80 con 0x7fa57416d170 2023-10-06T03:24:22.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.661+0000 7fa57b59d700 1 -- 172.21.15.81:0/934361658 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa574156dc0 con 0x7fa57416d170 2023-10-06T03:24:22.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.661+0000 7fa56a7fc700 1 -- 172.21.15.81:0/934361658 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa564007240 con 0x7fa57416d170 2023-10-06T03:24:22.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.662+0000 7fa56a7fc700 1 --2- 172.21.15.81:0/934361658 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa558066f30 0x7fa5580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:22.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.662+0000 7fa56a7fc700 1 -- 172.21.15.81:0/934361658 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa564084950 con 0x7fa57416d170 2023-10-06T03:24:22.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.662+0000 7fa57a59b700 1 --2- 172.21.15.81:0/934361658 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa558066f30 0x7fa5580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:22.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.663+0000 7fa57a59b700 1 --2- 172.21.15.81:0/934361658 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa558066f30 0x7fa5580693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa57000afd0 tx=0x7fa57001a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:22.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.667+0000 7fa56a7fc700 1 -- 172.21.15.81:0/934361658 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa574156dc0 con 0x7fa57416d170 2023-10-06T03:24:22.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.858+0000 7fa57b59d700 1 -- 172.21.15.81:0/934361658 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa574156dc0 con 0x7fa57416d170 2023-10-06T03:24:22.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.859+0000 7fa56a7fc700 1 -- 172.21.15.81:0/934361658 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa574156dc0 con 0x7fa57416d170 2023-10-06T03:24:22.860 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-10-06T03:24:22.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.861+0000 7fa57b59d700 1 -- 172.21.15.81:0/934361658 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa558066f30 msgr2=0x7fa5580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:22.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.861+0000 7fa57b59d700 1 --2- 172.21.15.81:0/934361658 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa558066f30 0x7fa5580693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa57000afd0 tx=0x7fa57001a000 comp rx=0 tx=0).stop 2023-10-06T03:24:22.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.861+0000 7fa57b59d700 1 -- 172.21.15.81:0/934361658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa57416d170 msgr2=0x7fa5740b27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:22.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.861+0000 7fa57b59d700 1 --2- 172.21.15.81:0/934361658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa57416d170 0x7fa5740b27d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa564002950 tx=0x7fa564007d30 comp rx=0 tx=0).stop 2023-10-06T03:24:22.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.861+0000 7fa57b59d700 1 -- 172.21.15.81:0/934361658 shutdown_connections 2023-10-06T03:24:22.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.861+0000 7fa57b59d700 1 --2- 172.21.15.81:0/934361658 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa558066f30 0x7fa5580693e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:22.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.861+0000 7fa57b59d700 1 --2- 172.21.15.81:0/934361658 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa5740b2d10 0x7fa574154940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:22.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.861+0000 7fa57b59d700 1 --2- 172.21.15.81:0/934361658 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa560003a60 0x7fa574155690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:22.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.861+0000 7fa57b59d700 1 --2- 172.21.15.81:0/934361658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa57416d170 0x7fa5740b27d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:22.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.861+0000 7fa57b59d700 1 -- 172.21.15.81:0/934361658 >> 172.21.15.81:0/934361658 conn(0x7fa5740ce100 msgr2=0x7fa5740cd560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:22.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.861+0000 7fa57b59d700 1 -- 172.21.15.81:0/934361658 shutdown_connections 2023-10-06T03:24:22.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:22.861+0000 7fa57b59d700 1 -- 172.21.15.81:0/934361658 wait complete. 2023-10-06T03:24:22.880 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:24:23.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.065+0000 7f917bfff700 1 Processor -- start 2023-10-06T03:24:23.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.065+0000 7f917bfff700 1 -- start start 2023-10-06T03:24:23.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.066+0000 7f917bfff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f917c1535a0 0x7f917c15ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:23.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.066+0000 7f917bfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f917c15a560 0x7f917c153970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:23.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.066+0000 7f917bfff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f917c157670 0x7f917c0b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:23.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.066+0000 7f917bfff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f917c15bef0 con 0x7f917c15a560 2023-10-06T03:24:23.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.066+0000 7f917bfff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f917c0d1160 con 0x7f917c1535a0 2023-10-06T03:24:23.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.066+0000 7f917bfff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f917c15a9e0 con 0x7f917c157670 2023-10-06T03:24:23.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.066+0000 7f917a7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f917c15a560 0x7f917c153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:23.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.066+0000 7f917a7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f917c15a560 0x7f917c153970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55218/0 (socket says 172.21.15.81:55218) 2023-10-06T03:24:23.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.066+0000 7f917a7fc700 1 -- 172.21.15.81:0/1828987565 learned_addr learned my addr 172.21.15.81:0/1828987565 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:23.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.067+0000 7f917affd700 1 --2- 172.21.15.81:0/1828987565 >> v2:172.21.15.83:3300/0 conn(0x7f917c1535a0 0x7f917c15ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:23.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.067+0000 7f917b7fe700 1 --2- 172.21.15.81:0/1828987565 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f917c157670 0x7f917c0b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:23.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.067+0000 7f917a7fc700 1 -- 172.21.15.81:0/1828987565 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f917c157670 msgr2=0x7f917c0b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:23.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.067+0000 7f917a7fc700 1 --2- 172.21.15.81:0/1828987565 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f917c157670 0x7f917c0b1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.067+0000 7f917a7fc700 1 -- 172.21.15.81:0/1828987565 >> v2:172.21.15.83:3300/0 conn(0x7f917c1535a0 msgr2=0x7f917c15ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:23.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.067+0000 7f917a7fc700 1 --2- 172.21.15.81:0/1828987565 >> v2:172.21.15.83:3300/0 conn(0x7f917c1535a0 0x7f917c15ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.067+0000 7f917a7fc700 1 -- 172.21.15.81:0/1828987565 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f917c153eb0 con 0x7f917c15a560 2023-10-06T03:24:23.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.067+0000 7f917a7fc700 1 --2- 172.21.15.81:0/1828987565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f917c15a560 0x7f917c153970 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f917c0d1430 tx=0x7f9170009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96955f5cf6fc8de3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:23.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.067+0000 7f9179ffb700 1 -- 172.21.15.81:0/1828987565 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917000b860 con 0x7f917c15a560 2023-10-06T03:24:23.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.067+0000 7f9179ffb700 1 -- 172.21.15.81:0/1828987565 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f917000b9c0 con 0x7f917c15a560 2023-10-06T03:24:23.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.067+0000 7f9179ffb700 1 -- 172.21.15.81:0/1828987565 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917000bd60 con 0x7f917c15a560 2023-10-06T03:24:23.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.068+0000 7f917bfff700 1 -- 172.21.15.81:0/1828987565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f917c15a560 msgr2=0x7f917c153970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:23.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.068+0000 7f917bfff700 1 --2- 172.21.15.81:0/1828987565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f917c15a560 0x7f917c153970 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f917c0d1430 tx=0x7f9170009250 comp rx=0 tx=0).stop 2023-10-06T03:24:23.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.068+0000 7f917bfff700 1 -- 172.21.15.81:0/1828987565 shutdown_connections 2023-10-06T03:24:23.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.068+0000 7f917bfff700 1 --2- 172.21.15.81:0/1828987565 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f917c157670 0x7f917c0b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.068+0000 7f917bfff700 1 --2- 172.21.15.81:0/1828987565 >> v2:172.21.15.83:3300/0 conn(0x7f917c1535a0 0x7f917c15ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.068+0000 7f917bfff700 1 --2- 172.21.15.81:0/1828987565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f917c15a560 0x7f917c153970 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.068+0000 7f917bfff700 1 -- 172.21.15.81:0/1828987565 >> 172.21.15.81:0/1828987565 conn(0x7f917c068230 msgr2=0x7f917c068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:23.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.068+0000 7f917bfff700 1 -- 172.21.15.81:0/1828987565 shutdown_connections 2023-10-06T03:24:23.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.068+0000 7f917bfff700 1 -- 172.21.15.81:0/1828987565 wait complete. 2023-10-06T03:24:23.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.070+0000 7f917bfff700 1 Processor -- start 2023-10-06T03:24:23.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.070+0000 7f917bfff700 1 -- start start 2023-10-06T03:24:23.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.070+0000 7f917bfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f917c1535a0 0x7f917c0cf990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:23.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.071+0000 7f917bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f917c157670 0x7f917c155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:23.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.071+0000 7f917bfff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f917c15a560 0x7f917c16c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:23.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.071+0000 7f917bfff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917c1570d0 con 0x7f917c157670 2023-10-06T03:24:23.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.071+0000 7f917bfff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917c169f70 con 0x7f917c1535a0 2023-10-06T03:24:23.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.071+0000 7f917bfff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f917c16a250 con 0x7f917c15a560 2023-10-06T03:24:23.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.071+0000 7f917a7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f917c157670 0x7f917c155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:23.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.071+0000 7f917a7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f917c157670 0x7f917c155ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55232/0 (socket says 172.21.15.81:55232) 2023-10-06T03:24:23.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.071+0000 7f917a7fc700 1 -- 172.21.15.81:0/2165639435 learned_addr learned my addr 172.21.15.81:0/2165639435 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:23.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.071+0000 7f917affd700 1 --2- 172.21.15.81:0/2165639435 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f917c1535a0 0x7f917c0cf990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:23.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.071+0000 7f917b7fe700 1 --2- 172.21.15.81:0/2165639435 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f917c15a560 0x7f917c16c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:23.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.071+0000 7f917a7fc700 1 -- 172.21.15.81:0/2165639435 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f917c15a560 msgr2=0x7f917c16c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:23.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.071+0000 7f917a7fc700 1 --2- 172.21.15.81:0/2165639435 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f917c15a560 0x7f917c16c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.071+0000 7f917a7fc700 1 -- 172.21.15.81:0/2165639435 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f917c1535a0 msgr2=0x7f917c0cf990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:23.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.071+0000 7f917a7fc700 1 --2- 172.21.15.81:0/2165639435 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f917c1535a0 0x7f917c0cf990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.071+0000 7f917a7fc700 1 -- 172.21.15.81:0/2165639435 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91700094f0 con 0x7f917c157670 2023-10-06T03:24:23.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.071+0000 7f917a7fc700 1 --2- 172.21.15.81:0/2165639435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f917c157670 0x7f917c155ef0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f917c088fa0 tx=0x7f9170017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:23.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.072+0000 7f9162ffd700 1 -- 172.21.15.81:0/2165639435 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9170011e70 con 0x7f917c157670 2023-10-06T03:24:23.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.072+0000 7f9162ffd700 1 -- 172.21.15.81:0/2165639435 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9170024440 con 0x7f917c157670 2023-10-06T03:24:23.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.072+0000 7f9162ffd700 1 -- 172.21.15.81:0/2165639435 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9170024800 con 0x7f917c157670 2023-10-06T03:24:23.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.072+0000 7f917bfff700 1 -- 172.21.15.81:0/2165639435 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f917c16a530 con 0x7f917c157670 2023-10-06T03:24:23.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.072+0000 7f917bfff700 1 -- 172.21.15.81:0/2165639435 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f917c169b90 con 0x7f917c157670 2023-10-06T03:24:23.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.073+0000 7f917bfff700 1 -- 172.21.15.81:0/2165639435 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f917c04c3c0 con 0x7f917c157670 2023-10-06T03:24:23.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.073+0000 7f9162ffd700 1 -- 172.21.15.81:0/2165639435 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f917001a420 con 0x7f917c157670 2023-10-06T03:24:23.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.075+0000 7f9162ffd700 1 --2- 172.21.15.81:0/2165639435 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f9168066f30 0x7f91680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:23.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.075+0000 7f9162ffd700 1 -- 172.21.15.81:0/2165639435 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f9170086830 con 0x7f917c157670 2023-10-06T03:24:23.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.075+0000 7f917affd700 1 --2- 172.21.15.81:0/2165639435 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f9168066f30 0x7f91680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:23.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.075+0000 7f917affd700 1 --2- 172.21.15.81:0/2165639435 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f9168066f30 0x7f91680693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f916c006fd0 tx=0x7f916c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:23.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.079+0000 7f9162ffd700 1 -- 172.21.15.81:0/2165639435 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f91700535b0 con 0x7f917c157670 2023-10-06T03:24:23.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.269+0000 7f917bfff700 1 -- 172.21.15.81:0/2165639435 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f917c15b2e0 con 0x7f917c157670 2023-10-06T03:24:23.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.270+0000 7f9162ffd700 1 -- 172.21.15.81:0/2165639435 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9170056bd0 con 0x7f917c157670 2023-10-06T03:24:23.271 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-06T03:24:23.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.272+0000 7f917bfff700 1 -- 172.21.15.81:0/2165639435 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f9168066f30 msgr2=0x7f91680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:23.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.272+0000 7f917bfff700 1 --2- 172.21.15.81:0/2165639435 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f9168066f30 0x7f91680693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f916c006fd0 tx=0x7f916c008040 comp rx=0 tx=0).stop 2023-10-06T03:24:23.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.272+0000 7f917bfff700 1 -- 172.21.15.81:0/2165639435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f917c157670 msgr2=0x7f917c155ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:23.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.272+0000 7f917bfff700 1 --2- 172.21.15.81:0/2165639435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f917c157670 0x7f917c155ef0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f917c088fa0 tx=0x7f9170017000 comp rx=0 tx=0).stop 2023-10-06T03:24:23.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.272+0000 7f917bfff700 1 -- 172.21.15.81:0/2165639435 shutdown_connections 2023-10-06T03:24:23.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.272+0000 7f917bfff700 1 --2- 172.21.15.81:0/2165639435 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f9168066f30 0x7f91680693e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.272+0000 7f917bfff700 1 --2- 172.21.15.81:0/2165639435 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f917c15a560 0x7f917c16c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.272+0000 7f917bfff700 1 --2- 172.21.15.81:0/2165639435 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f917c1535a0 0x7f917c0cf990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.272+0000 7f917bfff700 1 --2- 172.21.15.81:0/2165639435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f917c157670 0x7f917c155ef0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.272+0000 7f917bfff700 1 -- 172.21.15.81:0/2165639435 >> 172.21.15.81:0/2165639435 conn(0x7f917c068230 msgr2=0x7f917c152da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:23.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.272+0000 7f917bfff700 1 -- 172.21.15.81:0/2165639435 shutdown_connections 2023-10-06T03:24:23.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.272+0000 7f917bfff700 1 -- 172.21.15.81:0/2165639435 wait complete. 2023-10-06T03:24:23.291 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:24:23.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.474+0000 7f24b67ff700 1 Processor -- start 2023-10-06T03:24:23.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.474+0000 7f24b67ff700 1 -- start start 2023-10-06T03:24:23.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.476+0000 7f24b67ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f24b0159e30 0x7f24b00ca520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:23.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.476+0000 7f24b67ff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24b006ab00 con 0x7f24b00caa60 2023-10-06T03:24:23.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.476+0000 7f24b67ff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24b0069ef0 con 0x7f24b0159a60 2023-10-06T03:24:23.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.476+0000 7f24b67ff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24b006a1d0 con 0x7f24b0159e30 2023-10-06T03:24:23.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.476+0000 7f24b4d9c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f24b00caa60 0x7f24b0155650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33164/0 (socket says 172.21.15.81:33164) 2023-10-06T03:24:23.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.476+0000 7f24b4d9c700 1 -- 172.21.15.81:0/2779715206 learned_addr learned my addr 172.21.15.81:0/2779715206 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:24:23.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.476+0000 7f24a7fff700 1 --2- 172.21.15.81:0/2779715206 >> v2:172.21.15.83:3300/0 conn(0x7f24b0159e30 0x7f24b00ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:23.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.476+0000 7f24af7fe700 1 -- 172.21.15.81:0/2779715206 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1191281753 0 0) 0x7f24b006ab00 con 0x7f24b00caa60 2023-10-06T03:24:23.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.477+0000 7f24af7fe700 1 -- 172.21.15.81:0/2779715206 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f249c003570 con 0x7f24b00caa60 2023-10-06T03:24:23.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.477+0000 7f24af7fe700 1 -- 172.21.15.81:0/2779715206 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2416498496 0 0) 0x7f24b0069ef0 con 0x7f24b0159a60 2023-10-06T03:24:23.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.477+0000 7f24af7fe700 1 -- 172.21.15.81:0/2779715206 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24b006ab00 con 0x7f24b0159a60 2023-10-06T03:24:23.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.477+0000 7f24a7fff700 1 -- 172.21.15.81:0/2779715206 >> v1:172.21.15.83:6789/0 conn(0x7f24b0159a60 legacy=0x7f24b006af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:23.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.477+0000 7f24af7fe700 1 -- 172.21.15.81:0/2779715206 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2977528663 0 0) 0x7f249c003570 con 0x7f24b00caa60 2023-10-06T03:24:23.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.477+0000 7f24a7fff700 1 -- 172.21.15.81:0/2779715206 >> v1:172.21.15.81:6789/0 conn(0x7f24b00caa60 legacy=0x7f24b0155650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:23.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.477+0000 7f24a7fff700 1 -- 172.21.15.81:0/2779715206 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b006a4b0 con 0x7f24b0159e30 2023-10-06T03:24:23.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.477+0000 7f24a7fff700 1 --2- 172.21.15.81:0/2779715206 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f24b0159e30 0x7f24b00ca520 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f249800aa90 tx=0x7f249800a330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6a06fcb23989e52 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:23.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.477+0000 7f24af7fe700 1 -- 172.21.15.81:0/2779715206 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a80017f0 con 0x7f24b0159e30 2023-10-06T03:24:23.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.477+0000 7f24af7fe700 1 -- 172.21.15.81:0/2779715206 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249800aed0 con 0x7f24b0159e30 2023-10-06T03:24:23.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.477+0000 7f24af7fe700 1 -- 172.21.15.81:0/2779715206 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249800c890 con 0x7f24b0159e30 2023-10-06T03:24:23.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.478+0000 7f24b67ff700 1 -- 172.21.15.81:0/2779715206 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f24b0159e30 msgr2=0x7f24b00ca520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:23.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.478+0000 7f24b67ff700 1 --2- 172.21.15.81:0/2779715206 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f24b0159e30 0x7f24b00ca520 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f249800aa90 tx=0x7f249800a330 comp rx=0 tx=0).stop 2023-10-06T03:24:23.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.478+0000 7f24b67ff700 1 -- 172.21.15.81:0/2779715206 shutdown_connections 2023-10-06T03:24:23.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.478+0000 7f24b67ff700 1 --2- 172.21.15.81:0/2779715206 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f24b0159e30 0x7f24b00ca520 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.478+0000 7f24b67ff700 1 -- 172.21.15.81:0/2779715206 >> 172.21.15.81:0/2779715206 conn(0x7f24b00cc090 msgr2=0x7f24b00cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:23.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.478+0000 7f24b67ff700 1 -- 172.21.15.81:0/2779715206 shutdown_connections 2023-10-06T03:24:23.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.478+0000 7f24b67ff700 1 -- 172.21.15.81:0/2779715206 wait complete. 2023-10-06T03:24:23.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.479+0000 7f24b67ff700 1 Processor -- start 2023-10-06T03:24:23.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.480+0000 7f24b67ff700 1 -- start start 2023-10-06T03:24:23.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.480+0000 7f24b67ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24b00caa60 0x7f24b0169e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:23.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.480+0000 7f24b67ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f24b0159a60 0x7f24b00c5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:23.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.480+0000 7f24b67ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f24b0159e30 0x7f24b014ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:23.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.480+0000 7f24b67ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b0152d50 con 0x7f24b00caa60 2023-10-06T03:24:23.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.480+0000 7f24b67ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b016a3e0 con 0x7f24b0159a60 2023-10-06T03:24:23.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.480+0000 7f24b67ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24b016a6c0 con 0x7f24b0159e30 2023-10-06T03:24:23.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.481+0000 7f24affff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24b00caa60 0x7f24b0169e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:23.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.481+0000 7f24affff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24b00caa60 0x7f24b0169e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55234/0 (socket says 172.21.15.81:55234) 2023-10-06T03:24:23.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.481+0000 7f24affff700 1 -- 172.21.15.81:0/1182889624 learned_addr learned my addr 172.21.15.81:0/1182889624 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:23.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.481+0000 7f24b4d9c700 1 --2- 172.21.15.81:0/1182889624 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f24b0159e30 0x7f24b014ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:23.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.481+0000 7f24a7fff700 1 --2- 172.21.15.81:0/1182889624 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f24b0159a60 0x7f24b00c5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:23.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.481+0000 7f24affff700 1 -- 172.21.15.81:0/1182889624 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f24b0159e30 msgr2=0x7f24b014ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:23.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.481+0000 7f24affff700 1 --2- 172.21.15.81:0/1182889624 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f24b0159e30 0x7f24b014ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.481+0000 7f24affff700 1 -- 172.21.15.81:0/1182889624 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f24b0159a60 msgr2=0x7f24b00c5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:23.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.481+0000 7f24affff700 1 --2- 172.21.15.81:0/1182889624 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f24b0159a60 0x7f24b00c5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.481+0000 7f24affff700 1 -- 172.21.15.81:0/1182889624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f249800a5d0 con 0x7f24b00caa60 2023-10-06T03:24:23.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.481+0000 7f24affff700 1 --2- 172.21.15.81:0/1182889624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24b00caa60 0x7f24b0169e00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f24a000c7c0 tx=0x7f24a0007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:23.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.482+0000 7f24acff9700 1 -- 172.21.15.81:0/1182889624 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a0001530 con 0x7f24b00caa60 2023-10-06T03:24:23.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.482+0000 7f24acff9700 1 -- 172.21.15.81:0/1182889624 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a00016b0 con 0x7f24b00caa60 2023-10-06T03:24:23.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.482+0000 7f24b67ff700 1 -- 172.21.15.81:0/1182889624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24b016a9a0 con 0x7f24b00caa60 2023-10-06T03:24:23.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.482+0000 7f24acff9700 1 -- 172.21.15.81:0/1182889624 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a0001a70 con 0x7f24b00caa60 2023-10-06T03:24:23.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.482+0000 7f24b67ff700 1 -- 172.21.15.81:0/1182889624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24b00c6490 con 0x7f24b00caa60 2023-10-06T03:24:23.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.483+0000 7f24b67ff700 1 -- 172.21.15.81:0/1182889624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24b004c3c0 con 0x7f24b00caa60 2023-10-06T03:24:23.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.484+0000 7f24acff9700 1 -- 172.21.15.81:0/1182889624 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f24a001b3b0 con 0x7f24b00caa60 2023-10-06T03:24:23.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.485+0000 7f24acff9700 1 --2- 172.21.15.81:0/1182889624 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2490066f30 0x7f24900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:23.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.485+0000 7f24acff9700 1 -- 172.21.15.81:0/1182889624 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f24a00841d0 con 0x7f24b00caa60 2023-10-06T03:24:23.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.485+0000 7f24a7fff700 1 --2- 172.21.15.81:0/1182889624 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2490066f30 0x7f24900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:23.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.485+0000 7f24a7fff700 1 --2- 172.21.15.81:0/1182889624 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2490066f30 0x7f24900693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f249800a370 tx=0x7f2498019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:23.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.489+0000 7f24acff9700 1 -- 172.21.15.81:0/1182889624 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f24a0050f50 con 0x7f24b00caa60 2023-10-06T03:24:23.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.684+0000 7f24b67ff700 1 -- 172.21.15.81:0/1182889624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f24b00ca300 con 0x7f24b00caa60 2023-10-06T03:24:23.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.684+0000 7f24acff9700 1 -- 172.21.15.81:0/1182889624 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f24a0054570 con 0x7f24b00caa60 2023-10-06T03:24:23.685 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-10-06T03:24:23.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.687+0000 7f24b67ff700 1 -- 172.21.15.81:0/1182889624 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2490066f30 msgr2=0x7f24900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:23.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.687+0000 7f24b67ff700 1 --2- 172.21.15.81:0/1182889624 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2490066f30 0x7f24900693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f249800a370 tx=0x7f2498019000 comp rx=0 tx=0).stop 2023-10-06T03:24:23.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.687+0000 7f24b67ff700 1 -- 172.21.15.81:0/1182889624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24b00caa60 msgr2=0x7f24b0169e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:23.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.687+0000 7f24b67ff700 1 --2- 172.21.15.81:0/1182889624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24b00caa60 0x7f24b0169e00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f24a000c7c0 tx=0x7f24a0007e00 comp rx=0 tx=0).stop 2023-10-06T03:24:23.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.687+0000 7f24b67ff700 1 -- 172.21.15.81:0/1182889624 shutdown_connections 2023-10-06T03:24:23.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.687+0000 7f24b67ff700 1 --2- 172.21.15.81:0/1182889624 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2490066f30 0x7f24900693e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.687+0000 7f24b67ff700 1 --2- 172.21.15.81:0/1182889624 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f24b0159e30 0x7f24b014ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.687+0000 7f24b67ff700 1 --2- 172.21.15.81:0/1182889624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24b00caa60 0x7f24b0169e00 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.687+0000 7f24b67ff700 1 --2- 172.21.15.81:0/1182889624 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f24b0159a60 0x7f24b00c5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.687+0000 7f24b67ff700 1 -- 172.21.15.81:0/1182889624 >> 172.21.15.81:0/1182889624 conn(0x7f24b00cc090 msgr2=0x7f24b0150ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:23.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.687+0000 7f24b67ff700 1 -- 172.21.15.81:0/1182889624 shutdown_connections 2023-10-06T03:24:23.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.687+0000 7f24b67ff700 1 -- 172.21.15.81:0/1182889624 wait complete. 2023-10-06T03:24:23.705 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:24:23.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.888+0000 7fa433dff700 1 Processor -- start 2023-10-06T03:24:23.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.888+0000 7fa433dff700 1 -- start start 2023-10-06T03:24:23.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.889+0000 7fa433dff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa42c159e30 0x7fa42c0ca520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:23.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.889+0000 7fa433dff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa42c0caa60 0x7fa42c155650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:23.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.889+0000 7fa433dff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa42c06ab00 con 0x7fa42c159a60 2023-10-06T03:24:23.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.890+0000 7fa433dff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa42c069ef0 con 0x7fa42c159e30 2023-10-06T03:24:23.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.890+0000 7fa433dff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c06a1d0 con 0x7fa42c0caa60 2023-10-06T03:24:23.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.890+0000 7fa431b9b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa42c159a60 0x7fa42c06af90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33172/0 (socket says 172.21.15.81:33172) 2023-10-06T03:24:23.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.890+0000 7fa431b9b700 1 -- 172.21.15.81:0/1584563063 learned_addr learned my addr 172.21.15.81:0/1584563063 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:24:23.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.890+0000 7fa43139a700 1 --2- 172.21.15.81:0/1584563063 >> v2:172.21.15.83:3300/0 conn(0x7fa42c159e30 0x7fa42c0ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:23.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.890+0000 7fa43239c700 1 --2- 172.21.15.81:0/1584563063 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa42c0caa60 0x7fa42c155650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:23.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.890+0000 7fa430b99700 1 -- 172.21.15.81:0/1584563063 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4274889550 0 0) 0x7fa42c06ab00 con 0x7fa42c159a60 2023-10-06T03:24:23.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.890+0000 7fa430b99700 1 -- 172.21.15.81:0/1584563063 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa418003570 con 0x7fa42c159a60 2023-10-06T03:24:23.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.890+0000 7fa430b99700 1 -- 172.21.15.81:0/1584563063 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3206807220 0 0) 0x7fa418003570 con 0x7fa42c159a60 2023-10-06T03:24:23.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.890+0000 7fa430b99700 1 -- 172.21.15.81:0/1584563063 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa42c0caa60 msgr2=0x7fa42c155650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:23.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.890+0000 7fa430b99700 1 --2- 172.21.15.81:0/1584563063 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa42c0caa60 0x7fa42c155650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.890+0000 7fa430b99700 1 -- 172.21.15.81:0/1584563063 >> v2:172.21.15.83:3300/0 conn(0x7fa42c159e30 msgr2=0x7fa42c0ca520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:23.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.890+0000 7fa430b99700 1 --2- 172.21.15.81:0/1584563063 >> v2:172.21.15.83:3300/0 conn(0x7fa42c159e30 0x7fa42c0ca520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.890+0000 7fa430b99700 1 -- 172.21.15.81:0/1584563063 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa42c06a4b0 con 0x7fa42c159a60 2023-10-06T03:24:23.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.890+0000 7fa430b99700 1 -- 172.21.15.81:0/1584563063 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2513016936 0 0) 0x7fa4280015f0 con 0x7fa42c159a60 2023-10-06T03:24:23.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.890+0000 7fa430b99700 1 -- 172.21.15.81:0/1584563063 >> v1:172.21.15.81:6789/0 conn(0x7fa42c159a60 legacy=0x7fa42c06af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:23.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.891+0000 7fa430b99700 1 --2- 172.21.15.81:0/1584563063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa418003ae0 0x7fa418003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:23.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.891+0000 7fa430b99700 1 --2- 172.21.15.81:0/1584563063 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa418004810 0x7fa418004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:23.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.891+0000 7fa430b99700 1 --2- 172.21.15.81:0/1584563063 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa42c0caa60 0x7fa4180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:23.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.891+0000 7fa430b99700 1 -- 172.21.15.81:0/1584563063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c069ef0 con 0x7fa418003ae0 2023-10-06T03:24:23.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.891+0000 7fa430b99700 1 -- 172.21.15.81:0/1584563063 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c06a1d0 con 0x7fa418004810 2023-10-06T03:24:23.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.891+0000 7fa430b99700 1 -- 172.21.15.81:0/1584563063 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa41800bb10 con 0x7fa42c0caa60 2023-10-06T03:24:23.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.891+0000 7fa431b9b700 1 --2- 172.21.15.81:0/1584563063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa418003ae0 0x7fa418003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:23.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.891+0000 7fa43139a700 1 --2- 172.21.15.81:0/1584563063 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa418004810 0x7fa418004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:23.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.891+0000 7fa43239c700 1 --2- 172.21.15.81:0/1584563063 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa42c0caa60 0x7fa4180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:23.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.891+0000 7fa431b9b700 1 -- 172.21.15.81:0/1584563063 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa42c0caa60 msgr2=0x7fa4180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:23.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.891+0000 7fa431b9b700 1 --2- 172.21.15.81:0/1584563063 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa42c0caa60 0x7fa4180051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.891+0000 7fa431b9b700 1 -- 172.21.15.81:0/1584563063 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa418004810 msgr2=0x7fa418004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:23.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.891+0000 7fa431b9b700 1 --2- 172.21.15.81:0/1584563063 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa418004810 0x7fa418004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.891+0000 7fa431b9b700 1 -- 172.21.15.81:0/1584563063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa418003570 con 0x7fa418003ae0 2023-10-06T03:24:23.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.891+0000 7fa431b9b700 1 --2- 172.21.15.81:0/1584563063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa418003ae0 0x7fa418003ef0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa42800c220 tx=0x7fa42c06aa70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff9bd1919f4c2288 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:23.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.892+0000 7fa430b99700 1 -- 172.21.15.81:0/1584563063 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42800cb50 con 0x7fa418003ae0 2023-10-06T03:24:23.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.892+0000 7fa430b99700 1 -- 172.21.15.81:0/1584563063 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa42800ccb0 con 0x7fa418003ae0 2023-10-06T03:24:23.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.892+0000 7fa430b99700 1 -- 172.21.15.81:0/1584563063 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa428007320 con 0x7fa418003ae0 2023-10-06T03:24:23.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.892+0000 7fa433dff700 1 -- 172.21.15.81:0/1584563063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa418003ae0 msgr2=0x7fa418003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:23.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.892+0000 7fa433dff700 1 --2- 172.21.15.81:0/1584563063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa418003ae0 0x7fa418003ef0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa42800c220 tx=0x7fa42c06aa70 comp rx=0 tx=0).stop 2023-10-06T03:24:23.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.892+0000 7fa43239c700 1 -- 172.21.15.81:0/1584563063 reap_dead start 2023-10-06T03:24:23.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.892+0000 7fa433dff700 1 -- 172.21.15.81:0/1584563063 shutdown_connections 2023-10-06T03:24:23.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.892+0000 7fa433dff700 1 -- 172.21.15.81:0/1584563063 >> 172.21.15.81:0/1584563063 conn(0x7fa42c0cc090 msgr2=0x7fa42c0cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:23.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.892+0000 7fa433dff700 1 -- 172.21.15.81:0/1584563063 shutdown_connections 2023-10-06T03:24:23.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.892+0000 7fa433dff700 1 -- 172.21.15.81:0/1584563063 wait complete. 2023-10-06T03:24:23.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.894+0000 7fa433dff700 1 Processor -- start 2023-10-06T03:24:23.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.894+0000 7fa433dff700 1 -- start start 2023-10-06T03:24:23.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.895+0000 7fa433dff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa418003ae0 0x7fa42c0c3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:23.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.895+0000 7fa433dff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa42c13c1b0 0x7fa42c0c3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:23.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.895+0000 7fa433dff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa42c0c50c0 0x7fa42c0c5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:23.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.895+0000 7fa433dff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c0c6600 con 0x7fa42c0c50c0 2023-10-06T03:24:23.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.895+0000 7fa433dff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c0ac830 con 0x7fa42c13c1b0 2023-10-06T03:24:23.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.895+0000 7fa433dff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c14f160 con 0x7fa418003ae0 2023-10-06T03:24:23.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.895+0000 7fa43239c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa42c0c50c0 0x7fa42c0c5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:23.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.895+0000 7fa43239c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa42c0c50c0 0x7fa42c0c5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55242/0 (socket says 172.21.15.81:55242) 2023-10-06T03:24:23.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.895+0000 7fa43239c700 1 -- 172.21.15.81:0/430378299 learned_addr learned my addr 172.21.15.81:0/430378299 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:23.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.895+0000 7fa431b9b700 1 --2- 172.21.15.81:0/430378299 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa418003ae0 0x7fa42c0c3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:23.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.895+0000 7fa43139a700 1 --2- 172.21.15.81:0/430378299 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa42c13c1b0 0x7fa42c0c3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:23.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.895+0000 7fa43239c700 1 -- 172.21.15.81:0/430378299 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa418003ae0 msgr2=0x7fa42c0c3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:23.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.895+0000 7fa43239c700 1 --2- 172.21.15.81:0/430378299 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa418003ae0 0x7fa42c0c3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.895+0000 7fa43239c700 1 -- 172.21.15.81:0/430378299 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa42c13c1b0 msgr2=0x7fa42c0c3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:23.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.895+0000 7fa43239c700 1 --2- 172.21.15.81:0/430378299 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa42c13c1b0 0x7fa42c0c3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:23.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.895+0000 7fa43239c700 1 -- 172.21.15.81:0/430378299 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa42c0c5d60 con 0x7fa42c0c50c0 2023-10-06T03:24:23.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.896+0000 7fa43239c700 1 --2- 172.21.15.81:0/430378299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa42c0c50c0 0x7fa42c0c5540 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa424008340 tx=0x7fa42400a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:23.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.896+0000 7fa421ffb700 1 -- 172.21.15.81:0/430378299 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa424007be0 con 0x7fa42c0c50c0 2023-10-06T03:24:23.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.896+0000 7fa421ffb700 1 -- 172.21.15.81:0/430378299 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa424010040 con 0x7fa42c0c50c0 2023-10-06T03:24:23.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.896+0000 7fa433dff700 1 -- 172.21.15.81:0/430378299 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa42c0c6040 con 0x7fa42c0c50c0 2023-10-06T03:24:23.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.896+0000 7fa421ffb700 1 -- 172.21.15.81:0/430378299 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa424016440 con 0x7fa42c0c50c0 2023-10-06T03:24:23.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.896+0000 7fa433dff700 1 -- 172.21.15.81:0/430378299 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa42c0c5a80 con 0x7fa42c0c50c0 2023-10-06T03:24:23.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.897+0000 7fa433dff700 1 -- 172.21.15.81:0/430378299 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa42c04c3c0 con 0x7fa42c0c50c0 2023-10-06T03:24:23.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.898+0000 7fa421ffb700 1 -- 172.21.15.81:0/430378299 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa42401f3b0 con 0x7fa42c0c50c0 2023-10-06T03:24:23.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.899+0000 7fa421ffb700 1 --2- 172.21.15.81:0/430378299 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa410066f30 0x7fa4100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:23.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.899+0000 7fa421ffb700 1 -- 172.21.15.81:0/430378299 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa424084dd0 con 0x7fa42c0c50c0 2023-10-06T03:24:23.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.899+0000 7fa431b9b700 1 --2- 172.21.15.81:0/430378299 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa410066f30 0x7fa4100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:23.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.899+0000 7fa431b9b700 1 --2- 172.21.15.81:0/430378299 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa410066f30 0x7fa4100693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa428000ef0 tx=0x7fa428015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:23.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:23.903+0000 7fa421ffb700 1 -- 172.21.15.81:0/430378299 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa424051b50 con 0x7fa42c0c50c0 2023-10-06T03:24:24.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.091+0000 7fa433dff700 1 -- 172.21.15.81:0/430378299 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa42c14f390 con 0x7fa42c0c50c0 2023-10-06T03:24:24.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.092+0000 7fa421ffb700 1 -- 172.21.15.81:0/430378299 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa424055170 con 0x7fa42c0c50c0 2023-10-06T03:24:24.093 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-10-06T03:24:24.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.094+0000 7fa433dff700 1 -- 172.21.15.81:0/430378299 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa410066f30 msgr2=0x7fa4100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:24.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.094+0000 7fa433dff700 1 --2- 172.21.15.81:0/430378299 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa410066f30 0x7fa4100693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa428000ef0 tx=0x7fa428015000 comp rx=0 tx=0).stop 2023-10-06T03:24:24.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.094+0000 7fa433dff700 1 -- 172.21.15.81:0/430378299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa42c0c50c0 msgr2=0x7fa42c0c5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:24.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.094+0000 7fa433dff700 1 --2- 172.21.15.81:0/430378299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa42c0c50c0 0x7fa42c0c5540 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa424008340 tx=0x7fa42400a890 comp rx=0 tx=0).stop 2023-10-06T03:24:24.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.094+0000 7fa433dff700 1 -- 172.21.15.81:0/430378299 shutdown_connections 2023-10-06T03:24:24.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.094+0000 7fa433dff700 1 --2- 172.21.15.81:0/430378299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa42c0c50c0 0x7fa42c0c5540 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.094+0000 7fa433dff700 1 --2- 172.21.15.81:0/430378299 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa410066f30 0x7fa4100693e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.094+0000 7fa433dff700 1 --2- 172.21.15.81:0/430378299 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa418003ae0 0x7fa42c0c3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.094+0000 7fa433dff700 1 --2- 172.21.15.81:0/430378299 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa42c13c1b0 0x7fa42c0c3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.094+0000 7fa433dff700 1 -- 172.21.15.81:0/430378299 >> 172.21.15.81:0/430378299 conn(0x7fa42c0cc090 msgr2=0x7fa42c150cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:24.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.094+0000 7fa433dff700 1 -- 172.21.15.81:0/430378299 shutdown_connections 2023-10-06T03:24:24.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.094+0000 7fa433dff700 1 -- 172.21.15.81:0/430378299 wait complete. 2023-10-06T03:24:24.112 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T03:24:24.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.294+0000 7f4d101ff700 1 Processor -- start 2023-10-06T03:24:24.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.294+0000 7f4d101ff700 1 -- start start 2023-10-06T03:24:24.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.295+0000 7f4d101ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4d080b29d0 0x7f4d080c6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:24.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.295+0000 7f4d101ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4d080c5210 0x7f4d080cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:24.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.295+0000 7f4d101ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f4d080cefb0 0x7f4d080ad580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:24.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.295+0000 7f4d101ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d080c70d0 con 0x7f4d080b29d0 2023-10-06T03:24:24.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.295+0000 7f4d101ff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d080cf430 con 0x7f4d080cefb0 2023-10-06T03:24:24.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.296+0000 7f4d101ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d080cf7d0 con 0x7f4d080c5210 2023-10-06T03:24:24.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.296+0000 7f4d0df9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4d080b29d0 0x7f4d080c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:24.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.296+0000 7f4d0df9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4d080b29d0 0x7f4d080c6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55258/0 (socket says 172.21.15.81:55258) 2023-10-06T03:24:24.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.296+0000 7f4d0df9b700 1 -- 172.21.15.81:0/4012547597 learned_addr learned my addr 172.21.15.81:0/4012547597 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:24.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.296+0000 7f4d0e79c700 1 --2- 172.21.15.81:0/4012547597 >> v2:172.21.15.83:3300/0 conn(0x7f4d080cefb0 0x7f4d080ad580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:24.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.296+0000 7f4d0d79a700 1 --2- 172.21.15.81:0/4012547597 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4d080c5210 0x7f4d080cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:24.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.296+0000 7f4d0df9b700 1 -- 172.21.15.81:0/4012547597 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4d080c5210 msgr2=0x7f4d080cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:24.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.296+0000 7f4d0df9b700 1 --2- 172.21.15.81:0/4012547597 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4d080c5210 0x7f4d080cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.296+0000 7f4d0df9b700 1 -- 172.21.15.81:0/4012547597 >> v2:172.21.15.83:3300/0 conn(0x7f4d080cefb0 msgr2=0x7f4d080ad580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:24.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.296+0000 7f4d0df9b700 1 --2- 172.21.15.81:0/4012547597 >> v2:172.21.15.83:3300/0 conn(0x7f4d080cefb0 0x7f4d080ad580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.296+0000 7f4d0df9b700 1 -- 172.21.15.81:0/4012547597 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d08159b10 con 0x7f4d080b29d0 2023-10-06T03:24:24.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.296+0000 7f4d0d79a700 1 --2- 172.21.15.81:0/4012547597 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4d080c5210 0x7f4d080cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:24.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.296+0000 7f4d0df9b700 1 --2- 172.21.15.81:0/4012547597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d080b29d0 0x7f4d080c6130 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4d080caa60 tx=0x7f4d04009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9190c385a7e835f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:24.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.297+0000 7f4d0cf99700 1 -- 172.21.15.81:0/4012547597 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d04005c10 con 0x7f4d080b29d0 2023-10-06T03:24:24.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.297+0000 7f4d0cf99700 1 -- 172.21.15.81:0/4012547597 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d04005d70 con 0x7f4d080b29d0 2023-10-06T03:24:24.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.297+0000 7f4d0cf99700 1 -- 172.21.15.81:0/4012547597 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0400b840 con 0x7f4d080b29d0 2023-10-06T03:24:24.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.297+0000 7f4d101ff700 1 -- 172.21.15.81:0/4012547597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d080b29d0 msgr2=0x7f4d080c6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:24.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.297+0000 7f4d101ff700 1 --2- 172.21.15.81:0/4012547597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d080b29d0 0x7f4d080c6130 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4d080caa60 tx=0x7f4d04009220 comp rx=0 tx=0).stop 2023-10-06T03:24:24.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.297+0000 7f4d101ff700 1 -- 172.21.15.81:0/4012547597 shutdown_connections 2023-10-06T03:24:24.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.297+0000 7f4d101ff700 1 --2- 172.21.15.81:0/4012547597 >> v2:172.21.15.83:3300/0 conn(0x7f4d080cefb0 0x7f4d080ad580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.297+0000 7f4d101ff700 1 --2- 172.21.15.81:0/4012547597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d080b29d0 0x7f4d080c6130 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.297+0000 7f4d101ff700 1 --2- 172.21.15.81:0/4012547597 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4d080c5210 0x7f4d080cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.297+0000 7f4d101ff700 1 -- 172.21.15.81:0/4012547597 >> 172.21.15.81:0/4012547597 conn(0x7f4d080997d0 msgr2=0x7f4d0806f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.297+0000 7f4d101ff700 1 -- 172.21.15.81:0/4012547597 shutdown_connections 2023-10-06T03:24:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.297+0000 7f4d101ff700 1 -- 172.21.15.81:0/4012547597 wait complete. 2023-10-06T03:24:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.299+0000 7f4d101ff700 1 Processor -- start 2023-10-06T03:24:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.299+0000 7f4d101ff700 1 -- start start 2023-10-06T03:24:24.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.300+0000 7f4d101ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d080b29d0 0x7f4d0815c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:24.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.300+0000 7f4d101ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4d080c5210 0x7f4d080683b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:24.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.300+0000 7f4d101ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d080cefb0 0x7f4d080688f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:24.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.300+0000 7f4d101ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d080c9290 con 0x7f4d080cefb0 2023-10-06T03:24:24.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.300+0000 7f4d101ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d080c9540 con 0x7f4d080b29d0 2023-10-06T03:24:24.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.300+0000 7f4d101ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d080c9820 con 0x7f4d080c5210 2023-10-06T03:24:24.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.300+0000 7f4d0e79c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d080cefb0 0x7f4d080688f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:24.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.300+0000 7f4d0e79c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d080cefb0 0x7f4d080688f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55268/0 (socket says 172.21.15.81:55268) 2023-10-06T03:24:24.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.300+0000 7f4d0e79c700 1 -- 172.21.15.81:0/3837182789 learned_addr learned my addr 172.21.15.81:0/3837182789 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:24.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.300+0000 7f4d0df9b700 1 --2- 172.21.15.81:0/3837182789 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d080b29d0 0x7f4d0815c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:24.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.300+0000 7f4d0d79a700 1 --2- 172.21.15.81:0/3837182789 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4d080c5210 0x7f4d080683b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:24.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.300+0000 7f4d0e79c700 1 -- 172.21.15.81:0/3837182789 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4d080c5210 msgr2=0x7f4d080683b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:24.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.300+0000 7f4d0e79c700 1 --2- 172.21.15.81:0/3837182789 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4d080c5210 0x7f4d080683b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.301+0000 7f4d0e79c700 1 -- 172.21.15.81:0/3837182789 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d080b29d0 msgr2=0x7f4d0815c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:24.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.301+0000 7f4d0e79c700 1 --2- 172.21.15.81:0/3837182789 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d080b29d0 0x7f4d0815c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.301+0000 7f4d0e79c700 1 -- 172.21.15.81:0/3837182789 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d04009480 con 0x7f4d080cefb0 2023-10-06T03:24:24.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.301+0000 7f4d0df9b700 1 --2- 172.21.15.81:0/3837182789 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d080b29d0 0x7f4d0815c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:24.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.301+0000 7f4d0e79c700 1 --2- 172.21.15.81:0/3837182789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d080cefb0 0x7f4d080688f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4d00007f20 tx=0x7f4d00009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:24.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.301+0000 7f4cfdffb700 1 -- 172.21.15.81:0/3837182789 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0000eca0 con 0x7f4d080cefb0 2023-10-06T03:24:24.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.301+0000 7f4cfdffb700 1 -- 172.21.15.81:0/3837182789 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d0000ee20 con 0x7f4d080cefb0 2023-10-06T03:24:24.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.301+0000 7f4d101ff700 1 -- 172.21.15.81:0/3837182789 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d080c9b00 con 0x7f4d080cefb0 2023-10-06T03:24:24.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.301+0000 7f4cfdffb700 1 -- 172.21.15.81:0/3837182789 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d00014670 con 0x7f4d080cefb0 2023-10-06T03:24:24.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.301+0000 7f4d101ff700 1 -- 172.21.15.81:0/3837182789 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d080ca0c0 con 0x7f4d080cefb0 2023-10-06T03:24:24.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.302+0000 7f4d101ff700 1 -- 172.21.15.81:0/3837182789 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d0804c3c0 con 0x7f4d080cefb0 2023-10-06T03:24:24.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.303+0000 7f4cfdffb700 1 -- 172.21.15.81:0/3837182789 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4d000149e0 con 0x7f4d080cefb0 2023-10-06T03:24:24.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.304+0000 7f4cfdffb700 1 --2- 172.21.15.81:0/3837182789 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f4cec066f30 0x7f4cec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:24.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.304+0000 7f4cfdffb700 1 -- 172.21.15.81:0/3837182789 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f4d00085150 con 0x7f4d080cefb0 2023-10-06T03:24:24.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.304+0000 7f4d0df9b700 1 --2- 172.21.15.81:0/3837182789 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f4cec066f30 0x7f4cec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:24.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.304+0000 7f4d0df9b700 1 --2- 172.21.15.81:0/3837182789 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f4cec066f30 0x7f4cec0693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4d04009260 tx=0x7f4d04016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:24.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.307+0000 7f4cfdffb700 1 -- 172.21.15.81:0/3837182789 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4d00051ed0 con 0x7f4d080cefb0 2023-10-06T03:24:24.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.496+0000 7f4d101ff700 1 -- 172.21.15.81:0/3837182789 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f4d08063500 con 0x7f4d080cefb0 2023-10-06T03:24:24.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.497+0000 7f4cfdffb700 1 -- 172.21.15.81:0/3837182789 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4d000554f0 con 0x7f4d080cefb0 2023-10-06T03:24:24.498 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-10-06T03:24:24.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.499+0000 7f4d101ff700 1 -- 172.21.15.81:0/3837182789 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f4cec066f30 msgr2=0x7f4cec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:24.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.499+0000 7f4d101ff700 1 --2- 172.21.15.81:0/3837182789 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f4cec066f30 0x7f4cec0693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4d04009260 tx=0x7f4d04016000 comp rx=0 tx=0).stop 2023-10-06T03:24:24.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.499+0000 7f4d101ff700 1 -- 172.21.15.81:0/3837182789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d080cefb0 msgr2=0x7f4d080688f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:24.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.499+0000 7f4d101ff700 1 --2- 172.21.15.81:0/3837182789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d080cefb0 0x7f4d080688f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4d00007f20 tx=0x7f4d00009860 comp rx=0 tx=0).stop 2023-10-06T03:24:24.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.499+0000 7f4d101ff700 1 -- 172.21.15.81:0/3837182789 shutdown_connections 2023-10-06T03:24:24.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.499+0000 7f4d101ff700 1 --2- 172.21.15.81:0/3837182789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d080cefb0 0x7f4d080688f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.499+0000 7f4d101ff700 1 --2- 172.21.15.81:0/3837182789 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d080b29d0 0x7f4d0815c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.499+0000 7f4d101ff700 1 --2- 172.21.15.81:0/3837182789 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f4cec066f30 0x7f4cec0693e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.499+0000 7f4d101ff700 1 --2- 172.21.15.81:0/3837182789 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4d080c5210 0x7f4d080683b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.499+0000 7f4d101ff700 1 -- 172.21.15.81:0/3837182789 >> 172.21.15.81:0/3837182789 conn(0x7f4d080997d0 msgr2=0x7f4d080cb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:24.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.499+0000 7f4d101ff700 1 -- 172.21.15.81:0/3837182789 shutdown_connections 2023-10-06T03:24:24.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.499+0000 7f4d101ff700 1 -- 172.21.15.81:0/3837182789 wait complete. 2023-10-06T03:24:24.517 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:24:24.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.695+0000 7fdd367ff700 1 Processor -- start 2023-10-06T03:24:24.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.695+0000 7fdd367ff700 1 -- start start 2023-10-06T03:24:24.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.696+0000 7fdd367ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdd3013f9c0 0x7fdd300ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:24.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.696+0000 7fdd367ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdd300cab60 0x7fdd30159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:24.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.696+0000 7fdd367ff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd300cafe0 con 0x7fdd3013fd90 2023-10-06T03:24:24.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.696+0000 7fdd367ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd300cb2c0 con 0x7fdd3013f9c0 2023-10-06T03:24:24.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.696+0000 7fdd367ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd300cb5a0 con 0x7fdd300cab60 2023-10-06T03:24:24.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.697+0000 7fdd2ffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdd3013f9c0 0x7fdd300ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:24.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.697+0000 7fdd2ffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdd3013f9c0 0x7fdd300ca620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55276/0 (socket says 172.21.15.81:55276) 2023-10-06T03:24:24.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.697+0000 7fdd2ffff700 1 -- 172.21.15.81:0/3582570688 learned_addr learned my addr 172.21.15.81:0/3582570688 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:24.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.697+0000 7fdd2f7fe700 1 --2- 172.21.15.81:0/3582570688 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdd300cab60 0x7fdd30159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:24.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.697+0000 7fdd2ffff700 1 -- 172.21.15.81:0/3582570688 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdd300cab60 msgr2=0x7fdd30159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:24.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.697+0000 7fdd2ffff700 1 --2- 172.21.15.81:0/3582570688 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdd300cab60 0x7fdd30159eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.697+0000 7fdd2ffff700 1 -- 172.21.15.81:0/3582570688 >> v1:172.21.15.83:6789/0 conn(0x7fdd3013fd90 legacy=0x7fdd3006e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:24.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.697+0000 7fdd2ffff700 1 -- 172.21.15.81:0/3582570688 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd300cb880 con 0x7fdd3013f9c0 2023-10-06T03:24:24.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.697+0000 7fdd2ffff700 1 --2- 172.21.15.81:0/3582570688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd3013f9c0 0x7fdd300ca620 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdd200099b0 tx=0x7fdd20009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ccffdb602f540e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:24.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.698+0000 7fdd2effd700 1 -- 172.21.15.81:0/3582570688 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd20009ea0 con 0x7fdd3013f9c0 2023-10-06T03:24:24.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.698+0000 7fdd2effd700 1 -- 172.21.15.81:0/3582570688 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd2000b860 con 0x7fdd3013f9c0 2023-10-06T03:24:24.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.698+0000 7fdd2effd700 1 -- 172.21.15.81:0/3582570688 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2000bc00 con 0x7fdd3013f9c0 2023-10-06T03:24:24.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.698+0000 7fdd367ff700 1 -- 172.21.15.81:0/3582570688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd3013f9c0 msgr2=0x7fdd300ca620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:24.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.698+0000 7fdd367ff700 1 --2- 172.21.15.81:0/3582570688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd3013f9c0 0x7fdd300ca620 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdd200099b0 tx=0x7fdd20009250 comp rx=0 tx=0).stop 2023-10-06T03:24:24.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.698+0000 7fdd367ff700 1 -- 172.21.15.81:0/3582570688 shutdown_connections 2023-10-06T03:24:24.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.698+0000 7fdd367ff700 1 --2- 172.21.15.81:0/3582570688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd3013f9c0 0x7fdd300ca620 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.698+0000 7fdd367ff700 1 --2- 172.21.15.81:0/3582570688 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdd300cab60 0x7fdd30159eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.698+0000 7fdd367ff700 1 -- 172.21.15.81:0/3582570688 >> 172.21.15.81:0/3582570688 conn(0x7fdd300cc090 msgr2=0x7fdd300cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:24.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.698+0000 7fdd367ff700 1 -- 172.21.15.81:0/3582570688 shutdown_connections 2023-10-06T03:24:24.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.698+0000 7fdd367ff700 1 -- 172.21.15.81:0/3582570688 wait complete. 2023-10-06T03:24:24.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.700+0000 7fdd367ff700 1 Processor -- start 2023-10-06T03:24:24.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.700+0000 7fdd367ff700 1 -- start start 2023-10-06T03:24:24.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.701+0000 7fdd367ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdd3013f9c0 0x7fdd3015bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:24.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.701+0000 7fdd367ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd3013fd90 0x7fdd30159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:24.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.701+0000 7fdd367ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd301598d0 0x7fdd3015a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:24.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.701+0000 7fdd367ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3015a930 con 0x7fdd3013fd90 2023-10-06T03:24:24.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.701+0000 7fdd367ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3015ab30 con 0x7fdd301598d0 2023-10-06T03:24:24.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.701+0000 7fdd367ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3015ae10 con 0x7fdd3013f9c0 2023-10-06T03:24:24.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.701+0000 7fdd2f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd3013fd90 0x7fdd30159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:24.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.701+0000 7fdd2f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd3013fd90 0x7fdd30159eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55278/0 (socket says 172.21.15.81:55278) 2023-10-06T03:24:24.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.701+0000 7fdd2f7fe700 1 -- 172.21.15.81:0/1034037462 learned_addr learned my addr 172.21.15.81:0/1034037462 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:24.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.701+0000 7fdd2ffff700 1 --2- 172.21.15.81:0/1034037462 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdd3013f9c0 0x7fdd3015bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:24.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.701+0000 7fdd2f7fe700 1 -- 172.21.15.81:0/1034037462 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdd3013f9c0 msgr2=0x7fdd3015bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:24.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.701+0000 7fdd2f7fe700 1 --2- 172.21.15.81:0/1034037462 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdd3013f9c0 0x7fdd3015bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.701+0000 7fdd2f7fe700 1 -- 172.21.15.81:0/1034037462 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd301598d0 msgr2=0x7fdd3015a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:24.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.701+0000 7fdd34d9c700 1 --2- 172.21.15.81:0/1034037462 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd301598d0 0x7fdd3015a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:24.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.701+0000 7fdd2f7fe700 1 --2- 172.21.15.81:0/1034037462 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd301598d0 0x7fdd3015a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.701+0000 7fdd2f7fe700 1 -- 172.21.15.81:0/1034037462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd200094f0 con 0x7fdd3013fd90 2023-10-06T03:24:24.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.701+0000 7fdd34d9c700 1 --2- 172.21.15.81:0/1034037462 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd301598d0 0x7fdd3015a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:24.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.702+0000 7fdd2f7fe700 1 --2- 172.21.15.81:0/1034037462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd3013fd90 0x7fdd30159eb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdd2400ec80 tx=0x7fdd240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:24.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.702+0000 7fdd17fff700 1 -- 172.21.15.81:0/1034037462 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2400c9d0 con 0x7fdd3013fd90 2023-10-06T03:24:24.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.702+0000 7fdd17fff700 1 -- 172.21.15.81:0/1034037462 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd2400cb30 con 0x7fdd3013fd90 2023-10-06T03:24:24.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.702+0000 7fdd17fff700 1 -- 172.21.15.81:0/1034037462 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd24013470 con 0x7fdd3013fd90 2023-10-06T03:24:24.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.702+0000 7fdd367ff700 1 -- 172.21.15.81:0/1034037462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd3015b0f0 con 0x7fdd3013fd90 2023-10-06T03:24:24.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.702+0000 7fdd367ff700 1 -- 172.21.15.81:0/1034037462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd3015b6b0 con 0x7fdd3013fd90 2023-10-06T03:24:24.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.703+0000 7fdd367ff700 1 -- 172.21.15.81:0/1034037462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd3004c3c0 con 0x7fdd3013fd90 2023-10-06T03:24:24.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.704+0000 7fdd17fff700 1 -- 172.21.15.81:0/1034037462 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdd24013820 con 0x7fdd3013fd90 2023-10-06T03:24:24.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.705+0000 7fdd17fff700 1 --2- 172.21.15.81:0/1034037462 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fdd1c066f30 0x7fdd1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:24.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.705+0000 7fdd17fff700 1 -- 172.21.15.81:0/1034037462 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fdd24084cf0 con 0x7fdd3013fd90 2023-10-06T03:24:24.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.705+0000 7fdd2ffff700 1 --2- 172.21.15.81:0/1034037462 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fdd1c066f30 0x7fdd1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:24.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.706+0000 7fdd2ffff700 1 --2- 172.21.15.81:0/1034037462 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fdd1c066f30 0x7fdd1c0693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdd200099b0 tx=0x7fdd20017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:24.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.709+0000 7fdd17fff700 1 -- 172.21.15.81:0/1034037462 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdd24089070 con 0x7fdd3013fd90 2023-10-06T03:24:24.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.903+0000 7fdd367ff700 1 -- 172.21.15.81:0/1034037462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd3006f720 con 0x7fdd3013fd90 2023-10-06T03:24:24.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.904+0000 7fdd17fff700 1 -- 172.21.15.81:0/1034037462 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18659 (secure 0 0 0) 0x7fdd24051b10 con 0x7fdd3013fd90 2023-10-06T03:24:24.906 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:24:24.906 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"fsid":"1807b5d7-9be8-43ad-aaf8-99a4273430b3","created":"2023-10-06T03:23:20.805306+0000","modified":"2023-10-06T03:23:45.419616+0000","last_up_change":"2023-10-06T03:23:32.735796+0000","last_in_change":"2023-10-06T03:23:24.109024+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:33.198850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:33.606744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:23:38.742266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:23:39.347944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:23:42.959054+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"14fb667d-a677-4978-a477-80027f889d36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":85563},{"type":"v1","addr":"172.21.15.81:6818","nonce":85563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":85563},{"type":"v1","addr":"172.21.15.81:6822","nonce":85563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":85563},{"type":"v1","addr":"172.21.15.81:6830","nonce":85563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":85563},{"type":"v1","addr":"172.21.15.81:6826","nonce":85563}]},"public_addr":"172.21.15.81:6818/85563","cluster_addr":"172.21.15.81:6822/85563","heartbeat_back_addr":"172.21.15.81:6830/85563","heartbeat_front_addr":"172.21.15.81:6826/85563","state":["exists","up"]},{"osd":1,"uuid":"974d8a86-1829-4176-89ce-18e6038857f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":85561},{"type":"v1","addr":"172.21.15.81:6801","nonce":85561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":85561},{"type":"v1","addr":"172.21.15.81:6803","nonce":85561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":85561},{"type":"v1","addr":"172.21.15.81:6807","nonce":85561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":85561},{"type":"v1","addr":"172.21.15.81:6805","nonce":85561}]},"public_addr":"172.21.15.81:6801/85561","cluster_addr":"172.21.15.81:6803/85561","heartbeat_back_addr":"172.21.15.81:6807/85561","heartbeat_front_addr":"172.21.15.81:6805/85561","state":["exists","up"]},{"osd":2,"uuid":"ffbfe056-46bc-46e0-bf49-4d8f8650e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":85564},{"type":"v1","addr":"172.21.15.81:6809","nonce":85564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":85564},{"type":"v1","addr":"172.21.15.81:6811","nonce":85564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":85564},{"type":"v1","addr":"172.21.15.81:6815","nonce":85564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":85564},{"type":"v1","addr":"172.21.15.81:6813","nonce":85564}]},"public_addr":"172.21.15.81:6809/85564","cluster_addr":"172.21.15.81:6811/85564","heartbeat_back_addr":"172.21.15.81:6815/85564","heartbeat_front_addr":"172.21.15.81:6813/85564","state":["exists","up"]},{"osd":3,"uuid":"ef9a8314-3d37-4ea1-858a-e704d5695002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":85562},{"type":"v1","addr":"172.21.15.81:6819","nonce":85562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":85562},{"type":"v1","addr":"172.21.15.81:6823","nonce":85562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":85562},{"type":"v1","addr":"172.21.15.81:6831","nonce":85562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":85562},{"type":"v1","addr":"172.21.15.81:6827","nonce":85562}]},"public_addr":"172.21.15.81:6819/85562","cluster_addr":"172.21.15.81:6823/85562","heartbeat_back_addr":"172.21.15.81:6831/85562","heartbeat_front_addr":"172.21.15.81:6827/85562","state":["exists","up"]},{"osd":4,"uuid":"d83506a0-2c96-4bcb-a9fa-05e43dc329df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":85785},{"type":"v1","addr":"172.21.15.83:6801","nonce":85785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":85785},{"type":"v1","addr":"172.21.15.83:6803","nonce":85785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":85785},{"type":"v1","addr":"172.21.15.83:6807","nonce":85785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":85785},{"type":"v1","addr":"172.21.15.83:6805","nonce":85785}]},"public_addr":"172.21.15.83:6801/85785","cluster_addr":"172.21.15.83:6803/85785","heartbeat_back_addr":"172.21.15.83:6807/85785","heartbeat_front_addr":"172.21.15.83:6805/85785","state":["exists","up"]},{"osd":5,"uuid":"10687c63-a3d5-472f-acc0-4f61847b6e0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":85818},{"type":"v1","addr":"172.21.15.83:6825","nonce":85818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":85818},{"type":"v1","addr":"172.21.15.83:6827","nonce":85818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":85818},{"type":"v1","addr":"172.21.15.83:6831","nonce":85818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":85818},{"type":"v1","addr":"172.21.15.83:6829","nonce":85818}]},"public_addr":"172.21.15.83:6825/85818","cluster_addr":"172.21.15.83:6827/85818","heartbeat_back_addr":"172.21.15.83:6831/85818","heartbeat_front_addr":"172.21.15.83:6829/85818","state":["exists","up"]},{"osd":6,"uuid":"2e9daf76-5607-4a29-9a58-6e270700d223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":85787},{"type":"v1","addr":"172.21.15.83:6811","nonce":85787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":85787},{"type":"v1","addr":"172.21.15.83:6815","nonce":85787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":85787},{"type":"v1","addr":"172.21.15.83:6823","nonce":85787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6817","nonce":85787},{"type":"v1","addr":"172.21.15.83:6819","nonce":85787}]},"public_addr":"172.21.15.83:6811/85787","cluster_addr":"172.21.15.83:6815/85787","heartbeat_back_addr":"172.21.15.83:6823/85787","heartbeat_front_addr":"172.21.15.83:6819/85787","state":["exists","up"]},{"osd":7,"uuid":"5019e1ff-233a-4a5a-91ca-8afccb7ab6e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":85786},{"type":"v1","addr":"172.21.15.83:6810","nonce":85786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":85786},{"type":"v1","addr":"172.21.15.83:6814","nonce":85786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":85786},{"type":"v1","addr":"172.21.15.83:6822","nonce":85786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":85786},{"type":"v1","addr":"172.21.15.83:6818","nonce":85786}]},"public_addr":"172.21.15.83:6810/85786","cluster_addr":"172.21.15.83:6814/85786","heartbeat_back_addr":"172.21.15.83:6822/85786","heartbeat_front_addr":"172.21.15.83:6818/85786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.393431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.360031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.407428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.391613+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.403211+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.438142+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.496181+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.472323+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:24:24.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.907+0000 7fdd367ff700 1 -- 172.21.15.81:0/1034037462 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fdd1c066f30 msgr2=0x7fdd1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:24.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.907+0000 7fdd367ff700 1 --2- 172.21.15.81:0/1034037462 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fdd1c066f30 0x7fdd1c0693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdd200099b0 tx=0x7fdd20017000 comp rx=0 tx=0).stop 2023-10-06T03:24:24.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.907+0000 7fdd367ff700 1 -- 172.21.15.81:0/1034037462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd3013fd90 msgr2=0x7fdd30159eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:24.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.907+0000 7fdd367ff700 1 --2- 172.21.15.81:0/1034037462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd3013fd90 0x7fdd30159eb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdd2400ec80 tx=0x7fdd240091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.907+0000 7fdd367ff700 1 -- 172.21.15.81:0/1034037462 shutdown_connections 2023-10-06T03:24:24.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.907+0000 7fdd367ff700 1 --2- 172.21.15.81:0/1034037462 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd301598d0 0x7fdd3015a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.907+0000 7fdd367ff700 1 --2- 172.21.15.81:0/1034037462 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fdd1c066f30 0x7fdd1c0693e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.907+0000 7fdd367ff700 1 --2- 172.21.15.81:0/1034037462 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdd3013f9c0 0x7fdd3015bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.907+0000 7fdd367ff700 1 --2- 172.21.15.81:0/1034037462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd3013fd90 0x7fdd30159eb0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:24.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.907+0000 7fdd367ff700 1 -- 172.21.15.81:0/1034037462 >> 172.21.15.81:0/1034037462 conn(0x7fdd300cc090 msgr2=0x7fdd3013ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:24.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.907+0000 7fdd367ff700 1 -- 172.21.15.81:0/1034037462 shutdown_connections 2023-10-06T03:24:24.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:24.907+0000 7fdd367ff700 1 -- 172.21.15.81:0/1034037462 wait complete. 2023-10-06T03:24:24.926 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:23:33.198850+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:23:33.606744+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:23:38.742266+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:23:39.347944+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T03:23:42.959054+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:24:24.926 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:24:25.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.112+0000 7f0baffff700 1 Processor -- start 2023-10-06T03:24:25.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.112+0000 7f0baffff700 1 -- start start 2023-10-06T03:24:25.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.113+0000 7f0baffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0bb0156400 0x7f0bb00c6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:25.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.113+0000 7f0baffff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0bb00c7340 0x7f0bb006a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:25.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.113+0000 7f0baffff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bb006e080 con 0x7f0bb0156030 2023-10-06T03:24:25.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.113+0000 7f0baffff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bb006d1b0 con 0x7f0bb0156400 2023-10-06T03:24:25.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.113+0000 7f0baffff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb006ec20 con 0x7f0bb00c7340 2023-10-06T03:24:25.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.113+0000 7f0ba7fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0bb0156400 0x7f0bb00c6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:25.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.113+0000 7f0ba7fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0bb0156400 0x7f0bb00c6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55280/0 (socket says 172.21.15.81:55280) 2023-10-06T03:24:25.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.113+0000 7f0ba7fff700 1 -- 172.21.15.81:0/829870283 learned_addr learned my addr 172.21.15.81:0/829870283 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:25.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.113+0000 7f0baf7fe700 1 --2- 172.21.15.81:0/829870283 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0bb00c7340 0x7f0bb006a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:25.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.114+0000 7f0ba7fff700 1 -- 172.21.15.81:0/829870283 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0bb00c7340 msgr2=0x7f0bb006a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:25.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.114+0000 7f0ba7fff700 1 --2- 172.21.15.81:0/829870283 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0bb00c7340 0x7f0bb006a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.114+0000 7f0ba7fff700 1 -- 172.21.15.81:0/829870283 >> v1:172.21.15.83:6789/0 conn(0x7f0bb0156030 legacy=0x7f0bb006e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:25.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.114+0000 7f0ba7fff700 1 -- 172.21.15.81:0/829870283 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb006d470 con 0x7f0bb0156400 2023-10-06T03:24:25.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.114+0000 7f0ba7fff700 1 --2- 172.21.15.81:0/829870283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bb0156400 0x7f0bb00c6e00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0b980099b0 tx=0x7f0b98009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f31f3d0ec34a1edb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:25.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.114+0000 7f0bae7fc700 1 -- 172.21.15.81:0/829870283 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b98009ea0 con 0x7f0bb0156400 2023-10-06T03:24:25.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.114+0000 7f0bae7fc700 1 -- 172.21.15.81:0/829870283 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b9800b860 con 0x7f0bb0156400 2023-10-06T03:24:25.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.114+0000 7f0bae7fc700 1 -- 172.21.15.81:0/829870283 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9800bc00 con 0x7f0bb0156400 2023-10-06T03:24:25.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.115+0000 7f0baffff700 1 -- 172.21.15.81:0/829870283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bb0156400 msgr2=0x7f0bb00c6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:25.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.115+0000 7f0baffff700 1 --2- 172.21.15.81:0/829870283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bb0156400 0x7f0bb00c6e00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0b980099b0 tx=0x7f0b98009250 comp rx=0 tx=0).stop 2023-10-06T03:24:25.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.115+0000 7f0baffff700 1 -- 172.21.15.81:0/829870283 shutdown_connections 2023-10-06T03:24:25.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.115+0000 7f0baffff700 1 --2- 172.21.15.81:0/829870283 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0bb00c7340 0x7f0bb006a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.115+0000 7f0baffff700 1 --2- 172.21.15.81:0/829870283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bb0156400 0x7f0bb00c6e00 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.115+0000 7f0baffff700 1 -- 172.21.15.81:0/829870283 >> 172.21.15.81:0/829870283 conn(0x7f0bb00680b0 msgr2=0x7f0bb00cbeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:25.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.115+0000 7f0baffff700 1 -- 172.21.15.81:0/829870283 shutdown_connections 2023-10-06T03:24:25.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.115+0000 7f0baffff700 1 -- 172.21.15.81:0/829870283 wait complete. 2023-10-06T03:24:25.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.116+0000 7f0baffff700 1 Processor -- start 2023-10-06T03:24:25.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.117+0000 7f0baffff700 1 -- start start 2023-10-06T03:24:25.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.117+0000 7f0baffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bb00c7340 0x7f0bb014fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:25.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.118+0000 7f0baffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0bb0156030 0x7f0bb00c1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:25.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.118+0000 7f0baffff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0bb0156400 0x7f0bb016d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:25.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.118+0000 7f0baffff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb00c1750 con 0x7f0bb00c7340 2023-10-06T03:24:25.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.118+0000 7f0baffff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb00c1a00 con 0x7f0bb0156030 2023-10-06T03:24:25.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.118+0000 7f0baffff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb00c1ce0 con 0x7f0bb0156400 2023-10-06T03:24:25.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.118+0000 7f0baeffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bb00c7340 0x7f0bb014fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:25.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.118+0000 7f0baeffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bb00c7340 0x7f0bb014fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55288/0 (socket says 172.21.15.81:55288) 2023-10-06T03:24:25.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.118+0000 7f0baeffd700 1 -- 172.21.15.81:0/4268819311 learned_addr learned my addr 172.21.15.81:0/4268819311 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:25.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.118+0000 7f0baf7fe700 1 --2- 172.21.15.81:0/4268819311 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0bb0156400 0x7f0bb016d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:25.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.118+0000 7f0ba7fff700 1 --2- 172.21.15.81:0/4268819311 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0bb0156030 0x7f0bb00c1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:25.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.118+0000 7f0baeffd700 1 -- 172.21.15.81:0/4268819311 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0bb0156400 msgr2=0x7f0bb016d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:25.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.118+0000 7f0baeffd700 1 --2- 172.21.15.81:0/4268819311 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0bb0156400 0x7f0bb016d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.118+0000 7f0baeffd700 1 -- 172.21.15.81:0/4268819311 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0bb0156030 msgr2=0x7f0bb00c1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:25.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.118+0000 7f0baeffd700 1 --2- 172.21.15.81:0/4268819311 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0bb0156030 0x7f0bb00c1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.118+0000 7f0baeffd700 1 -- 172.21.15.81:0/4268819311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b980094f0 con 0x7f0bb00c7340 2023-10-06T03:24:25.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.118+0000 7f0ba7fff700 1 --2- 172.21.15.81:0/4268819311 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0bb0156030 0x7f0bb00c1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:25.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.118+0000 7f0baeffd700 1 --2- 172.21.15.81:0/4268819311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bb00c7340 0x7f0bb014fff0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0ba000c590 tx=0x7f0ba000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:25.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.119+0000 7f0ba6ffd700 1 -- 172.21.15.81:0/4268819311 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba0011590 con 0x7f0bb00c7340 2023-10-06T03:24:25.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.119+0000 7f0ba6ffd700 1 -- 172.21.15.81:0/4268819311 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba00116f0 con 0x7f0bb00c7340 2023-10-06T03:24:25.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.119+0000 7f0ba6ffd700 1 -- 172.21.15.81:0/4268819311 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba0011ab0 con 0x7f0bb00c7340 2023-10-06T03:24:25.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.119+0000 7f0baffff700 1 -- 172.21.15.81:0/4268819311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bb00c1fc0 con 0x7f0bb00c7340 2023-10-06T03:24:25.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.119+0000 7f0baffff700 1 -- 172.21.15.81:0/4268819311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bb014aa60 con 0x7f0bb00c7340 2023-10-06T03:24:25.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.120+0000 7f0baffff700 1 -- 172.21.15.81:0/4268819311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bb016afd0 con 0x7f0bb00c7340 2023-10-06T03:24:25.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.120+0000 7f0ba6ffd700 1 -- 172.21.15.81:0/4268819311 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0ba001b3b0 con 0x7f0bb00c7340 2023-10-06T03:24:25.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.121+0000 7f0ba6ffd700 1 --2- 172.21.15.81:0/4268819311 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0b90066f30 0x7f0b900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:25.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.121+0000 7f0ba6ffd700 1 -- 172.21.15.81:0/4268819311 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f0ba0083f50 con 0x7f0bb00c7340 2023-10-06T03:24:25.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.122+0000 7f0ba7fff700 1 --2- 172.21.15.81:0/4268819311 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0b90066f30 0x7f0b900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:25.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.122+0000 7f0ba7fff700 1 --2- 172.21.15.81:0/4268819311 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0b90066f30 0x7f0b900693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0b980099b0 tx=0x7f0b98017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:25.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.125+0000 7f0ba6ffd700 1 -- 172.21.15.81:0/4268819311 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0bb016afd0 con 0x7f0bb00c7340 2023-10-06T03:24:25.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.313+0000 7f0baffff700 1 -- 172.21.15.81:0/4268819311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0bb016afd0 con 0x7f0bb00c7340 2023-10-06T03:24:25.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.314+0000 7f0ba6ffd700 1 -- 172.21.15.81:0/4268819311 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0bb016afd0 con 0x7f0bb00c7340 2023-10-06T03:24:25.315 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-10-06T03:24:25.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.316+0000 7f0baffff700 1 -- 172.21.15.81:0/4268819311 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0b90066f30 msgr2=0x7f0b900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:25.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.316+0000 7f0baffff700 1 --2- 172.21.15.81:0/4268819311 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0b90066f30 0x7f0b900693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0b980099b0 tx=0x7f0b98017000 comp rx=0 tx=0).stop 2023-10-06T03:24:25.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.316+0000 7f0baffff700 1 -- 172.21.15.81:0/4268819311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bb00c7340 msgr2=0x7f0bb014fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:25.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.316+0000 7f0baffff700 1 --2- 172.21.15.81:0/4268819311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bb00c7340 0x7f0bb014fff0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0ba000c590 tx=0x7f0ba000c950 comp rx=0 tx=0).stop 2023-10-06T03:24:25.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.316+0000 7f0baffff700 1 -- 172.21.15.81:0/4268819311 shutdown_connections 2023-10-06T03:24:25.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.316+0000 7f0baffff700 1 --2- 172.21.15.81:0/4268819311 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0b90066f30 0x7f0b900693e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.316+0000 7f0baffff700 1 --2- 172.21.15.81:0/4268819311 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0bb0156400 0x7f0bb016d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.316+0000 7f0baffff700 1 --2- 172.21.15.81:0/4268819311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bb00c7340 0x7f0bb014fff0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.316+0000 7f0baffff700 1 --2- 172.21.15.81:0/4268819311 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0bb0156030 0x7f0bb00c1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.316+0000 7f0baffff700 1 -- 172.21.15.81:0/4268819311 >> 172.21.15.81:0/4268819311 conn(0x7f0bb00680b0 msgr2=0x7f0bb0069b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:25.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.316+0000 7f0baffff700 1 -- 172.21.15.81:0/4268819311 shutdown_connections 2023-10-06T03:24:25.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.317+0000 7f0baffff700 1 -- 172.21.15.81:0/4268819311 wait complete. 2023-10-06T03:24:25.334 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:24:25.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.517+0000 7fd8fb59e700 1 Processor -- start 2023-10-06T03:24:25.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.517+0000 7fd8fb59e700 1 -- start start 2023-10-06T03:24:25.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.518+0000 7fd8fb59e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd8fc1535a0 0x7fd8fc15ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:25.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.518+0000 7fd8fb59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd8fc157670 0x7fd8fc0b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:25.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.518+0000 7fd8fb59e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8fc15bef0 con 0x7fd8fc15a560 2023-10-06T03:24:25.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.518+0000 7fd8fb59e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8fc0d1160 con 0x7fd8fc157670 2023-10-06T03:24:25.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.518+0000 7fd8fb59e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8fc15a9e0 con 0x7fd8fc1535a0 2023-10-06T03:24:25.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.518+0000 7fd8fad9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd8fc157670 0x7fd8fc0b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:25.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.518+0000 7fd8fad9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd8fc157670 0x7fd8fc0b1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55292/0 (socket says 172.21.15.81:55292) 2023-10-06T03:24:25.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.518+0000 7fd8fad9d700 1 -- 172.21.15.81:0/4123539072 learned_addr learned my addr 172.21.15.81:0/4123539072 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:25.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.519+0000 7fd8fa59c700 1 --2- 172.21.15.81:0/4123539072 >> v2:172.21.15.83:3300/0 conn(0x7fd8fc1535a0 0x7fd8fc15ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:25.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.519+0000 7fd8fad9d700 1 -- 172.21.15.81:0/4123539072 >> v2:172.21.15.83:3300/0 conn(0x7fd8fc1535a0 msgr2=0x7fd8fc15ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:25.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.519+0000 7fd8fad9d700 1 --2- 172.21.15.81:0/4123539072 >> v2:172.21.15.83:3300/0 conn(0x7fd8fc1535a0 0x7fd8fc15ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.519+0000 7fd8fad9d700 1 -- 172.21.15.81:0/4123539072 >> v1:172.21.15.83:6789/0 conn(0x7fd8fc15a560 legacy=0x7fd8fc153970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:25.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.519+0000 7fd8fad9d700 1 -- 172.21.15.81:0/4123539072 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8fc15b2e0 con 0x7fd8fc157670 2023-10-06T03:24:25.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.519+0000 7fd8fa59c700 1 --2- 172.21.15.81:0/4123539072 >> v2:172.21.15.83:3300/0 conn(0x7fd8fc1535a0 0x7fd8fc15ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:25.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.519+0000 7fd8fad9d700 1 --2- 172.21.15.81:0/4123539072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8fc157670 0x7fd8fc0b1cf0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc0d1430 tx=0x7fd8f4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e8f9e5ff38f9acf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:25.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.519+0000 7fd8f959a700 1 -- 172.21.15.81:0/4123539072 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f400e070 con 0x7fd8fc157670 2023-10-06T03:24:25.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.519+0000 7fd8f959a700 1 -- 172.21.15.81:0/4123539072 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f400ba10 con 0x7fd8fc157670 2023-10-06T03:24:25.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.519+0000 7fd8f959a700 1 -- 172.21.15.81:0/4123539072 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f40092e0 con 0x7fd8fc157670 2023-10-06T03:24:25.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.520+0000 7fd8fb59e700 1 -- 172.21.15.81:0/4123539072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8fc157670 msgr2=0x7fd8fc0b1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:25.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.520+0000 7fd8fb59e700 1 --2- 172.21.15.81:0/4123539072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8fc157670 0x7fd8fc0b1cf0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc0d1430 tx=0x7fd8f4009840 comp rx=0 tx=0).stop 2023-10-06T03:24:25.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.520+0000 7fd8fb59e700 1 -- 172.21.15.81:0/4123539072 shutdown_connections 2023-10-06T03:24:25.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.520+0000 7fd8fb59e700 1 --2- 172.21.15.81:0/4123539072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8fc157670 0x7fd8fc0b1cf0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.520+0000 7fd8fb59e700 1 --2- 172.21.15.81:0/4123539072 >> v2:172.21.15.83:3300/0 conn(0x7fd8fc1535a0 0x7fd8fc15ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.520+0000 7fd8fb59e700 1 -- 172.21.15.81:0/4123539072 >> 172.21.15.81:0/4123539072 conn(0x7fd8fc068230 msgr2=0x7fd8fc068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:25.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.520+0000 7fd8fb59e700 1 -- 172.21.15.81:0/4123539072 shutdown_connections 2023-10-06T03:24:25.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.520+0000 7fd8fb59e700 1 -- 172.21.15.81:0/4123539072 wait complete. 2023-10-06T03:24:25.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.521+0000 7fd8fb59e700 1 Processor -- start 2023-10-06T03:24:25.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.521+0000 7fd8fb59e700 1 -- start start 2023-10-06T03:24:25.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.522+0000 7fd8fb59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8fc1535a0 0x7fd8fc0b21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:25.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.522+0000 7fd8fb59e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8fc157670 0x7fd8fc156270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:25.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.522+0000 7fd8fb59e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd8fc15a560 0x7fd8fc152d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:25.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.522+0000 7fd8fb59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc156970 con 0x7fd8fc1535a0 2023-10-06T03:24:25.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.522+0000 7fd8fb59e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc0afcf0 con 0x7fd8fc157670 2023-10-06T03:24:25.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.522+0000 7fd8fb59e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc0affd0 con 0x7fd8fc15a560 2023-10-06T03:24:25.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.522+0000 7fd8fa59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8fc1535a0 0x7fd8fc0b21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:25.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.522+0000 7fd8fa59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8fc1535a0 0x7fd8fc0b21a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55304/0 (socket says 172.21.15.81:55304) 2023-10-06T03:24:25.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.523+0000 7fd8fa59c700 1 -- 172.21.15.81:0/1703235998 learned_addr learned my addr 172.21.15.81:0/1703235998 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:25.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.523+0000 7fd8fad9d700 1 --2- 172.21.15.81:0/1703235998 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd8fc15a560 0x7fd8fc152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:25.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.523+0000 7fd8f9d9b700 1 --2- 172.21.15.81:0/1703235998 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8fc157670 0x7fd8fc156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:25.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.523+0000 7fd8fa59c700 1 -- 172.21.15.81:0/1703235998 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd8fc15a560 msgr2=0x7fd8fc152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:25.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.523+0000 7fd8fa59c700 1 --2- 172.21.15.81:0/1703235998 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd8fc15a560 0x7fd8fc152d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.523+0000 7fd8fa59c700 1 -- 172.21.15.81:0/1703235998 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8fc157670 msgr2=0x7fd8fc156270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:25.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.523+0000 7fd8fa59c700 1 --2- 172.21.15.81:0/1703235998 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8fc157670 0x7fd8fc156270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.523+0000 7fd8fa59c700 1 -- 172.21.15.81:0/1703235998 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f4009ae0 con 0x7fd8fc1535a0 2023-10-06T03:24:25.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.523+0000 7fd8fa59c700 1 --2- 172.21.15.81:0/1703235998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8fc1535a0 0x7fd8fc0b21a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec00c830 tx=0x7fd8ec008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:25.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.523+0000 7fd8ea7fc700 1 -- 172.21.15.81:0/1703235998 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec011600 con 0x7fd8fc1535a0 2023-10-06T03:24:25.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.523+0000 7fd8ea7fc700 1 -- 172.21.15.81:0/1703235998 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8ec011760 con 0x7fd8fc1535a0 2023-10-06T03:24:25.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.523+0000 7fd8ea7fc700 1 -- 172.21.15.81:0/1703235998 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec011b20 con 0x7fd8fc1535a0 2023-10-06T03:24:25.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.523+0000 7fd8fb59e700 1 -- 172.21.15.81:0/1703235998 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8fc0b02b0 con 0x7fd8fc1535a0 2023-10-06T03:24:25.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.524+0000 7fd8fb59e700 1 -- 172.21.15.81:0/1703235998 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8fc153290 con 0x7fd8fc1535a0 2023-10-06T03:24:25.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.525+0000 7fd8fb59e700 1 -- 172.21.15.81:0/1703235998 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8fc04c3c0 con 0x7fd8fc1535a0 2023-10-06T03:24:25.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.525+0000 7fd8ea7fc700 1 -- 172.21.15.81:0/1703235998 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd8ec00a3e0 con 0x7fd8fc1535a0 2023-10-06T03:24:25.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.526+0000 7fd8ea7fc700 1 --2- 172.21.15.81:0/1703235998 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fd8dc066f30 0x7fd8dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:25.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.526+0000 7fd8ea7fc700 1 -- 172.21.15.81:0/1703235998 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fd8ec084e10 con 0x7fd8fc1535a0 2023-10-06T03:24:25.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.527+0000 7fd8f9d9b700 1 --2- 172.21.15.81:0/1703235998 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fd8dc066f30 0x7fd8dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:25.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.527+0000 7fd8f9d9b700 1 --2- 172.21.15.81:0/1703235998 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fd8dc066f30 0x7fd8dc0693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0006fd0 tx=0x7fd8f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:25.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.530+0000 7fd8ea7fc700 1 -- 172.21.15.81:0/1703235998 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd8ec051c30 con 0x7fd8fc1535a0 2023-10-06T03:24:25.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.722+0000 7fd8fb59e700 1 -- 172.21.15.81:0/1703235998 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd8fc15b5c0 con 0x7fd8fc1535a0 2023-10-06T03:24:25.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.722+0000 7fd8ea7fc700 1 -- 172.21.15.81:0/1703235998 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd8ec0150a0 con 0x7fd8fc1535a0 2023-10-06T03:24:25.723 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-06T03:24:25.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.724+0000 7fd8fb59e700 1 -- 172.21.15.81:0/1703235998 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fd8dc066f30 msgr2=0x7fd8dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:25.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.724+0000 7fd8fb59e700 1 --2- 172.21.15.81:0/1703235998 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fd8dc066f30 0x7fd8dc0693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0006fd0 tx=0x7fd8f0008040 comp rx=0 tx=0).stop 2023-10-06T03:24:25.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.724+0000 7fd8fb59e700 1 -- 172.21.15.81:0/1703235998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8fc1535a0 msgr2=0x7fd8fc0b21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:25.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.724+0000 7fd8fb59e700 1 --2- 172.21.15.81:0/1703235998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8fc1535a0 0x7fd8fc0b21a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec00c830 tx=0x7fd8ec008040 comp rx=0 tx=0).stop 2023-10-06T03:24:25.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.724+0000 7fd8fb59e700 1 -- 172.21.15.81:0/1703235998 shutdown_connections 2023-10-06T03:24:25.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.724+0000 7fd8fb59e700 1 --2- 172.21.15.81:0/1703235998 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fd8dc066f30 0x7fd8dc0693e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.724+0000 7fd8fb59e700 1 --2- 172.21.15.81:0/1703235998 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd8fc15a560 0x7fd8fc152d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.724+0000 7fd8fb59e700 1 --2- 172.21.15.81:0/1703235998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8fc1535a0 0x7fd8fc0b21a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.724+0000 7fd8fb59e700 1 --2- 172.21.15.81:0/1703235998 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8fc157670 0x7fd8fc156270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.724+0000 7fd8fb59e700 1 -- 172.21.15.81:0/1703235998 >> 172.21.15.81:0/1703235998 conn(0x7fd8fc068230 msgr2=0x7fd8fc0cf990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:25.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.725+0000 7fd8fb59e700 1 -- 172.21.15.81:0/1703235998 shutdown_connections 2023-10-06T03:24:25.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.725+0000 7fd8fb59e700 1 -- 172.21.15.81:0/1703235998 wait complete. 2023-10-06T03:24:25.743 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:24:25.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.927+0000 7f1a7d5ff700 1 Processor -- start 2023-10-06T03:24:25.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.927+0000 7f1a7d5ff700 1 -- start start 2023-10-06T03:24:25.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.928+0000 7f1a7d5ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1a780b2520 0x7f1a780b55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:25.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.928+0000 7f1a7d5ff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a78159a20 con 0x7f1a780b2150 2023-10-06T03:24:25.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.928+0000 7f1a7d5ff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a780ce9a0 con 0x7f1a78158eb0 2023-10-06T03:24:25.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.928+0000 7f1a7d5ff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a780b5c30 con 0x7f1a780b2520 2023-10-06T03:24:25.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.928+0000 7f1a76ffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1a780b2150 0x7f1a780b4ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33180/0 (socket says 172.21.15.81:33180) 2023-10-06T03:24:25.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.929+0000 7f1a76ffd700 1 -- 172.21.15.81:0/805859964 learned_addr learned my addr 172.21.15.81:0/805859964 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:24:25.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.929+0000 7f1a75ffb700 1 -- 172.21.15.81:0/805859964 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2448802127 0 0) 0x7f1a78159a20 con 0x7f1a780b2150 2023-10-06T03:24:25.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.929+0000 7f1a75ffb700 1 -- 172.21.15.81:0/805859964 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a60003570 con 0x7f1a780b2150 2023-10-06T03:24:25.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.929+0000 7f1a767fc700 1 --2- 172.21.15.81:0/805859964 >> v2:172.21.15.83:3300/0 conn(0x7f1a780b2520 0x7f1a780b55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:25.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.929+0000 7f1a75ffb700 1 -- 172.21.15.81:0/805859964 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2752160264 0 0) 0x7f1a60003570 con 0x7f1a780b2150 2023-10-06T03:24:25.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.929+0000 7f1a75ffb700 1 -- 172.21.15.81:0/805859964 >> v2:172.21.15.83:3300/0 conn(0x7f1a780b2520 msgr2=0x7f1a780b55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:25.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.929+0000 7f1a75ffb700 1 --2- 172.21.15.81:0/805859964 >> v2:172.21.15.83:3300/0 conn(0x7f1a780b2520 0x7f1a780b55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.929+0000 7f1a75ffb700 1 -- 172.21.15.81:0/805859964 >> v1:172.21.15.83:6789/0 conn(0x7f1a78158eb0 legacy=0x7f1a78159310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:25.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.929+0000 7f1a75ffb700 1 -- 172.21.15.81:0/805859964 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a780b5f10 con 0x7f1a780b2150 2023-10-06T03:24:25.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.929+0000 7f1a75ffb700 1 -- 172.21.15.81:0/805859964 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2513016936 0 0) 0x7f1a680015f0 con 0x7f1a780b2150 2023-10-06T03:24:25.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.929+0000 7f1a75ffb700 1 -- 172.21.15.81:0/805859964 >> v1:172.21.15.81:6789/0 conn(0x7f1a780b2150 legacy=0x7f1a780b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:25.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.929+0000 7f1a75ffb700 1 --2- 172.21.15.81:0/805859964 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1a60003ab0 0x7f1a60003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:25.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.929+0000 7f1a75ffb700 1 --2- 172.21.15.81:0/805859964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a60004810 0x7f1a60004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:25.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.929+0000 7f1a75ffb700 1 --2- 172.21.15.81:0/805859964 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a600052e0 0x7f1a6000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:25.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.929+0000 7f1a75ffb700 1 -- 172.21.15.81:0/805859964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a780b5c30 con 0x7f1a60004810 2023-10-06T03:24:25.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.929+0000 7f1a75ffb700 1 -- 172.21.15.81:0/805859964 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6000c1e0 con 0x7f1a600052e0 2023-10-06T03:24:25.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.929+0000 7f1a75ffb700 1 -- 172.21.15.81:0/805859964 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6000c3a0 con 0x7f1a60003ab0 2023-10-06T03:24:25.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.929+0000 7f1a767fc700 1 --2- 172.21.15.81:0/805859964 >> v2:172.21.15.83:3300/0 conn(0x7f1a780b2520 0x7f1a780b55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:25.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.930+0000 7f1a767fc700 1 --2- 172.21.15.81:0/805859964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a60004810 0x7f1a60004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:25.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.930+0000 7f1a76ffd700 1 --2- 172.21.15.81:0/805859964 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1a60003ab0 0x7f1a60003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:25.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.930+0000 7f1a777fe700 1 --2- 172.21.15.81:0/805859964 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a600052e0 0x7f1a6000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:25.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.930+0000 7f1a767fc700 1 -- 172.21.15.81:0/805859964 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1a60003ab0 msgr2=0x7f1a60003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:25.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.930+0000 7f1a767fc700 1 --2- 172.21.15.81:0/805859964 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1a60003ab0 0x7f1a60003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.930+0000 7f1a767fc700 1 -- 172.21.15.81:0/805859964 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a600052e0 msgr2=0x7f1a6000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:25.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.930+0000 7f1a767fc700 1 --2- 172.21.15.81:0/805859964 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a600052e0 0x7f1a6000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.930+0000 7f1a767fc700 1 -- 172.21.15.81:0/805859964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a60003570 con 0x7f1a60004810 2023-10-06T03:24:25.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.930+0000 7f1a777fe700 1 -- 172.21.15.81:0/805859964 reap_dead start 2023-10-06T03:24:25.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.930+0000 7f1a767fc700 1 --2- 172.21.15.81:0/805859964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a60004810 0x7f1a60004c80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c009ba0 tx=0x7f1a6c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=435f52e540faf44 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:25.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.930+0000 7f1a75ffb700 1 -- 172.21.15.81:0/805859964 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c00c070 con 0x7f1a60004810 2023-10-06T03:24:25.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.930+0000 7f1a75ffb700 1 -- 172.21.15.81:0/805859964 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a6c00e5e0 con 0x7f1a60004810 2023-10-06T03:24:25.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.931+0000 7f1a75ffb700 1 -- 172.21.15.81:0/805859964 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c009510 con 0x7f1a60004810 2023-10-06T03:24:25.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.931+0000 7f1a7d5ff700 1 -- 172.21.15.81:0/805859964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a60004810 msgr2=0x7f1a60004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:25.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.931+0000 7f1a7d5ff700 1 --2- 172.21.15.81:0/805859964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a60004810 0x7f1a60004c80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c009ba0 tx=0x7f1a6c008040 comp rx=0 tx=0).stop 2023-10-06T03:24:25.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.931+0000 7f1a7d5ff700 1 -- 172.21.15.81:0/805859964 shutdown_connections 2023-10-06T03:24:25.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.931+0000 7f1a7d5ff700 1 --2- 172.21.15.81:0/805859964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a60004810 0x7f1a60004c80 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.931+0000 7f1a7d5ff700 1 -- 172.21.15.81:0/805859964 >> 172.21.15.81:0/805859964 conn(0x7f1a7806ed10 msgr2=0x7f1a7806f110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:25.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.931+0000 7f1a7d5ff700 1 -- 172.21.15.81:0/805859964 shutdown_connections 2023-10-06T03:24:25.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.931+0000 7f1a7d5ff700 1 -- 172.21.15.81:0/805859964 wait complete. 2023-10-06T03:24:25.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.933+0000 7f1a7d5ff700 1 Processor -- start 2023-10-06T03:24:25.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.933+0000 7f1a7d5ff700 1 -- start start 2023-10-06T03:24:25.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.933+0000 7f1a7d5ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1a60004810 0x7f1a780b55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:25.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.933+0000 7f1a7d5ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a7815bcd0 0x7f1a7814cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:25.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.933+0000 7f1a7d5ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a78155470 0x7f1a781558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:25.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.934+0000 7f1a7d5ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a78155e30 con 0x7f1a7815bcd0 2023-10-06T03:24:25.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.934+0000 7f1a7d5ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7815d0a0 con 0x7f1a78155470 2023-10-06T03:24:25.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.934+0000 7f1a7d5ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7815c490 con 0x7f1a60004810 2023-10-06T03:24:25.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.934+0000 7f1a767fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a7815bcd0 0x7f1a7814cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:25.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.934+0000 7f1a767fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a7815bcd0 0x7f1a7814cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55316/0 (socket says 172.21.15.81:55316) 2023-10-06T03:24:25.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.934+0000 7f1a767fc700 1 -- 172.21.15.81:0/2595590364 learned_addr learned my addr 172.21.15.81:0/2595590364 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:25.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.934+0000 7f1a76ffd700 1 --2- 172.21.15.81:0/2595590364 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1a60004810 0x7f1a780b55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:25.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.934+0000 7f1a777fe700 1 --2- 172.21.15.81:0/2595590364 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a78155470 0x7f1a781558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:25.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.934+0000 7f1a767fc700 1 -- 172.21.15.81:0/2595590364 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1a60004810 msgr2=0x7f1a780b55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:25.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.934+0000 7f1a767fc700 1 --2- 172.21.15.81:0/2595590364 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1a60004810 0x7f1a780b55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.934+0000 7f1a767fc700 1 -- 172.21.15.81:0/2595590364 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a78155470 msgr2=0x7f1a781558f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:25.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.934+0000 7f1a767fc700 1 --2- 172.21.15.81:0/2595590364 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a78155470 0x7f1a781558f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:25.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.934+0000 7f1a767fc700 1 -- 172.21.15.81:0/2595590364 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a7815c770 con 0x7f1a7815bcd0 2023-10-06T03:24:25.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.934+0000 7f1a777fe700 1 --2- 172.21.15.81:0/2595590364 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a78155470 0x7f1a781558f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:25.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.934+0000 7f1a767fc700 1 --2- 172.21.15.81:0/2595590364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a7815bcd0 0x7f1a7814cb00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1a6000c1b0 tx=0x7f1a6c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:25.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.935+0000 7f1a5effd700 1 -- 172.21.15.81:0/2595590364 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c009510 con 0x7f1a7815bcd0 2023-10-06T03:24:25.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.935+0000 7f1a5effd700 1 -- 172.21.15.81:0/2595590364 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a6c01c440 con 0x7f1a7815bcd0 2023-10-06T03:24:25.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.935+0000 7f1a7d5ff700 1 -- 172.21.15.81:0/2595590364 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a7815ca50 con 0x7f1a7815bcd0 2023-10-06T03:24:25.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.935+0000 7f1a5effd700 1 -- 172.21.15.81:0/2595590364 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c01c800 con 0x7f1a7815bcd0 2023-10-06T03:24:25.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.935+0000 7f1a7d5ff700 1 -- 172.21.15.81:0/2595590364 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a7815c120 con 0x7f1a7815bcd0 2023-10-06T03:24:25.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.936+0000 7f1a7d5ff700 1 -- 172.21.15.81:0/2595590364 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a7815d210 con 0x7f1a7815bcd0 2023-10-06T03:24:25.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.936+0000 7f1a5effd700 1 -- 172.21.15.81:0/2595590364 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1a6c01cbf0 con 0x7f1a7815bcd0 2023-10-06T03:24:25.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.937+0000 7f1a5effd700 1 --2- 172.21.15.81:0/2595590364 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f1a64066f60 0x7f1a64069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:25.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.937+0000 7f1a5effd700 1 -- 172.21.15.81:0/2595590364 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f1a6c086280 con 0x7f1a7815bcd0 2023-10-06T03:24:25.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.938+0000 7f1a76ffd700 1 --2- 172.21.15.81:0/2595590364 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f1a64066f60 0x7f1a64069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:25.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.938+0000 7f1a76ffd700 1 --2- 172.21.15.81:0/2595590364 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f1a64066f60 0x7f1a64069410 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1a68000e10 tx=0x7f1a68009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:25.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:25.942+0000 7f1a5effd700 1 -- 172.21.15.81:0/2595590364 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1a6c0530a0 con 0x7f1a7815bcd0 2023-10-06T03:24:26.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.131+0000 7f1a7d5ff700 1 -- 172.21.15.81:0/2595590364 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1a7804c3c0 con 0x7f1a7815bcd0 2023-10-06T03:24:26.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.131+0000 7f1a5effd700 1 -- 172.21.15.81:0/2595590364 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1a6c0566c0 con 0x7f1a7815bcd0 2023-10-06T03:24:26.132 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-10-06T03:24:26.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.133+0000 7f1a7d5ff700 1 -- 172.21.15.81:0/2595590364 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f1a64066f60 msgr2=0x7f1a64069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:26.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.133+0000 7f1a7d5ff700 1 --2- 172.21.15.81:0/2595590364 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f1a64066f60 0x7f1a64069410 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1a68000e10 tx=0x7f1a68009040 comp rx=0 tx=0).stop 2023-10-06T03:24:26.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.133+0000 7f1a7d5ff700 1 -- 172.21.15.81:0/2595590364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a7815bcd0 msgr2=0x7f1a7814cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:26.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.133+0000 7f1a7d5ff700 1 --2- 172.21.15.81:0/2595590364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a7815bcd0 0x7f1a7814cb00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1a6000c1b0 tx=0x7f1a6c01a000 comp rx=0 tx=0).stop 2023-10-06T03:24:26.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.133+0000 7f1a7d5ff700 1 -- 172.21.15.81:0/2595590364 shutdown_connections 2023-10-06T03:24:26.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.133+0000 7f1a7d5ff700 1 --2- 172.21.15.81:0/2595590364 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a78155470 0x7f1a781558f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:26.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.133+0000 7f1a7d5ff700 1 --2- 172.21.15.81:0/2595590364 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f1a64066f60 0x7f1a64069410 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:26.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.133+0000 7f1a7d5ff700 1 --2- 172.21.15.81:0/2595590364 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1a60004810 0x7f1a780b55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:26.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.133+0000 7f1a7d5ff700 1 --2- 172.21.15.81:0/2595590364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a7815bcd0 0x7f1a7814cb00 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:26.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.133+0000 7f1a7d5ff700 1 -- 172.21.15.81:0/2595590364 >> 172.21.15.81:0/2595590364 conn(0x7f1a7806ed10 msgr2=0x7f1a7814f030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:26.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.133+0000 7f1a7d5ff700 1 -- 172.21.15.81:0/2595590364 shutdown_connections 2023-10-06T03:24:26.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.134+0000 7f1a7d5ff700 1 -- 172.21.15.81:0/2595590364 wait complete. 2023-10-06T03:24:26.151 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:24:26.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.333+0000 7f27e53ff700 1 Processor -- start 2023-10-06T03:24:26.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.333+0000 7f27e53ff700 1 -- start start 2023-10-06T03:24:26.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.334+0000 7f27e53ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f27e013fd70 0x7f27e00ca640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:26.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.335+0000 7f27e53ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f27e015ac50 0x7f27e00c6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:26.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.335+0000 7f27e53ff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e00cb580 con 0x7f27e015a0c0 2023-10-06T03:24:26.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.335+0000 7f27e53ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27e00c6800 con 0x7f27e013fd70 2023-10-06T03:24:26.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.335+0000 7f27e53ff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27e0069880 con 0x7f27e015ac50 2023-10-06T03:24:26.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.335+0000 7f27deffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f27e013fd70 0x7f27e00ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:26.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.335+0000 7f27d7fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f27e015a0c0 0x7f27e015a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33192/0 (socket says 172.21.15.81:33192) 2023-10-06T03:24:26.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.335+0000 7f27d7fff700 1 -- 172.21.15.81:0/2242666040 learned_addr learned my addr 172.21.15.81:0/2242666040 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:24:26.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.335+0000 7f27df7fe700 1 --2- 172.21.15.81:0/2242666040 >> v2:172.21.15.83:3300/0 conn(0x7f27e015ac50 0x7f27e00c6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:26.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.335+0000 7f27deffd700 1 -- 172.21.15.81:0/2242666040 >> v2:172.21.15.83:3300/0 conn(0x7f27e015ac50 msgr2=0x7f27e00c6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:26.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.335+0000 7f27deffd700 1 --2- 172.21.15.81:0/2242666040 >> v2:172.21.15.83:3300/0 conn(0x7f27e015ac50 0x7f27e00c6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:26.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.335+0000 7f27deffd700 1 -- 172.21.15.81:0/2242666040 >> v1:172.21.15.81:6789/0 conn(0x7f27e015a0c0 legacy=0x7f27e015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:26.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.335+0000 7f27deffd700 1 -- 172.21.15.81:0/2242666040 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e00cace0 con 0x7f27e013fd70 2023-10-06T03:24:26.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.335+0000 7f27df7fe700 1 --2- 172.21.15.81:0/2242666040 >> v2:172.21.15.83:3300/0 conn(0x7f27e015ac50 0x7f27e00c6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:26.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.336+0000 7f27deffd700 1 --2- 172.21.15.81:0/2242666040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27e013fd70 0x7f27e00ca640 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f27e00cc040 tx=0x7f27d0009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae1e63cae1dc7979 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:26.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.336+0000 7f27de7fc700 1 -- 172.21.15.81:0/2242666040 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d0005c10 con 0x7f27e013fd70 2023-10-06T03:24:26.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.336+0000 7f27de7fc700 1 -- 172.21.15.81:0/2242666040 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d0005d70 con 0x7f27e013fd70 2023-10-06T03:24:26.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.336+0000 7f27de7fc700 1 -- 172.21.15.81:0/2242666040 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d0006260 con 0x7f27e013fd70 2023-10-06T03:24:26.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.336+0000 7f27e53ff700 1 -- 172.21.15.81:0/2242666040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27e013fd70 msgr2=0x7f27e00ca640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:26.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.336+0000 7f27e53ff700 1 --2- 172.21.15.81:0/2242666040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27e013fd70 0x7f27e00ca640 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f27e00cc040 tx=0x7f27d0009120 comp rx=0 tx=0).stop 2023-10-06T03:24:26.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.336+0000 7f27e53ff700 1 -- 172.21.15.81:0/2242666040 shutdown_connections 2023-10-06T03:24:26.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.336+0000 7f27e53ff700 1 --2- 172.21.15.81:0/2242666040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27e013fd70 0x7f27e00ca640 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:26.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.336+0000 7f27e53ff700 1 --2- 172.21.15.81:0/2242666040 >> v2:172.21.15.83:3300/0 conn(0x7f27e015ac50 0x7f27e00c6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:26.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.336+0000 7f27e53ff700 1 -- 172.21.15.81:0/2242666040 >> 172.21.15.81:0/2242666040 conn(0x7f27e00cc090 msgr2=0x7f27e00cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:26.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.337+0000 7f27e53ff700 1 -- 172.21.15.81:0/2242666040 shutdown_connections 2023-10-06T03:24:26.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.337+0000 7f27e53ff700 1 -- 172.21.15.81:0/2242666040 wait complete. 2023-10-06T03:24:26.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.338+0000 7f27e53ff700 1 Processor -- start 2023-10-06T03:24:26.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.338+0000 7f27e53ff700 1 -- start start 2023-10-06T03:24:26.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.339+0000 7f27e53ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f27e013fd70 0x7f27e01562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:26.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.339+0000 7f27e53ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27e015a0c0 0x7f27e00afaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:26.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.339+0000 7f27e53ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27e015ac50 0x7f27e00c4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:26.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.339+0000 7f27e53ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e0157480 con 0x7f27e015ac50 2023-10-06T03:24:26.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.339+0000 7f27e53ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e01567e0 con 0x7f27e015a0c0 2023-10-06T03:24:26.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.339+0000 7f27e53ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27e0159150 con 0x7f27e013fd70 2023-10-06T03:24:26.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.339+0000 7f27df7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27e015ac50 0x7f27e00c4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:26.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.339+0000 7f27df7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27e015ac50 0x7f27e00c4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55334/0 (socket says 172.21.15.81:55334) 2023-10-06T03:24:26.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.339+0000 7f27df7fe700 1 -- 172.21.15.81:0/3094141737 learned_addr learned my addr 172.21.15.81:0/3094141737 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:26.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.339+0000 7f27deffd700 1 --2- 172.21.15.81:0/3094141737 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f27e013fd70 0x7f27e01562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:26.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.339+0000 7f27d7fff700 1 --2- 172.21.15.81:0/3094141737 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27e015a0c0 0x7f27e00afaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:26.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.340+0000 7f27df7fe700 1 -- 172.21.15.81:0/3094141737 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f27e013fd70 msgr2=0x7f27e01562a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:26.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.340+0000 7f27df7fe700 1 --2- 172.21.15.81:0/3094141737 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f27e013fd70 0x7f27e01562a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:26.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.340+0000 7f27df7fe700 1 -- 172.21.15.81:0/3094141737 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27e015a0c0 msgr2=0x7f27e00afaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:26.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.340+0000 7f27df7fe700 1 --2- 172.21.15.81:0/3094141737 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27e015a0c0 0x7f27e00afaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:26.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.340+0000 7f27df7fe700 1 -- 172.21.15.81:0/3094141737 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d00093c0 con 0x7f27e015ac50 2023-10-06T03:24:26.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.340+0000 7f27d7fff700 1 --2- 172.21.15.81:0/3094141737 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27e015a0c0 0x7f27e00afaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:26.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.340+0000 7f27df7fe700 1 --2- 172.21.15.81:0/3094141737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27e015ac50 0x7f27e00c4d20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f27d800d1b0 tx=0x7f27d8009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:26.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.340+0000 7f27d6ffd700 1 -- 172.21.15.81:0/3094141737 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d800dd40 con 0x7f27e015ac50 2023-10-06T03:24:26.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.340+0000 7f27d6ffd700 1 -- 172.21.15.81:0/3094141737 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d800f040 con 0x7f27e015ac50 2023-10-06T03:24:26.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.340+0000 7f27e53ff700 1 -- 172.21.15.81:0/3094141737 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27e0156b70 con 0x7f27e015ac50 2023-10-06T03:24:26.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.340+0000 7f27d6ffd700 1 -- 172.21.15.81:0/3094141737 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d8015650 con 0x7f27e015ac50 2023-10-06T03:24:26.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.340+0000 7f27e53ff700 1 -- 172.21.15.81:0/3094141737 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27e0156e30 con 0x7f27e015ac50 2023-10-06T03:24:26.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.341+0000 7f27e53ff700 1 -- 172.21.15.81:0/3094141737 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27e0157630 con 0x7f27e015ac50 2023-10-06T03:24:26.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.342+0000 7f27d6ffd700 1 -- 172.21.15.81:0/3094141737 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f27d8015a40 con 0x7f27e015ac50 2023-10-06T03:24:26.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.343+0000 7f27d6ffd700 1 --2- 172.21.15.81:0/3094141737 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f27c0066f30 0x7f27c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:26.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.343+0000 7f27d6ffd700 1 -- 172.21.15.81:0/3094141737 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f27d8085190 con 0x7f27e015ac50 2023-10-06T03:24:26.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.343+0000 7f27deffd700 1 --2- 172.21.15.81:0/3094141737 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f27c0066f30 0x7f27c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:26.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.344+0000 7f27deffd700 1 --2- 172.21.15.81:0/3094141737 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f27c0066f30 0x7f27c00693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f27e00cc040 tx=0x7f27d0016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:26.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.347+0000 7f27d6ffd700 1 -- 172.21.15.81:0/3094141737 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f27d8051fb0 con 0x7f27e015ac50 2023-10-06T03:24:26.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.536+0000 7f27e53ff700 1 -- 172.21.15.81:0/3094141737 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f27e004c3c0 con 0x7f27e015ac50 2023-10-06T03:24:26.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.536+0000 7f27d6ffd700 1 -- 172.21.15.81:0/3094141737 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f27d800dea0 con 0x7f27e015ac50 2023-10-06T03:24:26.537 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-10-06T03:24:26.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.538+0000 7f27e53ff700 1 -- 172.21.15.81:0/3094141737 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f27c0066f30 msgr2=0x7f27c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:26.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.538+0000 7f27e53ff700 1 --2- 172.21.15.81:0/3094141737 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f27c0066f30 0x7f27c00693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f27e00cc040 tx=0x7f27d0016000 comp rx=0 tx=0).stop 2023-10-06T03:24:26.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.538+0000 7f27e53ff700 1 -- 172.21.15.81:0/3094141737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27e015ac50 msgr2=0x7f27e00c4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:26.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.538+0000 7f27e53ff700 1 --2- 172.21.15.81:0/3094141737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27e015ac50 0x7f27e00c4d20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f27d800d1b0 tx=0x7f27d8009a50 comp rx=0 tx=0).stop 2023-10-06T03:24:26.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.539+0000 7f27e53ff700 1 -- 172.21.15.81:0/3094141737 shutdown_connections 2023-10-06T03:24:26.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.539+0000 7f27e53ff700 1 --2- 172.21.15.81:0/3094141737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27e015ac50 0x7f27e00c4d20 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:26.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.539+0000 7f27e53ff700 1 --2- 172.21.15.81:0/3094141737 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f27c0066f30 0x7f27c00693e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:26.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.539+0000 7f27e53ff700 1 --2- 172.21.15.81:0/3094141737 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f27e013fd70 0x7f27e01562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:26.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.539+0000 7f27e53ff700 1 --2- 172.21.15.81:0/3094141737 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27e015a0c0 0x7f27e00afaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:26.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.539+0000 7f27e53ff700 1 -- 172.21.15.81:0/3094141737 >> 172.21.15.81:0/3094141737 conn(0x7f27e00cc090 msgr2=0x7f27e00cc460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:26.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.539+0000 7f27e53ff700 1 -- 172.21.15.81:0/3094141737 shutdown_connections 2023-10-06T03:24:26.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.539+0000 7f27e53ff700 1 -- 172.21.15.81:0/3094141737 wait complete. 2023-10-06T03:24:26.557 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T03:24:26.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.738+0000 7fa2e93ff700 1 Processor -- start 2023-10-06T03:24:26.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.738+0000 7fa2e93ff700 1 -- start start 2023-10-06T03:24:26.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.739+0000 7fa2e93ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2e406b3a0 0x7fa2e406b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:26.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.739+0000 7fa2e93ff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2e4068500 con 0x7fa2e41594c0 2023-10-06T03:24:26.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.739+0000 7fa2e93ff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2e40aa940 con 0x7fa2e4159890 2023-10-06T03:24:26.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.739+0000 7fa2e93ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e406bd80 con 0x7fa2e406b3a0 2023-10-06T03:24:26.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.739+0000 7fa2e2ffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa2e41594c0 0x7fa2e406c0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33194/0 (socket says 172.21.15.81:33194) 2023-10-06T03:24:26.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.739+0000 7fa2e2ffd700 1 -- 172.21.15.81:0/540734548 learned_addr learned my addr 172.21.15.81:0/540734548 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:24:26.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.740+0000 7fa2e37fe700 1 --2- 172.21.15.81:0/540734548 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2e406b3a0 0x7fa2e406b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:26.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.740+0000 7fa2e1ffb700 1 -- 172.21.15.81:0/540734548 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3075120448 0 0) 0x7fa2e4068500 con 0x7fa2e41594c0 2023-10-06T03:24:26.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.740+0000 7fa2e1ffb700 1 -- 172.21.15.81:0/540734548 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2cc003570 con 0x7fa2e41594c0 2023-10-06T03:24:26.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.740+0000 7fa2e1ffb700 1 -- 172.21.15.81:0/540734548 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3035793835 0 0) 0x7fa2e40aa940 con 0x7fa2e4159890 2023-10-06T03:24:26.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.740+0000 7fa2e1ffb700 1 -- 172.21.15.81:0/540734548 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2e4068500 con 0x7fa2e4159890 2023-10-06T03:24:26.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.740+0000 7fa2e37fe700 1 -- 172.21.15.81:0/540734548 >> v1:172.21.15.83:6789/0 conn(0x7fa2e4159890 legacy=0x7fa2e4068990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:26.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.740+0000 7fa2e37fe700 1 -- 172.21.15.81:0/540734548 >> v1:172.21.15.81:6789/0 conn(0x7fa2e41594c0 legacy=0x7fa2e406c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:26.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.740+0000 7fa2e37fe700 1 -- 172.21.15.81:0/540734548 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e40aa380 con 0x7fa2e406b3a0 2023-10-06T03:24:26.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.740+0000 7fa2e37fe700 1 --2- 172.21.15.81:0/540734548 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2e406b3a0 0x7fa2e406b840 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc009ec0 tx=0x7fa2dc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6a66a9494a828ae server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:26.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.741+0000 7fa2e1ffb700 1 -- 172.21.15.81:0/540734548 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2dc00e070 con 0x7fa2e406b3a0 2023-10-06T03:24:26.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.741+0000 7fa2e1ffb700 1 -- 172.21.15.81:0/540734548 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2dc00bb40 con 0x7fa2e406b3a0 2023-10-06T03:24:26.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.741+0000 7fa2e1ffb700 1 -- 172.21.15.81:0/540734548 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2dc012430 con 0x7fa2e406b3a0 2023-10-06T03:24:26.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.741+0000 7fa2e93ff700 1 -- 172.21.15.81:0/540734548 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2e406b3a0 msgr2=0x7fa2e406b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:26.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.741+0000 7fa2e93ff700 1 --2- 172.21.15.81:0/540734548 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2e406b3a0 0x7fa2e406b840 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc009ec0 tx=0x7fa2dc009780 comp rx=0 tx=0).stop 2023-10-06T03:24:26.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.741+0000 7fa2e93ff700 1 -- 172.21.15.81:0/540734548 shutdown_connections 2023-10-06T03:24:26.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.741+0000 7fa2e93ff700 1 --2- 172.21.15.81:0/540734548 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2e406b3a0 0x7fa2e406b840 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:26.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.741+0000 7fa2e93ff700 1 -- 172.21.15.81:0/540734548 >> 172.21.15.81:0/540734548 conn(0x7fa2e406a910 msgr2=0x7fa2e40ae4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:26.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.741+0000 7fa2e93ff700 1 -- 172.21.15.81:0/540734548 shutdown_connections 2023-10-06T03:24:26.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.741+0000 7fa2e93ff700 1 -- 172.21.15.81:0/540734548 wait complete. 2023-10-06T03:24:26.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.743+0000 7fa2e93ff700 1 Processor -- start 2023-10-06T03:24:26.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.743+0000 7fa2e93ff700 1 -- start start 2023-10-06T03:24:26.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.744+0000 7fa2e93ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2e406b3a0 0x7fa2e4147830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:26.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.744+0000 7fa2e93ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2e41594c0 0x7fa2e40b1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:26.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.744+0000 7fa2e93ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2e4159890 0x7fa2e40b1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:26.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.744+0000 7fa2e93ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e4147d70 con 0x7fa2e4159890 2023-10-06T03:24:26.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.744+0000 7fa2e93ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e414daf0 con 0x7fa2e406b3a0 2023-10-06T03:24:26.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.744+0000 7fa2e93ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e414ddd0 con 0x7fa2e41594c0 2023-10-06T03:24:26.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.744+0000 7fa2e37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2e4159890 0x7fa2e40b1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:26.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.744+0000 7fa2e37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2e4159890 0x7fa2e40b1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55340/0 (socket says 172.21.15.81:55340) 2023-10-06T03:24:26.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.744+0000 7fa2e37fe700 1 -- 172.21.15.81:0/1734033867 learned_addr learned my addr 172.21.15.81:0/1734033867 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:26.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.744+0000 7fa2e2ffd700 1 --2- 172.21.15.81:0/1734033867 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2e406b3a0 0x7fa2e4147830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:26.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.744+0000 7fa2e27fc700 1 --2- 172.21.15.81:0/1734033867 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2e41594c0 0x7fa2e40b1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:26.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.744+0000 7fa2e37fe700 1 -- 172.21.15.81:0/1734033867 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2e41594c0 msgr2=0x7fa2e40b1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:26.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.744+0000 7fa2e37fe700 1 --2- 172.21.15.81:0/1734033867 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2e41594c0 0x7fa2e40b1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:26.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.744+0000 7fa2e37fe700 1 -- 172.21.15.81:0/1734033867 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2e406b3a0 msgr2=0x7fa2e4147830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:26.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.744+0000 7fa2e37fe700 1 --2- 172.21.15.81:0/1734033867 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2e406b3a0 0x7fa2e4147830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:26.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.744+0000 7fa2e37fe700 1 -- 172.21.15.81:0/1734033867 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2dc009a20 con 0x7fa2e4159890 2023-10-06T03:24:26.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.744+0000 7fa2e2ffd700 1 --2- 172.21.15.81:0/1734033867 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2e406b3a0 0x7fa2e4147830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:26.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.745+0000 7fa2e37fe700 1 --2- 172.21.15.81:0/1734033867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2e4159890 0x7fa2e40b1eb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc013000 tx=0x7fa2dc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:26.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.745+0000 7fa2caffd700 1 -- 172.21.15.81:0/1734033867 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2dc012e40 con 0x7fa2e4159890 2023-10-06T03:24:26.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.745+0000 7fa2caffd700 1 -- 172.21.15.81:0/1734033867 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2dc01b600 con 0x7fa2e4159890 2023-10-06T03:24:26.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.745+0000 7fa2e93ff700 1 -- 172.21.15.81:0/1734033867 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2e414e0b0 con 0x7fa2e4159890 2023-10-06T03:24:26.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.745+0000 7fa2caffd700 1 -- 172.21.15.81:0/1734033867 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2dc01b9c0 con 0x7fa2e4159890 2023-10-06T03:24:26.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.745+0000 7fa2e93ff700 1 -- 172.21.15.81:0/1734033867 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2e414d750 con 0x7fa2e4159890 2023-10-06T03:24:26.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.746+0000 7fa2e93ff700 1 -- 172.21.15.81:0/1734033867 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2e40aee30 con 0x7fa2e4159890 2023-10-06T03:24:26.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.747+0000 7fa2caffd700 1 -- 172.21.15.81:0/1734033867 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa2dc02e3f0 con 0x7fa2e4159890 2023-10-06T03:24:26.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.748+0000 7fa2caffd700 1 --2- 172.21.15.81:0/1734033867 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa2d0066f30 0x7fa2d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:26.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.748+0000 7fa2caffd700 1 -- 172.21.15.81:0/1734033867 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa2dc086540 con 0x7fa2e4159890 2023-10-06T03:24:26.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.748+0000 7fa2e2ffd700 1 --2- 172.21.15.81:0/1734033867 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa2d0066f30 0x7fa2d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:26.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.749+0000 7fa2e2ffd700 1 --2- 172.21.15.81:0/1734033867 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa2d0066f30 0x7fa2d00693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa2d40058d0 tx=0x7fa2d4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:26.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.752+0000 7fa2caffd700 1 -- 172.21.15.81:0/1734033867 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa2dc0532c0 con 0x7fa2e4159890 2023-10-06T03:24:26.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.940+0000 7fa2e93ff700 1 -- 172.21.15.81:0/1734033867 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa2e404c3c0 con 0x7fa2e4159890 2023-10-06T03:24:26.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.941+0000 7fa2caffd700 1 -- 172.21.15.81:0/1734033867 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa2dc0568e0 con 0x7fa2e4159890 2023-10-06T03:24:26.942 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-10-06T03:24:26.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.943+0000 7fa2e93ff700 1 -- 172.21.15.81:0/1734033867 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa2d0066f30 msgr2=0x7fa2d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:26.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.943+0000 7fa2e93ff700 1 --2- 172.21.15.81:0/1734033867 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa2d0066f30 0x7fa2d00693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa2d40058d0 tx=0x7fa2d4009040 comp rx=0 tx=0).stop 2023-10-06T03:24:26.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.943+0000 7fa2e93ff700 1 -- 172.21.15.81:0/1734033867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2e4159890 msgr2=0x7fa2e40b1eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:26.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.943+0000 7fa2e93ff700 1 --2- 172.21.15.81:0/1734033867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2e4159890 0x7fa2e40b1eb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc013000 tx=0x7fa2dc019000 comp rx=0 tx=0).stop 2023-10-06T03:24:26.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.943+0000 7fa2e93ff700 1 -- 172.21.15.81:0/1734033867 shutdown_connections 2023-10-06T03:24:26.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.943+0000 7fa2e93ff700 1 --2- 172.21.15.81:0/1734033867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2e4159890 0x7fa2e40b1eb0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:26.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.943+0000 7fa2e93ff700 1 --2- 172.21.15.81:0/1734033867 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2e406b3a0 0x7fa2e4147830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:26.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.943+0000 7fa2e93ff700 1 --2- 172.21.15.81:0/1734033867 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa2d0066f30 0x7fa2d00693e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:26.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.943+0000 7fa2e93ff700 1 --2- 172.21.15.81:0/1734033867 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2e41594c0 0x7fa2e40b1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:26.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.943+0000 7fa2e93ff700 1 -- 172.21.15.81:0/1734033867 >> 172.21.15.81:0/1734033867 conn(0x7fa2e406a910 msgr2=0x7fa2e41525a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:26.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.943+0000 7fa2e93ff700 1 -- 172.21.15.81:0/1734033867 shutdown_connections 2023-10-06T03:24:26.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:26.943+0000 7fa2e93ff700 1 -- 172.21.15.81:0/1734033867 wait complete. 2023-10-06T03:24:26.961 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:24:27.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.139+0000 7f95029ff700 1 Processor -- start 2023-10-06T03:24:27.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.139+0000 7f95029ff700 1 -- start start 2023-10-06T03:24:27.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.141+0000 7f95029ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f94fc1557f0 0x7f94fc156c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:27.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.141+0000 7f95029ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f94fc069ee0 0x7f94fc06a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:27.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.141+0000 7f95029ff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94fc0c9c60 con 0x7f94fc155bc0 2023-10-06T03:24:27.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.141+0000 7f95029ff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94fc06df20 con 0x7f94fc1557f0 2023-10-06T03:24:27.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.141+0000 7f95029ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94fc06a8a0 con 0x7f94fc069ee0 2023-10-06T03:24:27.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.141+0000 7f94fbfff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f94fc1557f0 0x7f94fc156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:27.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.141+0000 7f9500f9c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f94fc069ee0 0x7f94fc06a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:27.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.141+0000 7f94fbfff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f94fc1557f0 0x7f94fc156c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:53382/0 (socket says 172.21.15.81:53382) 2023-10-06T03:24:27.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.141+0000 7f94fbfff700 1 -- 172.21.15.81:0/2409409439 learned_addr learned my addr 172.21.15.81:0/2409409439 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:27.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.142+0000 7f94fbfff700 1 -- 172.21.15.81:0/2409409439 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f94fc069ee0 msgr2=0x7f94fc06a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:27.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.142+0000 7f94fbfff700 1 --2- 172.21.15.81:0/2409409439 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f94fc069ee0 0x7f94fc06a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:27.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.142+0000 7f94fbfff700 1 -- 172.21.15.81:0/2409409439 >> v1:172.21.15.83:6789/0 conn(0x7f94fc155bc0 legacy=0x7f94fc0c6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:27.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.142+0000 7f94fbfff700 1 -- 172.21.15.81:0/2409409439 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94fc06dc60 con 0x7f94fc1557f0 2023-10-06T03:24:27.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.142+0000 7f94fbfff700 1 --2- 172.21.15.81:0/2409409439 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f94fc1557f0 0x7f94fc156c90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f94ec0099b0 tx=0x7f94ec009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2ee9709d0448b9f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:27.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.142+0000 7f94fb7fe700 1 -- 172.21.15.81:0/2409409439 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ec009ea0 con 0x7f94fc1557f0 2023-10-06T03:24:27.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.142+0000 7f94fb7fe700 1 -- 172.21.15.81:0/2409409439 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94ec00b860 con 0x7f94fc1557f0 2023-10-06T03:24:27.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.142+0000 7f94fb7fe700 1 -- 172.21.15.81:0/2409409439 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ec00bc00 con 0x7f94fc1557f0 2023-10-06T03:24:27.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.143+0000 7f95029ff700 1 -- 172.21.15.81:0/2409409439 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f94fc1557f0 msgr2=0x7f94fc156c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:27.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.143+0000 7f95029ff700 1 --2- 172.21.15.81:0/2409409439 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f94fc1557f0 0x7f94fc156c90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f94ec0099b0 tx=0x7f94ec009250 comp rx=0 tx=0).stop 2023-10-06T03:24:27.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.143+0000 7f95029ff700 1 -- 172.21.15.81:0/2409409439 shutdown_connections 2023-10-06T03:24:27.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.143+0000 7f95029ff700 1 --2- 172.21.15.81:0/2409409439 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f94fc069ee0 0x7f94fc06a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:27.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.143+0000 7f95029ff700 1 --2- 172.21.15.81:0/2409409439 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f94fc1557f0 0x7f94fc156c90 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:27.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.143+0000 7f95029ff700 1 -- 172.21.15.81:0/2409409439 >> 172.21.15.81:0/2409409439 conn(0x7f94fc0cc090 msgr2=0x7f94fc0cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:27.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.143+0000 7f95029ff700 1 -- 172.21.15.81:0/2409409439 shutdown_connections 2023-10-06T03:24:27.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.143+0000 7f95029ff700 1 -- 172.21.15.81:0/2409409439 wait complete. 2023-10-06T03:24:27.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.144+0000 7f95029ff700 1 Processor -- start 2023-10-06T03:24:27.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.144+0000 7f95029ff700 1 -- start start 2023-10-06T03:24:27.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.145+0000 7f95029ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f94fc069ee0 0x7f94fc154700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:27.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.145+0000 7f95029ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f94fc1557f0 0x7f94fc1572f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:27.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.145+0000 7f95029ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94fc155bc0 0x7f94fc0a5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:27.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.145+0000 7f95029ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94fc154c40 con 0x7f94fc155bc0 2023-10-06T03:24:27.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.145+0000 7f95029ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94fc0cab90 con 0x7f94fc1557f0 2023-10-06T03:24:27.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.145+0000 7f95029ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94fc157830 con 0x7f94fc069ee0 2023-10-06T03:24:27.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.146+0000 7f9500f9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94fc155bc0 0x7f94fc0a5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:27.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.146+0000 7f9500f9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94fc155bc0 0x7f94fc0a5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55342/0 (socket says 172.21.15.81:55342) 2023-10-06T03:24:27.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.146+0000 7f9500f9c700 1 -- 172.21.15.81:0/467351736 learned_addr learned my addr 172.21.15.81:0/467351736 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:27.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.146+0000 7f94fbfff700 1 --2- 172.21.15.81:0/467351736 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f94fc069ee0 0x7f94fc154700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:27.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.146+0000 7f94f3fff700 1 --2- 172.21.15.81:0/467351736 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f94fc1557f0 0x7f94fc1572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:27.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.146+0000 7f9500f9c700 1 -- 172.21.15.81:0/467351736 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f94fc069ee0 msgr2=0x7f94fc154700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:27.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.146+0000 7f9500f9c700 1 --2- 172.21.15.81:0/467351736 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f94fc069ee0 0x7f94fc154700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:27.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.146+0000 7f9500f9c700 1 -- 172.21.15.81:0/467351736 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f94fc1557f0 msgr2=0x7f94fc1572f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:27.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.146+0000 7f9500f9c700 1 --2- 172.21.15.81:0/467351736 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f94fc1557f0 0x7f94fc1572f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:27.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.146+0000 7f9500f9c700 1 -- 172.21.15.81:0/467351736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ec0094f0 con 0x7f94fc155bc0 2023-10-06T03:24:27.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.146+0000 7f9500f9c700 1 --2- 172.21.15.81:0/467351736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94fc155bc0 0x7f94fc0a5430 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f94f4009df0 tx=0x7f94f400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:27.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.146+0000 7f94f8ff9700 1 -- 172.21.15.81:0/467351736 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f400cb50 con 0x7f94fc155bc0 2023-10-06T03:24:27.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.147+0000 7f94f8ff9700 1 -- 172.21.15.81:0/467351736 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94f400f040 con 0x7f94fc155bc0 2023-10-06T03:24:27.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.147+0000 7f94f8ff9700 1 -- 172.21.15.81:0/467351736 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f4014480 con 0x7f94fc155bc0 2023-10-06T03:24:27.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.147+0000 7f95029ff700 1 -- 172.21.15.81:0/467351736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94fc0cae30 con 0x7f94fc155bc0 2023-10-06T03:24:27.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.147+0000 7f95029ff700 1 -- 172.21.15.81:0/467351736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94fc156b90 con 0x7f94fc155bc0 2023-10-06T03:24:27.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.148+0000 7f95029ff700 1 -- 172.21.15.81:0/467351736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94fc0c6380 con 0x7f94fc155bc0 2023-10-06T03:24:27.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.148+0000 7f94f8ff9700 1 -- 172.21.15.81:0/467351736 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f94f4014830 con 0x7f94fc155bc0 2023-10-06T03:24:27.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.149+0000 7f94f8ff9700 1 --2- 172.21.15.81:0/467351736 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f94dc066f30 0x7f94dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:27.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.149+0000 7f94f8ff9700 1 -- 172.21.15.81:0/467351736 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f94f40855e0 con 0x7f94fc155bc0 2023-10-06T03:24:27.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.149+0000 7f94fbfff700 1 --2- 172.21.15.81:0/467351736 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f94dc066f30 0x7f94dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:27.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.150+0000 7f94fbfff700 1 --2- 172.21.15.81:0/467351736 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f94dc066f30 0x7f94dc0693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f94ec0099b0 tx=0x7f94ec017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:27.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.153+0000 7f94f8ff9700 1 -- 172.21.15.81:0/467351736 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f94f4052400 con 0x7f94fc155bc0 2023-10-06T03:24:27.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.343+0000 7f95029ff700 1 -- 172.21.15.81:0/467351736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f94fc04c3c0 con 0x7f94fc155bc0 2023-10-06T03:24:27.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.344+0000 7f94f8ff9700 1 -- 172.21.15.81:0/467351736 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18659 (secure 0 0 0) 0x7f94f4055a20 con 0x7f94fc155bc0 2023-10-06T03:24:27.345 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:24:27.346 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"fsid":"1807b5d7-9be8-43ad-aaf8-99a4273430b3","created":"2023-10-06T03:23:20.805306+0000","modified":"2023-10-06T03:23:45.419616+0000","last_up_change":"2023-10-06T03:23:32.735796+0000","last_in_change":"2023-10-06T03:23:24.109024+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:33.198850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:33.606744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:23:38.742266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:23:39.347944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:23:42.959054+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"14fb667d-a677-4978-a477-80027f889d36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":85563},{"type":"v1","addr":"172.21.15.81:6818","nonce":85563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":85563},{"type":"v1","addr":"172.21.15.81:6822","nonce":85563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":85563},{"type":"v1","addr":"172.21.15.81:6830","nonce":85563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":85563},{"type":"v1","addr":"172.21.15.81:6826","nonce":85563}]},"public_addr":"172.21.15.81:6818/85563","cluster_addr":"172.21.15.81:6822/85563","heartbeat_back_addr":"172.21.15.81:6830/85563","heartbeat_front_addr":"172.21.15.81:6826/85563","state":["exists","up"]},{"osd":1,"uuid":"974d8a86-1829-4176-89ce-18e6038857f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":85561},{"type":"v1","addr":"172.21.15.81:6801","nonce":85561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":85561},{"type":"v1","addr":"172.21.15.81:6803","nonce":85561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":85561},{"type":"v1","addr":"172.21.15.81:6807","nonce":85561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":85561},{"type":"v1","addr":"172.21.15.81:6805","nonce":85561}]},"public_addr":"172.21.15.81:6801/85561","cluster_addr":"172.21.15.81:6803/85561","heartbeat_back_addr":"172.21.15.81:6807/85561","heartbeat_front_addr":"172.21.15.81:6805/85561","state":["exists","up"]},{"osd":2,"uuid":"ffbfe056-46bc-46e0-bf49-4d8f8650e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":85564},{"type":"v1","addr":"172.21.15.81:6809","nonce":85564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":85564},{"type":"v1","addr":"172.21.15.81:6811","nonce":85564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":85564},{"type":"v1","addr":"172.21.15.81:6815","nonce":85564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":85564},{"type":"v1","addr":"172.21.15.81:6813","nonce":85564}]},"public_addr":"172.21.15.81:6809/85564","cluster_addr":"172.21.15.81:6811/85564","heartbeat_back_addr":"172.21.15.81:6815/85564","heartbeat_front_addr":"172.21.15.81:6813/85564","state":["exists","up"]},{"osd":3,"uuid":"ef9a8314-3d37-4ea1-858a-e704d5695002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":85562},{"type":"v1","addr":"172.21.15.81:6819","nonce":85562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":85562},{"type":"v1","addr":"172.21.15.81:6823","nonce":85562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":85562},{"type":"v1","addr":"172.21.15.81:6831","nonce":85562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":85562},{"type":"v1","addr":"172.21.15.81:6827","nonce":85562}]},"public_addr":"172.21.15.81:6819/85562","cluster_addr":"172.21.15.81:6823/85562","heartbeat_back_addr":"172.21.15.81:6831/85562","heartbeat_front_addr":"172.21.15.81:6827/85562","state":["exists","up"]},{"osd":4,"uuid":"d83506a0-2c96-4bcb-a9fa-05e43dc329df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":85785},{"type":"v1","addr":"172.21.15.83:6801","nonce":85785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":85785},{"type":"v1","addr":"172.21.15.83:6803","nonce":85785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":85785},{"type":"v1","addr":"172.21.15.83:6807","nonce":85785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":85785},{"type":"v1","addr":"172.21.15.83:6805","nonce":85785}]},"public_addr":"172.21.15.83:6801/85785","cluster_addr":"172.21.15.83:6803/85785","heartbeat_back_addr":"172.21.15.83:6807/85785","heartbeat_front_addr":"172.21.15.83:6805/85785","state":["exists","up"]},{"osd":5,"uuid":"10687c63-a3d5-472f-acc0-4f61847b6e0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":85818},{"type":"v1","addr":"172.21.15.83:6825","nonce":85818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":85818},{"type":"v1","addr":"172.21.15.83:6827","nonce":85818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":85818},{"type":"v1","addr":"172.21.15.83:6831","nonce":85818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":85818},{"type":"v1","addr":"172.21.15.83:6829","nonce":85818}]},"public_addr":"172.21.15.83:6825/85818","cluster_addr":"172.21.15.83:6827/85818","heartbeat_back_addr":"172.21.15.83:6831/85818","heartbeat_front_addr":"172.21.15.83:6829/85818","state":["exists","up"]},{"osd":6,"uuid":"2e9daf76-5607-4a29-9a58-6e270700d223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":85787},{"type":"v1","addr":"172.21.15.83:6811","nonce":85787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":85787},{"type":"v1","addr":"172.21.15.83:6815","nonce":85787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":85787},{"type":"v1","addr":"172.21.15.83:6823","nonce":85787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6817","nonce":85787},{"type":"v1","addr":"172.21.15.83:6819","nonce":85787}]},"public_addr":"172.21.15.83:6811/85787","cluster_addr":"172.21.15.83:6815/85787","heartbeat_back_addr":"172.21.15.83:6823/85787","heartbeat_front_addr":"172.21.15.83:6819/85787","state":["exists","up"]},{"osd":7,"uuid":"5019e1ff-233a-4a5a-91ca-8afccb7ab6e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":85786},{"type":"v1","addr":"172.21.15.83:6810","nonce":85786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":85786},{"type":"v1","addr":"172.21.15.83:6814","nonce":85786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":85786},{"type":"v1","addr":"172.21.15.83:6822","nonce":85786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":85786},{"type":"v1","addr":"172.21.15.83:6818","nonce":85786}]},"public_addr":"172.21.15.83:6810/85786","cluster_addr":"172.21.15.83:6814/85786","heartbeat_back_addr":"172.21.15.83:6822/85786","heartbeat_front_addr":"172.21.15.83:6818/85786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.393431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.360031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.407428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.391613+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.403211+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.438142+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.496181+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.472323+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:24:27.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.346+0000 7f95029ff700 1 -- 172.21.15.81:0/467351736 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f94dc066f30 msgr2=0x7f94dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:27.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.346+0000 7f95029ff700 1 --2- 172.21.15.81:0/467351736 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f94dc066f30 0x7f94dc0693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f94ec0099b0 tx=0x7f94ec017000 comp rx=0 tx=0).stop 2023-10-06T03:24:27.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.347+0000 7f95029ff700 1 -- 172.21.15.81:0/467351736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94fc155bc0 msgr2=0x7f94fc0a5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:27.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.347+0000 7f95029ff700 1 --2- 172.21.15.81:0/467351736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94fc155bc0 0x7f94fc0a5430 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f94f4009df0 tx=0x7f94f400b040 comp rx=0 tx=0).stop 2023-10-06T03:24:27.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.347+0000 7f95029ff700 1 -- 172.21.15.81:0/467351736 shutdown_connections 2023-10-06T03:24:27.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.347+0000 7f95029ff700 1 --2- 172.21.15.81:0/467351736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94fc155bc0 0x7f94fc0a5430 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:27.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.347+0000 7f95029ff700 1 --2- 172.21.15.81:0/467351736 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f94dc066f30 0x7f94dc0693e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:27.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.347+0000 7f95029ff700 1 --2- 172.21.15.81:0/467351736 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f94fc069ee0 0x7f94fc154700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:27.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.347+0000 7f95029ff700 1 --2- 172.21.15.81:0/467351736 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f94fc1557f0 0x7f94fc1572f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:27.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.347+0000 7f95029ff700 1 -- 172.21.15.81:0/467351736 >> 172.21.15.81:0/467351736 conn(0x7f94fc0cc090 msgr2=0x7f94fc0c9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:27.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.347+0000 7f95029ff700 1 -- 172.21.15.81:0/467351736 shutdown_connections 2023-10-06T03:24:27.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.347+0000 7f95029ff700 1 -- 172.21.15.81:0/467351736 wait complete. 2023-10-06T03:24:27.365 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:23:33.198850+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:23:33.606744+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:23:38.742266+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:23:39.347944+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T03:23:42.959054+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:24:27.366 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:24:27.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.548+0000 7f723e7ff700 1 Processor -- start 2023-10-06T03:24:27.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.548+0000 7f723e7ff700 1 -- start start 2023-10-06T03:24:27.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.549+0000 7f723e7ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f72380b29d0 0x7f72380c6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:27.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.549+0000 7f723e7ff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72380cf7d0 con 0x7f72380c5210 2023-10-06T03:24:27.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.549+0000 7f723e7ff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7238159b10 con 0x7f72380cf180 2023-10-06T03:24:27.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.549+0000 7f723e7ff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72380c70d0 con 0x7f72380b29d0 2023-10-06T03:24:27.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.550+0000 7f72377fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f72380c5210 0x7f72380cea70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33200/0 (socket says 172.21.15.81:33200) 2023-10-06T03:24:27.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.550+0000 7f72377fe700 1 -- 172.21.15.81:0/2320277373 learned_addr learned my addr 172.21.15.81:0/2320277373 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:24:27.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.550+0000 7f7237fff700 1 --2- 172.21.15.81:0/2320277373 >> v2:172.21.15.83:3300/0 conn(0x7f72380b29d0 0x7f72380c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:27.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.550+0000 7f7236ffd700 1 -- 172.21.15.81:0/2320277373 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3169806411 0 0) 0x7f72380cf7d0 con 0x7f72380c5210 2023-10-06T03:24:27.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.550+0000 7f7236ffd700 1 -- 172.21.15.81:0/2320277373 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7220003570 con 0x7f72380c5210 2023-10-06T03:24:27.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.550+0000 7f7236ffd700 1 -- 172.21.15.81:0/2320277373 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3615403308 0 0) 0x7f7238159b10 con 0x7f72380cf180 2023-10-06T03:24:27.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.550+0000 7f7236ffd700 1 -- 172.21.15.81:0/2320277373 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72380cf7d0 con 0x7f72380cf180 2023-10-06T03:24:27.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.550+0000 7f7237fff700 1 -- 172.21.15.81:0/2320277373 >> v1:172.21.15.83:6789/0 conn(0x7f72380cf180 legacy=0x7f7238163270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:27.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.550+0000 7f7237fff700 1 -- 172.21.15.81:0/2320277373 >> v1:172.21.15.81:6789/0 conn(0x7f72380c5210 legacy=0x7f72380cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:27.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.550+0000 7f7237fff700 1 -- 172.21.15.81:0/2320277373 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72380c6830 con 0x7f72380b29d0 2023-10-06T03:24:27.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.550+0000 7f7237fff700 1 --2- 172.21.15.81:0/2320277373 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72380b29d0 0x7f72380c6130 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f72280098d0 tx=0x7f7228009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bba16184518fcb74 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:27.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.551+0000 7f7236ffd700 1 -- 172.21.15.81:0/2320277373 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7228005c10 con 0x7f72380b29d0 2023-10-06T03:24:27.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.551+0000 7f7236ffd700 1 -- 172.21.15.81:0/2320277373 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7228005d70 con 0x7f72380b29d0 2023-10-06T03:24:27.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.551+0000 7f7236ffd700 1 -- 172.21.15.81:0/2320277373 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7228006260 con 0x7f72380b29d0 2023-10-06T03:24:27.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.551+0000 7f723e7ff700 1 -- 172.21.15.81:0/2320277373 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72380b29d0 msgr2=0x7f72380c6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:27.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.551+0000 7f723e7ff700 1 --2- 172.21.15.81:0/2320277373 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72380b29d0 0x7f72380c6130 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f72280098d0 tx=0x7f7228009120 comp rx=0 tx=0).stop 2023-10-06T03:24:27.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.551+0000 7f723e7ff700 1 -- 172.21.15.81:0/2320277373 shutdown_connections 2023-10-06T03:24:27.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.551+0000 7f723e7ff700 1 --2- 172.21.15.81:0/2320277373 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72380b29d0 0x7f72380c6130 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:27.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.551+0000 7f723e7ff700 1 -- 172.21.15.81:0/2320277373 >> 172.21.15.81:0/2320277373 conn(0x7f72380997d0 msgr2=0x7f723806f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:27.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.551+0000 7f723e7ff700 1 -- 172.21.15.81:0/2320277373 shutdown_connections 2023-10-06T03:24:27.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.551+0000 7f723e7ff700 1 -- 172.21.15.81:0/2320277373 wait complete. 2023-10-06T03:24:27.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.553+0000 7f723e7ff700 1 Processor -- start 2023-10-06T03:24:27.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.553+0000 7f723e7ff700 1 -- start start 2023-10-06T03:24:27.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.554+0000 7f723e7ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72380b29d0 0x7f7238169e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:27.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.554+0000 7f723e7ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72380c5210 0x7f7238157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:27.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.554+0000 7f723e7ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f72380cf180 0x7f72380d0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:27.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.554+0000 7f723e7ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72380b4750 con 0x7f72380b29d0 2023-10-06T03:24:27.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.554+0000 7f723e7ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f723815b270 con 0x7f72380c5210 2023-10-06T03:24:27.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.554+0000 7f723e7ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f723815acb0 con 0x7f72380cf180 2023-10-06T03:24:27.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.554+0000 7f7237fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72380b29d0 0x7f7238169e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:27.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.554+0000 7f7237fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72380b29d0 0x7f7238169e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55346/0 (socket says 172.21.15.81:55346) 2023-10-06T03:24:27.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.554+0000 7f7237fff700 1 -- 172.21.15.81:0/673890372 learned_addr learned my addr 172.21.15.81:0/673890372 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:27.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.554+0000 7f72377fe700 1 --2- 172.21.15.81:0/673890372 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72380c5210 0x7f7238157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:27.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.554+0000 7f723cd9c700 1 --2- 172.21.15.81:0/673890372 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f72380cf180 0x7f72380d0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:27.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.555+0000 7f7237fff700 1 -- 172.21.15.81:0/673890372 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f72380cf180 msgr2=0x7f72380d0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:27.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.555+0000 7f7237fff700 1 --2- 172.21.15.81:0/673890372 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f72380cf180 0x7f72380d0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:27.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.555+0000 7f7237fff700 1 -- 172.21.15.81:0/673890372 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72380c5210 msgr2=0x7f7238157210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:27.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.555+0000 7f7237fff700 1 --2- 172.21.15.81:0/673890372 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72380c5210 0x7f7238157210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:27.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.555+0000 7f7237fff700 1 -- 172.21.15.81:0/673890372 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72280093c0 con 0x7f72380b29d0 2023-10-06T03:24:27.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.555+0000 7f7237fff700 1 --2- 172.21.15.81:0/673890372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72380b29d0 0x7f7238169e70 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7228009390 tx=0x7f7228016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:27.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.555+0000 7f721ffff700 1 -- 172.21.15.81:0/673890372 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f722801d7b0 con 0x7f72380b29d0 2023-10-06T03:24:27.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.555+0000 7f721ffff700 1 -- 172.21.15.81:0/673890372 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f722801d910 con 0x7f72380b29d0 2023-10-06T03:24:27.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.555+0000 7f721ffff700 1 -- 172.21.15.81:0/673890372 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f722801dcd0 con 0x7f72380b29d0 2023-10-06T03:24:27.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.555+0000 7f723e7ff700 1 -- 172.21.15.81:0/673890372 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f723815af90 con 0x7f72380b29d0 2023-10-06T03:24:27.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.555+0000 7f723e7ff700 1 -- 172.21.15.81:0/673890372 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7238157750 con 0x7f72380b29d0 2023-10-06T03:24:27.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.556+0000 7f723e7ff700 1 -- 172.21.15.81:0/673890372 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f723804c3c0 con 0x7f72380b29d0 2023-10-06T03:24:27.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.557+0000 7f721ffff700 1 -- 172.21.15.81:0/673890372 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f722801b690 con 0x7f72380b29d0 2023-10-06T03:24:27.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.558+0000 7f721ffff700 1 --2- 172.21.15.81:0/673890372 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7224066f30 0x7f72240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:27.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.558+0000 7f721ffff700 1 -- 172.21.15.81:0/673890372 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f7228086960 con 0x7f72380b29d0 2023-10-06T03:24:27.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.558+0000 7f72377fe700 1 --2- 172.21.15.81:0/673890372 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7224066f30 0x7f72240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:27.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.559+0000 7f72377fe700 1 --2- 172.21.15.81:0/673890372 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7224066f30 0x7f72240693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f72380c9690 tx=0x7f722c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:27.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.562+0000 7f721ffff700 1 -- 172.21.15.81:0/673890372 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f72280536e0 con 0x7f72380b29d0 2023-10-06T03:24:27.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.755+0000 7f723e7ff700 1 -- 172.21.15.81:0/673890372 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f72380cf5b0 con 0x7f72380b29d0 2023-10-06T03:24:27.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.755+0000 7f721ffff700 1 -- 172.21.15.81:0/673890372 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7228056d00 con 0x7f72380b29d0 2023-10-06T03:24:27.756 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-10-06T03:24:27.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.757+0000 7f723e7ff700 1 -- 172.21.15.81:0/673890372 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7224066f30 msgr2=0x7f72240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:27.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.757+0000 7f723e7ff700 1 --2- 172.21.15.81:0/673890372 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7224066f30 0x7f72240693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f72380c9690 tx=0x7f722c009040 comp rx=0 tx=0).stop 2023-10-06T03:24:27.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.757+0000 7f723e7ff700 1 -- 172.21.15.81:0/673890372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72380b29d0 msgr2=0x7f7238169e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:27.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.757+0000 7f723e7ff700 1 --2- 172.21.15.81:0/673890372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72380b29d0 0x7f7238169e70 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7228009390 tx=0x7f7228016000 comp rx=0 tx=0).stop 2023-10-06T03:24:27.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.758+0000 7f723e7ff700 1 -- 172.21.15.81:0/673890372 shutdown_connections 2023-10-06T03:24:27.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.758+0000 7f723e7ff700 1 --2- 172.21.15.81:0/673890372 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7224066f30 0x7f72240693e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:27.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.758+0000 7f723e7ff700 1 --2- 172.21.15.81:0/673890372 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f72380cf180 0x7f72380d0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:27.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.758+0000 7f723e7ff700 1 --2- 172.21.15.81:0/673890372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72380b29d0 0x7f7238169e70 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:27.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.758+0000 7f723e7ff700 1 --2- 172.21.15.81:0/673890372 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72380c5210 0x7f7238157210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:27.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.758+0000 7f723e7ff700 1 -- 172.21.15.81:0/673890372 >> 172.21.15.81:0/673890372 conn(0x7f72380997d0 msgr2=0x7f72380cb570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:27.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.758+0000 7f723e7ff700 1 -- 172.21.15.81:0/673890372 shutdown_connections 2023-10-06T03:24:27.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.758+0000 7f723e7ff700 1 -- 172.21.15.81:0/673890372 wait complete. 2023-10-06T03:24:27.776 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:24:27.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.965+0000 7f6001f9d700 1 Processor -- start 2023-10-06T03:24:27.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.965+0000 7f6001f9d700 1 -- start start 2023-10-06T03:24:27.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.966+0000 7f6001f9d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f5ffc159750 0x7f5ffc0aba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:27.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.966+0000 7f6001f9d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ffc0c7cc0 con 0x7f5ffc0ae560 2023-10-06T03:24:27.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.966+0000 7f6001f9d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ffc0c7fa0 con 0x7f5ffc159b20 2023-10-06T03:24:27.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.966+0000 7f6001f9d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ffc0abfa0 con 0x7f5ffc159750 2023-10-06T03:24:27.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.966+0000 7f5ffbfff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5ffc0ae560 0x7f5ffc0c7420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33216/0 (socket says 172.21.15.81:33216) 2023-10-06T03:24:27.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.966+0000 7f5ffbfff700 1 -- 172.21.15.81:0/3857611704 learned_addr learned my addr 172.21.15.81:0/3857611704 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:24:27.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.967+0000 7f6000f9b700 1 --2- 172.21.15.81:0/3857611704 >> v2:172.21.15.83:3300/0 conn(0x7f5ffc159750 0x7f5ffc0aba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:27.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.967+0000 7f5ffb7fe700 1 -- 172.21.15.81:0/3857611704 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1499521838 0 0) 0x7f5ffc0c7cc0 con 0x7f5ffc0ae560 2023-10-06T03:24:27.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.967+0000 7f5ffb7fe700 1 -- 172.21.15.81:0/3857611704 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fec003570 con 0x7f5ffc0ae560 2023-10-06T03:24:27.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.967+0000 7f5ffb7fe700 1 -- 172.21.15.81:0/3857611704 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2691149202 0 0) 0x7f5ffc0c7fa0 con 0x7f5ffc159b20 2023-10-06T03:24:27.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.967+0000 7f5ffb7fe700 1 -- 172.21.15.81:0/3857611704 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ffc0c7cc0 con 0x7f5ffc159b20 2023-10-06T03:24:27.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.967+0000 7f5ffb7fe700 1 -- 172.21.15.81:0/3857611704 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3673344855 0 0) 0x7f5fec003570 con 0x7f5ffc0ae560 2023-10-06T03:24:27.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.967+0000 7f6000f9b700 1 -- 172.21.15.81:0/3857611704 >> v1:172.21.15.83:6789/0 conn(0x7f5ffc159b20 legacy=0x7f5ffc155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:27.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.967+0000 7f6000f9b700 1 -- 172.21.15.81:0/3857611704 >> v1:172.21.15.81:6789/0 conn(0x7f5ffc0ae560 legacy=0x7f5ffc0c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:27.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.967+0000 7f6000f9b700 1 -- 172.21.15.81:0/3857611704 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ffc069350 con 0x7f5ffc159750 2023-10-06T03:24:27.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.967+0000 7f6000f9b700 1 --2- 172.21.15.81:0/3857611704 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ffc159750 0x7f5ffc0aba60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5ff0009e60 tx=0x7f5ff0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b42224ab8acf73 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:27.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.968+0000 7f5ffb7fe700 1 -- 172.21.15.81:0/3857611704 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff000e070 con 0x7f5ffc159750 2023-10-06T03:24:27.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.968+0000 7f5ffb7fe700 1 -- 172.21.15.81:0/3857611704 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff000b7a0 con 0x7f5ffc159750 2023-10-06T03:24:27.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.968+0000 7f5ffb7fe700 1 -- 172.21.15.81:0/3857611704 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe8001470 con 0x7f5ffc159750 2023-10-06T03:24:27.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.968+0000 7f6001f9d700 1 -- 172.21.15.81:0/3857611704 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ffc159750 msgr2=0x7f5ffc0aba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:27.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.968+0000 7f6001f9d700 1 --2- 172.21.15.81:0/3857611704 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ffc159750 0x7f5ffc0aba60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5ff0009e60 tx=0x7f5ff0009780 comp rx=0 tx=0).stop 2023-10-06T03:24:27.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.968+0000 7f6001f9d700 1 -- 172.21.15.81:0/3857611704 shutdown_connections 2023-10-06T03:24:27.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.968+0000 7f6001f9d700 1 --2- 172.21.15.81:0/3857611704 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ffc159750 0x7f5ffc0aba60 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:27.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.968+0000 7f6001f9d700 1 -- 172.21.15.81:0/3857611704 >> 172.21.15.81:0/3857611704 conn(0x7f5ffc0680b0 msgr2=0x7f5ffc0cbeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:27.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.968+0000 7f6001f9d700 1 -- 172.21.15.81:0/3857611704 shutdown_connections 2023-10-06T03:24:27.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.968+0000 7f6001f9d700 1 -- 172.21.15.81:0/3857611704 wait complete. 2023-10-06T03:24:27.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.970+0000 7f6001f9d700 1 Processor -- start 2023-10-06T03:24:27.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.970+0000 7f6001f9d700 1 -- start start 2023-10-06T03:24:27.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.971+0000 7f6001f9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ffc0ae560 0x7f5ffc0c3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:27.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.971+0000 7f6001f9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ffc159750 0x7f5ffc14e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:27.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.971+0000 7f6001f9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ffc159b20 0x7f5ffc0acb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:27.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.971+0000 7f6001f9d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ffc0c5ab0 con 0x7f5ffc0ae560 2023-10-06T03:24:27.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.971+0000 7f6001f9d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ffc0b0560 con 0x7f5ffc159750 2023-10-06T03:24:27.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.971+0000 7f6001f9d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ffc0af950 con 0x7f5ffc159b20 2023-10-06T03:24:27.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.971+0000 7f6000f9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ffc0ae560 0x7f5ffc0c3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:27.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.971+0000 7f6000f9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ffc0ae560 0x7f5ffc0c3d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55352/0 (socket says 172.21.15.81:55352) 2023-10-06T03:24:27.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.971+0000 7f6000f9b700 1 -- 172.21.15.81:0/3134056041 learned_addr learned my addr 172.21.15.81:0/3134056041 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:27.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.971+0000 7f5ffbfff700 1 --2- 172.21.15.81:0/3134056041 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ffc159750 0x7f5ffc14e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:27.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.971+0000 7f600179c700 1 --2- 172.21.15.81:0/3134056041 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ffc159b20 0x7f5ffc0acb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:27.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.972+0000 7f6000f9b700 1 -- 172.21.15.81:0/3134056041 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ffc159b20 msgr2=0x7f5ffc0acb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:27.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.972+0000 7f6000f9b700 1 --2- 172.21.15.81:0/3134056041 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ffc159b20 0x7f5ffc0acb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:27.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.972+0000 7f6000f9b700 1 -- 172.21.15.81:0/3134056041 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ffc159750 msgr2=0x7f5ffc14e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:27.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.972+0000 7f6000f9b700 1 --2- 172.21.15.81:0/3134056041 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ffc159750 0x7f5ffc14e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:27.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.972+0000 7f6000f9b700 1 -- 172.21.15.81:0/3134056041 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff0009a20 con 0x7f5ffc0ae560 2023-10-06T03:24:27.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.972+0000 7f5ffbfff700 1 --2- 172.21.15.81:0/3134056041 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ffc159750 0x7f5ffc14e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:27.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.972+0000 7f6000f9b700 1 --2- 172.21.15.81:0/3134056041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ffc0ae560 0x7f5ffc0c3d10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5ff00099f0 tx=0x7f5ff0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:27.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.972+0000 7f5ff8ff9700 1 -- 172.21.15.81:0/3134056041 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff0012b70 con 0x7f5ffc0ae560 2023-10-06T03:24:27.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.972+0000 7f5ff8ff9700 1 -- 172.21.15.81:0/3134056041 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff0012cd0 con 0x7f5ffc0ae560 2023-10-06T03:24:27.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.972+0000 7f6001f9d700 1 -- 172.21.15.81:0/3134056041 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ffc0afc30 con 0x7f5ffc0ae560 2023-10-06T03:24:27.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.972+0000 7f5ff8ff9700 1 -- 172.21.15.81:0/3134056041 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff001e6a0 con 0x7f5ffc0ae560 2023-10-06T03:24:27.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.972+0000 7f6001f9d700 1 -- 172.21.15.81:0/3134056041 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ffc0b01f0 con 0x7f5ffc0ae560 2023-10-06T03:24:27.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.973+0000 7f6001f9d700 1 -- 172.21.15.81:0/3134056041 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ffc0b0840 con 0x7f5ffc0ae560 2023-10-06T03:24:27.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.974+0000 7f5ff8ff9700 1 -- 172.21.15.81:0/3134056041 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5ff001ea50 con 0x7f5ffc0ae560 2023-10-06T03:24:27.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.975+0000 7f5ff8ff9700 1 --2- 172.21.15.81:0/3134056041 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f5fe0066f30 0x7f5fe00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:27.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.975+0000 7f5ff8ff9700 1 -- 172.21.15.81:0/3134056041 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f5ff0086a40 con 0x7f5ffc0ae560 2023-10-06T03:24:27.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.976+0000 7f5ffbfff700 1 --2- 172.21.15.81:0/3134056041 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f5fe0066f30 0x7f5fe00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:27.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.976+0000 7f5ffbfff700 1 --2- 172.21.15.81:0/3134056041 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f5fe0066f30 0x7f5fe00693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8001540 tx=0x7f5fe8001940 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:27.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:27.980+0000 7f5ff8ff9700 1 -- 172.21.15.81:0/3134056041 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ff0053780 con 0x7f5ffc0ae560 2023-10-06T03:24:28.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.171+0000 7f6001f9d700 1 -- 172.21.15.81:0/3134056041 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5ffc06cfb0 con 0x7f5ffc0ae560 2023-10-06T03:24:28.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.172+0000 7f5ff8ff9700 1 -- 172.21.15.81:0/3134056041 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5ff0056da0 con 0x7f5ffc0ae560 2023-10-06T03:24:28.173 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-06T03:24:28.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.174+0000 7f6001f9d700 1 -- 172.21.15.81:0/3134056041 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f5fe0066f30 msgr2=0x7f5fe00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:28.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.174+0000 7f6001f9d700 1 --2- 172.21.15.81:0/3134056041 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f5fe0066f30 0x7f5fe00693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8001540 tx=0x7f5fe8001940 comp rx=0 tx=0).stop 2023-10-06T03:24:28.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.174+0000 7f6001f9d700 1 -- 172.21.15.81:0/3134056041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ffc0ae560 msgr2=0x7f5ffc0c3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:28.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.174+0000 7f6001f9d700 1 --2- 172.21.15.81:0/3134056041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ffc0ae560 0x7f5ffc0c3d10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5ff00099f0 tx=0x7f5ff0017000 comp rx=0 tx=0).stop 2023-10-06T03:24:28.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.174+0000 7f6001f9d700 1 -- 172.21.15.81:0/3134056041 shutdown_connections 2023-10-06T03:24:28.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.174+0000 7f6001f9d700 1 --2- 172.21.15.81:0/3134056041 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f5fe0066f30 0x7f5fe00693e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.174+0000 7f6001f9d700 1 --2- 172.21.15.81:0/3134056041 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ffc159b20 0x7f5ffc0acb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.174+0000 7f6001f9d700 1 --2- 172.21.15.81:0/3134056041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ffc0ae560 0x7f5ffc0c3d10 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.174+0000 7f6001f9d700 1 --2- 172.21.15.81:0/3134056041 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ffc159750 0x7f5ffc14e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.174+0000 7f6001f9d700 1 -- 172.21.15.81:0/3134056041 >> 172.21.15.81:0/3134056041 conn(0x7f5ffc0680b0 msgr2=0x7f5ffc0c81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:28.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.174+0000 7f6001f9d700 1 -- 172.21.15.81:0/3134056041 shutdown_connections 2023-10-06T03:24:28.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.174+0000 7f6001f9d700 1 -- 172.21.15.81:0/3134056041 wait complete. 2023-10-06T03:24:28.192 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:24:28.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.374+0000 7f2610d9d700 1 Processor -- start 2023-10-06T03:24:28.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.374+0000 7f2610d9d700 1 -- start start 2023-10-06T03:24:28.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.375+0000 7f2610d9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f260c1594a0 0x7f260c06b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:28.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.375+0000 7f2610d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f260c15ded0 0x7f260c0c99d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:28.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.375+0000 7f2610d9d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f260c159870 0x7f260c0c7570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:28.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.375+0000 7f2610d9d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f260c06b680 con 0x7f260c15ded0 2023-10-06T03:24:28.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.375+0000 7f2610d9d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f260c06acb0 con 0x7f260c159870 2023-10-06T03:24:28.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.375+0000 7f2610d9d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f260c06a3c0 con 0x7f260c1594a0 2023-10-06T03:24:28.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.375+0000 7f260affd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f260c15ded0 0x7f260c0c99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:28.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.375+0000 7f260affd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f260c15ded0 0x7f260c0c99d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55362/0 (socket says 172.21.15.81:55362) 2023-10-06T03:24:28.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.376+0000 7f260affd700 1 -- 172.21.15.81:0/3211838394 learned_addr learned my addr 172.21.15.81:0/3211838394 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:28.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.376+0000 7f260bfff700 1 --2- 172.21.15.81:0/3211838394 >> v2:172.21.15.83:3300/0 conn(0x7f260c159870 0x7f260c0c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:28.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.376+0000 7f260b7fe700 1 --2- 172.21.15.81:0/3211838394 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f260c1594a0 0x7f260c06b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:28.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.376+0000 7f260affd700 1 -- 172.21.15.81:0/3211838394 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f260c1594a0 msgr2=0x7f260c06b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:28.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.376+0000 7f260affd700 1 --2- 172.21.15.81:0/3211838394 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f260c1594a0 0x7f260c06b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.376+0000 7f260affd700 1 -- 172.21.15.81:0/3211838394 >> v2:172.21.15.83:3300/0 conn(0x7f260c159870 msgr2=0x7f260c0c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:28.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.376+0000 7f260affd700 1 --2- 172.21.15.81:0/3211838394 >> v2:172.21.15.83:3300/0 conn(0x7f260c159870 0x7f260c0c7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.376+0000 7f260affd700 1 -- 172.21.15.81:0/3211838394 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260c0ca340 con 0x7f260c15ded0 2023-10-06T03:24:28.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.376+0000 7f260affd700 1 --2- 172.21.15.81:0/3211838394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f260c15ded0 0x7f260c0c99d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f260c06e590 tx=0x7f2600009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d180229520bfa574 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:28.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.376+0000 7f260a7fc700 1 -- 172.21.15.81:0/3211838394 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260000b860 con 0x7f260c15ded0 2023-10-06T03:24:28.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.376+0000 7f260a7fc700 1 -- 172.21.15.81:0/3211838394 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f260000b9c0 con 0x7f260c15ded0 2023-10-06T03:24:28.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.376+0000 7f260a7fc700 1 -- 172.21.15.81:0/3211838394 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260000bd60 con 0x7f260c15ded0 2023-10-06T03:24:28.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.377+0000 7f2610d9d700 1 -- 172.21.15.81:0/3211838394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f260c15ded0 msgr2=0x7f260c0c99d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:28.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.377+0000 7f2610d9d700 1 --2- 172.21.15.81:0/3211838394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f260c15ded0 0x7f260c0c99d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f260c06e590 tx=0x7f2600009250 comp rx=0 tx=0).stop 2023-10-06T03:24:28.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.377+0000 7f2610d9d700 1 -- 172.21.15.81:0/3211838394 shutdown_connections 2023-10-06T03:24:28.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.377+0000 7f2610d9d700 1 --2- 172.21.15.81:0/3211838394 >> v2:172.21.15.83:3300/0 conn(0x7f260c159870 0x7f260c0c7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.377+0000 7f2610d9d700 1 --2- 172.21.15.81:0/3211838394 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f260c1594a0 0x7f260c06b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.377+0000 7f2610d9d700 1 --2- 172.21.15.81:0/3211838394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f260c15ded0 0x7f260c0c99d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.377+0000 7f2610d9d700 1 -- 172.21.15.81:0/3211838394 >> 172.21.15.81:0/3211838394 conn(0x7f260c0686f0 msgr2=0x7f260c068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:28.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.377+0000 7f2610d9d700 1 -- 172.21.15.81:0/3211838394 shutdown_connections 2023-10-06T03:24:28.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.377+0000 7f2610d9d700 1 -- 172.21.15.81:0/3211838394 wait complete. 2023-10-06T03:24:28.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.378+0000 7f2610d9d700 1 Processor -- start 2023-10-06T03:24:28.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.379+0000 7f2610d9d700 1 -- start start 2023-10-06T03:24:28.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.379+0000 7f2610d9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f260c1594a0 0x7f260c0c3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:28.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.379+0000 7f2610d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f260c159870 0x7f260c16a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:28.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.379+0000 7f2610d9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f260c15ded0 0x7f260c15b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:28.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.379+0000 7f2610d9d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260c16a950 con 0x7f260c159870 2023-10-06T03:24:28.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.379+0000 7f2610d9d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260c16b4d0 con 0x7f260c15ded0 2023-10-06T03:24:28.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.379+0000 7f2610d9d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f260c0c2c00 con 0x7f260c1594a0 2023-10-06T03:24:28.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.380+0000 7f260affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f260c159870 0x7f260c16a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:28.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.380+0000 7f260affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f260c159870 0x7f260c16a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55366/0 (socket says 172.21.15.81:55366) 2023-10-06T03:24:28.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.380+0000 7f260affd700 1 -- 172.21.15.81:0/2727158447 learned_addr learned my addr 172.21.15.81:0/2727158447 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:28.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.380+0000 7f260b7fe700 1 --2- 172.21.15.81:0/2727158447 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f260c1594a0 0x7f260c0c3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:28.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.380+0000 7f260affd700 1 -- 172.21.15.81:0/2727158447 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f260c1594a0 msgr2=0x7f260c0c3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:28.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.380+0000 7f260bfff700 1 --2- 172.21.15.81:0/2727158447 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f260c15ded0 0x7f260c15b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:28.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.380+0000 7f260affd700 1 --2- 172.21.15.81:0/2727158447 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f260c1594a0 0x7f260c0c3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.380+0000 7f260affd700 1 -- 172.21.15.81:0/2727158447 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f260c15ded0 msgr2=0x7f260c15b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:28.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.380+0000 7f260affd700 1 --2- 172.21.15.81:0/2727158447 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f260c15ded0 0x7f260c15b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.380+0000 7f260affd700 1 -- 172.21.15.81:0/2727158447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26000094f0 con 0x7f260c159870 2023-10-06T03:24:28.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.380+0000 7f260b7fe700 1 --2- 172.21.15.81:0/2727158447 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f260c1594a0 0x7f260c0c3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:28.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.380+0000 7f260affd700 1 --2- 172.21.15.81:0/2727158447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f260c159870 0x7f260c16a1b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2600006fd0 tx=0x7f2600017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:28.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.381+0000 7f25f37fe700 1 -- 172.21.15.81:0/2727158447 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2600024440 con 0x7f260c159870 2023-10-06T03:24:28.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.381+0000 7f25f37fe700 1 -- 172.21.15.81:0/2727158447 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26000245a0 con 0x7f260c159870 2023-10-06T03:24:28.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.381+0000 7f2610d9d700 1 -- 172.21.15.81:0/2727158447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f260c16aba0 con 0x7f260c159870 2023-10-06T03:24:28.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.381+0000 7f25f37fe700 1 -- 172.21.15.81:0/2727158447 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2600024960 con 0x7f260c159870 2023-10-06T03:24:28.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.381+0000 7f2610d9d700 1 -- 172.21.15.81:0/2727158447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f260c16b160 con 0x7f260c159870 2023-10-06T03:24:28.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.382+0000 7f2610d9d700 1 -- 172.21.15.81:0/2727158447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f260c16b640 con 0x7f260c159870 2023-10-06T03:24:28.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.383+0000 7f25f37fe700 1 -- 172.21.15.81:0/2727158447 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f260001a420 con 0x7f260c159870 2023-10-06T03:24:28.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.383+0000 7f25f37fe700 1 --2- 172.21.15.81:0/2727158447 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f25f8066f30 0x7f25f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:28.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.384+0000 7f25f37fe700 1 -- 172.21.15.81:0/2727158447 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f2600086720 con 0x7f260c159870 2023-10-06T03:24:28.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.384+0000 7f260b7fe700 1 --2- 172.21.15.81:0/2727158447 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f25f8066f30 0x7f25f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:28.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.384+0000 7f260b7fe700 1 --2- 172.21.15.81:0/2727158447 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f25f8066f30 0x7f25f80693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f25fc006fd0 tx=0x7f25fc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:28.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.388+0000 7f25f37fe700 1 -- 172.21.15.81:0/2727158447 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2600053500 con 0x7f260c159870 2023-10-06T03:24:28.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.578+0000 7f2610d9d700 1 -- 172.21.15.81:0/2727158447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f260c04c3c0 con 0x7f260c159870 2023-10-06T03:24:28.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.578+0000 7f25f37fe700 1 -- 172.21.15.81:0/2727158447 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2600056b20 con 0x7f260c159870 2023-10-06T03:24:28.579 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-10-06T03:24:28.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.581+0000 7f2610d9d700 1 -- 172.21.15.81:0/2727158447 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f25f8066f30 msgr2=0x7f25f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:28.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.581+0000 7f2610d9d700 1 --2- 172.21.15.81:0/2727158447 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f25f8066f30 0x7f25f80693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f25fc006fd0 tx=0x7f25fc008040 comp rx=0 tx=0).stop 2023-10-06T03:24:28.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.581+0000 7f2610d9d700 1 -- 172.21.15.81:0/2727158447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f260c159870 msgr2=0x7f260c16a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:28.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.581+0000 7f2610d9d700 1 --2- 172.21.15.81:0/2727158447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f260c159870 0x7f260c16a1b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2600006fd0 tx=0x7f2600017000 comp rx=0 tx=0).stop 2023-10-06T03:24:28.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.581+0000 7f2610d9d700 1 -- 172.21.15.81:0/2727158447 shutdown_connections 2023-10-06T03:24:28.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.581+0000 7f2610d9d700 1 --2- 172.21.15.81:0/2727158447 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f260c15ded0 0x7f260c15b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.581+0000 7f2610d9d700 1 --2- 172.21.15.81:0/2727158447 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f25f8066f30 0x7f25f80693e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.581+0000 7f2610d9d700 1 --2- 172.21.15.81:0/2727158447 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f260c1594a0 0x7f260c0c3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.581+0000 7f2610d9d700 1 --2- 172.21.15.81:0/2727158447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f260c159870 0x7f260c16a1b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.581+0000 7f2610d9d700 1 -- 172.21.15.81:0/2727158447 >> 172.21.15.81:0/2727158447 conn(0x7f260c0686f0 msgr2=0x7f260c0c7550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:28.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.581+0000 7f2610d9d700 1 -- 172.21.15.81:0/2727158447 shutdown_connections 2023-10-06T03:24:28.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.581+0000 7f2610d9d700 1 -- 172.21.15.81:0/2727158447 wait complete. 2023-10-06T03:24:28.599 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:24:28.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.784+0000 7ff4fffff700 1 Processor -- start 2023-10-06T03:24:28.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.785+0000 7ff4fffff700 1 -- start start 2023-10-06T03:24:28.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.786+0000 7ff4fffff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff5000b1f50 0x7ff50015c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:28.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.786+0000 7ff4fffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff500157cb0 0x7ff5000d0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:28.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.787+0000 7ff4fffff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff50015b4f0 con 0x7ff50015cad0 2023-10-06T03:24:28.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.787+0000 7ff4fffff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff50015b7d0 con 0x7ff500157cb0 2023-10-06T03:24:28.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.787+0000 7ff4fffff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff50015bab0 con 0x7ff5000b1f50 2023-10-06T03:24:28.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.787+0000 7ff4ff7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff500157cb0 0x7ff5000d0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:28.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.787+0000 7ff4ff7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff500157cb0 0x7ff5000d0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55382/0 (socket says 172.21.15.81:55382) 2023-10-06T03:24:28.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.787+0000 7ff4ff7fe700 1 -- 172.21.15.81:0/2655474931 learned_addr learned my addr 172.21.15.81:0/2655474931 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:28.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.787+0000 7ff4feffd700 1 --2- 172.21.15.81:0/2655474931 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff5000b1f50 0x7ff50015c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:28.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.787+0000 7ff4ff7fe700 1 -- 172.21.15.81:0/2655474931 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff5000b1f50 msgr2=0x7ff50015c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:28.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.787+0000 7ff4ff7fe700 1 --2- 172.21.15.81:0/2655474931 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff5000b1f50 0x7ff50015c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.787+0000 7ff4ff7fe700 1 -- 172.21.15.81:0/2655474931 >> v1:172.21.15.83:6789/0 conn(0x7ff50015cad0 legacy=0x7ff5001575a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:28.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.787+0000 7ff4ff7fe700 1 -- 172.21.15.81:0/2655474931 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff50015bd90 con 0x7ff500157cb0 2023-10-06T03:24:28.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.787+0000 7ff4ff7fe700 1 --2- 172.21.15.81:0/2655474931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff500157cb0 0x7ff5000d0790 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8009f20 tx=0x7ff4f8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e784fa8ff8b34d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:28.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.788+0000 7ff4fdffb700 1 -- 172.21.15.81:0/2655474931 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f800e070 con 0x7ff500157cb0 2023-10-06T03:24:28.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.788+0000 7ff4fdffb700 1 -- 172.21.15.81:0/2655474931 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f800ba80 con 0x7ff500157cb0 2023-10-06T03:24:28.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.788+0000 7ff4fdffb700 1 -- 172.21.15.81:0/2655474931 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f80092e0 con 0x7ff500157cb0 2023-10-06T03:24:28.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.788+0000 7ff4fffff700 1 -- 172.21.15.81:0/2655474931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff500157cb0 msgr2=0x7ff5000d0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:28.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.788+0000 7ff4fffff700 1 --2- 172.21.15.81:0/2655474931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff500157cb0 0x7ff5000d0790 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8009f20 tx=0x7ff4f8009840 comp rx=0 tx=0).stop 2023-10-06T03:24:28.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.789+0000 7ff4fffff700 1 -- 172.21.15.81:0/2655474931 shutdown_connections 2023-10-06T03:24:28.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.789+0000 7ff4fffff700 1 --2- 172.21.15.81:0/2655474931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff500157cb0 0x7ff5000d0790 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.789+0000 7ff4fffff700 1 --2- 172.21.15.81:0/2655474931 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff5000b1f50 0x7ff50015c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.789+0000 7ff4fffff700 1 -- 172.21.15.81:0/2655474931 >> 172.21.15.81:0/2655474931 conn(0x7ff50006ed10 msgr2=0x7ff50006f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:28.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.789+0000 7ff4fffff700 1 -- 172.21.15.81:0/2655474931 shutdown_connections 2023-10-06T03:24:28.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.789+0000 7ff4fffff700 1 -- 172.21.15.81:0/2655474931 wait complete. 2023-10-06T03:24:28.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.790+0000 7ff4fffff700 1 Processor -- start 2023-10-06T03:24:28.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.790+0000 7ff4fffff700 1 -- start start 2023-10-06T03:24:28.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.791+0000 7ff4fffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5000b1f50 0x7ff500150a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:28.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.791+0000 7ff4fffff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff500157cb0 0x7ff500142cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:28.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.791+0000 7ff4fffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff50015cad0 0x7ff5000b0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:28.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.791+0000 7ff4fffff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff500151b10 con 0x7ff50015cad0 2023-10-06T03:24:28.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.791+0000 7ff4fffff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5001549d0 con 0x7ff5000b1f50 2023-10-06T03:24:28.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.791+0000 7ff4fffff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff500151270 con 0x7ff500157cb0 2023-10-06T03:24:28.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.791+0000 7ff4ff7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff50015cad0 0x7ff5000b0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:28.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.791+0000 7ff4ff7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff50015cad0 0x7ff5000b0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55388/0 (socket says 172.21.15.81:55388) 2023-10-06T03:24:28.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.791+0000 7ff4ff7fe700 1 -- 172.21.15.81:0/3237181469 learned_addr learned my addr 172.21.15.81:0/3237181469 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:28.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.792+0000 7ff4feffd700 1 --2- 172.21.15.81:0/3237181469 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5000b1f50 0x7ff500150a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:28.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.792+0000 7ff4fe7fc700 1 --2- 172.21.15.81:0/3237181469 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff500157cb0 0x7ff500142cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:28.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.792+0000 7ff4ff7fe700 1 -- 172.21.15.81:0/3237181469 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff500157cb0 msgr2=0x7ff500142cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:28.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.792+0000 7ff4ff7fe700 1 --2- 172.21.15.81:0/3237181469 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff500157cb0 0x7ff500142cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.792+0000 7ff4ff7fe700 1 -- 172.21.15.81:0/3237181469 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5000b1f50 msgr2=0x7ff500150a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:28.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.792+0000 7ff4ff7fe700 1 --2- 172.21.15.81:0/3237181469 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5000b1f50 0x7ff500150a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.792+0000 7ff4ff7fe700 1 -- 172.21.15.81:0/3237181469 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f8009ae0 con 0x7ff50015cad0 2023-10-06T03:24:28.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.792+0000 7ff4ff7fe700 1 --2- 172.21.15.81:0/3237181469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff50015cad0 0x7ff5000b0db0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff500088d60 tx=0x7ff4f8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:28.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.792+0000 7ff4e6ffd700 1 -- 172.21.15.81:0/3237181469 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f80032f0 con 0x7ff50015cad0 2023-10-06T03:24:28.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.792+0000 7ff4e6ffd700 1 -- 172.21.15.81:0/3237181469 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f8008dd0 con 0x7ff50015cad0 2023-10-06T03:24:28.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.792+0000 7ff4fffff700 1 -- 172.21.15.81:0/3237181469 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff500151550 con 0x7ff50015cad0 2023-10-06T03:24:28.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.792+0000 7ff4e6ffd700 1 -- 172.21.15.81:0/3237181469 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f8026690 con 0x7ff50015cad0 2023-10-06T03:24:28.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.792+0000 7ff4fffff700 1 -- 172.21.15.81:0/3237181469 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff500154c70 con 0x7ff50015cad0 2023-10-06T03:24:28.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.794+0000 7ff4fffff700 1 -- 172.21.15.81:0/3237181469 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff500151040 con 0x7ff50015cad0 2023-10-06T03:24:28.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.794+0000 7ff4e6ffd700 1 -- 172.21.15.81:0/3237181469 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff4f8003040 con 0x7ff50015cad0 2023-10-06T03:24:28.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.796+0000 7ff4e6ffd700 1 --2- 172.21.15.81:0/3237181469 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff4ec066f30 0x7ff4ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:28.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.796+0000 7ff4e6ffd700 1 -- 172.21.15.81:0/3237181469 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6867+0+0 (secure 0 0 0) 0x7ff4f80869c0 con 0x7ff50015cad0 2023-10-06T03:24:28.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.796+0000 7ff4feffd700 1 --2- 172.21.15.81:0/3237181469 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff4ec066f30 0x7ff4ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:28.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.796+0000 7ff4feffd700 1 --2- 172.21.15.81:0/3237181469 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff4ec066f30 0x7ff4ec0693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0006fd0 tx=0x7ff4f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:28.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.800+0000 7ff4e6ffd700 1 -- 172.21.15.81:0/3237181469 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff4f8053700 con 0x7ff50015cad0 2023-10-06T03:24:28.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.990+0000 7ff4fffff700 1 -- 172.21.15.81:0/3237181469 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff50004c3f0 con 0x7ff50015cad0 2023-10-06T03:24:28.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.990+0000 7ff4e6ffd700 1 -- 172.21.15.81:0/3237181469 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff4f8056d20 con 0x7ff50015cad0 2023-10-06T03:24:28.991 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-10-06T03:24:28.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.992+0000 7ff4fffff700 1 -- 172.21.15.81:0/3237181469 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff4ec066f30 msgr2=0x7ff4ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:28.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.992+0000 7ff4fffff700 1 --2- 172.21.15.81:0/3237181469 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff4ec066f30 0x7ff4ec0693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0006fd0 tx=0x7ff4f0008040 comp rx=0 tx=0).stop 2023-10-06T03:24:28.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.992+0000 7ff4fffff700 1 -- 172.21.15.81:0/3237181469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff50015cad0 msgr2=0x7ff5000b0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:28.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.992+0000 7ff4fffff700 1 --2- 172.21.15.81:0/3237181469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff50015cad0 0x7ff5000b0db0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff500088d60 tx=0x7ff4f8018000 comp rx=0 tx=0).stop 2023-10-06T03:24:28.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.992+0000 7ff4fffff700 1 -- 172.21.15.81:0/3237181469 shutdown_connections 2023-10-06T03:24:28.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.992+0000 7ff4fffff700 1 --2- 172.21.15.81:0/3237181469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff50015cad0 0x7ff5000b0db0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.992+0000 7ff4fffff700 1 --2- 172.21.15.81:0/3237181469 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5000b1f50 0x7ff500150a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.992+0000 7ff4fffff700 1 --2- 172.21.15.81:0/3237181469 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff4ec066f30 0x7ff4ec0693e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.992+0000 7ff4fffff700 1 --2- 172.21.15.81:0/3237181469 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff500157cb0 0x7ff500142cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:28.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.992+0000 7ff4fffff700 1 -- 172.21.15.81:0/3237181469 >> 172.21.15.81:0/3237181469 conn(0x7ff50006ed10 msgr2=0x7ff50014d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:28.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.992+0000 7ff4fffff700 1 -- 172.21.15.81:0/3237181469 shutdown_connections 2023-10-06T03:24:28.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:28.993+0000 7ff4fffff700 1 -- 172.21.15.81:0/3237181469 wait complete. 2023-10-06T03:24:29.011 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T03:24:29.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.192+0000 7fc4783ff700 1 Processor -- start 2023-10-06T03:24:29.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.192+0000 7fc4783ff700 1 -- start start 2023-10-06T03:24:29.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.194+0000 7fc4783ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc47013fd70 0x7fc4700ca640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:29.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.194+0000 7fc4783ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc47015a0c0 0x7fc47015a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:29.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.194+0000 7fc4783ff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4700cb580 con 0x7fc47015aa80 2023-10-06T03:24:29.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.194+0000 7fc4783ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4700c6800 con 0x7fc47013fd70 2023-10-06T03:24:29.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.194+0000 7fc4783ff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc470069880 con 0x7fc47015a0c0 2023-10-06T03:24:29.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.194+0000 7fc47619b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc47013fd70 0x7fc4700ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:29.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.194+0000 7fc47619b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc47013fd70 0x7fc4700ca640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55390/0 (socket says 172.21.15.81:55390) 2023-10-06T03:24:29.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.194+0000 7fc47619b700 1 -- 172.21.15.81:0/2478808467 learned_addr learned my addr 172.21.15.81:0/2478808467 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:29.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.194+0000 7fc47619b700 1 -- 172.21.15.81:0/2478808467 >> v2:172.21.15.83:3300/0 conn(0x7fc47015a0c0 msgr2=0x7fc47015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:29.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.194+0000 7fc47619b700 1 --2- 172.21.15.81:0/2478808467 >> v2:172.21.15.83:3300/0 conn(0x7fc47015a0c0 0x7fc47015a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:29.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.194+0000 7fc47619b700 1 -- 172.21.15.81:0/2478808467 >> v1:172.21.15.83:6789/0 conn(0x7fc47015aa80 legacy=0x7fc47006e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:29.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.194+0000 7fc47619b700 1 -- 172.21.15.81:0/2478808467 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc47015aee0 con 0x7fc47013fd70 2023-10-06T03:24:29.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.195+0000 7fc47619b700 1 --2- 172.21.15.81:0/2478808467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc47013fd70 0x7fc4700ca640 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc470069360 tx=0x7fc46c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3644545126e68d60 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:29.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.195+0000 7fc475199700 1 -- 172.21.15.81:0/2478808467 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46c005c10 con 0x7fc47013fd70 2023-10-06T03:24:29.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.195+0000 7fc475199700 1 -- 172.21.15.81:0/2478808467 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc46c005d70 con 0x7fc47013fd70 2023-10-06T03:24:29.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.195+0000 7fc475199700 1 -- 172.21.15.81:0/2478808467 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46c00b840 con 0x7fc47013fd70 2023-10-06T03:24:29.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.195+0000 7fc4783ff700 1 -- 172.21.15.81:0/2478808467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc47013fd70 msgr2=0x7fc4700ca640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:29.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.195+0000 7fc4783ff700 1 --2- 172.21.15.81:0/2478808467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc47013fd70 0x7fc4700ca640 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc470069360 tx=0x7fc46c009220 comp rx=0 tx=0).stop 2023-10-06T03:24:29.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.196+0000 7fc4783ff700 1 -- 172.21.15.81:0/2478808467 shutdown_connections 2023-10-06T03:24:29.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.196+0000 7fc4783ff700 1 --2- 172.21.15.81:0/2478808467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc47013fd70 0x7fc4700ca640 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:29.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.196+0000 7fc4783ff700 1 --2- 172.21.15.81:0/2478808467 >> v2:172.21.15.83:3300/0 conn(0x7fc47015a0c0 0x7fc47015a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:29.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.196+0000 7fc4783ff700 1 -- 172.21.15.81:0/2478808467 >> 172.21.15.81:0/2478808467 conn(0x7fc4700cc090 msgr2=0x7fc4700cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:29.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.196+0000 7fc4783ff700 1 -- 172.21.15.81:0/2478808467 shutdown_connections 2023-10-06T03:24:29.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.196+0000 7fc4783ff700 1 -- 172.21.15.81:0/2478808467 wait complete. 2023-10-06T03:24:29.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.197+0000 7fc4783ff700 1 Processor -- start 2023-10-06T03:24:29.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.197+0000 7fc4783ff700 1 -- start start 2023-10-06T03:24:29.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.198+0000 7fc4783ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc47013fd70 0x7fc470169650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:29.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.198+0000 7fc4783ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc47015a0c0 0x7fc47016c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:29.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.198+0000 7fc4783ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc47015aa80 0x7fc47015f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:29.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.198+0000 7fc4783ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc470169b90 con 0x7fc47013fd70 2023-10-06T03:24:29.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.198+0000 7fc4783ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4700aee30 con 0x7fc47015a0c0 2023-10-06T03:24:29.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.198+0000 7fc4783ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4700af0f0 con 0x7fc47015aa80 2023-10-06T03:24:29.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.198+0000 7fc47619b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc47013fd70 0x7fc470169650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:29.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.198+0000 7fc47619b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc47013fd70 0x7fc470169650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55404/0 (socket says 172.21.15.81:55404) 2023-10-06T03:24:29.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.198+0000 7fc47619b700 1 -- 172.21.15.81:0/2743681450 learned_addr learned my addr 172.21.15.81:0/2743681450 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:29.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.199+0000 7fc47619b700 1 -- 172.21.15.81:0/2743681450 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc47015aa80 msgr2=0x7fc47015f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:29.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.199+0000 7fc47619b700 1 --2- 172.21.15.81:0/2743681450 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc47015aa80 0x7fc47015f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:29.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.199+0000 7fc47619b700 1 -- 172.21.15.81:0/2743681450 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc47015a0c0 msgr2=0x7fc47016c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:29.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.199+0000 7fc47619b700 1 --2- 172.21.15.81:0/2743681450 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc47015a0c0 0x7fc47016c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:29.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.199+0000 7fc47619b700 1 -- 172.21.15.81:0/2743681450 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc46c009480 con 0x7fc47013fd70 2023-10-06T03:24:29.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.199+0000 7fc47619b700 1 --2- 172.21.15.81:0/2743681450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc47013fd70 0x7fc470169650 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc46c009260 tx=0x7fc46c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:29.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.199+0000 7fc4667fc700 1 -- 172.21.15.81:0/2743681450 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46c011ae0 con 0x7fc47013fd70 2023-10-06T03:24:29.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.199+0000 7fc4667fc700 1 -- 172.21.15.81:0/2743681450 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc46c011c80 con 0x7fc47013fd70 2023-10-06T03:24:29.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.199+0000 7fc4783ff700 1 -- 172.21.15.81:0/2743681450 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4700af3d0 con 0x7fc47013fd70 2023-10-06T03:24:29.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.199+0000 7fc4667fc700 1 -- 172.21.15.81:0/2743681450 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46c01d430 con 0x7fc47013fd70 2023-10-06T03:24:29.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.199+0000 7fc4783ff700 1 -- 172.21.15.81:0/2743681450 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4700af990 con 0x7fc47013fd70 2023-10-06T03:24:29.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.200+0000 7fc4783ff700 1 -- 172.21.15.81:0/2743681450 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4700afb80 con 0x7fc47013fd70 2023-10-06T03:24:29.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.201+0000 7fc4667fc700 1 -- 172.21.15.81:0/2743681450 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc46c01d7e0 con 0x7fc47013fd70 2023-10-06T03:24:29.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.202+0000 7fc4667fc700 1 --2- 172.21.15.81:0/2743681450 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc454066f30 0x7fc4540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:29.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.202+0000 7fc4667fc700 1 -- 172.21.15.81:0/2743681450 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fc46c086b60 con 0x7fc47013fd70 2023-10-06T03:24:29.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.202+0000 7fc47599a700 1 --2- 172.21.15.81:0/2743681450 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc454066f30 0x7fc4540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:29.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.203+0000 7fc47599a700 1 --2- 172.21.15.81:0/2743681450 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc454066f30 0x7fc4540693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc460006fd0 tx=0x7fc460006db0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:29.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.206+0000 7fc4667fc700 1 -- 172.21.15.81:0/2743681450 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc46c053940 con 0x7fc47013fd70 2023-10-06T03:24:29.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.396+0000 7fc4783ff700 1 -- 172.21.15.81:0/2743681450 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc47004c3c0 con 0x7fc47013fd70 2023-10-06T03:24:29.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.397+0000 7fc4667fc700 1 -- 172.21.15.81:0/2743681450 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc46c056f60 con 0x7fc47013fd70 2023-10-06T03:24:29.398 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-10-06T03:24:29.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.399+0000 7fc4783ff700 1 -- 172.21.15.81:0/2743681450 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc454066f30 msgr2=0x7fc4540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:29.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.399+0000 7fc4783ff700 1 --2- 172.21.15.81:0/2743681450 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc454066f30 0x7fc4540693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc460006fd0 tx=0x7fc460006db0 comp rx=0 tx=0).stop 2023-10-06T03:24:29.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.399+0000 7fc4783ff700 1 -- 172.21.15.81:0/2743681450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc47013fd70 msgr2=0x7fc470169650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:29.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.399+0000 7fc4783ff700 1 --2- 172.21.15.81:0/2743681450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc47013fd70 0x7fc470169650 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc46c009260 tx=0x7fc46c015000 comp rx=0 tx=0).stop 2023-10-06T03:24:29.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.399+0000 7fc4783ff700 1 -- 172.21.15.81:0/2743681450 shutdown_connections 2023-10-06T03:24:29.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.399+0000 7fc4783ff700 1 --2- 172.21.15.81:0/2743681450 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc454066f30 0x7fc4540693e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:29.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.399+0000 7fc4783ff700 1 --2- 172.21.15.81:0/2743681450 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc47015aa80 0x7fc47015f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:29.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.399+0000 7fc4783ff700 1 --2- 172.21.15.81:0/2743681450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc47013fd70 0x7fc470169650 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:29.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.399+0000 7fc4783ff700 1 --2- 172.21.15.81:0/2743681450 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc47015a0c0 0x7fc47016c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:29.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.399+0000 7fc4783ff700 1 -- 172.21.15.81:0/2743681450 >> 172.21.15.81:0/2743681450 conn(0x7fc4700cc090 msgr2=0x7fc4700ca410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:29.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.399+0000 7fc4783ff700 1 -- 172.21.15.81:0/2743681450 shutdown_connections 2023-10-06T03:24:29.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.399+0000 7fc4783ff700 1 -- 172.21.15.81:0/2743681450 wait complete. 2023-10-06T03:24:29.417 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:24:29.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.600+0000 7fb6629ff700 1 Processor -- start 2023-10-06T03:24:29.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.600+0000 7fb6629ff700 1 -- start start 2023-10-06T03:24:29.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.602+0000 7fb6629ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb65c13f9c0 0x7fb65c0ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:29.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.602+0000 7fb6629ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb65c0cab60 0x7fb65c159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:29.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.602+0000 7fb6629ff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb65c0cafe0 con 0x7fb65c13fd90 2023-10-06T03:24:29.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.602+0000 7fb6629ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb65c0cb2c0 con 0x7fb65c13f9c0 2023-10-06T03:24:29.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.602+0000 7fb6629ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb65c0cb5a0 con 0x7fb65c0cab60 2023-10-06T03:24:29.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.602+0000 7fb65bfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb65c13f9c0 0x7fb65c0ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:29.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.602+0000 7fb65bfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb65c13f9c0 0x7fb65c0ca620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55416/0 (socket says 172.21.15.81:55416) 2023-10-06T03:24:29.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.602+0000 7fb65bfff700 1 -- 172.21.15.81:0/4252567564 learned_addr learned my addr 172.21.15.81:0/4252567564 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:29.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.602+0000 7fb653fff700 1 --2- 172.21.15.81:0/4252567564 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb65c0cab60 0x7fb65c159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:29.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.603+0000 7fb65bfff700 1 -- 172.21.15.81:0/4252567564 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb65c0cab60 msgr2=0x7fb65c159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:29.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.603+0000 7fb65bfff700 1 --2- 172.21.15.81:0/4252567564 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb65c0cab60 0x7fb65c159eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:29.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.603+0000 7fb65bfff700 1 -- 172.21.15.81:0/4252567564 >> v1:172.21.15.83:6789/0 conn(0x7fb65c13fd90 legacy=0x7fb65c06e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:29.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.603+0000 7fb65bfff700 1 -- 172.21.15.81:0/4252567564 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb65c0cb880 con 0x7fb65c13f9c0 2023-10-06T03:24:29.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.603+0000 7fb65bfff700 1 --2- 172.21.15.81:0/4252567564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb65c13f9c0 0x7fb65c0ca620 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb64c00bc50 tx=0x7fb64c00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d70a75d08375482 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:29.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.603+0000 7fb65b7fe700 1 -- 172.21.15.81:0/4252567564 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb64c00be60 con 0x7fb65c13f9c0 2023-10-06T03:24:29.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.603+0000 7fb65b7fe700 1 -- 172.21.15.81:0/4252567564 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb64c00de00 con 0x7fb65c13f9c0 2023-10-06T03:24:29.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.603+0000 7fb65b7fe700 1 -- 172.21.15.81:0/4252567564 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb64c0196b0 con 0x7fb65c13f9c0 2023-10-06T03:24:29.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.604+0000 7fb6629ff700 1 -- 172.21.15.81:0/4252567564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb65c13f9c0 msgr2=0x7fb65c0ca620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:29.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.604+0000 7fb6629ff700 1 --2- 172.21.15.81:0/4252567564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb65c13f9c0 0x7fb65c0ca620 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb64c00bc50 tx=0x7fb64c00b4f0 comp rx=0 tx=0).stop 2023-10-06T03:24:29.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.604+0000 7fb6629ff700 1 -- 172.21.15.81:0/4252567564 shutdown_connections 2023-10-06T03:24:29.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.604+0000 7fb6629ff700 1 --2- 172.21.15.81:0/4252567564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb65c13f9c0 0x7fb65c0ca620 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:29.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.604+0000 7fb6629ff700 1 --2- 172.21.15.81:0/4252567564 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb65c0cab60 0x7fb65c159eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:29.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.604+0000 7fb6629ff700 1 -- 172.21.15.81:0/4252567564 >> 172.21.15.81:0/4252567564 conn(0x7fb65c0cc090 msgr2=0x7fb65c0cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:29.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.604+0000 7fb6629ff700 1 -- 172.21.15.81:0/4252567564 shutdown_connections 2023-10-06T03:24:29.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.604+0000 7fb6629ff700 1 -- 172.21.15.81:0/4252567564 wait complete. 2023-10-06T03:24:29.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.605+0000 7fb6629ff700 1 Processor -- start 2023-10-06T03:24:29.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.605+0000 7fb6629ff700 1 -- start start 2023-10-06T03:24:29.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.606+0000 7fb6629ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb65c13f9c0 0x7fb65c0ab910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:29.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.606+0000 7fb6629ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb65c13fd90 0x7fb65c0af090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:29.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.606+0000 7fb6629ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb65c0af5d0 0x7fb65c0afa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:29.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.606+0000 7fb6629ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb65c0c4ad0 con 0x7fb65c13f9c0 2023-10-06T03:24:29.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.606+0000 7fb6629ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb65c1597f0 con 0x7fb65c0af5d0 2023-10-06T03:24:29.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.606+0000 7fb6629ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb65c0c55f0 con 0x7fb65c13fd90 2023-10-06T03:24:29.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.606+0000 7fb65bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb65c13f9c0 0x7fb65c0ab910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:29.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.607+0000 7fb65bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb65c13f9c0 0x7fb65c0ab910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55422/0 (socket says 172.21.15.81:55422) 2023-10-06T03:24:29.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.607+0000 7fb65bfff700 1 -- 172.21.15.81:0/39272648 learned_addr learned my addr 172.21.15.81:0/39272648 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:29.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.607+0000 7fb653fff700 1 --2- 172.21.15.81:0/39272648 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb65c13fd90 0x7fb65c0af090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:29.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.607+0000 7fb660f9c700 1 --2- 172.21.15.81:0/39272648 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb65c0af5d0 0x7fb65c0afa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:29.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.607+0000 7fb65bfff700 1 -- 172.21.15.81:0/39272648 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb65c13fd90 msgr2=0x7fb65c0af090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:29.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.607+0000 7fb65bfff700 1 --2- 172.21.15.81:0/39272648 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb65c13fd90 0x7fb65c0af090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:29.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.607+0000 7fb65bfff700 1 -- 172.21.15.81:0/39272648 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb65c0af5d0 msgr2=0x7fb65c0afa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:29.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.607+0000 7fb65bfff700 1 --2- 172.21.15.81:0/39272648 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb65c0af5d0 0x7fb65c0afa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:29.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.607+0000 7fb65bfff700 1 -- 172.21.15.81:0/39272648 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb64c00b790 con 0x7fb65c13f9c0 2023-10-06T03:24:29.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.607+0000 7fb660f9c700 1 --2- 172.21.15.81:0/39272648 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb65c0af5d0 0x7fb65c0afa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:29.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.607+0000 7fb653fff700 1 --2- 172.21.15.81:0/39272648 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb65c13fd90 0x7fb65c0af090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:29.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.607+0000 7fb65bfff700 1 --2- 172.21.15.81:0/39272648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb65c13f9c0 0x7fb65c0ab910 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb64c006fd0 tx=0x7fb64c01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:29.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.607+0000 7fb658ff9700 1 -- 172.21.15.81:0/39272648 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb64c010750 con 0x7fb65c13f9c0 2023-10-06T03:24:29.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.607+0000 7fb658ff9700 1 -- 172.21.15.81:0/39272648 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb64c0108b0 con 0x7fb65c13f9c0 2023-10-06T03:24:29.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.607+0000 7fb658ff9700 1 -- 172.21.15.81:0/39272648 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb64c010c70 con 0x7fb65c13f9c0 2023-10-06T03:24:29.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.607+0000 7fb6629ff700 1 -- 172.21.15.81:0/39272648 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb65c0abf60 con 0x7fb65c13f9c0 2023-10-06T03:24:29.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.608+0000 7fb6629ff700 1 -- 172.21.15.81:0/39272648 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb65c0c5b00 con 0x7fb65c13f9c0 2023-10-06T03:24:29.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.608+0000 7fb6629ff700 1 -- 172.21.15.81:0/39272648 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb65c04c3c0 con 0x7fb65c13f9c0 2023-10-06T03:24:29.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.609+0000 7fb658ff9700 1 -- 172.21.15.81:0/39272648 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb64c02c440 con 0x7fb65c13f9c0 2023-10-06T03:24:29.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.610+0000 7fb658ff9700 1 --2- 172.21.15.81:0/39272648 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb63c066f30 0x7fb63c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:29.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.610+0000 7fb658ff9700 1 -- 172.21.15.81:0/39272648 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fb64c014070 con 0x7fb65c13f9c0 2023-10-06T03:24:29.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.610+0000 7fb653fff700 1 --2- 172.21.15.81:0/39272648 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb63c066f30 0x7fb63c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:29.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.611+0000 7fb653fff700 1 --2- 172.21.15.81:0/39272648 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb63c066f30 0x7fb63c0693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb65c06a540 tx=0x7fb644008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:29.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.614+0000 7fb658ff9700 1 -- 172.21.15.81:0/39272648 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb64c0534a0 con 0x7fb65c13f9c0 2023-10-06T03:24:29.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.812+0000 7fb6629ff700 1 -- 172.21.15.81:0/39272648 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb65c06f720 con 0x7fb65c13f9c0 2023-10-06T03:24:29.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.813+0000 7fb658ff9700 1 -- 172.21.15.81:0/39272648 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18754 (secure 0 0 0) 0x7fb64c056ac0 con 0x7fb65c13f9c0 2023-10-06T03:24:29.814 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:24:29.814 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"1807b5d7-9be8-43ad-aaf8-99a4273430b3","created":"2023-10-06T03:23:20.805306+0000","modified":"2023-10-06T03:24:28.774889+0000","last_up_change":"2023-10-06T03:23:32.735796+0000","last_in_change":"2023-10-06T03:23:24.109024+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:33.198850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:33.606744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:23:38.742266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:23:39.347944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:23:42.959054+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"14fb667d-a677-4978-a477-80027f889d36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":85563},{"type":"v1","addr":"172.21.15.81:6818","nonce":85563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":85563},{"type":"v1","addr":"172.21.15.81:6822","nonce":85563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":85563},{"type":"v1","addr":"172.21.15.81:6830","nonce":85563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":85563},{"type":"v1","addr":"172.21.15.81:6826","nonce":85563}]},"public_addr":"172.21.15.81:6818/85563","cluster_addr":"172.21.15.81:6822/85563","heartbeat_back_addr":"172.21.15.81:6830/85563","heartbeat_front_addr":"172.21.15.81:6826/85563","state":["exists","up"]},{"osd":1,"uuid":"974d8a86-1829-4176-89ce-18e6038857f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":85561},{"type":"v1","addr":"172.21.15.81:6801","nonce":85561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":85561},{"type":"v1","addr":"172.21.15.81:6803","nonce":85561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":85561},{"type":"v1","addr":"172.21.15.81:6807","nonce":85561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":85561},{"type":"v1","addr":"172.21.15.81:6805","nonce":85561}]},"public_addr":"172.21.15.81:6801/85561","cluster_addr":"172.21.15.81:6803/85561","heartbeat_back_addr":"172.21.15.81:6807/85561","heartbeat_front_addr":"172.21.15.81:6805/85561","state":["exists","up"]},{"osd":2,"uuid":"ffbfe056-46bc-46e0-bf49-4d8f8650e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":85564},{"type":"v1","addr":"172.21.15.81:6809","nonce":85564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":85564},{"type":"v1","addr":"172.21.15.81:6811","nonce":85564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":85564},{"type":"v1","addr":"172.21.15.81:6815","nonce":85564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":85564},{"type":"v1","addr":"172.21.15.81:6813","nonce":85564}]},"public_addr":"172.21.15.81:6809/85564","cluster_addr":"172.21.15.81:6811/85564","heartbeat_back_addr":"172.21.15.81:6815/85564","heartbeat_front_addr":"172.21.15.81:6813/85564","state":["exists","up"]},{"osd":3,"uuid":"ef9a8314-3d37-4ea1-858a-e704d5695002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":85562},{"type":"v1","addr":"172.21.15.81:6819","nonce":85562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":85562},{"type":"v1","addr":"172.21.15.81:6823","nonce":85562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":85562},{"type":"v1","addr":"172.21.15.81:6831","nonce":85562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":85562},{"type":"v1","addr":"172.21.15.81:6827","nonce":85562}]},"public_addr":"172.21.15.81:6819/85562","cluster_addr":"172.21.15.81:6823/85562","heartbeat_back_addr":"172.21.15.81:6831/85562","heartbeat_front_addr":"172.21.15.81:6827/85562","state":["exists","up"]},{"osd":4,"uuid":"d83506a0-2c96-4bcb-a9fa-05e43dc329df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":85785},{"type":"v1","addr":"172.21.15.83:6801","nonce":85785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":85785},{"type":"v1","addr":"172.21.15.83:6803","nonce":85785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":85785},{"type":"v1","addr":"172.21.15.83:6807","nonce":85785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":85785},{"type":"v1","addr":"172.21.15.83:6805","nonce":85785}]},"public_addr":"172.21.15.83:6801/85785","cluster_addr":"172.21.15.83:6803/85785","heartbeat_back_addr":"172.21.15.83:6807/85785","heartbeat_front_addr":"172.21.15.83:6805/85785","state":["exists","up"]},{"osd":5,"uuid":"10687c63-a3d5-472f-acc0-4f61847b6e0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":85818},{"type":"v1","addr":"172.21.15.83:6825","nonce":85818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":85818},{"type":"v1","addr":"172.21.15.83:6827","nonce":85818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":85818},{"type":"v1","addr":"172.21.15.83:6831","nonce":85818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":85818},{"type":"v1","addr":"172.21.15.83:6829","nonce":85818}]},"public_addr":"172.21.15.83:6825/85818","cluster_addr":"172.21.15.83:6827/85818","heartbeat_back_addr":"172.21.15.83:6831/85818","heartbeat_front_addr":"172.21.15.83:6829/85818","state":["exists","up"]},{"osd":6,"uuid":"2e9daf76-5607-4a29-9a58-6e270700d223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":85787},{"type":"v1","addr":"172.21.15.83:6811","nonce":85787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":85787},{"type":"v1","addr":"172.21.15.83:6815","nonce":85787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":85787},{"type":"v1","addr":"172.21.15.83:6823","nonce":85787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6817","nonce":85787},{"type":"v1","addr":"172.21.15.83:6819","nonce":85787}]},"public_addr":"172.21.15.83:6811/85787","cluster_addr":"172.21.15.83:6815/85787","heartbeat_back_addr":"172.21.15.83:6823/85787","heartbeat_front_addr":"172.21.15.83:6819/85787","state":["exists","up"]},{"osd":7,"uuid":"5019e1ff-233a-4a5a-91ca-8afccb7ab6e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":85786},{"type":"v1","addr":"172.21.15.83:6810","nonce":85786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":85786},{"type":"v1","addr":"172.21.15.83:6814","nonce":85786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":85786},{"type":"v1","addr":"172.21.15.83:6822","nonce":85786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":85786},{"type":"v1","addr":"172.21.15.83:6818","nonce":85786}]},"public_addr":"172.21.15.83:6810/85786","cluster_addr":"172.21.15.83:6814/85786","heartbeat_back_addr":"172.21.15.83:6822/85786","heartbeat_front_addr":"172.21.15.83:6818/85786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.393431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.360031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.407428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.391613+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.403211+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.438142+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.496181+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.472323+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":1,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:24:29.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.815+0000 7fb6629ff700 1 -- 172.21.15.81:0/39272648 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb63c066f30 msgr2=0x7fb63c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:29.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.815+0000 7fb6629ff700 1 --2- 172.21.15.81:0/39272648 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb63c066f30 0x7fb63c0693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb65c06a540 tx=0x7fb644008040 comp rx=0 tx=0).stop 2023-10-06T03:24:29.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.815+0000 7fb6629ff700 1 -- 172.21.15.81:0/39272648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb65c13f9c0 msgr2=0x7fb65c0ab910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:29.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.815+0000 7fb6629ff700 1 --2- 172.21.15.81:0/39272648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb65c13f9c0 0x7fb65c0ab910 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb64c006fd0 tx=0x7fb64c01b000 comp rx=0 tx=0).stop 2023-10-06T03:24:29.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.815+0000 7fb6629ff700 1 -- 172.21.15.81:0/39272648 shutdown_connections 2023-10-06T03:24:29.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.815+0000 7fb6629ff700 1 --2- 172.21.15.81:0/39272648 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb65c0af5d0 0x7fb65c0afa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:29.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.815+0000 7fb6629ff700 1 --2- 172.21.15.81:0/39272648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb65c13f9c0 0x7fb65c0ab910 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:29.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.815+0000 7fb6629ff700 1 --2- 172.21.15.81:0/39272648 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb63c066f30 0x7fb63c0693e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:29.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.815+0000 7fb6629ff700 1 --2- 172.21.15.81:0/39272648 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb65c13fd90 0x7fb65c0af090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:29.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.815+0000 7fb6629ff700 1 -- 172.21.15.81:0/39272648 >> 172.21.15.81:0/39272648 conn(0x7fb65c0cc090 msgr2=0x7fb65c13ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:29.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.815+0000 7fb6629ff700 1 -- 172.21.15.81:0/39272648 shutdown_connections 2023-10-06T03:24:29.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:29.816+0000 7fb6629ff700 1 -- 172.21.15.81:0/39272648 wait complete. 2023-10-06T03:24:29.834 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:23:33.198850+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:23:33.606744+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:23:38.742266+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:23:39.347944+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T03:23:42.959054+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:24:29.835 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:24:30.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.017+0000 7f14e4f9d700 1 Processor -- start 2023-10-06T03:24:30.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.017+0000 7f14e4f9d700 1 -- start start 2023-10-06T03:24:30.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.018+0000 7f14e4f9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f14e01535a0 0x7f14e015ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:30.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.018+0000 7f14e4f9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f14e015a560 0x7f14e0153970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:30.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.018+0000 7f14e4f9d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14e015bef0 con 0x7f14e0157670 2023-10-06T03:24:30.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.018+0000 7f14e4f9d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14e00d1160 con 0x7f14e015a560 2023-10-06T03:24:30.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.018+0000 7f14e4f9d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14e015a9d0 con 0x7f14e01535a0 2023-10-06T03:24:30.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.019+0000 7f14dffff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f14e0157670 0x7f14e00b1cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39492/0 (socket says 172.21.15.81:39492) 2023-10-06T03:24:30.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.019+0000 7f14dffff700 1 -- 172.21.15.81:0/1198252654 learned_addr learned my addr 172.21.15.81:0/1198252654 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:24:30.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.019+0000 7f14deffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f14e015a560 0x7f14e0153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:30.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.019+0000 7f14df7fe700 1 --2- 172.21.15.81:0/1198252654 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f14e01535a0 0x7f14e015ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:30.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.019+0000 7f14de7fc700 1 -- 172.21.15.81:0/1198252654 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2677922854 0 0) 0x7f14e015bef0 con 0x7f14e0157670 2023-10-06T03:24:30.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.019+0000 7f14de7fc700 1 -- 172.21.15.81:0/1198252654 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14c8003570 con 0x7f14e0157670 2023-10-06T03:24:30.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.019+0000 7f14deffd700 1 -- 172.21.15.81:0/1198252654 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f14e01535a0 msgr2=0x7f14e015ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:30.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.019+0000 7f14deffd700 1 --2- 172.21.15.81:0/1198252654 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f14e01535a0 0x7f14e015ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:30.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.019+0000 7f14deffd700 1 -- 172.21.15.81:0/1198252654 >> v1:172.21.15.81:6789/0 conn(0x7f14e0157670 legacy=0x7f14e00b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:30.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.019+0000 7f14deffd700 1 -- 172.21.15.81:0/1198252654 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e0153eb0 con 0x7f14e015a560 2023-10-06T03:24:30.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.019+0000 7f14deffd700 1 --2- 172.21.15.81:0/1198252654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14e015a560 0x7f14e0153970 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f14d40098e0 tx=0x7f14d40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=480262c7093db2fc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:30.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.020+0000 7f14de7fc700 1 -- 172.21.15.81:0/1198252654 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d400b640 con 0x7f14e015a560 2023-10-06T03:24:30.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.020+0000 7f14de7fc700 1 -- 172.21.15.81:0/1198252654 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d400b7a0 con 0x7f14e015a560 2023-10-06T03:24:30.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.020+0000 7f14de7fc700 1 -- 172.21.15.81:0/1198252654 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d400bb20 con 0x7f14e015a560 2023-10-06T03:24:30.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.020+0000 7f14e4f9d700 1 -- 172.21.15.81:0/1198252654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14e015a560 msgr2=0x7f14e0153970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:30.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.020+0000 7f14e4f9d700 1 --2- 172.21.15.81:0/1198252654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14e015a560 0x7f14e0153970 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f14d40098e0 tx=0x7f14d40091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:30.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.020+0000 7f14e4f9d700 1 -- 172.21.15.81:0/1198252654 shutdown_connections 2023-10-06T03:24:30.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.020+0000 7f14e4f9d700 1 --2- 172.21.15.81:0/1198252654 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f14e01535a0 0x7f14e015ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:30.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.020+0000 7f14e4f9d700 1 --2- 172.21.15.81:0/1198252654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14e015a560 0x7f14e0153970 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:30.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.020+0000 7f14e4f9d700 1 -- 172.21.15.81:0/1198252654 >> 172.21.15.81:0/1198252654 conn(0x7f14e0068230 msgr2=0x7f14e0068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:30.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.020+0000 7f14e4f9d700 1 -- 172.21.15.81:0/1198252654 shutdown_connections 2023-10-06T03:24:30.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.020+0000 7f14e4f9d700 1 -- 172.21.15.81:0/1198252654 wait complete. 2023-10-06T03:24:30.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.022+0000 7f14e4f9d700 1 Processor -- start 2023-10-06T03:24:30.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.022+0000 7f14e4f9d700 1 -- start start 2023-10-06T03:24:30.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.023+0000 7f14e4f9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f14e01535a0 0x7f14e0152df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:30.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.023+0000 7f14e4f9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14e0157670 0x7f14e0155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:30.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.023+0000 7f14e4f9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f14e015a560 0x7f14e015d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:30.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.023+0000 7f14e4f9d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e01540a0 con 0x7f14e0157670 2023-10-06T03:24:30.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.023+0000 7f14e4f9d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e0154ee0 con 0x7f14e01535a0 2023-10-06T03:24:30.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.023+0000 7f14e4f9d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14e01558b0 con 0x7f14e015a560 2023-10-06T03:24:30.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.023+0000 7f14deffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14e0157670 0x7f14e0155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:30.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.023+0000 7f14deffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14e0157670 0x7f14e0155370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55554/0 (socket says 172.21.15.81:55554) 2023-10-06T03:24:30.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.023+0000 7f14deffd700 1 -- 172.21.15.81:0/2580998971 learned_addr learned my addr 172.21.15.81:0/2580998971 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:30.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.023+0000 7f14dffff700 1 --2- 172.21.15.81:0/2580998971 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f14e015a560 0x7f14e015d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:30.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.023+0000 7f14df7fe700 1 --2- 172.21.15.81:0/2580998971 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f14e01535a0 0x7f14e0152df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:30.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.023+0000 7f14deffd700 1 -- 172.21.15.81:0/2580998971 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f14e015a560 msgr2=0x7f14e015d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:30.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.023+0000 7f14deffd700 1 --2- 172.21.15.81:0/2580998971 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f14e015a560 0x7f14e015d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:30.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.023+0000 7f14deffd700 1 -- 172.21.15.81:0/2580998971 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f14e01535a0 msgr2=0x7f14e0152df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:30.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.023+0000 7f14deffd700 1 --2- 172.21.15.81:0/2580998971 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f14e01535a0 0x7f14e0152df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:30.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.023+0000 7f14deffd700 1 -- 172.21.15.81:0/2580998971 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d4009420 con 0x7f14e0157670 2023-10-06T03:24:30.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.024+0000 7f14deffd700 1 --2- 172.21.15.81:0/2580998971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14e0157670 0x7f14e0155370 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f14e0088fa0 tx=0x7f14d4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:30.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.024+0000 7f14c77fe700 1 -- 172.21.15.81:0/2580998971 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d400b910 con 0x7f14e0157670 2023-10-06T03:24:30.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.024+0000 7f14c77fe700 1 -- 172.21.15.81:0/2580998971 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d400bab0 con 0x7f14e0157670 2023-10-06T03:24:30.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.024+0000 7f14e4f9d700 1 -- 172.21.15.81:0/2580998971 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14e01542d0 con 0x7f14e0157670 2023-10-06T03:24:30.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.024+0000 7f14c77fe700 1 -- 172.21.15.81:0/2580998971 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d4025670 con 0x7f14e0157670 2023-10-06T03:24:30.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.024+0000 7f14e4f9d700 1 -- 172.21.15.81:0/2580998971 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14e0154890 con 0x7f14e0157670 2023-10-06T03:24:30.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.025+0000 7f14e4f9d700 1 -- 172.21.15.81:0/2580998971 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14e004c3c0 con 0x7f14e0157670 2023-10-06T03:24:30.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.026+0000 7f14c77fe700 1 -- 172.21.15.81:0/2580998971 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f14d4023070 con 0x7f14e0157670 2023-10-06T03:24:30.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.027+0000 7f14c77fe700 1 --2- 172.21.15.81:0/2580998971 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f14cc066f30 0x7f14cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:30.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.027+0000 7f14c77fe700 1 -- 172.21.15.81:0/2580998971 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f14d4085f10 con 0x7f14e0157670 2023-10-06T03:24:30.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.027+0000 7f14df7fe700 1 --2- 172.21.15.81:0/2580998971 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f14cc066f30 0x7f14cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:30.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.027+0000 7f14df7fe700 1 --2- 172.21.15.81:0/2580998971 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f14cc066f30 0x7f14cc0693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f14d0006fd0 tx=0x7f14d0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:30.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.031+0000 7f14c77fe700 1 -- 172.21.15.81:0/2580998971 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f14d4052d00 con 0x7f14e0157670 2023-10-06T03:24:30.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.220+0000 7f14e4f9d700 1 -- 172.21.15.81:0/2580998971 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f14e015b2e0 con 0x7f14e0157670 2023-10-06T03:24:30.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.220+0000 7f14c77fe700 1 -- 172.21.15.81:0/2580998971 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f14d40150a0 con 0x7f14e0157670 2023-10-06T03:24:30.221 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-10-06T03:24:30.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.223+0000 7f14e4f9d700 1 -- 172.21.15.81:0/2580998971 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f14cc066f30 msgr2=0x7f14cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:30.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.223+0000 7f14e4f9d700 1 --2- 172.21.15.81:0/2580998971 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f14cc066f30 0x7f14cc0693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f14d0006fd0 tx=0x7f14d0008040 comp rx=0 tx=0).stop 2023-10-06T03:24:30.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.223+0000 7f14e4f9d700 1 -- 172.21.15.81:0/2580998971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14e0157670 msgr2=0x7f14e0155370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:30.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.223+0000 7f14e4f9d700 1 --2- 172.21.15.81:0/2580998971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14e0157670 0x7f14e0155370 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f14e0088fa0 tx=0x7f14d4017000 comp rx=0 tx=0).stop 2023-10-06T03:24:30.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.223+0000 7f14e4f9d700 1 -- 172.21.15.81:0/2580998971 shutdown_connections 2023-10-06T03:24:30.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.223+0000 7f14e4f9d700 1 --2- 172.21.15.81:0/2580998971 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f14cc066f30 0x7f14cc0693e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:30.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.223+0000 7f14e4f9d700 1 --2- 172.21.15.81:0/2580998971 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f14e015a560 0x7f14e015d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:30.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.223+0000 7f14e4f9d700 1 --2- 172.21.15.81:0/2580998971 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f14e01535a0 0x7f14e0152df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:30.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.223+0000 7f14e4f9d700 1 --2- 172.21.15.81:0/2580998971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14e0157670 0x7f14e0155370 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:30.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.223+0000 7f14e4f9d700 1 -- 172.21.15.81:0/2580998971 >> 172.21.15.81:0/2580998971 conn(0x7f14e0068230 msgr2=0x7f14e00b40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:30.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.223+0000 7f14e4f9d700 1 -- 172.21.15.81:0/2580998971 shutdown_connections 2023-10-06T03:24:30.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.223+0000 7f14e4f9d700 1 -- 172.21.15.81:0/2580998971 wait complete. 2023-10-06T03:24:30.241 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:24:30.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.424+0000 7f0d1c5ff700 1 Processor -- start 2023-10-06T03:24:30.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.425+0000 7f0d1c5ff700 1 -- start start 2023-10-06T03:24:30.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.426+0000 7f0d1c5ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0d140ae130 0x7f0d1406d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:30.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.426+0000 7f0d1c5ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f0d1406ddb0 0x7f0d140c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:30.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.426+0000 7f0d1c5ff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d1406a630 con 0x7f0d1406a180 2023-10-06T03:24:30.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.426+0000 7f0d1c5ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d1406a910 con 0x7f0d140ae130 2023-10-06T03:24:30.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.426+0000 7f0d1c5ff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d1406abf0 con 0x7f0d1406ddb0 2023-10-06T03:24:30.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.426+0000 7f0d1a39b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0d140ae130 0x7f0d1406d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:30.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.426+0000 7f0d1a39b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0d140ae130 0x7f0d1406d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55558/0 (socket says 172.21.15.81:55558) 2023-10-06T03:24:30.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.426+0000 7f0d1a39b700 1 -- 172.21.15.81:0/118993465 learned_addr learned my addr 172.21.15.81:0/118993465 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:30.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.426+0000 7f0d1ab9c700 1 --2- 172.21.15.81:0/118993465 >> v2:172.21.15.83:3300/0 conn(0x7f0d1406ddb0 0x7f0d140c6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:30.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.427+0000 7f0d1a39b700 1 -- 172.21.15.81:0/118993465 >> v2:172.21.15.83:3300/0 conn(0x7f0d1406ddb0 msgr2=0x7f0d140c6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:30.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.427+0000 7f0d1a39b700 1 --2- 172.21.15.81:0/118993465 >> v2:172.21.15.83:3300/0 conn(0x7f0d1406ddb0 0x7f0d140c6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:30.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.427+0000 7f0d1a39b700 1 -- 172.21.15.81:0/118993465 >> v1:172.21.15.83:6789/0 conn(0x7f0d1406a180 legacy=0x7f0d141570f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:30.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.427+0000 7f0d1a39b700 1 -- 172.21.15.81:0/118993465 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d1406aed0 con 0x7f0d140ae130 2023-10-06T03:24:30.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.427+0000 7f0d1a39b700 1 --2- 172.21.15.81:0/118993465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d140ae130 0x7f0d1406d870 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0d10009990 tx=0x7f0d10009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c452d08a20aa3fc2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:30.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.427+0000 7f0d19399700 1 -- 172.21.15.81:0/118993465 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d10009e80 con 0x7f0d140ae130 2023-10-06T03:24:30.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.427+0000 7f0d19399700 1 -- 172.21.15.81:0/118993465 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d10005c10 con 0x7f0d140ae130 2023-10-06T03:24:30.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.427+0000 7f0d19399700 1 -- 172.21.15.81:0/118993465 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1000b610 con 0x7f0d140ae130 2023-10-06T03:24:30.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.428+0000 7f0d1c5ff700 1 -- 172.21.15.81:0/118993465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d140ae130 msgr2=0x7f0d1406d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:30.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.428+0000 7f0d1c5ff700 1 --2- 172.21.15.81:0/118993465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d140ae130 0x7f0d1406d870 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0d10009990 tx=0x7f0d10009220 comp rx=0 tx=0).stop 2023-10-06T03:24:30.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.428+0000 7f0d1c5ff700 1 -- 172.21.15.81:0/118993465 shutdown_connections 2023-10-06T03:24:30.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.428+0000 7f0d1c5ff700 1 --2- 172.21.15.81:0/118993465 >> v2:172.21.15.83:3300/0 conn(0x7f0d1406ddb0 0x7f0d140c6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:30.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.428+0000 7f0d1c5ff700 1 --2- 172.21.15.81:0/118993465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d140ae130 0x7f0d1406d870 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:30.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.428+0000 7f0d1c5ff700 1 -- 172.21.15.81:0/118993465 >> 172.21.15.81:0/118993465 conn(0x7f0d140cc090 msgr2=0x7f0d140cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:30.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.428+0000 7f0d1c5ff700 1 -- 172.21.15.81:0/118993465 shutdown_connections 2023-10-06T03:24:30.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.428+0000 7f0d1c5ff700 1 -- 172.21.15.81:0/118993465 wait complete. 2023-10-06T03:24:30.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.429+0000 7f0d1c5ff700 1 Processor -- start 2023-10-06T03:24:30.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.430+0000 7f0d1c5ff700 1 -- start start 2023-10-06T03:24:30.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.430+0000 7f0d1c5ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0d1406a180 0x7f0d140af500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:30.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.430+0000 7f0d1c5ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d1406ddb0 0x7f0d1415e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:30.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.430+0000 7f0d1c5ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0d140ae130 0x7f0d1415ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:30.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.431+0000 7f0d1c5ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1415ad60 con 0x7f0d1406ddb0 2023-10-06T03:24:30.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.431+0000 7f0d1c5ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d14155f20 con 0x7f0d1406a180 2023-10-06T03:24:30.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.431+0000 7f0d1c5ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d14155680 con 0x7f0d140ae130 2023-10-06T03:24:30.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.431+0000 7f0d19b9a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d1406ddb0 0x7f0d1415e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:30.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.431+0000 7f0d19b9a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d1406ddb0 0x7f0d1415e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55564/0 (socket says 172.21.15.81:55564) 2023-10-06T03:24:30.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.431+0000 7f0d19b9a700 1 -- 172.21.15.81:0/2330845289 learned_addr learned my addr 172.21.15.81:0/2330845289 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:30.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.431+0000 7f0d1a39b700 1 --2- 172.21.15.81:0/2330845289 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0d1406a180 0x7f0d140af500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:30.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.431+0000 7f0d1ab9c700 1 --2- 172.21.15.81:0/2330845289 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0d140ae130 0x7f0d1415ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:30.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.431+0000 7f0d19b9a700 1 -- 172.21.15.81:0/2330845289 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0d140ae130 msgr2=0x7f0d1415ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:30.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.431+0000 7f0d19b9a700 1 --2- 172.21.15.81:0/2330845289 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0d140ae130 0x7f0d1415ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:30.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.431+0000 7f0d19b9a700 1 -- 172.21.15.81:0/2330845289 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0d1406a180 msgr2=0x7f0d140af500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:30.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.431+0000 7f0d19b9a700 1 --2- 172.21.15.81:0/2330845289 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0d1406a180 0x7f0d140af500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:30.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.431+0000 7f0d19b9a700 1 -- 172.21.15.81:0/2330845289 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d10009480 con 0x7f0d1406ddb0 2023-10-06T03:24:30.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.431+0000 7f0d1ab9c700 1 --2- 172.21.15.81:0/2330845289 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0d140ae130 0x7f0d1415ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:30.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.431+0000 7f0d19b9a700 1 --2- 172.21.15.81:0/2330845289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d1406ddb0 0x7f0d1415e940 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0d0400c7c0 tx=0x7f0d04007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:30.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.432+0000 7f0d0a7fc700 1 -- 172.21.15.81:0/2330845289 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d04011590 con 0x7f0d1406ddb0 2023-10-06T03:24:30.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.432+0000 7f0d0a7fc700 1 -- 172.21.15.81:0/2330845289 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d040116f0 con 0x7f0d1406ddb0 2023-10-06T03:24:30.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.432+0000 7f0d0a7fc700 1 -- 172.21.15.81:0/2330845289 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d04011ab0 con 0x7f0d1406ddb0 2023-10-06T03:24:30.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.432+0000 7f0d1c5ff700 1 -- 172.21.15.81:0/2330845289 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d14155960 con 0x7f0d1406ddb0 2023-10-06T03:24:30.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.432+0000 7f0d1c5ff700 1 -- 172.21.15.81:0/2330845289 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d1415c3e0 con 0x7f0d1406ddb0 2023-10-06T03:24:30.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.433+0000 7f0d1c5ff700 1 -- 172.21.15.81:0/2330845289 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d1406cee0 con 0x7f0d1406ddb0 2023-10-06T03:24:30.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.434+0000 7f0d0a7fc700 1 -- 172.21.15.81:0/2330845289 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0d0401b3b0 con 0x7f0d1406ddb0 2023-10-06T03:24:30.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.434+0000 7f0d0a7fc700 1 --2- 172.21.15.81:0/2330845289 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0cf8066f30 0x7f0cf80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:30.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.434+0000 7f0d0a7fc700 1 -- 172.21.15.81:0/2330845289 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f0d04083f10 con 0x7f0d1406ddb0 2023-10-06T03:24:30.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.435+0000 7f0d1a39b700 1 --2- 172.21.15.81:0/2330845289 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0cf8066f30 0x7f0cf80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:30.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.435+0000 7f0d1a39b700 1 --2- 172.21.15.81:0/2330845289 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0cf8066f30 0x7f0cf80693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0d10009260 tx=0x7f0d10016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:30.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.438+0000 7f0d0a7fc700 1 -- 172.21.15.81:0/2330845289 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0d04050c50 con 0x7f0d1406ddb0 2023-10-06T03:24:30.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.628+0000 7f0d1c5ff700 1 -- 172.21.15.81:0/2330845289 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0d14069a70 con 0x7f0d1406ddb0 2023-10-06T03:24:30.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.628+0000 7f0d0a7fc700 1 -- 172.21.15.81:0/2330845289 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0d04017020 con 0x7f0d1406ddb0 2023-10-06T03:24:30.629 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-06T03:24:30.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.630+0000 7f0d1c5ff700 1 -- 172.21.15.81:0/2330845289 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0cf8066f30 msgr2=0x7f0cf80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:30.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.630+0000 7f0d1c5ff700 1 --2- 172.21.15.81:0/2330845289 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0cf8066f30 0x7f0cf80693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0d10009260 tx=0x7f0d10016000 comp rx=0 tx=0).stop 2023-10-06T03:24:30.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.630+0000 7f0d1c5ff700 1 -- 172.21.15.81:0/2330845289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d1406ddb0 msgr2=0x7f0d1415e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:30.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.630+0000 7f0d1c5ff700 1 --2- 172.21.15.81:0/2330845289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d1406ddb0 0x7f0d1415e940 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0d0400c7c0 tx=0x7f0d04007f50 comp rx=0 tx=0).stop 2023-10-06T03:24:30.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.630+0000 7f0d1c5ff700 1 -- 172.21.15.81:0/2330845289 shutdown_connections 2023-10-06T03:24:30.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.630+0000 7f0d1c5ff700 1 --2- 172.21.15.81:0/2330845289 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0cf8066f30 0x7f0cf80693e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:30.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.630+0000 7f0d1c5ff700 1 --2- 172.21.15.81:0/2330845289 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0d140ae130 0x7f0d1415ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:30.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.630+0000 7f0d1c5ff700 1 --2- 172.21.15.81:0/2330845289 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0d1406a180 0x7f0d140af500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:30.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.630+0000 7f0d1c5ff700 1 --2- 172.21.15.81:0/2330845289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d1406ddb0 0x7f0d1415e940 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:30.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.630+0000 7f0d1c5ff700 1 -- 172.21.15.81:0/2330845289 >> 172.21.15.81:0/2330845289 conn(0x7f0d140cc090 msgr2=0x7f0d140637a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:30.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.631+0000 7f0d1c5ff700 1 -- 172.21.15.81:0/2330845289 shutdown_connections 2023-10-06T03:24:30.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.631+0000 7f0d1c5ff700 1 -- 172.21.15.81:0/2330845289 wait complete. 2023-10-06T03:24:30.649 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:24:30.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.832+0000 7f3300b9d700 1 Processor -- start 2023-10-06T03:24:30.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.832+0000 7f3300b9d700 1 -- start start 2023-10-06T03:24:30.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.833+0000 7f3300b9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f32fc0b2320 0x7f32fc1575a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:30.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.833+0000 7f3300b9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f32fc157ae0 0x7f32fc0d0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:30.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.833+0000 7f3300b9d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32fc15b4f0 con 0x7f32fc0b1f50 2023-10-06T03:24:30.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.833+0000 7f3300b9d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32fc157f20 con 0x7f32fc0b2320 2023-10-06T03:24:30.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.833+0000 7f3300b9d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc15b7d0 con 0x7f32fc157ae0 2023-10-06T03:24:30.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.834+0000 7f32faffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f32fc0b2320 0x7f32fc1575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:30.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.834+0000 7f32faffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f32fc0b2320 0x7f32fc1575a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55574/0 (socket says 172.21.15.81:55574) 2023-10-06T03:24:30.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.834+0000 7f32faffd700 1 -- 172.21.15.81:0/3126868713 learned_addr learned my addr 172.21.15.81:0/3126868713 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:30.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.834+0000 7f32faffd700 1 -- 172.21.15.81:0/3126868713 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f32fc157ae0 msgr2=0x7f32fc0d0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:30.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.834+0000 7f32fbfff700 1 --2- 172.21.15.81:0/3126868713 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f32fc157ae0 0x7f32fc0d0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:30.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.834+0000 7f32faffd700 1 --2- 172.21.15.81:0/3126868713 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f32fc157ae0 0x7f32fc0d0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:30.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.834+0000 7f32faffd700 1 -- 172.21.15.81:0/3126868713 >> v1:172.21.15.83:6789/0 conn(0x7f32fc0b1f50 legacy=0x7f32fc15c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:30.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.834+0000 7f32faffd700 1 -- 172.21.15.81:0/3126868713 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32fc15bab0 con 0x7f32fc0b2320 2023-10-06T03:24:30.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.834+0000 7f32fbfff700 1 --2- 172.21.15.81:0/3126868713 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f32fc157ae0 0x7f32fc0d0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:30.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.835+0000 7f32faffd700 1 --2- 172.21.15.81:0/3126868713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32fc0b2320 0x7f32fc1575a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f32f00099b0 tx=0x7f32f0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62d23d18a60ae031 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:30.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.835+0000 7f32fa7fc700 1 -- 172.21.15.81:0/3126868713 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f000b860 con 0x7f32fc0b2320 2023-10-06T03:24:30.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.835+0000 7f32fa7fc700 1 -- 172.21.15.81:0/3126868713 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f000b9c0 con 0x7f32fc0b2320 2023-10-06T03:24:30.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.835+0000 7f32fa7fc700 1 -- 172.21.15.81:0/3126868713 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f000bd60 con 0x7f32fc0b2320 2023-10-06T03:24:30.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.835+0000 7f3300b9d700 1 -- 172.21.15.81:0/3126868713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32fc0b2320 msgr2=0x7f32fc1575a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:30.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.835+0000 7f3300b9d700 1 --2- 172.21.15.81:0/3126868713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32fc0b2320 0x7f32fc1575a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f32f00099b0 tx=0x7f32f0009250 comp rx=0 tx=0).stop 2023-10-06T03:24:30.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.836+0000 7f3300b9d700 1 -- 172.21.15.81:0/3126868713 shutdown_connections 2023-10-06T03:24:30.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.836+0000 7f3300b9d700 1 --2- 172.21.15.81:0/3126868713 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f32fc157ae0 0x7f32fc0d0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:30.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.836+0000 7f3300b9d700 1 --2- 172.21.15.81:0/3126868713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32fc0b2320 0x7f32fc1575a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:30.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.836+0000 7f3300b9d700 1 -- 172.21.15.81:0/3126868713 >> 172.21.15.81:0/3126868713 conn(0x7f32fc06ed10 msgr2=0x7f32fc06f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:30.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.836+0000 7f3300b9d700 1 -- 172.21.15.81:0/3126868713 shutdown_connections 2023-10-06T03:24:30.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.836+0000 7f3300b9d700 1 -- 172.21.15.81:0/3126868713 wait complete. 2023-10-06T03:24:30.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.837+0000 7f3300b9d700 1 Processor -- start 2023-10-06T03:24:30.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.837+0000 7f3300b9d700 1 -- start start 2023-10-06T03:24:30.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.838+0000 7f3300b9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32fc0b1f50 0x7f32fc159a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:30.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.838+0000 7f3300b9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f32fc0b2320 0x7f32fc158060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:30.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.838+0000 7f3300b9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f32fc157ae0 0x7f32fc15f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:30.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.838+0000 7f3300b9d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc159f90 con 0x7f32fc0b1f50 2023-10-06T03:24:30.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.838+0000 7f3300b9d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc1595c0 con 0x7f32fc0b2320 2023-10-06T03:24:30.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.838+0000 7f3300b9d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc1589b0 con 0x7f32fc157ae0 2023-10-06T03:24:30.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.838+0000 7f32fb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32fc0b1f50 0x7f32fc159a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:30.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.839+0000 7f32fb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32fc0b1f50 0x7f32fc159a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55584/0 (socket says 172.21.15.81:55584) 2023-10-06T03:24:30.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.839+0000 7f32fb7fe700 1 -- 172.21.15.81:0/2321683050 learned_addr learned my addr 172.21.15.81:0/2321683050 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:30.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.839+0000 7f32faffd700 1 --2- 172.21.15.81:0/2321683050 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f32fc0b2320 0x7f32fc158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:30.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.839+0000 7f32fbfff700 1 --2- 172.21.15.81:0/2321683050 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f32fc157ae0 0x7f32fc15f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:30.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.839+0000 7f32fb7fe700 1 -- 172.21.15.81:0/2321683050 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f32fc157ae0 msgr2=0x7f32fc15f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:30.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.839+0000 7f32fb7fe700 1 --2- 172.21.15.81:0/2321683050 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f32fc157ae0 0x7f32fc15f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:30.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.839+0000 7f32fb7fe700 1 -- 172.21.15.81:0/2321683050 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f32fc0b2320 msgr2=0x7f32fc158060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:30.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.839+0000 7f32fb7fe700 1 --2- 172.21.15.81:0/2321683050 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f32fc0b2320 0x7f32fc158060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:30.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.839+0000 7f32fb7fe700 1 -- 172.21.15.81:0/2321683050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f00094f0 con 0x7f32fc0b1f50 2023-10-06T03:24:30.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.839+0000 7f32fb7fe700 1 --2- 172.21.15.81:0/2321683050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32fc0b1f50 0x7f32fc159a50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f32ec00c590 tx=0x7f32ec00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:30.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.839+0000 7f32e37fe700 1 -- 172.21.15.81:0/2321683050 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ec011590 con 0x7f32fc0b1f50 2023-10-06T03:24:30.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.839+0000 7f32e37fe700 1 -- 172.21.15.81:0/2321683050 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32ec011710 con 0x7f32fc0b1f50 2023-10-06T03:24:30.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.839+0000 7f32e37fe700 1 -- 172.21.15.81:0/2321683050 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ec011ad0 con 0x7f32fc0b1f50 2023-10-06T03:24:30.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.839+0000 7f3300b9d700 1 -- 172.21.15.81:0/2321683050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32fc158c90 con 0x7f32fc0b1f50 2023-10-06T03:24:30.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.840+0000 7f3300b9d700 1 -- 172.21.15.81:0/2321683050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32fc159250 con 0x7f32fc0b1f50 2023-10-06T03:24:30.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.840+0000 7f3300b9d700 1 -- 172.21.15.81:0/2321683050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32fc1598a0 con 0x7f32fc0b1f50 2023-10-06T03:24:30.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.842+0000 7f32e37fe700 1 -- 172.21.15.81:0/2321683050 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f32ec01b3b0 con 0x7f32fc0b1f50 2023-10-06T03:24:30.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.843+0000 7f32e37fe700 1 --2- 172.21.15.81:0/2321683050 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f32e8066f30 0x7f32e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:30.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.843+0000 7f32e37fe700 1 -- 172.21.15.81:0/2321683050 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f32ec083e10 con 0x7f32fc0b1f50 2023-10-06T03:24:30.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.843+0000 7f32faffd700 1 --2- 172.21.15.81:0/2321683050 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f32e8066f30 0x7f32e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:30.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.843+0000 7f32faffd700 1 --2- 172.21.15.81:0/2321683050 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f32e8066f30 0x7f32e80693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f32f00099b0 tx=0x7f32f0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:30.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:30.847+0000 7f32e37fe700 1 -- 172.21.15.81:0/2321683050 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f32ec050bf0 con 0x7f32fc0b1f50 2023-10-06T03:24:31.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.039+0000 7f3300b9d700 1 -- 172.21.15.81:0/2321683050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f32fc04c3c0 con 0x7f32fc0b1f50 2023-10-06T03:24:31.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.039+0000 7f32e37fe700 1 -- 172.21.15.81:0/2321683050 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f32ec017020 con 0x7f32fc0b1f50 2023-10-06T03:24:31.041 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-10-06T03:24:31.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.042+0000 7f3300b9d700 1 -- 172.21.15.81:0/2321683050 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f32e8066f30 msgr2=0x7f32e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:31.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.042+0000 7f3300b9d700 1 --2- 172.21.15.81:0/2321683050 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f32e8066f30 0x7f32e80693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f32f00099b0 tx=0x7f32f0017000 comp rx=0 tx=0).stop 2023-10-06T03:24:31.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.042+0000 7f3300b9d700 1 -- 172.21.15.81:0/2321683050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32fc0b1f50 msgr2=0x7f32fc159a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:31.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.042+0000 7f3300b9d700 1 --2- 172.21.15.81:0/2321683050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32fc0b1f50 0x7f32fc159a50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f32ec00c590 tx=0x7f32ec00c8a0 comp rx=0 tx=0).stop 2023-10-06T03:24:31.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.042+0000 7f3300b9d700 1 -- 172.21.15.81:0/2321683050 shutdown_connections 2023-10-06T03:24:31.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.042+0000 7f3300b9d700 1 --2- 172.21.15.81:0/2321683050 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f32e8066f30 0x7f32e80693e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:31.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.042+0000 7f3300b9d700 1 --2- 172.21.15.81:0/2321683050 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f32fc157ae0 0x7f32fc15f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:31.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.042+0000 7f3300b9d700 1 --2- 172.21.15.81:0/2321683050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32fc0b1f50 0x7f32fc159a50 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:31.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.042+0000 7f3300b9d700 1 --2- 172.21.15.81:0/2321683050 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f32fc0b2320 0x7f32fc158060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:31.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.042+0000 7f3300b9d700 1 -- 172.21.15.81:0/2321683050 >> 172.21.15.81:0/2321683050 conn(0x7f32fc06ed10 msgr2=0x7f32fc0b3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:31.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.042+0000 7f3300b9d700 1 -- 172.21.15.81:0/2321683050 shutdown_connections 2023-10-06T03:24:31.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.042+0000 7f3300b9d700 1 -- 172.21.15.81:0/2321683050 wait complete. 2023-10-06T03:24:31.060 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:24:31.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.241+0000 7f2805dff700 1 Processor -- start 2023-10-06T03:24:31.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.241+0000 7f2805dff700 1 -- start start 2023-10-06T03:24:31.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.243+0000 7f2805dff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2800159a60 0x7f280006af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:31.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.243+0000 7f2805dff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f280006b4d0 0x7f28000ca520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:31.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.243+0000 7f2805dff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2800159e30 0x7f28000caa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:31.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.243+0000 7f2805dff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f280006ab00 con 0x7f2800159e30 2023-10-06T03:24:31.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.243+0000 7f2805dff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2800069ef0 con 0x7f280006b4d0 2023-10-06T03:24:31.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.243+0000 7f2805dff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f280006a1d0 con 0x7f2800159a60 2023-10-06T03:24:31.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.243+0000 7f27fffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2800159e30 0x7f28000caa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:31.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.243+0000 7f27fffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2800159e30 0x7f28000caa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55598/0 (socket says 172.21.15.81:55598) 2023-10-06T03:24:31.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.243+0000 7f27fffff700 1 -- 172.21.15.81:0/820308368 learned_addr learned my addr 172.21.15.81:0/820308368 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:31.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.243+0000 7f27f7fff700 1 --2- 172.21.15.81:0/820308368 >> v2:172.21.15.83:3300/0 conn(0x7f280006b4d0 0x7f28000ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:31.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.243+0000 7f27ff7fe700 1 --2- 172.21.15.81:0/820308368 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2800159a60 0x7f280006af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:31.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.243+0000 7f27fffff700 1 -- 172.21.15.81:0/820308368 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2800159a60 msgr2=0x7f280006af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:31.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.243+0000 7f27fffff700 1 --2- 172.21.15.81:0/820308368 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2800159a60 0x7f280006af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:31.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.243+0000 7f27fffff700 1 -- 172.21.15.81:0/820308368 >> v2:172.21.15.83:3300/0 conn(0x7f280006b4d0 msgr2=0x7f28000ca520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:31.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.243+0000 7f27fffff700 1 --2- 172.21.15.81:0/820308368 >> v2:172.21.15.83:3300/0 conn(0x7f280006b4d0 0x7f28000ca520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:31.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.243+0000 7f27fffff700 1 -- 172.21.15.81:0/820308368 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f280006a4b0 con 0x7f2800159e30 2023-10-06T03:24:31.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.244+0000 7f27fffff700 1 --2- 172.21.15.81:0/820308368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2800159e30 0x7f28000caa60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2800065040 tx=0x7f27f8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66032a211b7d105 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:31.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.244+0000 7f27feffd700 1 -- 172.21.15.81:0/820308368 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f800e070 con 0x7f2800159e30 2023-10-06T03:24:31.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.244+0000 7f27feffd700 1 -- 172.21.15.81:0/820308368 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f800b970 con 0x7f2800159e30 2023-10-06T03:24:31.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.244+0000 7f27feffd700 1 -- 172.21.15.81:0/820308368 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f80092e0 con 0x7f2800159e30 2023-10-06T03:24:31.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.244+0000 7f2805dff700 1 -- 172.21.15.81:0/820308368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2800159e30 msgr2=0x7f28000caa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:31.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.244+0000 7f2805dff700 1 --2- 172.21.15.81:0/820308368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2800159e30 0x7f28000caa60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2800065040 tx=0x7f27f8009840 comp rx=0 tx=0).stop 2023-10-06T03:24:31.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.245+0000 7f2805dff700 1 -- 172.21.15.81:0/820308368 shutdown_connections 2023-10-06T03:24:31.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.245+0000 7f2805dff700 1 --2- 172.21.15.81:0/820308368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2800159e30 0x7f28000caa60 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:31.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.245+0000 7f2805dff700 1 --2- 172.21.15.81:0/820308368 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2800159a60 0x7f280006af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:31.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.245+0000 7f2805dff700 1 --2- 172.21.15.81:0/820308368 >> v2:172.21.15.83:3300/0 conn(0x7f280006b4d0 0x7f28000ca520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:31.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.245+0000 7f2805dff700 1 -- 172.21.15.81:0/820308368 >> 172.21.15.81:0/820308368 conn(0x7f28000cc090 msgr2=0x7f28000cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:31.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.245+0000 7f2805dff700 1 -- 172.21.15.81:0/820308368 shutdown_connections 2023-10-06T03:24:31.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.245+0000 7f2805dff700 1 -- 172.21.15.81:0/820308368 wait complete. 2023-10-06T03:24:31.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.246+0000 7f2805dff700 1 Processor -- start 2023-10-06T03:24:31.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.246+0000 7f2805dff700 1 -- start start 2023-10-06T03:24:31.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.247+0000 7f2805dff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f280006b4d0 0x7f280014ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:31.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.247+0000 7f2805dff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2800159a60 0x7f28000ac620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:31.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.247+0000 7f2805dff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2800159e30 0x7f280015d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:31.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.247+0000 7f2805dff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28000adb60 con 0x7f280006b4d0 2023-10-06T03:24:31.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.247+0000 7f2805dff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28000acf50 con 0x7f2800159e30 2023-10-06T03:24:31.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.247+0000 7f2805dff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28000ad230 con 0x7f2800159a60 2023-10-06T03:24:31.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.247+0000 7f27ff7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f280006b4d0 0x7f280014ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:31.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.247+0000 7f27ff7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f280006b4d0 0x7f280014ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55600/0 (socket says 172.21.15.81:55600) 2023-10-06T03:24:31.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.247+0000 7f27ff7fe700 1 -- 172.21.15.81:0/1541405152 learned_addr learned my addr 172.21.15.81:0/1541405152 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:31.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.248+0000 7f27f7fff700 1 --2- 172.21.15.81:0/1541405152 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2800159a60 0x7f28000ac620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:31.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.248+0000 7f27fffff700 1 --2- 172.21.15.81:0/1541405152 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2800159e30 0x7f280015d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:31.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.248+0000 7f27ff7fe700 1 -- 172.21.15.81:0/1541405152 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2800159a60 msgr2=0x7f28000ac620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:31.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.248+0000 7f27ff7fe700 1 --2- 172.21.15.81:0/1541405152 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2800159a60 0x7f28000ac620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:31.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.248+0000 7f27ff7fe700 1 -- 172.21.15.81:0/1541405152 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2800159e30 msgr2=0x7f280015d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:31.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.248+0000 7f27ff7fe700 1 --2- 172.21.15.81:0/1541405152 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2800159e30 0x7f280015d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:31.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.248+0000 7f27ff7fe700 1 -- 172.21.15.81:0/1541405152 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f8009ae0 con 0x7f280006b4d0 2023-10-06T03:24:31.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.248+0000 7f27ff7fe700 1 --2- 172.21.15.81:0/1541405152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f280006b4d0 0x7f280014ae20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f27f000ea20 tx=0x7f27f000a2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:31.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.248+0000 7f27f77fe700 1 -- 172.21.15.81:0/1541405152 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f000a7a0 con 0x7f280006b4d0 2023-10-06T03:24:31.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.248+0000 7f27f77fe700 1 -- 172.21.15.81:0/1541405152 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f000ee60 con 0x7f280006b4d0 2023-10-06T03:24:31.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.248+0000 7f27f77fe700 1 -- 172.21.15.81:0/1541405152 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f000cb40 con 0x7f280006b4d0 2023-10-06T03:24:31.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.248+0000 7f2805dff700 1 -- 172.21.15.81:0/1541405152 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28000ad510 con 0x7f280006b4d0 2023-10-06T03:24:31.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.249+0000 7f2805dff700 1 -- 172.21.15.81:0/1541405152 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f280014b360 con 0x7f280006b4d0 2023-10-06T03:24:31.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.249+0000 7f2805dff700 1 -- 172.21.15.81:0/1541405152 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f280004c3c0 con 0x7f280006b4d0 2023-10-06T03:24:31.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.250+0000 7f27f77fe700 1 -- 172.21.15.81:0/1541405152 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f27f00113f0 con 0x7f280006b4d0 2023-10-06T03:24:31.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.251+0000 7f27f77fe700 1 --2- 172.21.15.81:0/1541405152 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f27e0066f30 0x7f27e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:31.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.251+0000 7f27f77fe700 1 -- 172.21.15.81:0/1541405152 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f27f0015030 con 0x7f280006b4d0 2023-10-06T03:24:31.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.251+0000 7f27f7fff700 1 --2- 172.21.15.81:0/1541405152 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f27e0066f30 0x7f27e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:31.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.252+0000 7f27f7fff700 1 --2- 172.21.15.81:0/1541405152 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f27e0066f30 0x7f27e00693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f28000adfd0 tx=0x7f27e80091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:31.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.255+0000 7f27f77fe700 1 -- 172.21.15.81:0/1541405152 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f27f0051800 con 0x7f280006b4d0 2023-10-06T03:24:31.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.446+0000 7f2805dff700 1 -- 172.21.15.81:0/1541405152 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f28000ca300 con 0x7f280006b4d0 2023-10-06T03:24:31.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.446+0000 7f27f77fe700 1 -- 172.21.15.81:0/1541405152 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f27f001f0a0 con 0x7f280006b4d0 2023-10-06T03:24:31.447 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-10-06T03:24:31.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.448+0000 7f2805dff700 1 -- 172.21.15.81:0/1541405152 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f27e0066f30 msgr2=0x7f27e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:31.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.448+0000 7f2805dff700 1 --2- 172.21.15.81:0/1541405152 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f27e0066f30 0x7f27e00693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f28000adfd0 tx=0x7f27e80091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:31.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.448+0000 7f2805dff700 1 -- 172.21.15.81:0/1541405152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f280006b4d0 msgr2=0x7f280014ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:31.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.448+0000 7f2805dff700 1 --2- 172.21.15.81:0/1541405152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f280006b4d0 0x7f280014ae20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f27f000ea20 tx=0x7f27f000a2e0 comp rx=0 tx=0).stop 2023-10-06T03:24:31.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.448+0000 7f2805dff700 1 -- 172.21.15.81:0/1541405152 shutdown_connections 2023-10-06T03:24:31.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.448+0000 7f2805dff700 1 --2- 172.21.15.81:0/1541405152 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2800159e30 0x7f280015d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:31.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.448+0000 7f2805dff700 1 --2- 172.21.15.81:0/1541405152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f280006b4d0 0x7f280014ae20 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:31.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.448+0000 7f2805dff700 1 --2- 172.21.15.81:0/1541405152 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f27e0066f30 0x7f27e00693e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:31.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.448+0000 7f2805dff700 1 --2- 172.21.15.81:0/1541405152 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2800159a60 0x7f28000ac620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:31.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.448+0000 7f2805dff700 1 -- 172.21.15.81:0/1541405152 >> 172.21.15.81:0/1541405152 conn(0x7f28000cc090 msgr2=0x7f2800063500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:31.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.448+0000 7f2805dff700 1 -- 172.21.15.81:0/1541405152 shutdown_connections 2023-10-06T03:24:31.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.448+0000 7f2805dff700 1 -- 172.21.15.81:0/1541405152 wait complete. 2023-10-06T03:24:31.467 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T03:24:31.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.648+0000 7f3c8e39d700 1 Processor -- start 2023-10-06T03:24:31.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.648+0000 7f3c8e39d700 1 -- start start 2023-10-06T03:24:31.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.649+0000 7f3c8e39d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f3c881594a0 0x7f3c8806b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:31.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.649+0000 7f3c8e39d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3c8815ded0 0x7f3c880c99d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:31.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.649+0000 7f3c8e39d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c8806acb0 con 0x7f3c88159870 2023-10-06T03:24:31.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.649+0000 7f3c8e39d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c8806b680 con 0x7f3c881594a0 2023-10-06T03:24:31.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.649+0000 7f3c8e39d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8806a3c0 con 0x7f3c8815ded0 2023-10-06T03:24:31.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.650+0000 7f3c8db9c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3c88159870 0x7f3c880c7570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39508/0 (socket says 172.21.15.81:39508) 2023-10-06T03:24:31.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.650+0000 7f3c8db9c700 1 -- 172.21.15.81:0/1780354803 learned_addr learned my addr 172.21.15.81:0/1780354803 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:24:31.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.650+0000 7f3c8cb9a700 1 --2- 172.21.15.81:0/1780354803 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3c8815ded0 0x7f3c880c99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:31.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.650+0000 7f3c8d39b700 1 --2- 172.21.15.81:0/1780354803 >> v2:172.21.15.83:3300/0 conn(0x7f3c881594a0 0x7f3c8806b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:31.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.650+0000 7f3c7ffff700 1 -- 172.21.15.81:0/1780354803 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2290166423 0 0) 0x7f3c8806acb0 con 0x7f3c88159870 2023-10-06T03:24:31.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.650+0000 7f3c7ffff700 1 -- 172.21.15.81:0/1780354803 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c74003570 con 0x7f3c88159870 2023-10-06T03:24:31.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.650+0000 7f3c8cb9a700 1 -- 172.21.15.81:0/1780354803 >> v2:172.21.15.83:3300/0 conn(0x7f3c881594a0 msgr2=0x7f3c8806b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:31.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.650+0000 7f3c8cb9a700 1 --2- 172.21.15.81:0/1780354803 >> v2:172.21.15.83:3300/0 conn(0x7f3c881594a0 0x7f3c8806b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:31.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.650+0000 7f3c8cb9a700 1 -- 172.21.15.81:0/1780354803 >> v1:172.21.15.81:6789/0 conn(0x7f3c88159870 legacy=0x7f3c880c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:31.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.650+0000 7f3c8cb9a700 1 -- 172.21.15.81:0/1780354803 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c880ca340 con 0x7f3c8815ded0 2023-10-06T03:24:31.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.651+0000 7f3c8cb9a700 1 --2- 172.21.15.81:0/1780354803 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3c8815ded0 0x7f3c880c99d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3c780098e0 tx=0x7f3c780091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20c4a11f974a5684 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:31.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.651+0000 7f3c7ffff700 1 -- 172.21.15.81:0/1780354803 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c78011630 con 0x7f3c8815ded0 2023-10-06T03:24:31.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.651+0000 7f3c7ffff700 1 -- 172.21.15.81:0/1780354803 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c78011790 con 0x7f3c8815ded0 2023-10-06T03:24:31.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.651+0000 7f3c7ffff700 1 -- 172.21.15.81:0/1780354803 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c78011b30 con 0x7f3c8815ded0 2023-10-06T03:24:31.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.651+0000 7f3c8e39d700 1 -- 172.21.15.81:0/1780354803 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3c8815ded0 msgr2=0x7f3c880c99d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:31.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.651+0000 7f3c8e39d700 1 --2- 172.21.15.81:0/1780354803 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3c8815ded0 0x7f3c880c99d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3c780098e0 tx=0x7f3c780091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:31.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.651+0000 7f3c8e39d700 1 -- 172.21.15.81:0/1780354803 shutdown_connections 2023-10-06T03:24:31.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.651+0000 7f3c8e39d700 1 --2- 172.21.15.81:0/1780354803 >> v2:172.21.15.83:3300/0 conn(0x7f3c881594a0 0x7f3c8806b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:31.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.651+0000 7f3c8e39d700 1 --2- 172.21.15.81:0/1780354803 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3c8815ded0 0x7f3c880c99d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:31.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.651+0000 7f3c8e39d700 1 -- 172.21.15.81:0/1780354803 >> 172.21.15.81:0/1780354803 conn(0x7f3c880686f0 msgr2=0x7f3c88068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:31.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.651+0000 7f3c8e39d700 1 -- 172.21.15.81:0/1780354803 shutdown_connections 2023-10-06T03:24:31.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.652+0000 7f3c8e39d700 1 -- 172.21.15.81:0/1780354803 wait complete. 2023-10-06T03:24:31.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.653+0000 7f3c8e39d700 1 Processor -- start 2023-10-06T03:24:31.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.653+0000 7f3c8e39d700 1 -- start start 2023-10-06T03:24:31.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.654+0000 7f3c8e39d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3c881594a0 0x7f3c880c3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:31.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.654+0000 7f3c8e39d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c88159870 0x7f3c880cd890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:31.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.654+0000 7f3c8e39d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c8815ded0 0x7f3c88157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:31.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.654+0000 7f3c8e39d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c880c5570 con 0x7f3c8815ded0 2023-10-06T03:24:31.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.654+0000 7f3c8e39d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c880c49a0 con 0x7f3c88159870 2023-10-06T03:24:31.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.654+0000 7f3c8e39d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c880cddd0 con 0x7f3c881594a0 2023-10-06T03:24:31.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.654+0000 7f3c8db9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c8815ded0 0x7f3c88157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:31.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.654+0000 7f3c8d39b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3c881594a0 0x7f3c880c3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:31.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.654+0000 7f3c8db9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c8815ded0 0x7f3c88157030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55606/0 (socket says 172.21.15.81:55606) 2023-10-06T03:24:31.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.654+0000 7f3c8db9c700 1 -- 172.21.15.81:0/2166076515 learned_addr learned my addr 172.21.15.81:0/2166076515 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:31.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.654+0000 7f3c8cb9a700 1 --2- 172.21.15.81:0/2166076515 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c88159870 0x7f3c880cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:31.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.655+0000 7f3c8cb9a700 1 -- 172.21.15.81:0/2166076515 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3c881594a0 msgr2=0x7f3c880c3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:31.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.655+0000 7f3c8cb9a700 1 --2- 172.21.15.81:0/2166076515 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3c881594a0 0x7f3c880c3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:31.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.655+0000 7f3c8cb9a700 1 -- 172.21.15.81:0/2166076515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c8815ded0 msgr2=0x7f3c88157030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:31.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.655+0000 7f3c8cb9a700 1 --2- 172.21.15.81:0/2166076515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c8815ded0 0x7f3c88157030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:31.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.655+0000 7f3c8cb9a700 1 -- 172.21.15.81:0/2166076515 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c78009420 con 0x7f3c88159870 2023-10-06T03:24:31.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.655+0000 7f3c8db9c700 1 --2- 172.21.15.81:0/2166076515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c8815ded0 0x7f3c88157030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:24:31.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.655+0000 7f3c8cb9a700 1 --2- 172.21.15.81:0/2166076515 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c88159870 0x7f3c880cd890 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3c78016000 tx=0x7f3c78017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:31.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.655+0000 7f3c7d7fa700 1 -- 172.21.15.81:0/2166076515 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c78011900 con 0x7f3c88159870 2023-10-06T03:24:31.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.655+0000 7f3c7d7fa700 1 -- 172.21.15.81:0/2166076515 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c78011a80 con 0x7f3c88159870 2023-10-06T03:24:31.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.655+0000 7f3c8e39d700 1 -- 172.21.15.81:0/2166076515 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c880c4c40 con 0x7f3c88159870 2023-10-06T03:24:31.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.655+0000 7f3c7d7fa700 1 -- 172.21.15.81:0/2166076515 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c78025640 con 0x7f3c88159870 2023-10-06T03:24:31.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.655+0000 7f3c8e39d700 1 -- 172.21.15.81:0/2166076515 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c880c5200 con 0x7f3c88159870 2023-10-06T03:24:31.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.656+0000 7f3c8e39d700 1 -- 172.21.15.81:0/2166076515 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c880c56e0 con 0x7f3c88159870 2023-10-06T03:24:31.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.657+0000 7f3c7d7fa700 1 -- 172.21.15.81:0/2166076515 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3c780193b0 con 0x7f3c88159870 2023-10-06T03:24:31.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.658+0000 7f3c7d7fa700 1 --2- 172.21.15.81:0/2166076515 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f3c6c066f60 0x7f3c6c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:31.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.658+0000 7f3c7d7fa700 1 -- 172.21.15.81:0/2166076515 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f3c78086540 con 0x7f3c88159870 2023-10-06T03:24:31.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.658+0000 7f3c8d39b700 1 --2- 172.21.15.81:0/2166076515 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f3c6c066f60 0x7f3c6c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:31.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.659+0000 7f3c8d39b700 1 --2- 172.21.15.81:0/2166076515 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f3c6c066f60 0x7f3c6c069410 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3c84009d10 tx=0x7f3c840091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:31.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.662+0000 7f3c7d7fa700 1 -- 172.21.15.81:0/2166076515 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3c78053300 con 0x7f3c88159870 2023-10-06T03:24:31.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.853+0000 7f3c8e39d700 1 -- 172.21.15.81:0/2166076515 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3c8804c3c0 con 0x7f3c88159870 2023-10-06T03:24:31.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.854+0000 7f3c7d7fa700 1 -- 172.21.15.81:0/2166076515 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3c78056920 con 0x7f3c88159870 2023-10-06T03:24:31.855 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-10-06T03:24:31.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.856+0000 7f3c8e39d700 1 -- 172.21.15.81:0/2166076515 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f3c6c066f60 msgr2=0x7f3c6c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:31.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.856+0000 7f3c8e39d700 1 --2- 172.21.15.81:0/2166076515 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f3c6c066f60 0x7f3c6c069410 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3c84009d10 tx=0x7f3c840091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:31.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.856+0000 7f3c8e39d700 1 -- 172.21.15.81:0/2166076515 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c88159870 msgr2=0x7f3c880cd890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:31.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.856+0000 7f3c8e39d700 1 --2- 172.21.15.81:0/2166076515 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c88159870 0x7f3c880cd890 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3c78016000 tx=0x7f3c78017000 comp rx=0 tx=0).stop 2023-10-06T03:24:31.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.857+0000 7f3c8e39d700 1 -- 172.21.15.81:0/2166076515 shutdown_connections 2023-10-06T03:24:31.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.857+0000 7f3c8e39d700 1 --2- 172.21.15.81:0/2166076515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c8815ded0 0x7f3c88157030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:31.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.857+0000 7f3c8e39d700 1 --2- 172.21.15.81:0/2166076515 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f3c6c066f60 0x7f3c6c069410 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:31.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.857+0000 7f3c8e39d700 1 --2- 172.21.15.81:0/2166076515 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3c881594a0 0x7f3c880c3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:31.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.857+0000 7f3c8e39d700 1 --2- 172.21.15.81:0/2166076515 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c88159870 0x7f3c880cd890 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:31.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.857+0000 7f3c8e39d700 1 -- 172.21.15.81:0/2166076515 >> 172.21.15.81:0/2166076515 conn(0x7f3c880686f0 msgr2=0x7f3c880c7550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:31.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.857+0000 7f3c8e39d700 1 -- 172.21.15.81:0/2166076515 shutdown_connections 2023-10-06T03:24:31.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:31.857+0000 7f3c8e39d700 1 -- 172.21.15.81:0/2166076515 wait complete. 2023-10-06T03:24:31.882 INFO:tasks.cephfs_test_runner:Starting test: test_recover_fs_after_fsmap_removal (tasks.cephfs.test_recovery_fs.TestFSRecovery) 2023-10-06T03:24:31.883 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_recovery_fs.TestFSRecovery.test_recover_fs_after_fsmap_removal' 2023-10-06T03:24:32.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.063+0000 7f4755bff700 1 Processor -- start 2023-10-06T03:24:32.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.063+0000 7f4755bff700 1 -- start start 2023-10-06T03:24:32.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.064+0000 7f4755bff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f475006b530 0x7f47500ca090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:32.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.064+0000 7f4755bff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47500cb380 con 0x7f4750142fe0 2023-10-06T03:24:32.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.064+0000 7f4755bff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47500ca770 con 0x7f47500c9b00 2023-10-06T03:24:32.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.064+0000 7f4755bff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47500cbf20 con 0x7f475006b530 2023-10-06T03:24:32.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.064+0000 7f474f7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4750142fe0 0x7f47500cb810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39514/0 (socket says 172.21.15.81:39514) 2023-10-06T03:24:32.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.064+0000 7f474f7fe700 1 -- 172.21.15.81:0/2600525169 learned_addr learned my addr 172.21.15.81:0/2600525169 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:24:32.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.064+0000 7f474ffff700 1 --2- 172.21.15.81:0/2600525169 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f475006b530 0x7f47500ca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:32.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.065+0000 7f474e7fc700 1 -- 172.21.15.81:0/2600525169 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4155616505 0 0) 0x7f47500cb380 con 0x7f4750142fe0 2023-10-06T03:24:32.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.065+0000 7f474e7fc700 1 -- 172.21.15.81:0/2600525169 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4738003570 con 0x7f4750142fe0 2023-10-06T03:24:32.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.065+0000 7f474e7fc700 1 -- 172.21.15.81:0/2600525169 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2619705721 0 0) 0x7f47500ca770 con 0x7f47500c9b00 2023-10-06T03:24:32.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.065+0000 7f474e7fc700 1 -- 172.21.15.81:0/2600525169 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47500cb380 con 0x7f47500c9b00 2023-10-06T03:24:32.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.065+0000 7f474ffff700 1 -- 172.21.15.81:0/2600525169 >> v1:172.21.15.83:6789/0 conn(0x7f47500c9b00 legacy=0x7f475006ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:32.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.065+0000 7f474ffff700 1 -- 172.21.15.81:0/2600525169 >> v1:172.21.15.81:6789/0 conn(0x7f4750142fe0 legacy=0x7f47500cb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:32.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.065+0000 7f474ffff700 1 -- 172.21.15.81:0/2600525169 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47500caa50 con 0x7f475006b530 2023-10-06T03:24:32.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.065+0000 7f474ffff700 1 --2- 172.21.15.81:0/2600525169 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f475006b530 0x7f47500ca090 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4748009e90 tx=0x7f4748009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8a5926499c88924 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:32.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.066+0000 7f474e7fc700 1 -- 172.21.15.81:0/2600525169 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474800e070 con 0x7f475006b530 2023-10-06T03:24:32.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.066+0000 7f474e7fc700 1 -- 172.21.15.81:0/2600525169 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f474800bb80 con 0x7f475006b530 2023-10-06T03:24:32.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.066+0000 7f474e7fc700 1 -- 172.21.15.81:0/2600525169 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4748012430 con 0x7f475006b530 2023-10-06T03:24:32.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.066+0000 7f4755bff700 1 -- 172.21.15.81:0/2600525169 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f475006b530 msgr2=0x7f47500ca090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:32.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.066+0000 7f4755bff700 1 --2- 172.21.15.81:0/2600525169 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f475006b530 0x7f47500ca090 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4748009e90 tx=0x7f4748009780 comp rx=0 tx=0).stop 2023-10-06T03:24:32.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.066+0000 7f4755bff700 1 -- 172.21.15.81:0/2600525169 shutdown_connections 2023-10-06T03:24:32.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.066+0000 7f4755bff700 1 --2- 172.21.15.81:0/2600525169 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f475006b530 0x7f47500ca090 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:32.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.066+0000 7f4755bff700 1 -- 172.21.15.81:0/2600525169 >> 172.21.15.81:0/2600525169 conn(0x7f47500ccfd0 msgr2=0x7f47500c8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:32.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.066+0000 7f4755bff700 1 -- 172.21.15.81:0/2600525169 shutdown_connections 2023-10-06T03:24:32.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.066+0000 7f4755bff700 1 -- 172.21.15.81:0/2600525169 wait complete. 2023-10-06T03:24:32.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.068+0000 7f4755bff700 1 Processor -- start 2023-10-06T03:24:32.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.068+0000 7f4755bff700 1 -- start start 2023-10-06T03:24:32.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.069+0000 7f4755bff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f475006b530 0x7f475013c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:32.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.069+0000 7f4755bff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47500c9b00 0x7f47500c5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:32.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.069+0000 7f4755bff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4750142fe0 0x7f475015cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:32.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.069+0000 7f4755bff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4750159fc0 con 0x7f47500c9b00 2023-10-06T03:24:32.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.069+0000 7f4755bff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47500aff10 con 0x7f4750142fe0 2023-10-06T03:24:32.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.069+0000 7f4755bff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f475013cd80 con 0x7f475006b530 2023-10-06T03:24:32.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.069+0000 7f474effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47500c9b00 0x7f47500c5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:32.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.069+0000 7f474effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47500c9b00 0x7f47500c5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55618/0 (socket says 172.21.15.81:55618) 2023-10-06T03:24:32.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.069+0000 7f474effd700 1 -- 172.21.15.81:0/3825252732 learned_addr learned my addr 172.21.15.81:0/3825252732 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:32.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.069+0000 7f474effd700 1 -- 172.21.15.81:0/3825252732 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f475006b530 msgr2=0x7f475013c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:32.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.069+0000 7f474effd700 1 --2- 172.21.15.81:0/3825252732 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f475006b530 0x7f475013c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:32.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.069+0000 7f474effd700 1 -- 172.21.15.81:0/3825252732 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4750142fe0 msgr2=0x7f475015cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:32.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.069+0000 7f474effd700 1 --2- 172.21.15.81:0/3825252732 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4750142fe0 0x7f475015cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:32.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.069+0000 7f474effd700 1 -- 172.21.15.81:0/3825252732 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4748009a20 con 0x7f47500c9b00 2023-10-06T03:24:32.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.070+0000 7f474effd700 1 --2- 172.21.15.81:0/3825252732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47500c9b00 0x7f47500c5990 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f474400c790 tx=0x7f4744007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:32.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.070+0000 7f47377fe700 1 -- 172.21.15.81:0/3825252732 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4744010510 con 0x7f47500c9b00 2023-10-06T03:24:32.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.070+0000 7f47377fe700 1 -- 172.21.15.81:0/3825252732 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4744010670 con 0x7f47500c9b00 2023-10-06T03:24:32.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.070+0000 7f47377fe700 1 -- 172.21.15.81:0/3825252732 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4744010a10 con 0x7f47500c9b00 2023-10-06T03:24:32.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.070+0000 7f4755bff700 1 -- 172.21.15.81:0/3825252732 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47500af300 con 0x7f47500c9b00 2023-10-06T03:24:32.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.070+0000 7f4755bff700 1 -- 172.21.15.81:0/3825252732 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47500af940 con 0x7f47500c9b00 2023-10-06T03:24:32.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.071+0000 7f4755bff700 1 -- 172.21.15.81:0/3825252732 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47500afcc0 con 0x7f47500c9b00 2023-10-06T03:24:32.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.072+0000 7f47377fe700 1 -- 172.21.15.81:0/3825252732 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f474401b400 con 0x7f47500c9b00 2023-10-06T03:24:32.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.072+0000 7f47377fe700 1 --2- 172.21.15.81:0/3825252732 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f473c066f30 0x7f473c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:32.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.073+0000 7f47377fe700 1 -- 172.21.15.81:0/3825252732 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f47440848b0 con 0x7f47500c9b00 2023-10-06T03:24:32.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.073+0000 7f474f7fe700 1 --2- 172.21.15.81:0/3825252732 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f473c066f30 0x7f473c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:32.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.073+0000 7f474f7fe700 1 --2- 172.21.15.81:0/3825252732 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f473c066f30 0x7f473c0693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f47400058d0 tx=0x7f47400079d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:32.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.076+0000 7f47377fe700 1 -- 172.21.15.81:0/3825252732 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f47440515f0 con 0x7f47500c9b00 2023-10-06T03:24:32.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.339+0000 7f4755bff700 1 -- 172.21.15.81:0/3825252732 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_recovery_fs.TestFSRecovery.test_recover_fs_after_fsmap_removal"]} v 0) v1 -- 0x7f475004c3c0 con 0x7f47500c9b00 2023-10-06T03:24:32.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.800+0000 7f47377fe700 1 -- 172.21.15.81:0/3825252732 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_recovery_fs.TestFSRecovery.test_recover_fs_after_fsmap_removal"]}]=0 v68) v1 ==== 162+0+0 (secure 0 0 0) 0x7f4744054c10 con 0x7f47500c9b00 2023-10-06T03:24:32.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.803+0000 7f4755bff700 1 -- 172.21.15.81:0/3825252732 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f473c066f30 msgr2=0x7f473c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:32.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.803+0000 7f4755bff700 1 --2- 172.21.15.81:0/3825252732 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f473c066f30 0x7f473c0693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f47400058d0 tx=0x7f47400079d0 comp rx=0 tx=0).stop 2023-10-06T03:24:32.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.803+0000 7f4755bff700 1 -- 172.21.15.81:0/3825252732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47500c9b00 msgr2=0x7f47500c5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:32.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.803+0000 7f4755bff700 1 --2- 172.21.15.81:0/3825252732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47500c9b00 0x7f47500c5990 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f474400c790 tx=0x7f4744007e10 comp rx=0 tx=0).stop 2023-10-06T03:24:32.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.803+0000 7f4755bff700 1 -- 172.21.15.81:0/3825252732 shutdown_connections 2023-10-06T03:24:32.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.803+0000 7f4755bff700 1 --2- 172.21.15.81:0/3825252732 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4750142fe0 0x7f475015cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:32.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.803+0000 7f4755bff700 1 --2- 172.21.15.81:0/3825252732 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f473c066f30 0x7f473c0693e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:32.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.803+0000 7f4755bff700 1 --2- 172.21.15.81:0/3825252732 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f475006b530 0x7f475013c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:32.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.803+0000 7f4755bff700 1 --2- 172.21.15.81:0/3825252732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47500c9b00 0x7f47500c5990 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:32.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.803+0000 7f4755bff700 1 -- 172.21.15.81:0/3825252732 >> 172.21.15.81:0/3825252732 conn(0x7f47500ccfd0 msgr2=0x7f4750063500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:32.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.803+0000 7f4755bff700 1 -- 172.21.15.81:0/3825252732 shutdown_connections 2023-10-06T03:24:32.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:32.803+0000 7f4755bff700 1 -- 172.21.15.81:0/3825252732 wait complete. 2023-10-06T03:24:32.822 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T03:24:33.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.008+0000 7fb2c1dff700 1 Processor -- start 2023-10-06T03:24:33.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.009+0000 7fb2c1dff700 1 -- start start 2023-10-06T03:24:33.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.010+0000 7fb2c1dff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb2bc159e30 0x7fb2bc0ca520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:33.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.010+0000 7fb2c1dff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb2bc0caa60 0x7fb2bc155650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:33.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.010+0000 7fb2c1dff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2bc06ab00 con 0x7fb2bc159a60 2023-10-06T03:24:33.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.010+0000 7fb2c1dff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2bc069ef0 con 0x7fb2bc159e30 2023-10-06T03:24:33.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.010+0000 7fb2c1dff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2bc06a1d0 con 0x7fb2bc0caa60 2023-10-06T03:24:33.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.010+0000 7fb2baffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb2bc159e30 0x7fb2bc0ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:33.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.010+0000 7fb2baffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb2bc159e30 0x7fb2bc0ca520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55634/0 (socket says 172.21.15.81:55634) 2023-10-06T03:24:33.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.010+0000 7fb2baffd700 1 -- 172.21.15.81:0/3204547764 learned_addr learned my addr 172.21.15.81:0/3204547764 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:33.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.010+0000 7fb2bbfff700 1 --2- 172.21.15.81:0/3204547764 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb2bc0caa60 0x7fb2bc155650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:33.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.010+0000 7fb2baffd700 1 -- 172.21.15.81:0/3204547764 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb2bc0caa60 msgr2=0x7fb2bc155650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:33.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.011+0000 7fb2baffd700 1 --2- 172.21.15.81:0/3204547764 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb2bc0caa60 0x7fb2bc155650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:33.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.011+0000 7fb2baffd700 1 -- 172.21.15.81:0/3204547764 >> v1:172.21.15.83:6789/0 conn(0x7fb2bc159a60 legacy=0x7fb2bc06af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:33.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.011+0000 7fb2baffd700 1 -- 172.21.15.81:0/3204547764 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2bc06a4b0 con 0x7fb2bc159e30 2023-10-06T03:24:33.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.011+0000 7fb2bbfff700 1 --2- 172.21.15.81:0/3204547764 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb2bc0caa60 0x7fb2bc155650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:33.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.011+0000 7fb2baffd700 1 --2- 172.21.15.81:0/3204547764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2bc159e30 0x7fb2bc0ca520 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb2b000ab50 tx=0x7fb2b000a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44b5af70d54c9518 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:33.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.011+0000 7fb2ba7fc700 1 -- 172.21.15.81:0/3204547764 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b000ca20 con 0x7fb2bc159e30 2023-10-06T03:24:33.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.011+0000 7fb2ba7fc700 1 -- 172.21.15.81:0/3204547764 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2b000cb80 con 0x7fb2bc159e30 2023-10-06T03:24:33.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.011+0000 7fb2ba7fc700 1 -- 172.21.15.81:0/3204547764 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b00183f0 con 0x7fb2bc159e30 2023-10-06T03:24:33.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.012+0000 7fb2c1dff700 1 -- 172.21.15.81:0/3204547764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2bc159e30 msgr2=0x7fb2bc0ca520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:33.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.012+0000 7fb2c1dff700 1 --2- 172.21.15.81:0/3204547764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2bc159e30 0x7fb2bc0ca520 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb2b000ab50 tx=0x7fb2b000a3f0 comp rx=0 tx=0).stop 2023-10-06T03:24:33.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.012+0000 7fb2c1dff700 1 -- 172.21.15.81:0/3204547764 shutdown_connections 2023-10-06T03:24:33.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.012+0000 7fb2c1dff700 1 --2- 172.21.15.81:0/3204547764 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb2bc0caa60 0x7fb2bc155650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:33.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.012+0000 7fb2c1dff700 1 --2- 172.21.15.81:0/3204547764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2bc159e30 0x7fb2bc0ca520 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:33.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.012+0000 7fb2c1dff700 1 -- 172.21.15.81:0/3204547764 >> 172.21.15.81:0/3204547764 conn(0x7fb2bc0cc090 msgr2=0x7fb2bc0cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:33.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.012+0000 7fb2c1dff700 1 -- 172.21.15.81:0/3204547764 shutdown_connections 2023-10-06T03:24:33.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.012+0000 7fb2c1dff700 1 -- 172.21.15.81:0/3204547764 wait complete. 2023-10-06T03:24:33.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.013+0000 7fb2c1dff700 1 Processor -- start 2023-10-06T03:24:33.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.013+0000 7fb2c1dff700 1 -- start start 2023-10-06T03:24:33.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.014+0000 7fb2c1dff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2bc0caa60 0x7fb2bc1503d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:33.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.014+0000 7fb2c1dff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2bc159a60 0x7fb2bc0ae0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:33.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.014+0000 7fb2c1dff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb2bc159e30 0x7fb2bc0ac670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:33.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.014+0000 7fb2c1dff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2bc150910 con 0x7fb2bc0caa60 2023-10-06T03:24:33.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.014+0000 7fb2c1dff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2bc0adc60 con 0x7fb2bc159a60 2023-10-06T03:24:33.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.014+0000 7fb2c1dff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2bc0ae630 con 0x7fb2bc159e30 2023-10-06T03:24:33.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.014+0000 7fb2bb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2bc0caa60 0x7fb2bc1503d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:33.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.014+0000 7fb2bb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2bc0caa60 0x7fb2bc1503d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55638/0 (socket says 172.21.15.81:55638) 2023-10-06T03:24:33.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.014+0000 7fb2bb7fe700 1 -- 172.21.15.81:0/4129359161 learned_addr learned my addr 172.21.15.81:0/4129359161 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:33.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.015+0000 7fb2bbfff700 1 --2- 172.21.15.81:0/4129359161 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb2bc159e30 0x7fb2bc0ac670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:33.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.015+0000 7fb2baffd700 1 --2- 172.21.15.81:0/4129359161 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2bc159a60 0x7fb2bc0ae0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:33.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.015+0000 7fb2bb7fe700 1 -- 172.21.15.81:0/4129359161 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb2bc159e30 msgr2=0x7fb2bc0ac670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:33.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.015+0000 7fb2bb7fe700 1 --2- 172.21.15.81:0/4129359161 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb2bc159e30 0x7fb2bc0ac670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:33.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.015+0000 7fb2bb7fe700 1 -- 172.21.15.81:0/4129359161 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2bc159a60 msgr2=0x7fb2bc0ae0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:33.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.015+0000 7fb2bb7fe700 1 --2- 172.21.15.81:0/4129359161 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2bc159a60 0x7fb2bc0ae0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:33.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.015+0000 7fb2bb7fe700 1 -- 172.21.15.81:0/4129359161 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b000a690 con 0x7fb2bc0caa60 2023-10-06T03:24:33.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.015+0000 7fb2bbfff700 1 --2- 172.21.15.81:0/4129359161 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb2bc159e30 0x7fb2bc0ac670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:33.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.015+0000 7fb2baffd700 1 --2- 172.21.15.81:0/4129359161 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2bc159a60 0x7fb2bc0ae0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:33.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.015+0000 7fb2bb7fe700 1 --2- 172.21.15.81:0/4129359161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2bc0caa60 0x7fb2bc1503d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac00c5b0 tx=0x7fb2ac0020e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:33.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.015+0000 7fb2a37fe700 1 -- 172.21.15.81:0/4129359161 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac011590 con 0x7fb2bc0caa60 2023-10-06T03:24:33.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.015+0000 7fb2a37fe700 1 -- 172.21.15.81:0/4129359161 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2ac0116f0 con 0x7fb2bc0caa60 2023-10-06T03:24:33.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.015+0000 7fb2a37fe700 1 -- 172.21.15.81:0/4129359161 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac011a90 con 0x7fb2bc0caa60 2023-10-06T03:24:33.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.015+0000 7fb2c1dff700 1 -- 172.21.15.81:0/4129359161 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2bc0ad050 con 0x7fb2bc0caa60 2023-10-06T03:24:33.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.015+0000 7fb2c1dff700 1 -- 172.21.15.81:0/4129359161 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2bc0ad610 con 0x7fb2bc0caa60 2023-10-06T03:24:33.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.016+0000 7fb2c1dff700 1 -- 172.21.15.81:0/4129359161 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2bc04c3c0 con 0x7fb2bc0caa60 2023-10-06T03:24:33.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.017+0000 7fb2a37fe700 1 -- 172.21.15.81:0/4129359161 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb2ac012420 con 0x7fb2bc0caa60 2023-10-06T03:24:33.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.018+0000 7fb2a37fe700 1 --2- 172.21.15.81:0/4129359161 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb2a8066f30 0x7fb2a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:33.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.018+0000 7fb2a37fe700 1 -- 172.21.15.81:0/4129359161 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fb2ac084420 con 0x7fb2bc0caa60 2023-10-06T03:24:33.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.018+0000 7fb2baffd700 1 --2- 172.21.15.81:0/4129359161 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb2a8066f30 0x7fb2a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:33.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.019+0000 7fb2baffd700 1 --2- 172.21.15.81:0/4129359161 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb2a8066f30 0x7fb2a80693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb2b000ab50 tx=0x7fb2b0019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:33.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.022+0000 7fb2a37fe700 1 -- 172.21.15.81:0/4129359161 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb2ac051200 con 0x7fb2bc0caa60 2023-10-06T03:24:33.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.213+0000 7fb2c1dff700 1 -- 172.21.15.81:0/4129359161 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fb2bc0af060 con 0x7fb2bc0caa60 2023-10-06T03:24:33.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.218+0000 7fb2a37fe700 1 -- 172.21.15.81:0/4129359161 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb2ac054820 con 0x7fb2bc0caa60 2023-10-06T03:24:33.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.220+0000 7fb2c1dff700 1 -- 172.21.15.81:0/4129359161 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb2a8066f30 msgr2=0x7fb2a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:33.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.220+0000 7fb2c1dff700 1 --2- 172.21.15.81:0/4129359161 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb2a8066f30 0x7fb2a80693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb2b000ab50 tx=0x7fb2b0019000 comp rx=0 tx=0).stop 2023-10-06T03:24:33.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.220+0000 7fb2c1dff700 1 -- 172.21.15.81:0/4129359161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2bc0caa60 msgr2=0x7fb2bc1503d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:33.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.220+0000 7fb2c1dff700 1 --2- 172.21.15.81:0/4129359161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2bc0caa60 0x7fb2bc1503d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac00c5b0 tx=0x7fb2ac0020e0 comp rx=0 tx=0).stop 2023-10-06T03:24:33.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.220+0000 7fb2c1dff700 1 -- 172.21.15.81:0/4129359161 shutdown_connections 2023-10-06T03:24:33.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.220+0000 7fb2c1dff700 1 --2- 172.21.15.81:0/4129359161 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb2a8066f30 0x7fb2a80693e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:33.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.220+0000 7fb2c1dff700 1 --2- 172.21.15.81:0/4129359161 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb2bc159e30 0x7fb2bc0ac670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:33.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.220+0000 7fb2c1dff700 1 --2- 172.21.15.81:0/4129359161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2bc0caa60 0x7fb2bc1503d0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:33.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.220+0000 7fb2c1dff700 1 --2- 172.21.15.81:0/4129359161 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2bc159a60 0x7fb2bc0ae0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:33.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.220+0000 7fb2c1dff700 1 -- 172.21.15.81:0/4129359161 >> 172.21.15.81:0/4129359161 conn(0x7fb2bc0cc090 msgr2=0x7fb2bc0c67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:33.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.221+0000 7fb2c1dff700 1 -- 172.21.15.81:0/4129359161 shutdown_connections 2023-10-06T03:24:33.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:33.221+0000 7fb2c1dff700 1 -- 172.21.15.81:0/4129359161 wait complete. 2023-10-06T03:24:33.238 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T03:24:33.239 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:24:33.317 DEBUG:teuthology.orchestra.run.smithi083:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:24:33.406 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T03:24:33.406 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T03:24:33.406 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:24:33.406 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-10-06T03:24:33.530 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-10-06T03:24:33.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:33.531 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T03:24:33.568 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-06T03:24:33.568 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:24:33.568 DEBUG:teuthology.orchestra.run.smithi083:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-10-06T03:24:33.668 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T03:24:33.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:33.669 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T03:24:33.732 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-10-06T03:24:33.732 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:24:33.732 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-10-06T03:24:33.811 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-10-06T03:24:33.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:33.811 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T03:24:33.847 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-10-06T03:24:33.848 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:24:33.848 DEBUG:teuthology.orchestra.run.smithi083:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-10-06T03:24:33.927 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T03:24:33.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:33.927 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T03:24:33.963 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T03:24:33.963 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:24:34.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.141+0000 7fddd09fe700 1 Processor -- start 2023-10-06T03:24:34.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.142+0000 7fddd09fe700 1 -- start start 2023-10-06T03:24:34.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.143+0000 7fddd09fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fddcc142cf0 0x7fddcc0c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:34.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.143+0000 7fddd09fe700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddcc0cbd70 con 0x7fddcc0c9920 2023-10-06T03:24:34.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.143+0000 7fddd09fe700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddcc06b730 con 0x7fddcc1430c0 2023-10-06T03:24:34.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.143+0000 7fddd09fe700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc0ca5c0 con 0x7fddcc142cf0 2023-10-06T03:24:34.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.143+0000 7fddcad9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fddcc142cf0 0x7fddcc0c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:34.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.143+0000 7fddcb59e700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fddcc0c9920 0x7fddcc0c69a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39520/0 (socket says 172.21.15.81:39520) 2023-10-06T03:24:34.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.143+0000 7fddcb59e700 1 -- 172.21.15.81:0/3073075458 learned_addr learned my addr 172.21.15.81:0/3073075458 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:24:34.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.143+0000 7fddca59c700 1 --1- 172.21.15.81:0/3073075458 >> v1:172.21.15.83:6789/0 conn(0x7fddcc1430c0 0x7fddcc0cb660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:33346/0 (socket says 172.21.15.81:33346) 2023-10-06T03:24:34.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.144+0000 7fddcad9d700 1 -- 172.21.15.81:0/3073075458 >> v1:172.21.15.83:6789/0 conn(0x7fddcc1430c0 legacy=0x7fddcc0cb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:34.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.144+0000 7fddcad9d700 1 -- 172.21.15.81:0/3073075458 >> v1:172.21.15.81:6789/0 conn(0x7fddcc0c9920 legacy=0x7fddcc0c69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:34.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.144+0000 7fddc9d9b700 1 -- 172.21.15.81:0/3073075458 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 745989726 0 0) 0x7fddcc0cbd70 con 0x7fddcc0c9920 2023-10-06T03:24:34.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.144+0000 7fddcad9d700 1 -- 172.21.15.81:0/3073075458 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddcc0ca8a0 con 0x7fddcc142cf0 2023-10-06T03:24:34.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.144+0000 7fddcad9d700 1 --2- 172.21.15.81:0/3073075458 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fddcc142cf0 0x7fddcc0c9f30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fddbc009910 tx=0x7fddbc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba36194e029906be server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:34.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.144+0000 7fddc9d9b700 1 -- 172.21.15.81:0/3073075458 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddbc00b860 con 0x7fddcc142cf0 2023-10-06T03:24:34.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.144+0000 7fddc9d9b700 1 -- 172.21.15.81:0/3073075458 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddbc00b9c0 con 0x7fddcc142cf0 2023-10-06T03:24:34.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.144+0000 7fddc9d9b700 1 -- 172.21.15.81:0/3073075458 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddbc00bd60 con 0x7fddcc142cf0 2023-10-06T03:24:34.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.145+0000 7fddd09fe700 1 -- 172.21.15.81:0/3073075458 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fddcc142cf0 msgr2=0x7fddcc0c9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:34.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.145+0000 7fddd09fe700 1 --2- 172.21.15.81:0/3073075458 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fddcc142cf0 0x7fddcc0c9f30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fddbc009910 tx=0x7fddbc0091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:34.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.145+0000 7fddd09fe700 1 -- 172.21.15.81:0/3073075458 shutdown_connections 2023-10-06T03:24:34.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.145+0000 7fddd09fe700 1 --2- 172.21.15.81:0/3073075458 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fddcc142cf0 0x7fddcc0c9f30 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:34.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.145+0000 7fddd09fe700 1 -- 172.21.15.81:0/3073075458 >> 172.21.15.81:0/3073075458 conn(0x7fddcc0ccdd0 msgr2=0x7fddcc0c8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:34.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.145+0000 7fddd09fe700 1 -- 172.21.15.81:0/3073075458 shutdown_connections 2023-10-06T03:24:34.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.145+0000 7fddd09fe700 1 -- 172.21.15.81:0/3073075458 wait complete. 2023-10-06T03:24:34.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.146+0000 7fddd09fe700 1 Processor -- start 2023-10-06T03:24:34.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.147+0000 7fddd09fe700 1 -- start start 2023-10-06T03:24:34.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.147+0000 7fddd09fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fddcc0c9920 0x7fddcc158e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:34.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.147+0000 7fddd09fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddcc142cf0 0x7fddcc0c64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:34.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.148+0000 7fddd09fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fddcc1430c0 0x7fddcc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:34.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.148+0000 7fddd09fe700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc15b290 con 0x7fddcc142cf0 2023-10-06T03:24:34.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.148+0000 7fddd09fe700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc15ac60 con 0x7fddcc0c9920 2023-10-06T03:24:34.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.148+0000 7fddd09fe700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc0c6e30 con 0x7fddcc1430c0 2023-10-06T03:24:34.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.148+0000 7fddca59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddcc142cf0 0x7fddcc0c64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:34.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.148+0000 7fddca59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddcc142cf0 0x7fddcc0c64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55654/0 (socket says 172.21.15.81:55654) 2023-10-06T03:24:34.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.148+0000 7fddca59c700 1 -- 172.21.15.81:0/81834960 learned_addr learned my addr 172.21.15.81:0/81834960 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:34.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.148+0000 7fddcad9d700 1 --2- 172.21.15.81:0/81834960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fddcc0c9920 0x7fddcc158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:34.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.148+0000 7fddcb59e700 1 --2- 172.21.15.81:0/81834960 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fddcc1430c0 0x7fddcc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:34.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.148+0000 7fddca59c700 1 -- 172.21.15.81:0/81834960 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fddcc1430c0 msgr2=0x7fddcc06eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:34.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.148+0000 7fddca59c700 1 --2- 172.21.15.81:0/81834960 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fddcc1430c0 0x7fddcc06eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:34.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.148+0000 7fddca59c700 1 -- 172.21.15.81:0/81834960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fddcc0c9920 msgr2=0x7fddcc158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:34.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.148+0000 7fddca59c700 1 --2- 172.21.15.81:0/81834960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fddcc0c9920 0x7fddcc158e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:34.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.148+0000 7fddca59c700 1 -- 172.21.15.81:0/81834960 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddbc009420 con 0x7fddcc142cf0 2023-10-06T03:24:34.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.148+0000 7fddca59c700 1 --2- 172.21.15.81:0/81834960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddcc142cf0 0x7fddcc0c64e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fddc0001eb0 tx=0x7fddc0007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:34.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.149+0000 7fddb2ffd700 1 -- 172.21.15.81:0/81834960 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc0005a70 con 0x7fddcc142cf0 2023-10-06T03:24:34.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.149+0000 7fddb2ffd700 1 -- 172.21.15.81:0/81834960 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc0005bd0 con 0x7fddcc142cf0 2023-10-06T03:24:34.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.149+0000 7fddd09fe700 1 -- 172.21.15.81:0/81834960 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddcc0c7110 con 0x7fddcc142cf0 2023-10-06T03:24:34.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.149+0000 7fddb2ffd700 1 -- 172.21.15.81:0/81834960 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc00070d0 con 0x7fddcc142cf0 2023-10-06T03:24:34.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.149+0000 7fddd09fe700 1 -- 172.21.15.81:0/81834960 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddcc159360 con 0x7fddcc142cf0 2023-10-06T03:24:34.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.150+0000 7fddd09fe700 1 -- 172.21.15.81:0/81834960 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddcc15b440 con 0x7fddcc142cf0 2023-10-06T03:24:34.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.151+0000 7fddb2ffd700 1 -- 172.21.15.81:0/81834960 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fddc0007480 con 0x7fddcc142cf0 2023-10-06T03:24:34.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.151+0000 7fddb2ffd700 1 --2- 172.21.15.81:0/81834960 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fddb8066f30 0x7fddb80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:34.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.152+0000 7fddb2ffd700 1 -- 172.21.15.81:0/81834960 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fddc0083ea0 con 0x7fddcc142cf0 2023-10-06T03:24:34.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.152+0000 7fddcad9d700 1 --2- 172.21.15.81:0/81834960 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fddb8066f30 0x7fddb80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:34.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.152+0000 7fddcad9d700 1 --2- 172.21.15.81:0/81834960 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fddb8066f30 0x7fddb80693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fddbc0093f0 tx=0x7fddbc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:34.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.156+0000 7fddb2ffd700 1 -- 172.21.15.81:0/81834960 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fddcc15b440 con 0x7fddcc142cf0 2023-10-06T03:24:34.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.387+0000 7fddd09fe700 1 -- 172.21.15.81:0/81834960 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fddcc15b3d0 con 0x7fddcc142cf0 2023-10-06T03:24:34.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.388+0000 7fddb2ffd700 1 -- 172.21.15.81:0/81834960 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4590 (secure 0 0 0) 0x7fddc0017070 con 0x7fddcc142cf0 2023-10-06T03:24:34.389 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:24:34.389 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1255569320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1255569320},{"type":"v1","addr":"172.21.15.83:6835","nonce":1255569320}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1673166762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1673166762},{"type":"v1","addr":"172.21.15.81:6835","nonce":1673166762}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3689326153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3689326153},{"type":"v1","addr":"172.21.15.81:6837","nonce":3689326153}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:23:40.376852+0000","modified":"2023-10-06T03:23:56.657619+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6833/745669616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":745669616},{"type":"v1","addr":"172.21.15.83:6833","nonce":745669616}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T03:24:34.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.390+0000 7fddd09fe700 1 -- 172.21.15.81:0/81834960 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fddb8066f30 msgr2=0x7fddb80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:34.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.390+0000 7fddd09fe700 1 --2- 172.21.15.81:0/81834960 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fddb8066f30 0x7fddb80693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fddbc0093f0 tx=0x7fddbc017000 comp rx=0 tx=0).stop 2023-10-06T03:24:34.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.390+0000 7fddd09fe700 1 -- 172.21.15.81:0/81834960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddcc142cf0 msgr2=0x7fddcc0c64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:34.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.390+0000 7fddd09fe700 1 --2- 172.21.15.81:0/81834960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddcc142cf0 0x7fddcc0c64e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fddc0001eb0 tx=0x7fddc0007f40 comp rx=0 tx=0).stop 2023-10-06T03:24:34.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.390+0000 7fddd09fe700 1 -- 172.21.15.81:0/81834960 shutdown_connections 2023-10-06T03:24:34.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.390+0000 7fddd09fe700 1 --2- 172.21.15.81:0/81834960 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fddb8066f30 0x7fddb80693e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:34.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.390+0000 7fddd09fe700 1 --2- 172.21.15.81:0/81834960 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fddcc1430c0 0x7fddcc06eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:34.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.390+0000 7fddd09fe700 1 --2- 172.21.15.81:0/81834960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fddcc0c9920 0x7fddcc158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:34.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.390+0000 7fddd09fe700 1 --2- 172.21.15.81:0/81834960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddcc142cf0 0x7fddcc0c64e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:34.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.390+0000 7fddd09fe700 1 -- 172.21.15.81:0/81834960 >> 172.21.15.81:0/81834960 conn(0x7fddcc0ccdd0 msgr2=0x7fddcc0c2600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:34.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.390+0000 7fddd09fe700 1 -- 172.21.15.81:0/81834960 shutdown_connections 2023-10-06T03:24:34.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.390+0000 7fddd09fe700 1 -- 172.21.15.81:0/81834960 wait complete. 2023-10-06T03:24:34.393 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2023-10-06T03:24:34.408 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:24:34.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.587+0000 7f70279ff700 1 Processor -- start 2023-10-06T03:24:34.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.587+0000 7f70279ff700 1 -- start start 2023-10-06T03:24:34.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.588+0000 7f70279ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7020068bc0 0x7f70200ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:34.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.588+0000 7f70279ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f70200cfbc0 0x7f70200cd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:34.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.588+0000 7f70279ff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70200ce720 con 0x7f70201595b0 2023-10-06T03:24:34.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.588+0000 7f70279ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70200cd840 con 0x7f70200cfbc0 2023-10-06T03:24:34.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.588+0000 7f70279ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70200af730 con 0x7f7020068bc0 2023-10-06T03:24:34.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.589+0000 7f7025f9c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f70200cfbc0 0x7f70200cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:34.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.589+0000 7f702579b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f70201595b0 0x7f70200af020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39524/0 (socket says 172.21.15.81:39524) 2023-10-06T03:24:34.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.589+0000 7f702579b700 1 -- 172.21.15.81:0/2062530448 learned_addr learned my addr 172.21.15.81:0/2062530448 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:24:34.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.589+0000 7f7024f9a700 1 --2- 172.21.15.81:0/2062530448 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7020068bc0 0x7f70200ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:34.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.589+0000 7f7025f9c700 1 -- 172.21.15.81:0/2062530448 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7020068bc0 msgr2=0x7f70200ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:34.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.589+0000 7f7025f9c700 1 --2- 172.21.15.81:0/2062530448 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7020068bc0 0x7f70200ccdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:34.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.589+0000 7f7025f9c700 1 -- 172.21.15.81:0/2062530448 >> v1:172.21.15.81:6789/0 conn(0x7f70201595b0 legacy=0x7f70200af020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:34.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.589+0000 7f7025f9c700 1 -- 172.21.15.81:0/2062530448 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70200ce110 con 0x7f70200cfbc0 2023-10-06T03:24:34.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.589+0000 7f7017fff700 1 -- 172.21.15.81:0/2062530448 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3153503813 0 0) 0x7f70200ce720 con 0x7f70201595b0 2023-10-06T03:24:34.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.589+0000 7f7025f9c700 1 --2- 172.21.15.81:0/2062530448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70200cfbc0 0x7f70200cd300 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7018009e60 tx=0x7f7018009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=725241d8237a4df2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:34.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.589+0000 7f7017fff700 1 -- 172.21.15.81:0/2062530448 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701800e070 con 0x7f70200cfbc0 2023-10-06T03:24:34.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.590+0000 7f7017fff700 1 -- 172.21.15.81:0/2062530448 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f701800bc30 con 0x7f70200cfbc0 2023-10-06T03:24:34.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.590+0000 7f7017fff700 1 -- 172.21.15.81:0/2062530448 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7018012430 con 0x7f70200cfbc0 2023-10-06T03:24:34.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.590+0000 7f70279ff700 1 -- 172.21.15.81:0/2062530448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70200cfbc0 msgr2=0x7f70200cd300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:34.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.590+0000 7f70279ff700 1 --2- 172.21.15.81:0/2062530448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70200cfbc0 0x7f70200cd300 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7018009e60 tx=0x7f7018009780 comp rx=0 tx=0).stop 2023-10-06T03:24:34.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.590+0000 7f70279ff700 1 -- 172.21.15.81:0/2062530448 shutdown_connections 2023-10-06T03:24:34.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.590+0000 7f70279ff700 1 --2- 172.21.15.81:0/2062530448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70200cfbc0 0x7f70200cd300 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:34.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.590+0000 7f70279ff700 1 --2- 172.21.15.81:0/2062530448 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7020068bc0 0x7f70200ccdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:34.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.590+0000 7f70279ff700 1 -- 172.21.15.81:0/2062530448 >> 172.21.15.81:0/2062530448 conn(0x7f702006f7e0 msgr2=0x7f70200682b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:34.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.590+0000 7f70279ff700 1 -- 172.21.15.81:0/2062530448 shutdown_connections 2023-10-06T03:24:34.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.590+0000 7f70279ff700 1 -- 172.21.15.81:0/2062530448 wait complete. 2023-10-06T03:24:34.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.592+0000 7f70279ff700 1 Processor -- start 2023-10-06T03:24:34.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.592+0000 7f70279ff700 1 -- start start 2023-10-06T03:24:34.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.593+0000 7f70279ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7020068bc0 0x7f70200b3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:34.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.593+0000 7f70279ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f70200cfbc0 0x7f70200b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:34.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.593+0000 7f70279ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70201595b0 0x7f70200c9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:34.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.593+0000 7f70279ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70200b61f0 con 0x7f70201595b0 2023-10-06T03:24:34.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.593+0000 7f70279ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f702015d5e0 con 0x7f7020068bc0 2023-10-06T03:24:34.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.593+0000 7f70279ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70200b3890 con 0x7f70200cfbc0 2023-10-06T03:24:34.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.593+0000 7f7025f9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70201595b0 0x7f70200c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:34.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.593+0000 7f7025f9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70201595b0 0x7f70200c9990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55662/0 (socket says 172.21.15.81:55662) 2023-10-06T03:24:34.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.593+0000 7f7025f9c700 1 -- 172.21.15.81:0/2977373734 learned_addr learned my addr 172.21.15.81:0/2977373734 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:34.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.593+0000 7f7024f9a700 1 --2- 172.21.15.81:0/2977373734 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f70200cfbc0 0x7f70200b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:34.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.593+0000 7f702579b700 1 --2- 172.21.15.81:0/2977373734 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7020068bc0 0x7f70200b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:34.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.593+0000 7f7025f9c700 1 -- 172.21.15.81:0/2977373734 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f70200cfbc0 msgr2=0x7f70200b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:34.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.593+0000 7f7025f9c700 1 --2- 172.21.15.81:0/2977373734 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f70200cfbc0 0x7f70200b5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:34.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.593+0000 7f7025f9c700 1 -- 172.21.15.81:0/2977373734 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7020068bc0 msgr2=0x7f70200b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:34.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.593+0000 7f7025f9c700 1 --2- 172.21.15.81:0/2977373734 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7020068bc0 0x7f70200b3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:34.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.593+0000 7f7025f9c700 1 -- 172.21.15.81:0/2977373734 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7018009a20 con 0x7f70201595b0 2023-10-06T03:24:34.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.594+0000 7f7025f9c700 1 --2- 172.21.15.81:0/2977373734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70201595b0 0x7f70200c9990 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7018013000 tx=0x7f7018019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:34.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.594+0000 7f70157fa700 1 -- 172.21.15.81:0/2977373734 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7018027470 con 0x7f70201595b0 2023-10-06T03:24:34.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.594+0000 7f70157fa700 1 -- 172.21.15.81:0/2977373734 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7018027630 con 0x7f70201595b0 2023-10-06T03:24:34.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.594+0000 7f70157fa700 1 -- 172.21.15.81:0/2977373734 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70180279f0 con 0x7f70201595b0 2023-10-06T03:24:34.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.594+0000 7f70279ff700 1 -- 172.21.15.81:0/2977373734 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f702015d8a0 con 0x7f70201595b0 2023-10-06T03:24:34.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.594+0000 7f70279ff700 1 -- 172.21.15.81:0/2977373734 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f702015de60 con 0x7f70201595b0 2023-10-06T03:24:34.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.595+0000 7f70279ff700 1 -- 172.21.15.81:0/2977373734 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f702004c3c0 con 0x7f70201595b0 2023-10-06T03:24:34.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.596+0000 7f70157fa700 1 -- 172.21.15.81:0/2977373734 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7018024070 con 0x7f70201595b0 2023-10-06T03:24:34.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.596+0000 7f70157fa700 1 --2- 172.21.15.81:0/2977373734 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7004066f30 0x7f70040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:34.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.597+0000 7f70157fa700 1 -- 172.21.15.81:0/2977373734 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f70180871e0 con 0x7f70201595b0 2023-10-06T03:24:34.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.597+0000 7f702579b700 1 --2- 172.21.15.81:0/2977373734 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7004066f30 0x7f70040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:34.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.597+0000 7f702579b700 1 --2- 172.21.15.81:0/2977373734 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7004066f30 0x7f70040693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f701c007fd0 tx=0x7f701c007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:34.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.601+0000 7f70157fa700 1 -- 172.21.15.81:0/2977373734 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7018053f20 con 0x7f70201595b0 2023-10-06T03:24:34.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.792+0000 7f70279ff700 1 -- 172.21.15.81:0/2977373734 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70200afe40 con 0x7f70201595b0 2023-10-06T03:24:34.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.793+0000 7f70157fa700 1 -- 172.21.15.81:0/2977373734 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18754 (secure 0 0 0) 0x7f7018057540 con 0x7f70201595b0 2023-10-06T03:24:34.794 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:24:34.794 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"1807b5d7-9be8-43ad-aaf8-99a4273430b3","created":"2023-10-06T03:23:20.805306+0000","modified":"2023-10-06T03:24:28.774889+0000","last_up_change":"2023-10-06T03:23:32.735796+0000","last_in_change":"2023-10-06T03:23:24.109024+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:33.198850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:33.606744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:23:38.742266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:23:39.347944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:23:42.959054+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"14fb667d-a677-4978-a477-80027f889d36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":85563},{"type":"v1","addr":"172.21.15.81:6818","nonce":85563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":85563},{"type":"v1","addr":"172.21.15.81:6822","nonce":85563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":85563},{"type":"v1","addr":"172.21.15.81:6830","nonce":85563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":85563},{"type":"v1","addr":"172.21.15.81:6826","nonce":85563}]},"public_addr":"172.21.15.81:6818/85563","cluster_addr":"172.21.15.81:6822/85563","heartbeat_back_addr":"172.21.15.81:6830/85563","heartbeat_front_addr":"172.21.15.81:6826/85563","state":["exists","up"]},{"osd":1,"uuid":"974d8a86-1829-4176-89ce-18e6038857f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":85561},{"type":"v1","addr":"172.21.15.81:6801","nonce":85561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":85561},{"type":"v1","addr":"172.21.15.81:6803","nonce":85561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":85561},{"type":"v1","addr":"172.21.15.81:6807","nonce":85561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":85561},{"type":"v1","addr":"172.21.15.81:6805","nonce":85561}]},"public_addr":"172.21.15.81:6801/85561","cluster_addr":"172.21.15.81:6803/85561","heartbeat_back_addr":"172.21.15.81:6807/85561","heartbeat_front_addr":"172.21.15.81:6805/85561","state":["exists","up"]},{"osd":2,"uuid":"ffbfe056-46bc-46e0-bf49-4d8f8650e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":85564},{"type":"v1","addr":"172.21.15.81:6809","nonce":85564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":85564},{"type":"v1","addr":"172.21.15.81:6811","nonce":85564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":85564},{"type":"v1","addr":"172.21.15.81:6815","nonce":85564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":85564},{"type":"v1","addr":"172.21.15.81:6813","nonce":85564}]},"public_addr":"172.21.15.81:6809/85564","cluster_addr":"172.21.15.81:6811/85564","heartbeat_back_addr":"172.21.15.81:6815/85564","heartbeat_front_addr":"172.21.15.81:6813/85564","state":["exists","up"]},{"osd":3,"uuid":"ef9a8314-3d37-4ea1-858a-e704d5695002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":85562},{"type":"v1","addr":"172.21.15.81:6819","nonce":85562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":85562},{"type":"v1","addr":"172.21.15.81:6823","nonce":85562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":85562},{"type":"v1","addr":"172.21.15.81:6831","nonce":85562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":85562},{"type":"v1","addr":"172.21.15.81:6827","nonce":85562}]},"public_addr":"172.21.15.81:6819/85562","cluster_addr":"172.21.15.81:6823/85562","heartbeat_back_addr":"172.21.15.81:6831/85562","heartbeat_front_addr":"172.21.15.81:6827/85562","state":["exists","up"]},{"osd":4,"uuid":"d83506a0-2c96-4bcb-a9fa-05e43dc329df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":85785},{"type":"v1","addr":"172.21.15.83:6801","nonce":85785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":85785},{"type":"v1","addr":"172.21.15.83:6803","nonce":85785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":85785},{"type":"v1","addr":"172.21.15.83:6807","nonce":85785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":85785},{"type":"v1","addr":"172.21.15.83:6805","nonce":85785}]},"public_addr":"172.21.15.83:6801/85785","cluster_addr":"172.21.15.83:6803/85785","heartbeat_back_addr":"172.21.15.83:6807/85785","heartbeat_front_addr":"172.21.15.83:6805/85785","state":["exists","up"]},{"osd":5,"uuid":"10687c63-a3d5-472f-acc0-4f61847b6e0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":85818},{"type":"v1","addr":"172.21.15.83:6825","nonce":85818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":85818},{"type":"v1","addr":"172.21.15.83:6827","nonce":85818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":85818},{"type":"v1","addr":"172.21.15.83:6831","nonce":85818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":85818},{"type":"v1","addr":"172.21.15.83:6829","nonce":85818}]},"public_addr":"172.21.15.83:6825/85818","cluster_addr":"172.21.15.83:6827/85818","heartbeat_back_addr":"172.21.15.83:6831/85818","heartbeat_front_addr":"172.21.15.83:6829/85818","state":["exists","up"]},{"osd":6,"uuid":"2e9daf76-5607-4a29-9a58-6e270700d223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":85787},{"type":"v1","addr":"172.21.15.83:6811","nonce":85787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":85787},{"type":"v1","addr":"172.21.15.83:6815","nonce":85787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":85787},{"type":"v1","addr":"172.21.15.83:6823","nonce":85787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6817","nonce":85787},{"type":"v1","addr":"172.21.15.83:6819","nonce":85787}]},"public_addr":"172.21.15.83:6811/85787","cluster_addr":"172.21.15.83:6815/85787","heartbeat_back_addr":"172.21.15.83:6823/85787","heartbeat_front_addr":"172.21.15.83:6819/85787","state":["exists","up"]},{"osd":7,"uuid":"5019e1ff-233a-4a5a-91ca-8afccb7ab6e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":85786},{"type":"v1","addr":"172.21.15.83:6810","nonce":85786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":85786},{"type":"v1","addr":"172.21.15.83:6814","nonce":85786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":85786},{"type":"v1","addr":"172.21.15.83:6822","nonce":85786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":85786},{"type":"v1","addr":"172.21.15.83:6818","nonce":85786}]},"public_addr":"172.21.15.83:6810/85786","cluster_addr":"172.21.15.83:6814/85786","heartbeat_back_addr":"172.21.15.83:6822/85786","heartbeat_front_addr":"172.21.15.83:6818/85786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.393431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.360031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.407428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.391613+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.403211+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.438142+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.496181+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.472323+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":1,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:24:34.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.795+0000 7f70279ff700 1 -- 172.21.15.81:0/2977373734 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7004066f30 msgr2=0x7f70040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:34.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.795+0000 7f70279ff700 1 --2- 172.21.15.81:0/2977373734 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7004066f30 0x7f70040693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f701c007fd0 tx=0x7f701c007d30 comp rx=0 tx=0).stop 2023-10-06T03:24:34.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.795+0000 7f70279ff700 1 -- 172.21.15.81:0/2977373734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70201595b0 msgr2=0x7f70200c9990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:34.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.795+0000 7f70279ff700 1 --2- 172.21.15.81:0/2977373734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70201595b0 0x7f70200c9990 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7018013000 tx=0x7f7018019000 comp rx=0 tx=0).stop 2023-10-06T03:24:34.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.795+0000 7f70279ff700 1 -- 172.21.15.81:0/2977373734 shutdown_connections 2023-10-06T03:24:34.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.795+0000 7f70279ff700 1 --2- 172.21.15.81:0/2977373734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70201595b0 0x7f70200c9990 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:34.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.795+0000 7f70279ff700 1 --2- 172.21.15.81:0/2977373734 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7020068bc0 0x7f70200b3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:34.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.795+0000 7f70279ff700 1 --2- 172.21.15.81:0/2977373734 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7004066f30 0x7f70040693e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:34.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.795+0000 7f70279ff700 1 --2- 172.21.15.81:0/2977373734 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f70200cfbc0 0x7f70200b5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:34.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.795+0000 7f70279ff700 1 -- 172.21.15.81:0/2977373734 >> 172.21.15.81:0/2977373734 conn(0x7f702006f7e0 msgr2=0x7f70201585f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:34.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.795+0000 7f70279ff700 1 -- 172.21.15.81:0/2977373734 shutdown_connections 2023-10-06T03:24:34.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.795+0000 7f70279ff700 1 -- 172.21.15.81:0/2977373734 wait complete. 2023-10-06T03:24:34.815 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:23:33.198850+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:23:33.606744+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:23:38.742266+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:23:39.347944+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T03:23:42.959054+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:24:34.816 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:24:34.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.997+0000 7faef51ff700 1 Processor -- start 2023-10-06T03:24:34.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.997+0000 7faef51ff700 1 -- start start 2023-10-06T03:24:35.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.998+0000 7faef51ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faef00ca640 0x7faef015a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:35.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.998+0000 7faef51ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faef015ad10 0x7faef00c6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:35.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.998+0000 7faef51ff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faef00cb580 con 0x7faef013fd70 2023-10-06T03:24:35.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.998+0000 7faef51ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faef00c6800 con 0x7faef015ad10 2023-10-06T03:24:35.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.998+0000 7faef51ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faef00caa90 con 0x7faef00ca640 2023-10-06T03:24:35.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.999+0000 7faeef59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faef015ad10 0x7faef00c6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:35.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.999+0000 7faeef59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faef015ad10 0x7faef00c6c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55678/0 (socket says 172.21.15.81:55678) 2023-10-06T03:24:35.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.999+0000 7faeef59e700 1 -- 172.21.15.81:0/3930416985 learned_addr learned my addr 172.21.15.81:0/3930416985 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:35.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.999+0000 7faeee59c700 1 --2- 172.21.15.81:0/3930416985 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faef00ca640 0x7faef015a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:35.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.999+0000 7faeef59e700 1 -- 172.21.15.81:0/3930416985 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faef00ca640 msgr2=0x7faef015a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:35.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.999+0000 7faeef59e700 1 --2- 172.21.15.81:0/3930416985 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faef00ca640 0x7faef015a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:35.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.999+0000 7faeef59e700 1 -- 172.21.15.81:0/3930416985 >> v1:172.21.15.83:6789/0 conn(0x7faef013fd70 legacy=0x7faef015a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:35.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.999+0000 7faeef59e700 1 -- 172.21.15.81:0/3930416985 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef0069880 con 0x7faef015ad10 2023-10-06T03:24:35.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.999+0000 7faeef59e700 1 --2- 172.21.15.81:0/3930416985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faef015ad10 0x7faef00c6c90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7faee8009f20 tx=0x7faee8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6edccd858900730d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:35.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:34.999+0000 7faeedd9b700 1 -- 172.21.15.81:0/3930416985 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee800e070 con 0x7faef015ad10 2023-10-06T03:24:35.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.000+0000 7faeedd9b700 1 -- 172.21.15.81:0/3930416985 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee800ba80 con 0x7faef015ad10 2023-10-06T03:24:35.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.000+0000 7faeedd9b700 1 -- 172.21.15.81:0/3930416985 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee80092e0 con 0x7faef015ad10 2023-10-06T03:24:35.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.000+0000 7faef51ff700 1 -- 172.21.15.81:0/3930416985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faef015ad10 msgr2=0x7faef00c6c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:35.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.000+0000 7faef51ff700 1 --2- 172.21.15.81:0/3930416985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faef015ad10 0x7faef00c6c90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7faee8009f20 tx=0x7faee8009840 comp rx=0 tx=0).stop 2023-10-06T03:24:35.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.000+0000 7faef51ff700 1 -- 172.21.15.81:0/3930416985 shutdown_connections 2023-10-06T03:24:35.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.000+0000 7faef51ff700 1 --2- 172.21.15.81:0/3930416985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faef015ad10 0x7faef00c6c90 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:35.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.000+0000 7faef51ff700 1 --2- 172.21.15.81:0/3930416985 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faef00ca640 0x7faef015a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:35.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.000+0000 7faef51ff700 1 -- 172.21.15.81:0/3930416985 >> 172.21.15.81:0/3930416985 conn(0x7faef00cc090 msgr2=0x7faef00cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:35.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.000+0000 7faef51ff700 1 -- 172.21.15.81:0/3930416985 shutdown_connections 2023-10-06T03:24:35.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.000+0000 7faef51ff700 1 -- 172.21.15.81:0/3930416985 wait complete. 2023-10-06T03:24:35.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.002+0000 7faef51ff700 1 Processor -- start 2023-10-06T03:24:35.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.002+0000 7faef51ff700 1 -- start start 2023-10-06T03:24:35.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.003+0000 7faef51ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faef00ca640 0x7faef0158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:35.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.003+0000 7faef51ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faef013fd70 0x7faef015a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:35.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.003+0000 7faef51ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faef015ad10 0x7faef013e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:35.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.003+0000 7faef51ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef015a1d0 con 0x7faef015ad10 2023-10-06T03:24:35.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.003+0000 7faef51ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef013e7e0 con 0x7faef00ca640 2023-10-06T03:24:35.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.003+0000 7faef51ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faef01595c0 con 0x7faef013fd70 2023-10-06T03:24:35.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.003+0000 7faeef59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faef015ad10 0x7faef013e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:35.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.003+0000 7faeef59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faef015ad10 0x7faef013e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55680/0 (socket says 172.21.15.81:55680) 2023-10-06T03:24:35.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.003+0000 7faeef59e700 1 -- 172.21.15.81:0/96508165 learned_addr learned my addr 172.21.15.81:0/96508165 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:35.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.003+0000 7faeeed9d700 1 --2- 172.21.15.81:0/96508165 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faef00ca640 0x7faef0158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:35.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.003+0000 7faeef59e700 1 -- 172.21.15.81:0/96508165 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faef013fd70 msgr2=0x7faef015a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:35.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.003+0000 7faeee59c700 1 --2- 172.21.15.81:0/96508165 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faef013fd70 0x7faef015a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:35.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.003+0000 7faeef59e700 1 --2- 172.21.15.81:0/96508165 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faef013fd70 0x7faef015a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:35.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.003+0000 7faeef59e700 1 -- 172.21.15.81:0/96508165 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faef00ca640 msgr2=0x7faef0158fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:35.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.003+0000 7faeef59e700 1 --2- 172.21.15.81:0/96508165 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faef00ca640 0x7faef0158fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:35.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.003+0000 7faeef59e700 1 -- 172.21.15.81:0/96508165 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee8009ae0 con 0x7faef015ad10 2023-10-06T03:24:35.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.003+0000 7faeeed9d700 1 --2- 172.21.15.81:0/96508165 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faef00ca640 0x7faef0158fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:35.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.003+0000 7faeee59c700 1 --2- 172.21.15.81:0/96508165 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faef013fd70 0x7faef015a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:35.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.004+0000 7faeef59e700 1 --2- 172.21.15.81:0/96508165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faef015ad10 0x7faef013e2a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7faee8012000 tx=0x7faee8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:35.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.004+0000 7faed6ffd700 1 -- 172.21.15.81:0/96508165 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee80032f0 con 0x7faef015ad10 2023-10-06T03:24:35.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.004+0000 7faed6ffd700 1 -- 172.21.15.81:0/96508165 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee8007e70 con 0x7faef015ad10 2023-10-06T03:24:35.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.004+0000 7faef51ff700 1 -- 172.21.15.81:0/96508165 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faef01598a0 con 0x7faef015ad10 2023-10-06T03:24:35.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.004+0000 7faed6ffd700 1 -- 172.21.15.81:0/96508165 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee801e640 con 0x7faef015ad10 2023-10-06T03:24:35.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.004+0000 7faef51ff700 1 -- 172.21.15.81:0/96508165 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faef0159e60 con 0x7faef015ad10 2023-10-06T03:24:35.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.005+0000 7faef51ff700 1 -- 172.21.15.81:0/96508165 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faef004c3c0 con 0x7faef015ad10 2023-10-06T03:24:35.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.006+0000 7faed6ffd700 1 -- 172.21.15.81:0/96508165 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faee8003040 con 0x7faef015ad10 2023-10-06T03:24:35.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.007+0000 7faed6ffd700 1 --2- 172.21.15.81:0/96508165 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7faedc066f30 0x7faedc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:35.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.007+0000 7faed6ffd700 1 -- 172.21.15.81:0/96508165 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6867+0+0 (secure 0 0 0) 0x7faee8086d10 con 0x7faef015ad10 2023-10-06T03:24:35.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.007+0000 7faeeed9d700 1 --2- 172.21.15.81:0/96508165 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7faedc066f30 0x7faedc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:35.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.007+0000 7faeeed9d700 1 --2- 172.21.15.81:0/96508165 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7faedc066f30 0x7faedc0693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7faee0001870 tx=0x7faee0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:35.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.011+0000 7faed6ffd700 1 -- 172.21.15.81:0/96508165 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faee8053a50 con 0x7faef015ad10 2023-10-06T03:24:35.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.200+0000 7faef51ff700 1 -- 172.21.15.81:0/96508165 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7faef015a310 con 0x7faef015ad10 2023-10-06T03:24:35.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.200+0000 7faed6ffd700 1 -- 172.21.15.81:0/96508165 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7faee8057070 con 0x7faef015ad10 2023-10-06T03:24:35.202 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-10-06T03:24:35.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.202+0000 7faef51ff700 1 -- 172.21.15.81:0/96508165 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7faedc066f30 msgr2=0x7faedc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:35.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.202+0000 7faef51ff700 1 --2- 172.21.15.81:0/96508165 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7faedc066f30 0x7faedc0693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7faee0001870 tx=0x7faee0009040 comp rx=0 tx=0).stop 2023-10-06T03:24:35.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.202+0000 7faef51ff700 1 -- 172.21.15.81:0/96508165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faef015ad10 msgr2=0x7faef013e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:35.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.202+0000 7faef51ff700 1 --2- 172.21.15.81:0/96508165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faef015ad10 0x7faef013e2a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7faee8012000 tx=0x7faee8018000 comp rx=0 tx=0).stop 2023-10-06T03:24:35.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.202+0000 7faef51ff700 1 -- 172.21.15.81:0/96508165 shutdown_connections 2023-10-06T03:24:35.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.202+0000 7faef51ff700 1 --2- 172.21.15.81:0/96508165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faef015ad10 0x7faef013e2a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:35.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.202+0000 7faef51ff700 1 --2- 172.21.15.81:0/96508165 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faef00ca640 0x7faef0158fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:35.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.202+0000 7faef51ff700 1 --2- 172.21.15.81:0/96508165 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7faedc066f30 0x7faedc0693e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:35.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.202+0000 7faef51ff700 1 --2- 172.21.15.81:0/96508165 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faef013fd70 0x7faef015a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:35.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.202+0000 7faef51ff700 1 -- 172.21.15.81:0/96508165 >> 172.21.15.81:0/96508165 conn(0x7faef00cc090 msgr2=0x7faef0069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:35.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.203+0000 7faef51ff700 1 -- 172.21.15.81:0/96508165 shutdown_connections 2023-10-06T03:24:35.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.203+0000 7faef51ff700 1 -- 172.21.15.81:0/96508165 wait complete. 2023-10-06T03:24:35.221 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:24:35.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.404+0000 7fb4c1bff700 1 Processor -- start 2023-10-06T03:24:35.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.404+0000 7fb4c1bff700 1 -- start start 2023-10-06T03:24:35.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.405+0000 7fb4c1bff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb4bc159a60 0x7fb4bc06af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:35.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.405+0000 7fb4c1bff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb4bc06b4d0 0x7fb4bc0ca520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:35.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.405+0000 7fb4c1bff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4bc06ab00 con 0x7fb4bc159e30 2023-10-06T03:24:35.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.405+0000 7fb4c1bff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4bc069ef0 con 0x7fb4bc159a60 2023-10-06T03:24:35.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.405+0000 7fb4c1bff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4bc06a1d0 con 0x7fb4bc06b4d0 2023-10-06T03:24:35.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.405+0000 7fb4bb7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb4bc159a60 0x7fb4bc06af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:35.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.406+0000 7fb4bb7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb4bc159a60 0x7fb4bc06af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55688/0 (socket says 172.21.15.81:55688) 2023-10-06T03:24:35.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.406+0000 7fb4bb7fe700 1 -- 172.21.15.81:0/2866675457 learned_addr learned my addr 172.21.15.81:0/2866675457 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:35.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.406+0000 7fb4baffd700 1 --2- 172.21.15.81:0/2866675457 >> v2:172.21.15.83:3300/0 conn(0x7fb4bc06b4d0 0x7fb4bc0ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:35.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.406+0000 7fb4bb7fe700 1 -- 172.21.15.81:0/2866675457 >> v2:172.21.15.83:3300/0 conn(0x7fb4bc06b4d0 msgr2=0x7fb4bc0ca520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:35.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.406+0000 7fb4bb7fe700 1 --2- 172.21.15.81:0/2866675457 >> v2:172.21.15.83:3300/0 conn(0x7fb4bc06b4d0 0x7fb4bc0ca520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:35.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.406+0000 7fb4bb7fe700 1 -- 172.21.15.81:0/2866675457 >> v1:172.21.15.83:6789/0 conn(0x7fb4bc159e30 legacy=0x7fb4bc155650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:35.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.406+0000 7fb4bb7fe700 1 -- 172.21.15.81:0/2866675457 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4bc06a4b0 con 0x7fb4bc159a60 2023-10-06T03:24:35.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.406+0000 7fb4bb7fe700 1 --2- 172.21.15.81:0/2866675457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4bc159a60 0x7fb4bc06af90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc06d190 tx=0x7fb4ac009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b333208c7672131e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:35.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.406+0000 7fb4ba7fc700 1 -- 172.21.15.81:0/2866675457 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac005c10 con 0x7fb4bc159a60 2023-10-06T03:24:35.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.407+0000 7fb4ba7fc700 1 -- 172.21.15.81:0/2866675457 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4ac005d70 con 0x7fb4bc159a60 2023-10-06T03:24:35.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.407+0000 7fb4ba7fc700 1 -- 172.21.15.81:0/2866675457 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac00b880 con 0x7fb4bc159a60 2023-10-06T03:24:35.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.407+0000 7fb4c1bff700 1 -- 172.21.15.81:0/2866675457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4bc159a60 msgr2=0x7fb4bc06af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:35.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.407+0000 7fb4c1bff700 1 --2- 172.21.15.81:0/2866675457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4bc159a60 0x7fb4bc06af90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc06d190 tx=0x7fb4ac009220 comp rx=0 tx=0).stop 2023-10-06T03:24:35.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.407+0000 7fb4c1bff700 1 -- 172.21.15.81:0/2866675457 shutdown_connections 2023-10-06T03:24:35.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.407+0000 7fb4c1bff700 1 --2- 172.21.15.81:0/2866675457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4bc159a60 0x7fb4bc06af90 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:35.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.407+0000 7fb4c1bff700 1 --2- 172.21.15.81:0/2866675457 >> v2:172.21.15.83:3300/0 conn(0x7fb4bc06b4d0 0x7fb4bc0ca520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:35.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.407+0000 7fb4c1bff700 1 -- 172.21.15.81:0/2866675457 >> 172.21.15.81:0/2866675457 conn(0x7fb4bc0cc090 msgr2=0x7fb4bc0cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:35.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.407+0000 7fb4c1bff700 1 -- 172.21.15.81:0/2866675457 shutdown_connections 2023-10-06T03:24:35.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.407+0000 7fb4c1bff700 1 -- 172.21.15.81:0/2866675457 wait complete. 2023-10-06T03:24:35.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.409+0000 7fb4c1bff700 1 Processor -- start 2023-10-06T03:24:35.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.409+0000 7fb4c1bff700 1 -- start start 2023-10-06T03:24:35.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.410+0000 7fb4c1bff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb4bc06b4d0 0x7fb4bc0aaad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:35.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.410+0000 7fb4c1bff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb4bc159a60 0x7fb4bc0c1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:35.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.410+0000 7fb4c1bff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4bc159e30 0x7fb4bc0c2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:35.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.410+0000 7fb4c1bff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc0a9840 con 0x7fb4bc159e30 2023-10-06T03:24:35.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.410+0000 7fb4c1bff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc0c1600 con 0x7fb4bc159a60 2023-10-06T03:24:35.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.410+0000 7fb4c1bff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc0a9a50 con 0x7fb4bc06b4d0 2023-10-06T03:24:35.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.410+0000 7fb4bbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4bc159e30 0x7fb4bc0c2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:35.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.410+0000 7fb4bbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4bc159e30 0x7fb4bc0c2410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55702/0 (socket says 172.21.15.81:55702) 2023-10-06T03:24:35.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.410+0000 7fb4bbfff700 1 -- 172.21.15.81:0/3825628711 learned_addr learned my addr 172.21.15.81:0/3825628711 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:35.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.410+0000 7fb4baffd700 1 --2- 172.21.15.81:0/3825628711 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb4bc159a60 0x7fb4bc0c1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:35.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.410+0000 7fb4bb7fe700 1 --2- 172.21.15.81:0/3825628711 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb4bc06b4d0 0x7fb4bc0aaad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:35.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.410+0000 7fb4bbfff700 1 -- 172.21.15.81:0/3825628711 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb4bc06b4d0 msgr2=0x7fb4bc0aaad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:35.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.410+0000 7fb4bbfff700 1 --2- 172.21.15.81:0/3825628711 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb4bc06b4d0 0x7fb4bc0aaad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:35.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.410+0000 7fb4bbfff700 1 -- 172.21.15.81:0/3825628711 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb4bc159a60 msgr2=0x7fb4bc0c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:35.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.410+0000 7fb4bbfff700 1 --2- 172.21.15.81:0/3825628711 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb4bc159a60 0x7fb4bc0c1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:35.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.410+0000 7fb4bbfff700 1 -- 172.21.15.81:0/3825628711 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4ac009480 con 0x7fb4bc159e30 2023-10-06T03:24:35.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.411+0000 7fb4bbfff700 1 --2- 172.21.15.81:0/3825628711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4bc159e30 0x7fb4bc0c2410 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb4b400c8e0 tx=0x7fb4b4001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:35.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.411+0000 7fb4a37fe700 1 -- 172.21.15.81:0/3825628711 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b400ce80 con 0x7fb4bc159e30 2023-10-06T03:24:35.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.411+0000 7fb4a37fe700 1 -- 172.21.15.81:0/3825628711 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b400a7e0 con 0x7fb4bc159e30 2023-10-06T03:24:35.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.411+0000 7fb4c1bff700 1 -- 172.21.15.81:0/3825628711 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4bc0a9d30 con 0x7fb4bc159e30 2023-10-06T03:24:35.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.411+0000 7fb4a37fe700 1 -- 172.21.15.81:0/3825628711 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b400ab80 con 0x7fb4bc159e30 2023-10-06T03:24:35.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.411+0000 7fb4c1bff700 1 -- 172.21.15.81:0/3825628711 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4bc0aa5d0 con 0x7fb4bc159e30 2023-10-06T03:24:35.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.412+0000 7fb4c1bff700 1 -- 172.21.15.81:0/3825628711 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4bc0a9f20 con 0x7fb4bc159e30 2023-10-06T03:24:35.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.413+0000 7fb4a37fe700 1 -- 172.21.15.81:0/3825628711 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb4b4012420 con 0x7fb4bc159e30 2023-10-06T03:24:35.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.413+0000 7fb4a37fe700 1 --2- 172.21.15.81:0/3825628711 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb4a8066f30 0x7fb4a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:35.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.414+0000 7fb4a37fe700 1 -- 172.21.15.81:0/3825628711 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fb4b4084c70 con 0x7fb4bc159e30 2023-10-06T03:24:35.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.414+0000 7fb4bb7fe700 1 --2- 172.21.15.81:0/3825628711 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb4a8066f30 0x7fb4a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:35.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.414+0000 7fb4bb7fe700 1 --2- 172.21.15.81:0/3825628711 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb4a8066f30 0x7fb4a80693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac009260 tx=0x7fb4ac016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:35.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.417+0000 7fb4a37fe700 1 -- 172.21.15.81:0/3825628711 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb4b4051a50 con 0x7fb4bc159e30 2023-10-06T03:24:35.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.607+0000 7fb4c1bff700 1 -- 172.21.15.81:0/3825628711 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb4bc0aa120 con 0x7fb4bc159e30 2023-10-06T03:24:35.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.607+0000 7fb4a37fe700 1 -- 172.21.15.81:0/3825628711 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb4b4055070 con 0x7fb4bc159e30 2023-10-06T03:24:35.609 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-06T03:24:35.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.610+0000 7fb4c1bff700 1 -- 172.21.15.81:0/3825628711 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb4a8066f30 msgr2=0x7fb4a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:35.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.610+0000 7fb4c1bff700 1 --2- 172.21.15.81:0/3825628711 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb4a8066f30 0x7fb4a80693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac009260 tx=0x7fb4ac016000 comp rx=0 tx=0).stop 2023-10-06T03:24:35.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.610+0000 7fb4c1bff700 1 -- 172.21.15.81:0/3825628711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4bc159e30 msgr2=0x7fb4bc0c2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:35.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.610+0000 7fb4c1bff700 1 --2- 172.21.15.81:0/3825628711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4bc159e30 0x7fb4bc0c2410 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb4b400c8e0 tx=0x7fb4b4001710 comp rx=0 tx=0).stop 2023-10-06T03:24:35.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.610+0000 7fb4c1bff700 1 -- 172.21.15.81:0/3825628711 shutdown_connections 2023-10-06T03:24:35.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.610+0000 7fb4c1bff700 1 --2- 172.21.15.81:0/3825628711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4bc159e30 0x7fb4bc0c2410 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:35.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.610+0000 7fb4c1bff700 1 --2- 172.21.15.81:0/3825628711 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb4a8066f30 0x7fb4a80693e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:35.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.610+0000 7fb4c1bff700 1 --2- 172.21.15.81:0/3825628711 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb4bc06b4d0 0x7fb4bc0aaad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:35.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.610+0000 7fb4c1bff700 1 --2- 172.21.15.81:0/3825628711 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb4bc159a60 0x7fb4bc0c1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:35.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.610+0000 7fb4c1bff700 1 -- 172.21.15.81:0/3825628711 >> 172.21.15.81:0/3825628711 conn(0x7fb4bc0cc090 msgr2=0x7fb4bc0afda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:35.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.610+0000 7fb4c1bff700 1 -- 172.21.15.81:0/3825628711 shutdown_connections 2023-10-06T03:24:35.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.610+0000 7fb4c1bff700 1 -- 172.21.15.81:0/3825628711 wait complete. 2023-10-06T03:24:35.628 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:24:35.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.811+0000 7fea9dd9d700 1 Processor -- start 2023-10-06T03:24:35.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.811+0000 7fea9dd9d700 1 -- start start 2023-10-06T03:24:35.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.812+0000 7fea9dd9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea981594a0 0x7fea9806b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:35.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.812+0000 7fea9dd9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fea9815ded0 0x7fea980c99d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:35.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.812+0000 7fea9dd9d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fea98159870 0x7fea980c7570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:35.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.812+0000 7fea9dd9d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea9806b680 con 0x7fea9815ded0 2023-10-06T03:24:35.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.812+0000 7fea9dd9d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea9806acb0 con 0x7fea98159870 2023-10-06T03:24:35.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.812+0000 7fea9dd9d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea9806a3c0 con 0x7fea981594a0 2023-10-06T03:24:35.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.812+0000 7fea97fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fea9815ded0 0x7fea980c99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:35.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.812+0000 7fea97fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fea9815ded0 0x7fea980c99d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55704/0 (socket says 172.21.15.81:55704) 2023-10-06T03:24:35.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.812+0000 7fea97fff700 1 -- 172.21.15.81:0/1623816081 learned_addr learned my addr 172.21.15.81:0/1623816081 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:35.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.813+0000 7fea9d59c700 1 --2- 172.21.15.81:0/1623816081 >> v2:172.21.15.83:3300/0 conn(0x7fea98159870 0x7fea980c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:35.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.813+0000 7fea9cd9b700 1 --2- 172.21.15.81:0/1623816081 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea981594a0 0x7fea9806b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:35.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.813+0000 7fea97fff700 1 -- 172.21.15.81:0/1623816081 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea981594a0 msgr2=0x7fea9806b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:35.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.813+0000 7fea97fff700 1 --2- 172.21.15.81:0/1623816081 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea981594a0 0x7fea9806b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:35.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.813+0000 7fea97fff700 1 -- 172.21.15.81:0/1623816081 >> v2:172.21.15.83:3300/0 conn(0x7fea98159870 msgr2=0x7fea980c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:35.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.813+0000 7fea97fff700 1 --2- 172.21.15.81:0/1623816081 >> v2:172.21.15.83:3300/0 conn(0x7fea98159870 0x7fea980c7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:35.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.813+0000 7fea97fff700 1 -- 172.21.15.81:0/1623816081 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea980ca340 con 0x7fea9815ded0 2023-10-06T03:24:35.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.813+0000 7fea97fff700 1 --2- 172.21.15.81:0/1623816081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea9815ded0 0x7fea980c99d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fea9806e590 tx=0x7fea84009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dcc3d5e20738639 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:35.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.813+0000 7fea977fe700 1 -- 172.21.15.81:0/1623816081 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8400b640 con 0x7fea9815ded0 2023-10-06T03:24:35.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.813+0000 7fea977fe700 1 -- 172.21.15.81:0/1623816081 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea8400b7a0 con 0x7fea9815ded0 2023-10-06T03:24:35.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.813+0000 7fea977fe700 1 -- 172.21.15.81:0/1623816081 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8400bb60 con 0x7fea9815ded0 2023-10-06T03:24:35.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.814+0000 7fea9dd9d700 1 -- 172.21.15.81:0/1623816081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea9815ded0 msgr2=0x7fea980c99d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:35.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.814+0000 7fea9dd9d700 1 --2- 172.21.15.81:0/1623816081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea9815ded0 0x7fea980c99d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fea9806e590 tx=0x7fea84009250 comp rx=0 tx=0).stop 2023-10-06T03:24:35.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.814+0000 7fea9dd9d700 1 -- 172.21.15.81:0/1623816081 shutdown_connections 2023-10-06T03:24:35.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.814+0000 7fea9dd9d700 1 --2- 172.21.15.81:0/1623816081 >> v2:172.21.15.83:3300/0 conn(0x7fea98159870 0x7fea980c7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:35.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.814+0000 7fea9dd9d700 1 --2- 172.21.15.81:0/1623816081 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea981594a0 0x7fea9806b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:35.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.814+0000 7fea9dd9d700 1 --2- 172.21.15.81:0/1623816081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea9815ded0 0x7fea980c99d0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:35.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.814+0000 7fea9dd9d700 1 -- 172.21.15.81:0/1623816081 >> 172.21.15.81:0/1623816081 conn(0x7fea980686f0 msgr2=0x7fea98068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:35.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.814+0000 7fea9dd9d700 1 -- 172.21.15.81:0/1623816081 shutdown_connections 2023-10-06T03:24:35.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.814+0000 7fea9dd9d700 1 -- 172.21.15.81:0/1623816081 wait complete. 2023-10-06T03:24:35.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.815+0000 7fea9dd9d700 1 Processor -- start 2023-10-06T03:24:35.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.816+0000 7fea9dd9d700 1 -- start start 2023-10-06T03:24:35.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.816+0000 7fea9dd9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea981594a0 0x7fea980c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:35.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.816+0000 7fea9dd9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea98159870 0x7fea980c5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:35.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.816+0000 7fea9dd9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea9815ded0 0x7fea9814fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:35.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.816+0000 7fea9dd9d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea980c3810 con 0x7fea9815ded0 2023-10-06T03:24:35.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.816+0000 7fea9dd9d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea980c2c00 con 0x7fea98159870 2023-10-06T03:24:35.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.817+0000 7fea9dd9d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea980c2ee0 con 0x7fea981594a0 2023-10-06T03:24:35.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.817+0000 7fea9d59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea9815ded0 0x7fea9814fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:35.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.817+0000 7fea9d59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea9815ded0 0x7fea9814fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55716/0 (socket says 172.21.15.81:55716) 2023-10-06T03:24:35.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.817+0000 7fea9d59c700 1 -- 172.21.15.81:0/802186132 learned_addr learned my addr 172.21.15.81:0/802186132 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:35.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.817+0000 7fea9cd9b700 1 --2- 172.21.15.81:0/802186132 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea981594a0 0x7fea980c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:35.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.817+0000 7fea97fff700 1 --2- 172.21.15.81:0/802186132 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea98159870 0x7fea980c5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:35.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.817+0000 7fea9d59c700 1 -- 172.21.15.81:0/802186132 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea981594a0 msgr2=0x7fea980c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:35.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.817+0000 7fea9d59c700 1 --2- 172.21.15.81:0/802186132 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea981594a0 0x7fea980c3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:35.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.817+0000 7fea9d59c700 1 -- 172.21.15.81:0/802186132 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea98159870 msgr2=0x7fea980c5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:35.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.817+0000 7fea9d59c700 1 --2- 172.21.15.81:0/802186132 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea98159870 0x7fea980c5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:35.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.817+0000 7fea9d59c700 1 -- 172.21.15.81:0/802186132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea840094f0 con 0x7fea9815ded0 2023-10-06T03:24:35.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.817+0000 7fea9d59c700 1 --2- 172.21.15.81:0/802186132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea9815ded0 0x7fea9814fe50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fea90009df0 tx=0x7fea9000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:35.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.818+0000 7fea94ff9700 1 -- 172.21.15.81:0/802186132 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9000caa0 con 0x7fea9815ded0 2023-10-06T03:24:35.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.818+0000 7fea94ff9700 1 -- 172.21.15.81:0/802186132 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea9000f040 con 0x7fea9815ded0 2023-10-06T03:24:35.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.818+0000 7fea9dd9d700 1 -- 172.21.15.81:0/802186132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea980c31c0 con 0x7fea9815ded0 2023-10-06T03:24:35.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.818+0000 7fea94ff9700 1 -- 172.21.15.81:0/802186132 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9000ce70 con 0x7fea9815ded0 2023-10-06T03:24:35.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.818+0000 7fea9dd9d700 1 -- 172.21.15.81:0/802186132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea980c2880 con 0x7fea9815ded0 2023-10-06T03:24:35.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.819+0000 7fea9dd9d700 1 -- 172.21.15.81:0/802186132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea9804c3c0 con 0x7fea9815ded0 2023-10-06T03:24:35.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.820+0000 7fea94ff9700 1 -- 172.21.15.81:0/802186132 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fea90014690 con 0x7fea9815ded0 2023-10-06T03:24:35.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.821+0000 7fea94ff9700 1 --2- 172.21.15.81:0/802186132 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fea7c066f30 0x7fea7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:35.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.821+0000 7fea94ff9700 1 -- 172.21.15.81:0/802186132 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fea90085270 con 0x7fea9815ded0 2023-10-06T03:24:35.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.821+0000 7fea9cd9b700 1 --2- 172.21.15.81:0/802186132 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fea7c066f30 0x7fea7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:35.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.822+0000 7fea9cd9b700 1 --2- 172.21.15.81:0/802186132 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fea7c066f30 0x7fea7c0693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fea8c009c80 tx=0x7fea8c0091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:35.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:35.826+0000 7fea94ff9700 1 -- 172.21.15.81:0/802186132 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fea90055a40 con 0x7fea9815ded0 2023-10-06T03:24:36.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.018+0000 7fea9dd9d700 1 -- 172.21.15.81:0/802186132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fea980c9da0 con 0x7fea9815ded0 2023-10-06T03:24:36.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.018+0000 7fea94ff9700 1 -- 172.21.15.81:0/802186132 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fea900555d0 con 0x7fea9815ded0 2023-10-06T03:24:36.019 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-10-06T03:24:36.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.020+0000 7fea9dd9d700 1 -- 172.21.15.81:0/802186132 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fea7c066f30 msgr2=0x7fea7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:36.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.020+0000 7fea9dd9d700 1 --2- 172.21.15.81:0/802186132 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fea7c066f30 0x7fea7c0693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fea8c009c80 tx=0x7fea8c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:36.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.020+0000 7fea9dd9d700 1 -- 172.21.15.81:0/802186132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea9815ded0 msgr2=0x7fea9814fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:36.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.020+0000 7fea9dd9d700 1 --2- 172.21.15.81:0/802186132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea9815ded0 0x7fea9814fe50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fea90009df0 tx=0x7fea9000b040 comp rx=0 tx=0).stop 2023-10-06T03:24:36.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.020+0000 7fea9dd9d700 1 -- 172.21.15.81:0/802186132 shutdown_connections 2023-10-06T03:24:36.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.020+0000 7fea9dd9d700 1 --2- 172.21.15.81:0/802186132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea9815ded0 0x7fea9814fe50 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:36.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.020+0000 7fea9dd9d700 1 --2- 172.21.15.81:0/802186132 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fea7c066f30 0x7fea7c0693e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:36.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.020+0000 7fea9dd9d700 1 --2- 172.21.15.81:0/802186132 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea981594a0 0x7fea980c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:36.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.020+0000 7fea9dd9d700 1 --2- 172.21.15.81:0/802186132 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea98159870 0x7fea980c5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:36.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.020+0000 7fea9dd9d700 1 -- 172.21.15.81:0/802186132 >> 172.21.15.81:0/802186132 conn(0x7fea980686f0 msgr2=0x7fea980cc330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:36.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.021+0000 7fea9dd9d700 1 -- 172.21.15.81:0/802186132 shutdown_connections 2023-10-06T03:24:36.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.021+0000 7fea9dd9d700 1 -- 172.21.15.81:0/802186132 wait complete. 2023-10-06T03:24:36.039 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:24:36.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.219+0000 7fa4f65ff700 1 Processor -- start 2023-10-06T03:24:36.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.219+0000 7fa4f65ff700 1 -- start start 2023-10-06T03:24:36.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.221+0000 7fa4f65ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa4f0159a60 0x7fa4f006af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:36.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.221+0000 7fa4f65ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa4f0159e30 0x7fa4f0155650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:36.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.221+0000 7fa4f65ff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4f006ab00 con 0x7fa4f006b4d0 2023-10-06T03:24:36.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.221+0000 7fa4f65ff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4f0069ef0 con 0x7fa4f0159e30 2023-10-06T03:24:36.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.221+0000 7fa4f65ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f006a1d0 con 0x7fa4f0159a60 2023-10-06T03:24:36.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.221+0000 7fa4e7fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa4f006b4d0 0x7fa4f00ca520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39528/0 (socket says 172.21.15.81:39528) 2023-10-06T03:24:36.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.221+0000 7fa4e7fff700 1 -- 172.21.15.81:0/580620736 learned_addr learned my addr 172.21.15.81:0/580620736 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:24:36.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.221+0000 7fa4effff700 1 --2- 172.21.15.81:0/580620736 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa4f0159a60 0x7fa4f006af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:36.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.221+0000 7fa4f4b9c700 1 --2- 172.21.15.81:0/580620736 >> v2:172.21.15.83:3300/0 conn(0x7fa4f0159e30 0x7fa4f0155650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:36.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.221+0000 7fa4ef7fe700 1 -- 172.21.15.81:0/580620736 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1682161505 0 0) 0x7fa4f006ab00 con 0x7fa4f006b4d0 2023-10-06T03:24:36.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.222+0000 7fa4ef7fe700 1 -- 172.21.15.81:0/580620736 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4dc003570 con 0x7fa4f006b4d0 2023-10-06T03:24:36.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.222+0000 7fa4ef7fe700 1 -- 172.21.15.81:0/580620736 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1722273429 0 0) 0x7fa4dc003570 con 0x7fa4f006b4d0 2023-10-06T03:24:36.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.222+0000 7fa4ef7fe700 1 -- 172.21.15.81:0/580620736 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa4f0159a60 msgr2=0x7fa4f006af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:36.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.222+0000 7fa4ef7fe700 1 --2- 172.21.15.81:0/580620736 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa4f0159a60 0x7fa4f006af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:36.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.222+0000 7fa4ef7fe700 1 -- 172.21.15.81:0/580620736 >> v2:172.21.15.83:3300/0 conn(0x7fa4f0159e30 msgr2=0x7fa4f0155650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:36.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.222+0000 7fa4ef7fe700 1 --2- 172.21.15.81:0/580620736 >> v2:172.21.15.83:3300/0 conn(0x7fa4f0159e30 0x7fa4f0155650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:36.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.222+0000 7fa4ef7fe700 1 -- 172.21.15.81:0/580620736 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f006a4b0 con 0x7fa4f006b4d0 2023-10-06T03:24:36.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.222+0000 7fa4ef7fe700 1 -- 172.21.15.81:0/580620736 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2513016936 0 0) 0x7fa4d8001470 con 0x7fa4f006b4d0 2023-10-06T03:24:36.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.222+0000 7fa4ef7fe700 1 -- 172.21.15.81:0/580620736 >> v1:172.21.15.81:6789/0 conn(0x7fa4f006b4d0 legacy=0x7fa4f00ca520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:36.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.222+0000 7fa4ef7fe700 1 --2- 172.21.15.81:0/580620736 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa4f0159a60 0x7fa4dc003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:36.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.222+0000 7fa4ef7fe700 1 --2- 172.21.15.81:0/580620736 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa4dc003fe0 0x7fa4dc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:36.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.222+0000 7fa4ef7fe700 1 --2- 172.21.15.81:0/580620736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4dc004d50 0x7fa4dc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:36.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.222+0000 7fa4ef7fe700 1 -- 172.21.15.81:0/580620736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f0069ef0 con 0x7fa4dc004d50 2023-10-06T03:24:36.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.222+0000 7fa4ef7fe700 1 -- 172.21.15.81:0/580620736 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f006a1d0 con 0x7fa4dc003fe0 2023-10-06T03:24:36.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.222+0000 7fa4ef7fe700 1 -- 172.21.15.81:0/580620736 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc00dca0 con 0x7fa4f0159a60 2023-10-06T03:24:36.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.222+0000 7fa4f4b9c700 1 --2- 172.21.15.81:0/580620736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4dc004d50 0x7fa4dc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:36.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.222+0000 7fa4effff700 1 --2- 172.21.15.81:0/580620736 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa4f0159a60 0x7fa4dc003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:36.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.222+0000 7fa4e7fff700 1 --2- 172.21.15.81:0/580620736 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa4dc003fe0 0x7fa4dc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:36.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.223+0000 7fa4f4b9c700 1 -- 172.21.15.81:0/580620736 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa4f0159a60 msgr2=0x7fa4dc003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:36.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.223+0000 7fa4f4b9c700 1 --2- 172.21.15.81:0/580620736 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa4f0159a60 0x7fa4dc003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:36.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.223+0000 7fa4f4b9c700 1 -- 172.21.15.81:0/580620736 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa4dc003fe0 msgr2=0x7fa4dc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:36.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.223+0000 7fa4f4b9c700 1 --2- 172.21.15.81:0/580620736 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa4dc003fe0 0x7fa4dc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:36.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.223+0000 7fa4f4b9c700 1 -- 172.21.15.81:0/580620736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4dc003570 con 0x7fa4dc004d50 2023-10-06T03:24:36.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.223+0000 7fa4f4b9c700 1 --2- 172.21.15.81:0/580620736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4dc004d50 0x7fa4dc0051c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa4e800e210 tx=0x7fa4e800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a64742d207cd7e74 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:36.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.223+0000 7fa4ef7fe700 1 -- 172.21.15.81:0/580620736 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e800ea60 con 0x7fa4dc004d50 2023-10-06T03:24:36.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.223+0000 7fa4ef7fe700 1 -- 172.21.15.81:0/580620736 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e800f040 con 0x7fa4dc004d50 2023-10-06T03:24:36.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.223+0000 7fa4ef7fe700 1 -- 172.21.15.81:0/580620736 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e800ee10 con 0x7fa4dc004d50 2023-10-06T03:24:36.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.223+0000 7fa4f65ff700 1 -- 172.21.15.81:0/580620736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4dc004d50 msgr2=0x7fa4dc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:36.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.223+0000 7fa4f65ff700 1 --2- 172.21.15.81:0/580620736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4dc004d50 0x7fa4dc0051c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa4e800e210 tx=0x7fa4e800b040 comp rx=0 tx=0).stop 2023-10-06T03:24:36.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.224+0000 7fa4f4b9c700 1 -- 172.21.15.81:0/580620736 reap_dead start 2023-10-06T03:24:36.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.224+0000 7fa4f65ff700 1 -- 172.21.15.81:0/580620736 shutdown_connections 2023-10-06T03:24:36.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.224+0000 7fa4f65ff700 1 -- 172.21.15.81:0/580620736 >> 172.21.15.81:0/580620736 conn(0x7fa4f00cc090 msgr2=0x7fa4f00cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:36.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.224+0000 7fa4f65ff700 1 -- 172.21.15.81:0/580620736 shutdown_connections 2023-10-06T03:24:36.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.224+0000 7fa4f65ff700 1 -- 172.21.15.81:0/580620736 wait complete. 2023-10-06T03:24:36.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.225+0000 7fa4f65ff700 1 Processor -- start 2023-10-06T03:24:36.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.225+0000 7fa4f65ff700 1 -- start start 2023-10-06T03:24:36.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.226+0000 7fa4f65ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4dc004d50 0x7fa4f014d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:36.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.226+0000 7fa4f65ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa4f00ab910 0x7fa4f00aa1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:36.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.226+0000 7fa4f65ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa4f00aa720 0x7fa4f00aaba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:36.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.226+0000 7fa4f65ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f00a9d50 con 0x7fa4dc004d50 2023-10-06T03:24:36.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.226+0000 7fa4f65ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f00c4c30 con 0x7fa4f00aa720 2023-10-06T03:24:36.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.226+0000 7fa4f65ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f00ab0e0 con 0x7fa4f00ab910 2023-10-06T03:24:36.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.226+0000 7fa4effff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4dc004d50 0x7fa4f014d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:36.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.226+0000 7fa4effff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4dc004d50 0x7fa4f014d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55726/0 (socket says 172.21.15.81:55726) 2023-10-06T03:24:36.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.226+0000 7fa4effff700 1 -- 172.21.15.81:0/2083431073 learned_addr learned my addr 172.21.15.81:0/2083431073 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:36.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.227+0000 7fa4e7fff700 1 --2- 172.21.15.81:0/2083431073 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa4f00ab910 0x7fa4f00aa1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:36.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.227+0000 7fa4f4b9c700 1 --2- 172.21.15.81:0/2083431073 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa4f00aa720 0x7fa4f00aaba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:36.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.227+0000 7fa4effff700 1 -- 172.21.15.81:0/2083431073 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa4f00ab910 msgr2=0x7fa4f00aa1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:36.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.227+0000 7fa4effff700 1 --2- 172.21.15.81:0/2083431073 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa4f00ab910 0x7fa4f00aa1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:36.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.227+0000 7fa4effff700 1 -- 172.21.15.81:0/2083431073 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa4f00aa720 msgr2=0x7fa4f00aaba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:36.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.227+0000 7fa4effff700 1 --2- 172.21.15.81:0/2083431073 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa4f00aa720 0x7fa4f00aaba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:36.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.227+0000 7fa4effff700 1 -- 172.21.15.81:0/2083431073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f00c4ef0 con 0x7fa4dc004d50 2023-10-06T03:24:36.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.227+0000 7fa4effff700 1 --2- 172.21.15.81:0/2083431073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4dc004d50 0x7fa4f014d4d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0002f40 tx=0x7fa4e000a2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:36.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.227+0000 7fa4ecff9700 1 -- 172.21.15.81:0/2083431073 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e0005c10 con 0x7fa4dc004d50 2023-10-06T03:24:36.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.227+0000 7fa4ecff9700 1 -- 172.21.15.81:0/2083431073 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e0005d70 con 0x7fa4dc004d50 2023-10-06T03:24:36.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.227+0000 7fa4f65ff700 1 -- 172.21.15.81:0/2083431073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4f00c51d0 con 0x7fa4dc004d50 2023-10-06T03:24:36.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.227+0000 7fa4ecff9700 1 -- 172.21.15.81:0/2083431073 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e000faf0 con 0x7fa4dc004d50 2023-10-06T03:24:36.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.227+0000 7fa4f65ff700 1 -- 172.21.15.81:0/2083431073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4f014da10 con 0x7fa4dc004d50 2023-10-06T03:24:36.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.228+0000 7fa4f65ff700 1 -- 172.21.15.81:0/2083431073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4f00c5410 con 0x7fa4dc004d50 2023-10-06T03:24:36.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.229+0000 7fa4ecff9700 1 -- 172.21.15.81:0/2083431073 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa4e0006050 con 0x7fa4dc004d50 2023-10-06T03:24:36.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.230+0000 7fa4ecff9700 1 --2- 172.21.15.81:0/2083431073 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa4d0066f30 0x7fa4d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:36.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.231+0000 7fa4ecff9700 1 -- 172.21.15.81:0/2083431073 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fa4e0085310 con 0x7fa4dc004d50 2023-10-06T03:24:36.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.231+0000 7fa4e7fff700 1 --2- 172.21.15.81:0/2083431073 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa4d0066f30 0x7fa4d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:36.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.231+0000 7fa4e7fff700 1 --2- 172.21.15.81:0/2083431073 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa4d0066f30 0x7fa4d00693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8001d20 tx=0x7fa4d8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:36.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.234+0000 7fa4ecff9700 1 -- 172.21.15.81:0/2083431073 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa4f00c5410 con 0x7fa4dc004d50 2023-10-06T03:24:36.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.422+0000 7fa4f65ff700 1 -- 172.21.15.81:0/2083431073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa4f00a9840 con 0x7fa4dc004d50 2023-10-06T03:24:36.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.422+0000 7fa4ecff9700 1 -- 172.21.15.81:0/2083431073 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa4f00a9840 con 0x7fa4dc004d50 2023-10-06T03:24:36.423 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-10-06T03:24:36.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.425+0000 7fa4f65ff700 1 -- 172.21.15.81:0/2083431073 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa4d0066f30 msgr2=0x7fa4d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:36.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.425+0000 7fa4f65ff700 1 --2- 172.21.15.81:0/2083431073 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa4d0066f30 0x7fa4d00693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8001d20 tx=0x7fa4d8009040 comp rx=0 tx=0).stop 2023-10-06T03:24:36.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.425+0000 7fa4f65ff700 1 -- 172.21.15.81:0/2083431073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4dc004d50 msgr2=0x7fa4f014d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:36.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.425+0000 7fa4f65ff700 1 --2- 172.21.15.81:0/2083431073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4dc004d50 0x7fa4f014d4d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0002f40 tx=0x7fa4e000a2e0 comp rx=0 tx=0).stop 2023-10-06T03:24:36.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.425+0000 7fa4f65ff700 1 -- 172.21.15.81:0/2083431073 shutdown_connections 2023-10-06T03:24:36.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.425+0000 7fa4f65ff700 1 --2- 172.21.15.81:0/2083431073 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa4f00aa720 0x7fa4f00aaba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:36.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.425+0000 7fa4f65ff700 1 --2- 172.21.15.81:0/2083431073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4dc004d50 0x7fa4f014d4d0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:36.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.425+0000 7fa4f65ff700 1 --2- 172.21.15.81:0/2083431073 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa4d0066f30 0x7fa4d00693e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:36.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.425+0000 7fa4f65ff700 1 --2- 172.21.15.81:0/2083431073 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa4f00ab910 0x7fa4f00aa1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:36.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.425+0000 7fa4f65ff700 1 -- 172.21.15.81:0/2083431073 >> 172.21.15.81:0/2083431073 conn(0x7fa4f00cc090 msgr2=0x7fa4f00c2400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:36.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.425+0000 7fa4f65ff700 1 -- 172.21.15.81:0/2083431073 shutdown_connections 2023-10-06T03:24:36.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.425+0000 7fa4f65ff700 1 -- 172.21.15.81:0/2083431073 wait complete. 2023-10-06T03:24:36.443 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T03:24:36.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.625+0000 7f22b8dff700 1 Processor -- start 2023-10-06T03:24:36.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.625+0000 7f22b8dff700 1 -- start start 2023-10-06T03:24:36.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.626+0000 7f22b8dff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f22b40686d0 0x7f22b40cd390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:36.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.626+0000 7f22b8dff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f22b40cea00 0x7f22b415db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:36.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.626+0000 7f22b8dff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f22b4068aa0 0x7f22b4158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:36.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.626+0000 7f22b8dff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22b40cf170 con 0x7f22b40cea00 2023-10-06T03:24:36.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.626+0000 7f22b8dff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22b40cd8d0 con 0x7f22b4068aa0 2023-10-06T03:24:36.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.626+0000 7f22b8dff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b40cee90 con 0x7f22b40686d0 2023-10-06T03:24:36.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.626+0000 7f22b1d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f22b40cea00 0x7f22b415db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:36.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.626+0000 7f22b1d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f22b40cea00 0x7f22b415db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55728/0 (socket says 172.21.15.81:55728) 2023-10-06T03:24:36.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.626+0000 7f22b1d9b700 1 -- 172.21.15.81:0/3099558 learned_addr learned my addr 172.21.15.81:0/3099558 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:36.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.627+0000 7f22b259c700 1 --2- 172.21.15.81:0/3099558 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f22b40686d0 0x7f22b40cd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:36.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.627+0000 7f22b2d9d700 1 --2- 172.21.15.81:0/3099558 >> v2:172.21.15.83:3300/0 conn(0x7f22b4068aa0 0x7f22b4158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:36.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.627+0000 7f22b1d9b700 1 -- 172.21.15.81:0/3099558 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f22b40686d0 msgr2=0x7f22b40cd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:36.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.627+0000 7f22b1d9b700 1 --2- 172.21.15.81:0/3099558 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f22b40686d0 0x7f22b40cd390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:36.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.627+0000 7f22b1d9b700 1 -- 172.21.15.81:0/3099558 >> v2:172.21.15.83:3300/0 conn(0x7f22b4068aa0 msgr2=0x7f22b4158ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:36.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.627+0000 7f22b1d9b700 1 --2- 172.21.15.81:0/3099558 >> v2:172.21.15.83:3300/0 conn(0x7f22b4068aa0 0x7f22b4158ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:36.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.627+0000 7f22b1d9b700 1 -- 172.21.15.81:0/3099558 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b40cc8b0 con 0x7f22b40cea00 2023-10-06T03:24:36.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.627+0000 7f22b1d9b700 1 --2- 172.21.15.81:0/3099558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22b40cea00 0x7f22b415db40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f22b40cf830 tx=0x7f22a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df275f54272d4151 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:36.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.627+0000 7f22b159a700 1 -- 172.21.15.81:0/3099558 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a800b860 con 0x7f22b40cea00 2023-10-06T03:24:36.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.627+0000 7f22b159a700 1 -- 172.21.15.81:0/3099558 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a800b9c0 con 0x7f22b40cea00 2023-10-06T03:24:36.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.627+0000 7f22b159a700 1 -- 172.21.15.81:0/3099558 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a800bd60 con 0x7f22b40cea00 2023-10-06T03:24:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.628+0000 7f22b8dff700 1 -- 172.21.15.81:0/3099558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22b40cea00 msgr2=0x7f22b415db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.628+0000 7f22b8dff700 1 --2- 172.21.15.81:0/3099558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22b40cea00 0x7f22b415db40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f22b40cf830 tx=0x7f22a8009250 comp rx=0 tx=0).stop 2023-10-06T03:24:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.628+0000 7f22b8dff700 1 -- 172.21.15.81:0/3099558 shutdown_connections 2023-10-06T03:24:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.628+0000 7f22b8dff700 1 --2- 172.21.15.81:0/3099558 >> v2:172.21.15.83:3300/0 conn(0x7f22b4068aa0 0x7f22b4158ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.628+0000 7f22b8dff700 1 --2- 172.21.15.81:0/3099558 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f22b40686d0 0x7f22b40cd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.628+0000 7f22b8dff700 1 --2- 172.21.15.81:0/3099558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22b40cea00 0x7f22b415db40 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.628+0000 7f22b8dff700 1 -- 172.21.15.81:0/3099558 >> 172.21.15.81:0/3099558 conn(0x7f22b406ed10 msgr2=0x7f22b406f110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.628+0000 7f22b8dff700 1 -- 172.21.15.81:0/3099558 shutdown_connections 2023-10-06T03:24:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.628+0000 7f22b8dff700 1 -- 172.21.15.81:0/3099558 wait complete. 2023-10-06T03:24:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.630+0000 7f22b8dff700 1 Processor -- start 2023-10-06T03:24:36.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.630+0000 7f22b8dff700 1 -- start start 2023-10-06T03:24:36.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.631+0000 7f22b8dff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22b40686d0 0x7f22b40b53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:36.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.631+0000 7f22b8dff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f22b4068aa0 0x7f22b40b3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:36.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.631+0000 7f22b8dff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22b40cea00 0x7f22b416a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:36.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.631+0000 7f22b8dff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b40b4230 con 0x7f22b40cea00 2023-10-06T03:24:36.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.631+0000 7f22b8dff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b4169710 con 0x7f22b40686d0 2023-10-06T03:24:36.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.631+0000 7f22b8dff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b40b2d80 con 0x7f22b4068aa0 2023-10-06T03:24:36.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.631+0000 7f22b2d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22b40cea00 0x7f22b416a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:36.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.631+0000 7f22b2d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22b40cea00 0x7f22b416a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55738/0 (socket says 172.21.15.81:55738) 2023-10-06T03:24:36.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.631+0000 7f22b2d9d700 1 -- 172.21.15.81:0/2347506715 learned_addr learned my addr 172.21.15.81:0/2347506715 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:36.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.631+0000 7f22b1d9b700 1 --2- 172.21.15.81:0/2347506715 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f22b4068aa0 0x7f22b40b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:36.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.631+0000 7f22b259c700 1 --2- 172.21.15.81:0/2347506715 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22b40686d0 0x7f22b40b53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:36.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.631+0000 7f22b2d9d700 1 -- 172.21.15.81:0/2347506715 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f22b4068aa0 msgr2=0x7f22b40b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:36.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.631+0000 7f22b2d9d700 1 --2- 172.21.15.81:0/2347506715 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f22b4068aa0 0x7f22b40b3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:36.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.631+0000 7f22b2d9d700 1 -- 172.21.15.81:0/2347506715 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22b40686d0 msgr2=0x7f22b40b53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:36.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.631+0000 7f22b2d9d700 1 --2- 172.21.15.81:0/2347506715 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22b40686d0 0x7f22b40b53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:36.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.631+0000 7f22b2d9d700 1 -- 172.21.15.81:0/2347506715 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a80094f0 con 0x7f22b40cea00 2023-10-06T03:24:36.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.631+0000 7f22b259c700 1 --2- 172.21.15.81:0/2347506715 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22b40686d0 0x7f22b40b53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:36.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.632+0000 7f22b2d9d700 1 --2- 172.21.15.81:0/2347506715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22b40cea00 0x7f22b416a8e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f22ac009fa0 tx=0x7f22ac009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:36.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.632+0000 7f22a27fc700 1 -- 172.21.15.81:0/2347506715 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac00ecc0 con 0x7f22b40cea00 2023-10-06T03:24:36.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.632+0000 7f22a27fc700 1 -- 172.21.15.81:0/2347506715 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22ac00ee20 con 0x7f22b40cea00 2023-10-06T03:24:36.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.632+0000 7f22b8dff700 1 -- 172.21.15.81:0/2347506715 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22b41699b0 con 0x7f22b40cea00 2023-10-06T03:24:36.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.632+0000 7f22a27fc700 1 -- 172.21.15.81:0/2347506715 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac014670 con 0x7f22b40cea00 2023-10-06T03:24:36.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.632+0000 7f22b8dff700 1 -- 172.21.15.81:0/2347506715 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22b40b3c70 con 0x7f22b40cea00 2023-10-06T03:24:36.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.633+0000 7f22b8dff700 1 -- 172.21.15.81:0/2347506715 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22b4169b40 con 0x7f22b40cea00 2023-10-06T03:24:36.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.634+0000 7f22a27fc700 1 -- 172.21.15.81:0/2347506715 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f22ac0149e0 con 0x7f22b40cea00 2023-10-06T03:24:36.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.636+0000 7f22a27fc700 1 --2- 172.21.15.81:0/2347506715 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2294066f30 0x7f22940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:36.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.636+0000 7f22a27fc700 1 -- 172.21.15.81:0/2347506715 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f22ac085190 con 0x7f22b40cea00 2023-10-06T03:24:36.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.636+0000 7f22b259c700 1 --2- 172.21.15.81:0/2347506715 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2294066f30 0x7f22940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:36.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.636+0000 7f22b259c700 1 --2- 172.21.15.81:0/2347506715 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2294066f30 0x7f22940693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f22a4006fd0 tx=0x7f22a4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:36.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.639+0000 7f22a27fc700 1 -- 172.21.15.81:0/2347506715 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f22ac051ed0 con 0x7f22b40cea00 2023-10-06T03:24:36.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.833+0000 7f22b8dff700 1 -- 172.21.15.81:0/2347506715 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f22b404c3c0 con 0x7f22b40cea00 2023-10-06T03:24:36.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.833+0000 7f22a27fc700 1 -- 172.21.15.81:0/2347506715 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f22ac0554f0 con 0x7f22b40cea00 2023-10-06T03:24:36.835 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-10-06T03:24:36.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.836+0000 7f22b8dff700 1 -- 172.21.15.81:0/2347506715 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2294066f30 msgr2=0x7f22940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:36.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.836+0000 7f22b8dff700 1 --2- 172.21.15.81:0/2347506715 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2294066f30 0x7f22940693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f22a4006fd0 tx=0x7f22a4008040 comp rx=0 tx=0).stop 2023-10-06T03:24:36.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.836+0000 7f22b8dff700 1 -- 172.21.15.81:0/2347506715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22b40cea00 msgr2=0x7f22b416a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:36.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.836+0000 7f22b8dff700 1 --2- 172.21.15.81:0/2347506715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22b40cea00 0x7f22b416a8e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f22ac009fa0 tx=0x7f22ac009900 comp rx=0 tx=0).stop 2023-10-06T03:24:36.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.836+0000 7f22b8dff700 1 -- 172.21.15.81:0/2347506715 shutdown_connections 2023-10-06T03:24:36.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.836+0000 7f22b8dff700 1 --2- 172.21.15.81:0/2347506715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22b40cea00 0x7f22b416a8e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:36.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.836+0000 7f22b8dff700 1 --2- 172.21.15.81:0/2347506715 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22b40686d0 0x7f22b40b53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:36.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.836+0000 7f22b8dff700 1 --2- 172.21.15.81:0/2347506715 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2294066f30 0x7f22940693e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:36.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.836+0000 7f22b8dff700 1 --2- 172.21.15.81:0/2347506715 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f22b4068aa0 0x7f22b40b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:36.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.836+0000 7f22b8dff700 1 -- 172.21.15.81:0/2347506715 >> 172.21.15.81:0/2347506715 conn(0x7f22b406ed10 msgr2=0x7f22b41569e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:36.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.836+0000 7f22b8dff700 1 -- 172.21.15.81:0/2347506715 shutdown_connections 2023-10-06T03:24:36.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:36.836+0000 7f22b8dff700 1 -- 172.21.15.81:0/2347506715 wait complete. 2023-10-06T03:24:36.854 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:24:37.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.034+0000 7fdb54dff700 1 Processor -- start 2023-10-06T03:24:37.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.034+0000 7fdb54dff700 1 -- start start 2023-10-06T03:24:37.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.035+0000 7fdb54dff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdb500cbe60 0x7fdb500cc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:37.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.035+0000 7fdb54dff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fdb500c8e90 0x7fdb500c92a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:37.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.035+0000 7fdb54dff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb500cc810 con 0x7fdb50142d70 2023-10-06T03:24:37.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.035+0000 7fdb54dff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb500c8a00 con 0x7fdb500cbe60 2023-10-06T03:24:37.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.035+0000 7fdb54dff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb5006bbc0 con 0x7fdb500c8e90 2023-10-06T03:24:37.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.036+0000 7fdb4dd9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdb500cbe60 0x7fdb500cc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:37.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.036+0000 7fdb4dd9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdb500cbe60 0x7fdb500cc2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55744/0 (socket says 172.21.15.81:55744) 2023-10-06T03:24:37.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.036+0000 7fdb4dd9b700 1 -- 172.21.15.81:0/3585839322 learned_addr learned my addr 172.21.15.81:0/3585839322 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:37.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.036+0000 7fdb4ed9d700 1 --2- 172.21.15.81:0/3585839322 >> v2:172.21.15.83:3300/0 conn(0x7fdb500c8e90 0x7fdb500c92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:37.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.036+0000 7fdb4dd9b700 1 -- 172.21.15.81:0/3585839322 >> v2:172.21.15.83:3300/0 conn(0x7fdb500c8e90 msgr2=0x7fdb500c92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:37.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.036+0000 7fdb4dd9b700 1 --2- 172.21.15.81:0/3585839322 >> v2:172.21.15.83:3300/0 conn(0x7fdb500c8e90 0x7fdb500c92a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:37.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.036+0000 7fdb4dd9b700 1 -- 172.21.15.81:0/3585839322 >> v1:172.21.15.83:6789/0 conn(0x7fdb50142d70 legacy=0x7fdb50069730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:37.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.036+0000 7fdb4dd9b700 1 -- 172.21.15.81:0/3585839322 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb5006bea0 con 0x7fdb500cbe60 2023-10-06T03:24:37.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.036+0000 7fdb4ed9d700 1 --2- 172.21.15.81:0/3585839322 >> v2:172.21.15.83:3300/0 conn(0x7fdb500c8e90 0x7fdb500c92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:37.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.036+0000 7fdb4dd9b700 1 --2- 172.21.15.81:0/3585839322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb500cbe60 0x7fdb500cc2d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fdb500cf370 tx=0x7fdb44009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=594e18bbc73cbc8c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:37.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.037+0000 7fdb4d59a700 1 -- 172.21.15.81:0/3585839322 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4400b860 con 0x7fdb500cbe60 2023-10-06T03:24:37.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.037+0000 7fdb4d59a700 1 -- 172.21.15.81:0/3585839322 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb4400b9c0 con 0x7fdb500cbe60 2023-10-06T03:24:37.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.037+0000 7fdb4d59a700 1 -- 172.21.15.81:0/3585839322 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4400bd60 con 0x7fdb500cbe60 2023-10-06T03:24:37.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.037+0000 7fdb54dff700 1 -- 172.21.15.81:0/3585839322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb500cbe60 msgr2=0x7fdb500cc2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:37.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.037+0000 7fdb54dff700 1 --2- 172.21.15.81:0/3585839322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb500cbe60 0x7fdb500cc2d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fdb500cf370 tx=0x7fdb44009250 comp rx=0 tx=0).stop 2023-10-06T03:24:37.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.037+0000 7fdb54dff700 1 -- 172.21.15.81:0/3585839322 shutdown_connections 2023-10-06T03:24:37.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.037+0000 7fdb54dff700 1 --2- 172.21.15.81:0/3585839322 >> v2:172.21.15.83:3300/0 conn(0x7fdb500c8e90 0x7fdb500c92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:37.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.037+0000 7fdb54dff700 1 --2- 172.21.15.81:0/3585839322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb500cbe60 0x7fdb500cc2d0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:37.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.037+0000 7fdb54dff700 1 -- 172.21.15.81:0/3585839322 >> 172.21.15.81:0/3585839322 conn(0x7fdb500ce290 msgr2=0x7fdb500ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:37.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.037+0000 7fdb54dff700 1 -- 172.21.15.81:0/3585839322 shutdown_connections 2023-10-06T03:24:37.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.037+0000 7fdb54dff700 1 -- 172.21.15.81:0/3585839322 wait complete. 2023-10-06T03:24:37.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.039+0000 7fdb54dff700 1 Processor -- start 2023-10-06T03:24:37.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.039+0000 7fdb54dff700 1 -- start start 2023-10-06T03:24:37.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.040+0000 7fdb54dff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdb500c8e90 0x7fdb501579b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:37.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.040+0000 7fdb54dff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb500cbe60 0x7fdb500b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:37.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.040+0000 7fdb54dff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdb50142d70 0x7fdb501402f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:37.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.040+0000 7fdb54dff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb500b2e80 con 0x7fdb500cbe60 2023-10-06T03:24:37.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.040+0000 7fdb54dff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb500b28c0 con 0x7fdb50142d70 2023-10-06T03:24:37.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.040+0000 7fdb54dff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb500b2ba0 con 0x7fdb500c8e90 2023-10-06T03:24:37.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.040+0000 7fdb4dd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb500cbe60 0x7fdb500b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:37.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.040+0000 7fdb4dd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb500cbe60 0x7fdb500b1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55758/0 (socket says 172.21.15.81:55758) 2023-10-06T03:24:37.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.040+0000 7fdb4dd9b700 1 -- 172.21.15.81:0/2088671662 learned_addr learned my addr 172.21.15.81:0/2088671662 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:37.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.040+0000 7fdb4dd9b700 1 -- 172.21.15.81:0/2088671662 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdb500c8e90 msgr2=0x7fdb501579b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:37.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.040+0000 7fdb4ed9d700 1 --2- 172.21.15.81:0/2088671662 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdb50142d70 0x7fdb501402f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:37.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.040+0000 7fdb4e59c700 1 --2- 172.21.15.81:0/2088671662 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdb500c8e90 0x7fdb501579b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:37.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.040+0000 7fdb4dd9b700 1 --2- 172.21.15.81:0/2088671662 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdb500c8e90 0x7fdb501579b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:37.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.040+0000 7fdb4dd9b700 1 -- 172.21.15.81:0/2088671662 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdb50142d70 msgr2=0x7fdb501402f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:37.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.040+0000 7fdb4dd9b700 1 --2- 172.21.15.81:0/2088671662 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdb50142d70 0x7fdb501402f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:37.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.040+0000 7fdb4dd9b700 1 -- 172.21.15.81:0/2088671662 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb440094f0 con 0x7fdb500cbe60 2023-10-06T03:24:37.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.040+0000 7fdb4ed9d700 1 --2- 172.21.15.81:0/2088671662 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdb50142d70 0x7fdb501402f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:37.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.040+0000 7fdb4e59c700 1 --2- 172.21.15.81:0/2088671662 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdb500c8e90 0x7fdb501579b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:37.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.041+0000 7fdb4dd9b700 1 --2- 172.21.15.81:0/2088671662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb500cbe60 0x7fdb500b1ed0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fdb44009290 tx=0x7fdb44017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:37.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.041+0000 7fdb3e7fc700 1 -- 172.21.15.81:0/2088671662 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb44011e60 con 0x7fdb500cbe60 2023-10-06T03:24:37.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.041+0000 7fdb3e7fc700 1 -- 172.21.15.81:0/2088671662 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb4401f070 con 0x7fdb500cbe60 2023-10-06T03:24:37.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.041+0000 7fdb3e7fc700 1 -- 172.21.15.81:0/2088671662 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4401a870 con 0x7fdb500cbe60 2023-10-06T03:24:37.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.041+0000 7fdb54dff700 1 -- 172.21.15.81:0/2088671662 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb5013b740 con 0x7fdb500cbe60 2023-10-06T03:24:37.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.041+0000 7fdb54dff700 1 -- 172.21.15.81:0/2088671662 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb50157ef0 con 0x7fdb500cbe60 2023-10-06T03:24:37.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.042+0000 7fdb54dff700 1 -- 172.21.15.81:0/2088671662 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb5013bc60 con 0x7fdb500cbe60 2023-10-06T03:24:37.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.043+0000 7fdb3e7fc700 1 -- 172.21.15.81:0/2088671662 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdb4401abe0 con 0x7fdb500cbe60 2023-10-06T03:24:37.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.044+0000 7fdb3e7fc700 1 --2- 172.21.15.81:0/2088671662 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fdb30066f30 0x7fdb300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:37.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.044+0000 7fdb3e7fc700 1 -- 172.21.15.81:0/2088671662 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fdb44021070 con 0x7fdb500cbe60 2023-10-06T03:24:37.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.044+0000 7fdb4e59c700 1 --2- 172.21.15.81:0/2088671662 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fdb30066f30 0x7fdb300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:37.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.045+0000 7fdb4e59c700 1 --2- 172.21.15.81:0/2088671662 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fdb30066f30 0x7fdb300693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdb50069280 tx=0x7fdb40009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:37.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.048+0000 7fdb3e7fc700 1 -- 172.21.15.81:0/2088671662 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdb5013bc60 con 0x7fdb500cbe60 2023-10-06T03:24:37.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.278+0000 7fdb54dff700 1 -- 172.21.15.81:0/2088671662 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdb5013bc60 con 0x7fdb500cbe60 2023-10-06T03:24:37.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.279+0000 7fdb3e7fc700 1 -- 172.21.15.81:0/2088671662 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4590 (secure 0 0 0) 0x7fdb5013bc60 con 0x7fdb500cbe60 2023-10-06T03:24:37.280 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:24:37.280 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1255569320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1255569320},{"type":"v1","addr":"172.21.15.83:6835","nonce":1255569320}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1673166762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1673166762},{"type":"v1","addr":"172.21.15.81:6835","nonce":1673166762}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3689326153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3689326153},{"type":"v1","addr":"172.21.15.81:6837","nonce":3689326153}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:23:40.376852+0000","modified":"2023-10-06T03:23:56.657619+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6833/745669616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":745669616},{"type":"v1","addr":"172.21.15.83:6833","nonce":745669616}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T03:24:37.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.281+0000 7fdb54dff700 1 -- 172.21.15.81:0/2088671662 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fdb30066f30 msgr2=0x7fdb300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:37.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.281+0000 7fdb54dff700 1 --2- 172.21.15.81:0/2088671662 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fdb30066f30 0x7fdb300693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdb50069280 tx=0x7fdb40009040 comp rx=0 tx=0).stop 2023-10-06T03:24:37.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.281+0000 7fdb54dff700 1 -- 172.21.15.81:0/2088671662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb500cbe60 msgr2=0x7fdb500b1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:37.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.281+0000 7fdb54dff700 1 --2- 172.21.15.81:0/2088671662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb500cbe60 0x7fdb500b1ed0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fdb44009290 tx=0x7fdb44017000 comp rx=0 tx=0).stop 2023-10-06T03:24:37.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.281+0000 7fdb54dff700 1 -- 172.21.15.81:0/2088671662 shutdown_connections 2023-10-06T03:24:37.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.281+0000 7fdb54dff700 1 --2- 172.21.15.81:0/2088671662 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdb50142d70 0x7fdb501402f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:37.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.281+0000 7fdb54dff700 1 --2- 172.21.15.81:0/2088671662 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fdb30066f30 0x7fdb300693e0 secure :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdb50069280 tx=0x7fdb40009040 comp rx=0 tx=0).stop 2023-10-06T03:24:37.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.281+0000 7fdb54dff700 1 --2- 172.21.15.81:0/2088671662 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdb500c8e90 0x7fdb501579b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:37.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.281+0000 7fdb54dff700 1 --2- 172.21.15.81:0/2088671662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb500cbe60 0x7fdb500b1ed0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:37.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.281+0000 7fdb54dff700 1 -- 172.21.15.81:0/2088671662 >> 172.21.15.81:0/2088671662 conn(0x7fdb500ce290 msgr2=0x7fdb50158b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:37.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.282+0000 7fdb54dff700 1 -- 172.21.15.81:0/2088671662 shutdown_connections 2023-10-06T03:24:37.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.282+0000 7fdb54dff700 1 -- 172.21.15.81:0/2088671662 wait complete. 2023-10-06T03:24:37.284 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2023-10-06T03:24:37.300 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:24:37.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.478+0000 7ff11e5ff700 1 Processor -- start 2023-10-06T03:24:37.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.478+0000 7ff11e5ff700 1 -- start start 2023-10-06T03:24:37.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.479+0000 7ff11e5ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff1181557f0 0x7ff118156c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:37.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.479+0000 7ff11e5ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff118069ee0 0x7ff11806a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:37.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.479+0000 7ff11e5ff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1180c9c60 con 0x7ff118155bc0 2023-10-06T03:24:37.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.479+0000 7ff11e5ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff11806df20 con 0x7ff1181557f0 2023-10-06T03:24:37.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.479+0000 7ff11e5ff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff11806a860 con 0x7ff118069ee0 2023-10-06T03:24:37.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.480+0000 7ff117fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff1181557f0 0x7ff118156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:37.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.480+0000 7ff117fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff1181557f0 0x7ff118156c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55766/0 (socket says 172.21.15.81:55766) 2023-10-06T03:24:37.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.480+0000 7ff117fff700 1 -- 172.21.15.81:0/939631336 learned_addr learned my addr 172.21.15.81:0/939631336 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:37.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.480+0000 7ff11cb9c700 1 --2- 172.21.15.81:0/939631336 >> v2:172.21.15.83:3300/0 conn(0x7ff118069ee0 0x7ff11806a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:37.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.480+0000 7ff117fff700 1 -- 172.21.15.81:0/939631336 >> v2:172.21.15.83:3300/0 conn(0x7ff118069ee0 msgr2=0x7ff11806a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:37.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.480+0000 7ff117fff700 1 --2- 172.21.15.81:0/939631336 >> v2:172.21.15.83:3300/0 conn(0x7ff118069ee0 0x7ff11806a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:37.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.480+0000 7ff117fff700 1 -- 172.21.15.81:0/939631336 >> v1:172.21.15.83:6789/0 conn(0x7ff118155bc0 legacy=0x7ff1180c6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:37.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.480+0000 7ff117fff700 1 -- 172.21.15.81:0/939631336 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff11806dc60 con 0x7ff1181557f0 2023-10-06T03:24:37.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.480+0000 7ff117fff700 1 --2- 172.21.15.81:0/939631336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1181557f0 0x7ff118156c90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff1180aebb0 tx=0x7ff10800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b634ec77c0508ac7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:37.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.481+0000 7ff116ffd700 1 -- 172.21.15.81:0/939631336 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10800dba0 con 0x7ff1181557f0 2023-10-06T03:24:37.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.481+0000 7ff116ffd700 1 -- 172.21.15.81:0/939631336 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff10800dd00 con 0x7ff1181557f0 2023-10-06T03:24:37.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.481+0000 7ff116ffd700 1 -- 172.21.15.81:0/939631336 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1080196d0 con 0x7ff1181557f0 2023-10-06T03:24:37.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.481+0000 7ff11e5ff700 1 -- 172.21.15.81:0/939631336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1181557f0 msgr2=0x7ff118156c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:37.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.481+0000 7ff11e5ff700 1 --2- 172.21.15.81:0/939631336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1181557f0 0x7ff118156c90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff1180aebb0 tx=0x7ff10800b4f0 comp rx=0 tx=0).stop 2023-10-06T03:24:37.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.481+0000 7ff11e5ff700 1 -- 172.21.15.81:0/939631336 shutdown_connections 2023-10-06T03:24:37.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.481+0000 7ff11e5ff700 1 --2- 172.21.15.81:0/939631336 >> v2:172.21.15.83:3300/0 conn(0x7ff118069ee0 0x7ff11806a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:37.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.481+0000 7ff11e5ff700 1 --2- 172.21.15.81:0/939631336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1181557f0 0x7ff118156c90 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:37.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.481+0000 7ff11e5ff700 1 -- 172.21.15.81:0/939631336 >> 172.21.15.81:0/939631336 conn(0x7ff1180cc090 msgr2=0x7ff1180cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:37.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.481+0000 7ff11e5ff700 1 -- 172.21.15.81:0/939631336 shutdown_connections 2023-10-06T03:24:37.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.481+0000 7ff11e5ff700 1 -- 172.21.15.81:0/939631336 wait complete. 2023-10-06T03:24:37.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.483+0000 7ff11e5ff700 1 Processor -- start 2023-10-06T03:24:37.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.483+0000 7ff11e5ff700 1 -- start start 2023-10-06T03:24:37.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.484+0000 7ff11e5ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff118069ee0 0x7ff118157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:37.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.484+0000 7ff11e5ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1181557f0 0x7ff118150730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:37.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.484+0000 7ff11e5ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff118155bc0 0x7ff1180c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:37.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.484+0000 7ff11e5ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff11814d9f0 con 0x7ff118069ee0 2023-10-06T03:24:37.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.484+0000 7ff11e5ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff118157610 con 0x7ff1181557f0 2023-10-06T03:24:37.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.484+0000 7ff11e5ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1181578f0 con 0x7ff118155bc0 2023-10-06T03:24:37.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.484+0000 7ff117fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff118069ee0 0x7ff118157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:37.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.484+0000 7ff117fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff118069ee0 0x7ff118157030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55782/0 (socket says 172.21.15.81:55782) 2023-10-06T03:24:37.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.484+0000 7ff117fff700 1 -- 172.21.15.81:0/3494437367 learned_addr learned my addr 172.21.15.81:0/3494437367 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:37.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.484+0000 7ff11cb9c700 1 --2- 172.21.15.81:0/3494437367 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff118155bc0 0x7ff1180c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:37.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.484+0000 7ff1177fe700 1 --2- 172.21.15.81:0/3494437367 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1181557f0 0x7ff118150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:37.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.484+0000 7ff117fff700 1 -- 172.21.15.81:0/3494437367 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff118155bc0 msgr2=0x7ff1180c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:37.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.484+0000 7ff117fff700 1 --2- 172.21.15.81:0/3494437367 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff118155bc0 0x7ff1180c5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:37.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.484+0000 7ff117fff700 1 -- 172.21.15.81:0/3494437367 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1181557f0 msgr2=0x7ff118150730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:37.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.484+0000 7ff117fff700 1 --2- 172.21.15.81:0/3494437367 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1181557f0 0x7ff118150730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:37.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.484+0000 7ff117fff700 1 -- 172.21.15.81:0/3494437367 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff10800b790 con 0x7ff118069ee0 2023-10-06T03:24:37.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.484+0000 7ff1177fe700 1 --2- 172.21.15.81:0/3494437367 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1181557f0 0x7ff118150730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:37.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.485+0000 7ff117fff700 1 --2- 172.21.15.81:0/3494437367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff118069ee0 0x7ff118157030 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff1180690e0 tx=0x7ff10801b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:37.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.485+0000 7ff0fffff700 1 -- 172.21.15.81:0/3494437367 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff108010680 con 0x7ff118069ee0 2023-10-06T03:24:37.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.485+0000 7ff0fffff700 1 -- 172.21.15.81:0/3494437367 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff108010800 con 0x7ff118069ee0 2023-10-06T03:24:37.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.485+0000 7ff0fffff700 1 -- 172.21.15.81:0/3494437367 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff108010bc0 con 0x7ff118069ee0 2023-10-06T03:24:37.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.485+0000 7ff11e5ff700 1 -- 172.21.15.81:0/3494437367 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff11814dc40 con 0x7ff118069ee0 2023-10-06T03:24:37.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.485+0000 7ff11e5ff700 1 -- 172.21.15.81:0/3494437367 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff118150c70 con 0x7ff118069ee0 2023-10-06T03:24:37.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.486+0000 7ff11e5ff700 1 -- 172.21.15.81:0/3494437367 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff11804c3c0 con 0x7ff118069ee0 2023-10-06T03:24:37.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.487+0000 7ff0fffff700 1 -- 172.21.15.81:0/3494437367 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff1080183e0 con 0x7ff118069ee0 2023-10-06T03:24:37.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.488+0000 7ff0fffff700 1 --2- 172.21.15.81:0/3494437367 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff104066f30 0x7ff1040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:37.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.488+0000 7ff0fffff700 1 -- 172.21.15.81:0/3494437367 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6867+0+0 (secure 0 0 0) 0x7ff108014070 con 0x7ff118069ee0 2023-10-06T03:24:37.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.488+0000 7ff1177fe700 1 --2- 172.21.15.81:0/3494437367 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff104066f30 0x7ff1040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:37.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.488+0000 7ff1177fe700 1 --2- 172.21.15.81:0/3494437367 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff104066f30 0x7ff1040693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff10c007fd0 tx=0x7ff10c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:37.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.492+0000 7ff0fffff700 1 -- 172.21.15.81:0/3494437367 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff1080531b0 con 0x7ff118069ee0 2023-10-06T03:24:37.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.682+0000 7ff11e5ff700 1 -- 172.21.15.81:0/3494437367 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1180c2940 con 0x7ff118069ee0 2023-10-06T03:24:37.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.683+0000 7ff0fffff700 1 -- 172.21.15.81:0/3494437367 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18754 (secure 0 0 0) 0x7ff1080567d0 con 0x7ff118069ee0 2023-10-06T03:24:37.685 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:24:37.685 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"1807b5d7-9be8-43ad-aaf8-99a4273430b3","created":"2023-10-06T03:23:20.805306+0000","modified":"2023-10-06T03:24:28.774889+0000","last_up_change":"2023-10-06T03:23:32.735796+0000","last_in_change":"2023-10-06T03:23:24.109024+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:33.198850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:33.606744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:23:38.742266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:23:39.347944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:23:42.959054+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"14fb667d-a677-4978-a477-80027f889d36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":85563},{"type":"v1","addr":"172.21.15.81:6818","nonce":85563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":85563},{"type":"v1","addr":"172.21.15.81:6822","nonce":85563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":85563},{"type":"v1","addr":"172.21.15.81:6830","nonce":85563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":85563},{"type":"v1","addr":"172.21.15.81:6826","nonce":85563}]},"public_addr":"172.21.15.81:6818/85563","cluster_addr":"172.21.15.81:6822/85563","heartbeat_back_addr":"172.21.15.81:6830/85563","heartbeat_front_addr":"172.21.15.81:6826/85563","state":["exists","up"]},{"osd":1,"uuid":"974d8a86-1829-4176-89ce-18e6038857f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":85561},{"type":"v1","addr":"172.21.15.81:6801","nonce":85561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":85561},{"type":"v1","addr":"172.21.15.81:6803","nonce":85561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":85561},{"type":"v1","addr":"172.21.15.81:6807","nonce":85561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":85561},{"type":"v1","addr":"172.21.15.81:6805","nonce":85561}]},"public_addr":"172.21.15.81:6801/85561","cluster_addr":"172.21.15.81:6803/85561","heartbeat_back_addr":"172.21.15.81:6807/85561","heartbeat_front_addr":"172.21.15.81:6805/85561","state":["exists","up"]},{"osd":2,"uuid":"ffbfe056-46bc-46e0-bf49-4d8f8650e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":85564},{"type":"v1","addr":"172.21.15.81:6809","nonce":85564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":85564},{"type":"v1","addr":"172.21.15.81:6811","nonce":85564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":85564},{"type":"v1","addr":"172.21.15.81:6815","nonce":85564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":85564},{"type":"v1","addr":"172.21.15.81:6813","nonce":85564}]},"public_addr":"172.21.15.81:6809/85564","cluster_addr":"172.21.15.81:6811/85564","heartbeat_back_addr":"172.21.15.81:6815/85564","heartbeat_front_addr":"172.21.15.81:6813/85564","state":["exists","up"]},{"osd":3,"uuid":"ef9a8314-3d37-4ea1-858a-e704d5695002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":85562},{"type":"v1","addr":"172.21.15.81:6819","nonce":85562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":85562},{"type":"v1","addr":"172.21.15.81:6823","nonce":85562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":85562},{"type":"v1","addr":"172.21.15.81:6831","nonce":85562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":85562},{"type":"v1","addr":"172.21.15.81:6827","nonce":85562}]},"public_addr":"172.21.15.81:6819/85562","cluster_addr":"172.21.15.81:6823/85562","heartbeat_back_addr":"172.21.15.81:6831/85562","heartbeat_front_addr":"172.21.15.81:6827/85562","state":["exists","up"]},{"osd":4,"uuid":"d83506a0-2c96-4bcb-a9fa-05e43dc329df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":85785},{"type":"v1","addr":"172.21.15.83:6801","nonce":85785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":85785},{"type":"v1","addr":"172.21.15.83:6803","nonce":85785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":85785},{"type":"v1","addr":"172.21.15.83:6807","nonce":85785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":85785},{"type":"v1","addr":"172.21.15.83:6805","nonce":85785}]},"public_addr":"172.21.15.83:6801/85785","cluster_addr":"172.21.15.83:6803/85785","heartbeat_back_addr":"172.21.15.83:6807/85785","heartbeat_front_addr":"172.21.15.83:6805/85785","state":["exists","up"]},{"osd":5,"uuid":"10687c63-a3d5-472f-acc0-4f61847b6e0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":85818},{"type":"v1","addr":"172.21.15.83:6825","nonce":85818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":85818},{"type":"v1","addr":"172.21.15.83:6827","nonce":85818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":85818},{"type":"v1","addr":"172.21.15.83:6831","nonce":85818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":85818},{"type":"v1","addr":"172.21.15.83:6829","nonce":85818}]},"public_addr":"172.21.15.83:6825/85818","cluster_addr":"172.21.15.83:6827/85818","heartbeat_back_addr":"172.21.15.83:6831/85818","heartbeat_front_addr":"172.21.15.83:6829/85818","state":["exists","up"]},{"osd":6,"uuid":"2e9daf76-5607-4a29-9a58-6e270700d223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":85787},{"type":"v1","addr":"172.21.15.83:6811","nonce":85787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":85787},{"type":"v1","addr":"172.21.15.83:6815","nonce":85787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":85787},{"type":"v1","addr":"172.21.15.83:6823","nonce":85787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6817","nonce":85787},{"type":"v1","addr":"172.21.15.83:6819","nonce":85787}]},"public_addr":"172.21.15.83:6811/85787","cluster_addr":"172.21.15.83:6815/85787","heartbeat_back_addr":"172.21.15.83:6823/85787","heartbeat_front_addr":"172.21.15.83:6819/85787","state":["exists","up"]},{"osd":7,"uuid":"5019e1ff-233a-4a5a-91ca-8afccb7ab6e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":85786},{"type":"v1","addr":"172.21.15.83:6810","nonce":85786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":85786},{"type":"v1","addr":"172.21.15.83:6814","nonce":85786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":85786},{"type":"v1","addr":"172.21.15.83:6822","nonce":85786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":85786},{"type":"v1","addr":"172.21.15.83:6818","nonce":85786}]},"public_addr":"172.21.15.83:6810/85786","cluster_addr":"172.21.15.83:6814/85786","heartbeat_back_addr":"172.21.15.83:6822/85786","heartbeat_front_addr":"172.21.15.83:6818/85786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.393431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.360031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.407428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.391613+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.403211+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.438142+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.496181+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.472323+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":1,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:24:37.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.686+0000 7ff11e5ff700 1 -- 172.21.15.81:0/3494437367 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff104066f30 msgr2=0x7ff1040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:37.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.686+0000 7ff11e5ff700 1 --2- 172.21.15.81:0/3494437367 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff104066f30 0x7ff1040693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff10c007fd0 tx=0x7ff10c009040 comp rx=0 tx=0).stop 2023-10-06T03:24:37.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.686+0000 7ff11e5ff700 1 -- 172.21.15.81:0/3494437367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff118069ee0 msgr2=0x7ff118157030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:37.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.686+0000 7ff11e5ff700 1 --2- 172.21.15.81:0/3494437367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff118069ee0 0x7ff118157030 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff1180690e0 tx=0x7ff10801b000 comp rx=0 tx=0).stop 2023-10-06T03:24:37.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.686+0000 7ff11e5ff700 1 -- 172.21.15.81:0/3494437367 shutdown_connections 2023-10-06T03:24:37.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.686+0000 7ff11e5ff700 1 --2- 172.21.15.81:0/3494437367 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff104066f30 0x7ff1040693e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:37.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.686+0000 7ff11e5ff700 1 --2- 172.21.15.81:0/3494437367 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff118155bc0 0x7ff1180c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:37.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.686+0000 7ff11e5ff700 1 --2- 172.21.15.81:0/3494437367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff118069ee0 0x7ff118157030 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:37.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.686+0000 7ff11e5ff700 1 --2- 172.21.15.81:0/3494437367 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1181557f0 0x7ff118150730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:37.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.686+0000 7ff11e5ff700 1 -- 172.21.15.81:0/3494437367 >> 172.21.15.81:0/3494437367 conn(0x7ff1180cc090 msgr2=0x7ff1180c2230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:37.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.686+0000 7ff11e5ff700 1 -- 172.21.15.81:0/3494437367 shutdown_connections 2023-10-06T03:24:37.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.686+0000 7ff11e5ff700 1 -- 172.21.15.81:0/3494437367 wait complete. 2023-10-06T03:24:37.704 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T03:24:37.704 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:24:37.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.885+0000 7f75335ff700 1 Processor -- start 2023-10-06T03:24:37.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.885+0000 7f75335ff700 1 -- start start 2023-10-06T03:24:37.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.886+0000 7f75335ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f752c1557f0 0x7f752c156c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:37.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.887+0000 7f75335ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f752c155bc0 0x7f752c0c6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:37.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.887+0000 7f75335ff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f752c0c9c60 con 0x7f752c069ee0 2023-10-06T03:24:37.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.887+0000 7f75335ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f752c06df20 con 0x7f752c1557f0 2023-10-06T03:24:37.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.887+0000 7f75335ff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f752c0c74e0 con 0x7f752c155bc0 2023-10-06T03:24:37.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.887+0000 7f753139b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f752c1557f0 0x7f752c156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:37.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.887+0000 7f753139b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f752c1557f0 0x7f752c156c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55788/0 (socket says 172.21.15.81:55788) 2023-10-06T03:24:37.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.887+0000 7f753139b700 1 -- 172.21.15.81:0/1856108441 learned_addr learned my addr 172.21.15.81:0/1856108441 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:37.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.887+0000 7f7530b9a700 1 --2- 172.21.15.81:0/1856108441 >> v2:172.21.15.83:3300/0 conn(0x7f752c155bc0 0x7f752c0c6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:37.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.887+0000 7f753139b700 1 -- 172.21.15.81:0/1856108441 >> v2:172.21.15.83:3300/0 conn(0x7f752c155bc0 msgr2=0x7f752c0c6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:37.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.887+0000 7f753139b700 1 --2- 172.21.15.81:0/1856108441 >> v2:172.21.15.83:3300/0 conn(0x7f752c155bc0 0x7f752c0c6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:37.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.887+0000 7f753139b700 1 -- 172.21.15.81:0/1856108441 >> v1:172.21.15.83:6789/0 conn(0x7f752c069ee0 legacy=0x7f752c159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:37.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.887+0000 7f753139b700 1 -- 172.21.15.81:0/1856108441 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f752c06dc60 con 0x7f752c1557f0 2023-10-06T03:24:37.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.887+0000 7f7530b9a700 1 --2- 172.21.15.81:0/1856108441 >> v2:172.21.15.83:3300/0 conn(0x7f752c155bc0 0x7f752c0c6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:37.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.888+0000 7f753139b700 1 --2- 172.21.15.81:0/1856108441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f752c1557f0 0x7f752c156c90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f752c0cd0c0 tx=0x7f752800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=355b7f713eaaa557 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:37.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.888+0000 7f7523fff700 1 -- 172.21.15.81:0/1856108441 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752800dc10 con 0x7f752c1557f0 2023-10-06T03:24:37.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.888+0000 7f7523fff700 1 -- 172.21.15.81:0/1856108441 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752800dd70 con 0x7f752c1557f0 2023-10-06T03:24:37.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.888+0000 7f7523fff700 1 -- 172.21.15.81:0/1856108441 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75280106c0 con 0x7f752c1557f0 2023-10-06T03:24:37.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.888+0000 7f75335ff700 1 -- 172.21.15.81:0/1856108441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f752c1557f0 msgr2=0x7f752c156c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:37.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.888+0000 7f75335ff700 1 --2- 172.21.15.81:0/1856108441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f752c1557f0 0x7f752c156c90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f752c0cd0c0 tx=0x7f752800b4f0 comp rx=0 tx=0).stop 2023-10-06T03:24:37.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.888+0000 7f75335ff700 1 -- 172.21.15.81:0/1856108441 shutdown_connections 2023-10-06T03:24:37.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.888+0000 7f75335ff700 1 --2- 172.21.15.81:0/1856108441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f752c1557f0 0x7f752c156c90 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:37.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.888+0000 7f75335ff700 1 --2- 172.21.15.81:0/1856108441 >> v2:172.21.15.83:3300/0 conn(0x7f752c155bc0 0x7f752c0c6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:37.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.888+0000 7f75335ff700 1 -- 172.21.15.81:0/1856108441 >> 172.21.15.81:0/1856108441 conn(0x7f752c0cc090 msgr2=0x7f752c0cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:37.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.888+0000 7f75335ff700 1 -- 172.21.15.81:0/1856108441 shutdown_connections 2023-10-06T03:24:37.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.889+0000 7f75335ff700 1 -- 172.21.15.81:0/1856108441 wait complete. 2023-10-06T03:24:37.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.890+0000 7f75335ff700 1 Processor -- start 2023-10-06T03:24:37.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.890+0000 7f75335ff700 1 -- start start 2023-10-06T03:24:37.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.891+0000 7f75335ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f752c069ee0 0x7f752c14ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:37.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.891+0000 7f75335ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f752c1557f0 0x7f752c157c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:37.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.891+0000 7f75335ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f752c155bc0 0x7f752c158190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:37.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.891+0000 7f75335ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752c0c3140 con 0x7f752c1557f0 2023-10-06T03:24:37.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.891+0000 7f75335ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752c0c3fa0 con 0x7f752c155bc0 2023-10-06T03:24:37.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.891+0000 7f75335ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f752c0c3390 con 0x7f752c069ee0 2023-10-06T03:24:37.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.891+0000 7f7530b9a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f752c1557f0 0x7f752c157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:37.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.891+0000 7f753139b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f752c069ee0 0x7f752c14ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:37.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.891+0000 7f7530b9a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f752c1557f0 0x7f752c157c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55790/0 (socket says 172.21.15.81:55790) 2023-10-06T03:24:37.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.891+0000 7f7530b9a700 1 -- 172.21.15.81:0/2970922970 learned_addr learned my addr 172.21.15.81:0/2970922970 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:37.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.891+0000 7f7531b9c700 1 --2- 172.21.15.81:0/2970922970 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f752c155bc0 0x7f752c158190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:37.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.892+0000 7f7530b9a700 1 -- 172.21.15.81:0/2970922970 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f752c069ee0 msgr2=0x7f752c14ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:37.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.892+0000 7f7530b9a700 1 --2- 172.21.15.81:0/2970922970 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f752c069ee0 0x7f752c14ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:37.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.892+0000 7f7530b9a700 1 -- 172.21.15.81:0/2970922970 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f752c155bc0 msgr2=0x7f752c158190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:37.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.892+0000 7f7530b9a700 1 --2- 172.21.15.81:0/2970922970 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f752c155bc0 0x7f752c158190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:37.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.892+0000 7f7530b9a700 1 -- 172.21.15.81:0/2970922970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f752800b790 con 0x7f752c1557f0 2023-10-06T03:24:37.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.892+0000 7f7530b9a700 1 --2- 172.21.15.81:0/2970922970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f752c1557f0 0x7f752c157c50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f751c00c830 tx=0x7f751c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:37.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.892+0000 7f75217fa700 1 -- 172.21.15.81:0/2970922970 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751c011600 con 0x7f752c1557f0 2023-10-06T03:24:37.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.892+0000 7f75217fa700 1 -- 172.21.15.81:0/2970922970 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751c011760 con 0x7f752c1557f0 2023-10-06T03:24:37.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.892+0000 7f75217fa700 1 -- 172.21.15.81:0/2970922970 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751c011b20 con 0x7f752c1557f0 2023-10-06T03:24:37.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.892+0000 7f75335ff700 1 -- 172.21.15.81:0/2970922970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f752c0c3670 con 0x7f752c1557f0 2023-10-06T03:24:37.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.892+0000 7f75335ff700 1 -- 172.21.15.81:0/2970922970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f752c0c3c30 con 0x7f752c1557f0 2023-10-06T03:24:37.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.893+0000 7f75335ff700 1 -- 172.21.15.81:0/2970922970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f752c04c3c0 con 0x7f752c1557f0 2023-10-06T03:24:37.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.894+0000 7f75217fa700 1 -- 172.21.15.81:0/2970922970 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f751c018360 con 0x7f752c1557f0 2023-10-06T03:24:37.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.895+0000 7f75217fa700 1 --2- 172.21.15.81:0/2970922970 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7510066f30 0x7f75100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:37.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.896+0000 7f75217fa700 1 -- 172.21.15.81:0/2970922970 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f751c084950 con 0x7f752c1557f0 2023-10-06T03:24:37.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.896+0000 7f753139b700 1 --2- 172.21.15.81:0/2970922970 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7510066f30 0x7f75100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:37.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.896+0000 7f753139b700 1 --2- 172.21.15.81:0/2970922970 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7510066f30 0x7f75100693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f752c0cd0c0 tx=0x7f752801a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:37.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:37.900+0000 7f75217fa700 1 -- 172.21.15.81:0/2970922970 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f751c051730 con 0x7f752c1557f0 2023-10-06T03:24:38.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.134+0000 7f75335ff700 1 -- 172.21.15.81:0/2970922970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f752c06ac40 con 0x7f752c1557f0 2023-10-06T03:24:38.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.135+0000 7f75217fa700 1 -- 172.21.15.81:0/2970922970 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4590 (secure 0 0 0) 0x7f751c054d50 con 0x7f752c1557f0 2023-10-06T03:24:38.136 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:24:38.136 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1255569320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1255569320},{"type":"v1","addr":"172.21.15.83:6835","nonce":1255569320}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1673166762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1673166762},{"type":"v1","addr":"172.21.15.81:6835","nonce":1673166762}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3689326153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3689326153},{"type":"v1","addr":"172.21.15.81:6837","nonce":3689326153}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:23:40.376852+0000","modified":"2023-10-06T03:23:56.657619+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6833/745669616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":745669616},{"type":"v1","addr":"172.21.15.83:6833","nonce":745669616}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T03:24:38.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.137+0000 7f75335ff700 1 -- 172.21.15.81:0/2970922970 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7510066f30 msgr2=0x7f75100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:38.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.137+0000 7f75335ff700 1 --2- 172.21.15.81:0/2970922970 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7510066f30 0x7f75100693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f752c0cd0c0 tx=0x7f752801a000 comp rx=0 tx=0).stop 2023-10-06T03:24:38.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.137+0000 7f75335ff700 1 -- 172.21.15.81:0/2970922970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f752c1557f0 msgr2=0x7f752c157c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:38.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.137+0000 7f75335ff700 1 --2- 172.21.15.81:0/2970922970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f752c1557f0 0x7f752c157c50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f751c00c830 tx=0x7f751c008040 comp rx=0 tx=0).stop 2023-10-06T03:24:38.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.137+0000 7f75335ff700 1 -- 172.21.15.81:0/2970922970 shutdown_connections 2023-10-06T03:24:38.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.137+0000 7f75335ff700 1 --2- 172.21.15.81:0/2970922970 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f752c155bc0 0x7f752c158190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:38.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.137+0000 7f75335ff700 1 --2- 172.21.15.81:0/2970922970 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7510066f30 0x7f75100693e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:38.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.137+0000 7f75335ff700 1 --2- 172.21.15.81:0/2970922970 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f752c069ee0 0x7f752c14ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:38.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.137+0000 7f75335ff700 1 --2- 172.21.15.81:0/2970922970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f752c1557f0 0x7f752c157c50 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:38.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.137+0000 7f75335ff700 1 -- 172.21.15.81:0/2970922970 >> 172.21.15.81:0/2970922970 conn(0x7f752c0cc090 msgr2=0x7f752c0c6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:38.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.138+0000 7f75335ff700 1 -- 172.21.15.81:0/2970922970 shutdown_connections 2023-10-06T03:24:38.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.138+0000 7f75335ff700 1 -- 172.21.15.81:0/2970922970 wait complete. 2023-10-06T03:24:38.140 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2023-10-06T03:24:38.156 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:24:38.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.333+0000 7f95353ff700 1 Processor -- start 2023-10-06T03:24:38.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.333+0000 7f95353ff700 1 -- start start 2023-10-06T03:24:38.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.335+0000 7f95353ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f953006a5f0 0x7f9530156c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:38.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.335+0000 7f95353ff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95300c9c60 con 0x7f95301557f0 2023-10-06T03:24:38.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.335+0000 7f95353ff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f953006dc60 con 0x7f9530155bc0 2023-10-06T03:24:38.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.335+0000 7f95353ff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f953006df20 con 0x7f953006a5f0 2023-10-06T03:24:38.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.335+0000 7f952effd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f95301557f0 0x7f95300c6cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39532/0 (socket says 172.21.15.81:39532) 2023-10-06T03:24:38.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.335+0000 7f952effd700 1 -- 172.21.15.81:0/1297714465 learned_addr learned my addr 172.21.15.81:0/1297714465 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:24:38.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.335+0000 7f952f7fe700 1 --2- 172.21.15.81:0/1297714465 >> v2:172.21.15.83:3300/0 conn(0x7f953006a5f0 0x7f9530156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:38.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.335+0000 7f952dffb700 1 -- 172.21.15.81:0/1297714465 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4161415350 0 0) 0x7f95300c9c60 con 0x7f95301557f0 2023-10-06T03:24:38.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.335+0000 7f952dffb700 1 -- 172.21.15.81:0/1297714465 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9518003570 con 0x7f95301557f0 2023-10-06T03:24:38.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.335+0000 7f952dffb700 1 -- 172.21.15.81:0/1297714465 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3127298246 0 0) 0x7f953006dc60 con 0x7f9530155bc0 2023-10-06T03:24:38.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.335+0000 7f952dffb700 1 -- 172.21.15.81:0/1297714465 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95300c9c60 con 0x7f9530155bc0 2023-10-06T03:24:38.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.335+0000 7f952f7fe700 1 -- 172.21.15.81:0/1297714465 >> v1:172.21.15.83:6789/0 conn(0x7f9530155bc0 legacy=0x7f9530069ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:38.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.335+0000 7f952f7fe700 1 -- 172.21.15.81:0/1297714465 >> v1:172.21.15.81:6789/0 conn(0x7f95301557f0 legacy=0x7f95300c6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:38.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.335+0000 7f952f7fe700 1 -- 172.21.15.81:0/1297714465 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95300c74e0 con 0x7f953006a5f0 2023-10-06T03:24:38.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.336+0000 7f952f7fe700 1 --2- 172.21.15.81:0/1297714465 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f953006a5f0 0x7f9530156c90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f952800af70 tx=0x7f952800a890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8affd1771624cb85 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:38.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.336+0000 7f952dffb700 1 -- 172.21.15.81:0/1297714465 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952800f070 con 0x7f953006a5f0 2023-10-06T03:24:38.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.336+0000 7f952dffb700 1 -- 172.21.15.81:0/1297714465 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f952800a2e0 con 0x7f953006a5f0 2023-10-06T03:24:38.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.336+0000 7f952dffb700 1 -- 172.21.15.81:0/1297714465 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952800cbc0 con 0x7f953006a5f0 2023-10-06T03:24:38.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.336+0000 7f95353ff700 1 -- 172.21.15.81:0/1297714465 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f953006a5f0 msgr2=0x7f9530156c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:38.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.336+0000 7f95353ff700 1 --2- 172.21.15.81:0/1297714465 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f953006a5f0 0x7f9530156c90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f952800af70 tx=0x7f952800a890 comp rx=0 tx=0).stop 2023-10-06T03:24:38.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.337+0000 7f95353ff700 1 -- 172.21.15.81:0/1297714465 shutdown_connections 2023-10-06T03:24:38.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.337+0000 7f95353ff700 1 --2- 172.21.15.81:0/1297714465 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f953006a5f0 0x7f9530156c90 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:38.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.337+0000 7f95353ff700 1 -- 172.21.15.81:0/1297714465 >> 172.21.15.81:0/1297714465 conn(0x7f95300cc090 msgr2=0x7f95300cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:38.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.337+0000 7f95353ff700 1 -- 172.21.15.81:0/1297714465 shutdown_connections 2023-10-06T03:24:38.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.337+0000 7f95353ff700 1 -- 172.21.15.81:0/1297714465 wait complete. 2023-10-06T03:24:38.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.338+0000 7f95353ff700 1 Processor -- start 2023-10-06T03:24:38.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.338+0000 7f95353ff700 1 -- start start 2023-10-06T03:24:38.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.339+0000 7f95353ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f953006a5f0 0x7f9530169d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:38.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.339+0000 7f95353ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95301557f0 0x7f95300c4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:38.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.339+0000 7f95353ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9530155bc0 0x7f95300a9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:38.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.339+0000 7f95353ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95300c5af0 con 0x7f9530155bc0 2023-10-06T03:24:38.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.339+0000 7f95353ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95300c5060 con 0x7f95301557f0 2023-10-06T03:24:38.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.339+0000 7f95353ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f953016a5a0 con 0x7f953006a5f0 2023-10-06T03:24:38.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.339+0000 7f952f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9530155bc0 0x7f95300a9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:38.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.339+0000 7f952f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9530155bc0 0x7f95300a9840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55794/0 (socket says 172.21.15.81:55794) 2023-10-06T03:24:38.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.339+0000 7f952f7fe700 1 -- 172.21.15.81:0/2002033571 learned_addr learned my addr 172.21.15.81:0/2002033571 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:38.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.339+0000 7f952effd700 1 --2- 172.21.15.81:0/2002033571 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f953006a5f0 0x7f9530169d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:38.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.339+0000 7f952e7fc700 1 --2- 172.21.15.81:0/2002033571 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95301557f0 0x7f95300c4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:38.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.340+0000 7f952f7fe700 1 -- 172.21.15.81:0/2002033571 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f953006a5f0 msgr2=0x7f9530169d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:38.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.340+0000 7f952f7fe700 1 --2- 172.21.15.81:0/2002033571 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f953006a5f0 0x7f9530169d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:38.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.340+0000 7f952f7fe700 1 -- 172.21.15.81:0/2002033571 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95301557f0 msgr2=0x7f95300c4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:38.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.340+0000 7f952f7fe700 1 --2- 172.21.15.81:0/2002033571 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95301557f0 0x7f95300c4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:38.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.340+0000 7f952f7fe700 1 -- 172.21.15.81:0/2002033571 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f952800ab30 con 0x7f9530155bc0 2023-10-06T03:24:38.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.340+0000 7f952e7fc700 1 --2- 172.21.15.81:0/2002033571 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95301557f0 0x7f95300c4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:38.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.340+0000 7f952f7fe700 1 --2- 172.21.15.81:0/2002033571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9530155bc0 0x7f95300a9840 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f952800a8d0 tx=0x7f9528019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:38.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.340+0000 7f9516ffd700 1 -- 172.21.15.81:0/2002033571 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9528009bd0 con 0x7f9530155bc0 2023-10-06T03:24:38.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.340+0000 7f9516ffd700 1 -- 172.21.15.81:0/2002033571 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9528009d30 con 0x7f9530155bc0 2023-10-06T03:24:38.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.340+0000 7f9516ffd700 1 -- 172.21.15.81:0/2002033571 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9528009ea0 con 0x7f9530155bc0 2023-10-06T03:24:38.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.340+0000 7f95353ff700 1 -- 172.21.15.81:0/2002033571 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95300c5250 con 0x7f9530155bc0 2023-10-06T03:24:38.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.340+0000 7f95353ff700 1 -- 172.21.15.81:0/2002033571 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95300c5810 con 0x7f9530155bc0 2023-10-06T03:24:38.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.341+0000 7f95353ff700 1 -- 172.21.15.81:0/2002033571 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f953016a370 con 0x7f9530155bc0 2023-10-06T03:24:38.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.342+0000 7f9516ffd700 1 -- 172.21.15.81:0/2002033571 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f952801d8e0 con 0x7f9530155bc0 2023-10-06T03:24:38.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.343+0000 7f9516ffd700 1 --2- 172.21.15.81:0/2002033571 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f951c066f30 0x7f951c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:38.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.343+0000 7f9516ffd700 1 -- 172.21.15.81:0/2002033571 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f95280863d0 con 0x7f9530155bc0 2023-10-06T03:24:38.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.344+0000 7f952effd700 1 --2- 172.21.15.81:0/2002033571 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f951c066f30 0x7f951c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:38.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.344+0000 7f952effd700 1 --2- 172.21.15.81:0/2002033571 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f951c066f30 0x7f951c0693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9520007fd0 tx=0x7f9520009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:38.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.347+0000 7f9516ffd700 1 -- 172.21.15.81:0/2002033571 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f953016a370 con 0x7f9530155bc0 2023-10-06T03:24:38.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.581+0000 7f95353ff700 1 -- 172.21.15.81:0/2002033571 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f953016a370 con 0x7f9530155bc0 2023-10-06T03:24:38.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.582+0000 7f9516ffd700 1 -- 172.21.15.81:0/2002033571 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4590 (secure 0 0 0) 0x7f953016a370 con 0x7f9530155bc0 2023-10-06T03:24:38.583 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:24:38.583 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1255569320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1255569320},{"type":"v1","addr":"172.21.15.83:6835","nonce":1255569320}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1673166762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1673166762},{"type":"v1","addr":"172.21.15.81:6835","nonce":1673166762}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3689326153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3689326153},{"type":"v1","addr":"172.21.15.81:6837","nonce":3689326153}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:23:40.376852+0000","modified":"2023-10-06T03:23:56.657619+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6833/745669616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":745669616},{"type":"v1","addr":"172.21.15.83:6833","nonce":745669616}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T03:24:38.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.584+0000 7f95353ff700 1 -- 172.21.15.81:0/2002033571 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f951c066f30 msgr2=0x7f951c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:38.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.584+0000 7f95353ff700 1 --2- 172.21.15.81:0/2002033571 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f951c066f30 0x7f951c0693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9520007fd0 tx=0x7f9520009040 comp rx=0 tx=0).stop 2023-10-06T03:24:38.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.584+0000 7f95353ff700 1 -- 172.21.15.81:0/2002033571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9530155bc0 msgr2=0x7f95300a9840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:38.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.584+0000 7f95353ff700 1 --2- 172.21.15.81:0/2002033571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9530155bc0 0x7f95300a9840 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f952800a8d0 tx=0x7f9528019000 comp rx=0 tx=0).stop 2023-10-06T03:24:38.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.584+0000 7f95353ff700 1 -- 172.21.15.81:0/2002033571 shutdown_connections 2023-10-06T03:24:38.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.584+0000 7f95353ff700 1 --2- 172.21.15.81:0/2002033571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9530155bc0 0x7f95300a9840 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:38.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.584+0000 7f95353ff700 1 --2- 172.21.15.81:0/2002033571 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f951c066f30 0x7f951c0693e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:38.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.584+0000 7f95353ff700 1 --2- 172.21.15.81:0/2002033571 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f953006a5f0 0x7f9530169d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:38.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.584+0000 7f95353ff700 1 --2- 172.21.15.81:0/2002033571 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95301557f0 0x7f95300c4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:38.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.584+0000 7f95353ff700 1 -- 172.21.15.81:0/2002033571 >> 172.21.15.81:0/2002033571 conn(0x7f95300cc090 msgr2=0x7f95300c8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:38.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.585+0000 7f95353ff700 1 -- 172.21.15.81:0/2002033571 shutdown_connections 2023-10-06T03:24:38.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.585+0000 7f95353ff700 1 -- 172.21.15.81:0/2002033571 wait complete. 2023-10-06T03:24:38.587 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2023-10-06T03:24:38.603 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:24:38.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.781+0000 7f288359e700 1 Processor -- start 2023-10-06T03:24:38.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.781+0000 7f288359e700 1 -- start start 2023-10-06T03:24:38.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.782+0000 7f288359e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2884159710 0x7f288415d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:38.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.782+0000 7f288359e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f288415d6c0 0x7f28840685f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:38.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.782+0000 7f288359e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28840aaa60 con 0x7f2884159340 2023-10-06T03:24:38.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.782+0000 7f288359e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28840abbc0 con 0x7f288415d6c0 2023-10-06T03:24:38.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.782+0000 7f288359e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f288415dc40 con 0x7f2884159710 2023-10-06T03:24:38.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.783+0000 7f2882d9d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f288415d6c0 0x7f28840685f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:38.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.783+0000 7f2882d9d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f288415d6c0 0x7f28840685f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:41516/0 (socket says 172.21.15.81:41516) 2023-10-06T03:24:38.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.783+0000 7f2881d9b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2884159710 0x7f288415d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:38.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.783+0000 7f2882d9d700 1 -- 172.21.15.81:0/3487786467 learned_addr learned my addr 172.21.15.81:0/3487786467 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:38.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.783+0000 7f288259c700 1 --1- 172.21.15.81:0/3487786467 >> v1:172.21.15.83:6789/0 conn(0x7f2884159340 0x7f28840ab4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:33398/0 (socket says 172.21.15.81:33398) 2023-10-06T03:24:38.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.783+0000 7f2881d9b700 1 -- 172.21.15.81:0/3487786467 >> v2:172.21.15.83:3300/0 conn(0x7f288415d6c0 msgr2=0x7f28840685f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:38.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.783+0000 7f2881d9b700 1 --2- 172.21.15.81:0/3487786467 >> v2:172.21.15.83:3300/0 conn(0x7f288415d6c0 0x7f28840685f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:38.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.783+0000 7f2881d9b700 1 -- 172.21.15.81:0/3487786467 >> v1:172.21.15.83:6789/0 conn(0x7f2884159340 legacy=0x7f28840ab4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:38.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.783+0000 7f2881d9b700 1 -- 172.21.15.81:0/3487786467 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f288415df20 con 0x7f2884159710 2023-10-06T03:24:38.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.783+0000 7f2882d9d700 1 --2- 172.21.15.81:0/3487786467 >> v2:172.21.15.83:3300/0 conn(0x7f288415d6c0 0x7f28840685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:24:38.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.783+0000 7f2881d9b700 1 --2- 172.21.15.81:0/3487786467 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2884159710 0x7f288415d180 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f28780098e0 tx=0x7f28780091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecf65dfb115260c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:38.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.784+0000 7f288159a700 1 -- 172.21.15.81:0/3487786467 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287800b640 con 0x7f2884159710 2023-10-06T03:24:38.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.784+0000 7f288159a700 1 -- 172.21.15.81:0/3487786467 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287800b7a0 con 0x7f2884159710 2023-10-06T03:24:38.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.784+0000 7f288159a700 1 -- 172.21.15.81:0/3487786467 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287800bb40 con 0x7f2884159710 2023-10-06T03:24:38.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.784+0000 7f288359e700 1 -- 172.21.15.81:0/3487786467 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2884159710 msgr2=0x7f288415d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:38.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.784+0000 7f288359e700 1 --2- 172.21.15.81:0/3487786467 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2884159710 0x7f288415d180 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f28780098e0 tx=0x7f28780091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:38.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.784+0000 7f288359e700 1 -- 172.21.15.81:0/3487786467 shutdown_connections 2023-10-06T03:24:38.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.784+0000 7f288359e700 1 --2- 172.21.15.81:0/3487786467 >> v2:172.21.15.83:3300/0 conn(0x7f288415d6c0 0x7f28840685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:38.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.784+0000 7f288359e700 1 --2- 172.21.15.81:0/3487786467 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2884159710 0x7f288415d180 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:38.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.784+0000 7f288359e700 1 -- 172.21.15.81:0/3487786467 >> 172.21.15.81:0/3487786467 conn(0x7f288406db80 msgr2=0x7f288406df80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:38.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.784+0000 7f288359e700 1 -- 172.21.15.81:0/3487786467 shutdown_connections 2023-10-06T03:24:38.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.784+0000 7f288359e700 1 -- 172.21.15.81:0/3487786467 wait complete. 2023-10-06T03:24:38.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.786+0000 7f288359e700 1 Processor -- start 2023-10-06T03:24:38.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.786+0000 7f288359e700 1 -- start start 2023-10-06T03:24:38.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.787+0000 7f288359e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2884159340 0x7f2884148310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:38.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.787+0000 7f288359e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2884159710 0x7f288406ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:38.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.787+0000 7f288359e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f288415d6c0 0x7f288406b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:38.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.787+0000 7f288359e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2884148850 con 0x7f288415d6c0 2023-10-06T03:24:38.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.787+0000 7f288359e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f288416a9d0 con 0x7f2884159340 2023-10-06T03:24:38.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.787+0000 7f288359e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2884156f40 con 0x7f2884159710 2023-10-06T03:24:38.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.787+0000 7f2882d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f288415d6c0 0x7f288406b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:38.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.787+0000 7f2882d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f288415d6c0 0x7f288406b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55796/0 (socket says 172.21.15.81:55796) 2023-10-06T03:24:38.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.787+0000 7f2881d9b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2884159710 0x7f288406ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:38.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.787+0000 7f2882d9d700 1 -- 172.21.15.81:0/3937095767 learned_addr learned my addr 172.21.15.81:0/3937095767 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:38.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.787+0000 7f288259c700 1 --2- 172.21.15.81:0/3937095767 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2884159340 0x7f2884148310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:38.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.787+0000 7f2882d9d700 1 -- 172.21.15.81:0/3937095767 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2884159710 msgr2=0x7f288406ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:38.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.788+0000 7f2882d9d700 1 --2- 172.21.15.81:0/3937095767 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2884159710 0x7f288406ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:38.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.788+0000 7f2882d9d700 1 -- 172.21.15.81:0/3937095767 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2884159340 msgr2=0x7f2884148310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:38.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.788+0000 7f2882d9d700 1 --2- 172.21.15.81:0/3937095767 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2884159340 0x7f2884148310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:38.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.788+0000 7f2882d9d700 1 -- 172.21.15.81:0/3937095767 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f287c0094f0 con 0x7f288415d6c0 2023-10-06T03:24:38.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.788+0000 7f2882d9d700 1 --2- 172.21.15.81:0/3937095767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f288415d6c0 0x7f288406b1a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f287c00ea40 tx=0x7f287c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:38.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.788+0000 7f28727fc700 1 -- 172.21.15.81:0/3937095767 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c00ee80 con 0x7f288415d6c0 2023-10-06T03:24:38.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.788+0000 7f28727fc700 1 -- 172.21.15.81:0/3937095767 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287c00c850 con 0x7f288415d6c0 2023-10-06T03:24:38.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.788+0000 7f28727fc700 1 -- 172.21.15.81:0/3937095767 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c00cbf0 con 0x7f288415d6c0 2023-10-06T03:24:38.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.788+0000 7f288359e700 1 -- 172.21.15.81:0/3937095767 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2878009420 con 0x7f288415d6c0 2023-10-06T03:24:38.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.788+0000 7f288359e700 1 -- 172.21.15.81:0/3937095767 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2884157500 con 0x7f288415d6c0 2023-10-06T03:24:38.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.789+0000 7f288359e700 1 -- 172.21.15.81:0/3937095767 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f288406cdc0 con 0x7f288415d6c0 2023-10-06T03:24:38.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.790+0000 7f28727fc700 1 -- 172.21.15.81:0/3937095767 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f287c00cd50 con 0x7f288415d6c0 2023-10-06T03:24:38.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.791+0000 7f28727fc700 1 --2- 172.21.15.81:0/3937095767 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2864066f30 0x7f28640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:38.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.791+0000 7f28727fc700 1 -- 172.21.15.81:0/3937095767 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f287c084bd0 con 0x7f288415d6c0 2023-10-06T03:24:38.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.791+0000 7f288259c700 1 --2- 172.21.15.81:0/3937095767 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2864066f30 0x7f28640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:38.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.792+0000 7f288259c700 1 --2- 172.21.15.81:0/3937095767 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2864066f30 0x7f28640693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f28740020c0 tx=0x7f2874001ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:38.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.795+0000 7f28727fc700 1 -- 172.21.15.81:0/3937095767 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f287c051910 con 0x7f288415d6c0 2023-10-06T03:24:38.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.990+0000 7f288359e700 1 -- 172.21.15.81:0/3937095767 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f288404bb80 con 0x7f288415d6c0 2023-10-06T03:24:38.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.991+0000 7f28727fc700 1 -- 172.21.15.81:0/3937095767 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18754 (secure 0 0 0) 0x7f287c054f30 con 0x7f288415d6c0 2023-10-06T03:24:38.992 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:24:38.992 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"1807b5d7-9be8-43ad-aaf8-99a4273430b3","created":"2023-10-06T03:23:20.805306+0000","modified":"2023-10-06T03:24:28.774889+0000","last_up_change":"2023-10-06T03:23:32.735796+0000","last_in_change":"2023-10-06T03:23:24.109024+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:33.198850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:33.606744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:23:38.742266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:23:39.347944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:23:42.959054+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"14fb667d-a677-4978-a477-80027f889d36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":85563},{"type":"v1","addr":"172.21.15.81:6818","nonce":85563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":85563},{"type":"v1","addr":"172.21.15.81:6822","nonce":85563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":85563},{"type":"v1","addr":"172.21.15.81:6830","nonce":85563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":85563},{"type":"v1","addr":"172.21.15.81:6826","nonce":85563}]},"public_addr":"172.21.15.81:6818/85563","cluster_addr":"172.21.15.81:6822/85563","heartbeat_back_addr":"172.21.15.81:6830/85563","heartbeat_front_addr":"172.21.15.81:6826/85563","state":["exists","up"]},{"osd":1,"uuid":"974d8a86-1829-4176-89ce-18e6038857f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":85561},{"type":"v1","addr":"172.21.15.81:6801","nonce":85561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":85561},{"type":"v1","addr":"172.21.15.81:6803","nonce":85561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":85561},{"type":"v1","addr":"172.21.15.81:6807","nonce":85561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":85561},{"type":"v1","addr":"172.21.15.81:6805","nonce":85561}]},"public_addr":"172.21.15.81:6801/85561","cluster_addr":"172.21.15.81:6803/85561","heartbeat_back_addr":"172.21.15.81:6807/85561","heartbeat_front_addr":"172.21.15.81:6805/85561","state":["exists","up"]},{"osd":2,"uuid":"ffbfe056-46bc-46e0-bf49-4d8f8650e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":85564},{"type":"v1","addr":"172.21.15.81:6809","nonce":85564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":85564},{"type":"v1","addr":"172.21.15.81:6811","nonce":85564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":85564},{"type":"v1","addr":"172.21.15.81:6815","nonce":85564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":85564},{"type":"v1","addr":"172.21.15.81:6813","nonce":85564}]},"public_addr":"172.21.15.81:6809/85564","cluster_addr":"172.21.15.81:6811/85564","heartbeat_back_addr":"172.21.15.81:6815/85564","heartbeat_front_addr":"172.21.15.81:6813/85564","state":["exists","up"]},{"osd":3,"uuid":"ef9a8314-3d37-4ea1-858a-e704d5695002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":85562},{"type":"v1","addr":"172.21.15.81:6819","nonce":85562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":85562},{"type":"v1","addr":"172.21.15.81:6823","nonce":85562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":85562},{"type":"v1","addr":"172.21.15.81:6831","nonce":85562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":85562},{"type":"v1","addr":"172.21.15.81:6827","nonce":85562}]},"public_addr":"172.21.15.81:6819/85562","cluster_addr":"172.21.15.81:6823/85562","heartbeat_back_addr":"172.21.15.81:6831/85562","heartbeat_front_addr":"172.21.15.81:6827/85562","state":["exists","up"]},{"osd":4,"uuid":"d83506a0-2c96-4bcb-a9fa-05e43dc329df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":85785},{"type":"v1","addr":"172.21.15.83:6801","nonce":85785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":85785},{"type":"v1","addr":"172.21.15.83:6803","nonce":85785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":85785},{"type":"v1","addr":"172.21.15.83:6807","nonce":85785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":85785},{"type":"v1","addr":"172.21.15.83:6805","nonce":85785}]},"public_addr":"172.21.15.83:6801/85785","cluster_addr":"172.21.15.83:6803/85785","heartbeat_back_addr":"172.21.15.83:6807/85785","heartbeat_front_addr":"172.21.15.83:6805/85785","state":["exists","up"]},{"osd":5,"uuid":"10687c63-a3d5-472f-acc0-4f61847b6e0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":85818},{"type":"v1","addr":"172.21.15.83:6825","nonce":85818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":85818},{"type":"v1","addr":"172.21.15.83:6827","nonce":85818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":85818},{"type":"v1","addr":"172.21.15.83:6831","nonce":85818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":85818},{"type":"v1","addr":"172.21.15.83:6829","nonce":85818}]},"public_addr":"172.21.15.83:6825/85818","cluster_addr":"172.21.15.83:6827/85818","heartbeat_back_addr":"172.21.15.83:6831/85818","heartbeat_front_addr":"172.21.15.83:6829/85818","state":["exists","up"]},{"osd":6,"uuid":"2e9daf76-5607-4a29-9a58-6e270700d223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":85787},{"type":"v1","addr":"172.21.15.83:6811","nonce":85787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":85787},{"type":"v1","addr":"172.21.15.83:6815","nonce":85787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":85787},{"type":"v1","addr":"172.21.15.83:6823","nonce":85787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6817","nonce":85787},{"type":"v1","addr":"172.21.15.83:6819","nonce":85787}]},"public_addr":"172.21.15.83:6811/85787","cluster_addr":"172.21.15.83:6815/85787","heartbeat_back_addr":"172.21.15.83:6823/85787","heartbeat_front_addr":"172.21.15.83:6819/85787","state":["exists","up"]},{"osd":7,"uuid":"5019e1ff-233a-4a5a-91ca-8afccb7ab6e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":85786},{"type":"v1","addr":"172.21.15.83:6810","nonce":85786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":85786},{"type":"v1","addr":"172.21.15.83:6814","nonce":85786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":85786},{"type":"v1","addr":"172.21.15.83:6822","nonce":85786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":85786},{"type":"v1","addr":"172.21.15.83:6818","nonce":85786}]},"public_addr":"172.21.15.83:6810/85786","cluster_addr":"172.21.15.83:6814/85786","heartbeat_back_addr":"172.21.15.83:6822/85786","heartbeat_front_addr":"172.21.15.83:6818/85786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.393431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.360031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.407428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.391613+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.403211+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.438142+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.496181+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.472323+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":1,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:24:38.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.993+0000 7f288359e700 1 -- 172.21.15.81:0/3937095767 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2864066f30 msgr2=0x7f28640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:38.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.993+0000 7f288359e700 1 --2- 172.21.15.81:0/3937095767 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2864066f30 0x7f28640693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f28740020c0 tx=0x7f2874001ad0 comp rx=0 tx=0).stop 2023-10-06T03:24:38.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.993+0000 7f288359e700 1 -- 172.21.15.81:0/3937095767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f288415d6c0 msgr2=0x7f288406b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:38.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.993+0000 7f288359e700 1 --2- 172.21.15.81:0/3937095767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f288415d6c0 0x7f288406b1a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f287c00ea40 tx=0x7f287c009250 comp rx=0 tx=0).stop 2023-10-06T03:24:38.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.993+0000 7f288359e700 1 -- 172.21.15.81:0/3937095767 shutdown_connections 2023-10-06T03:24:38.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.993+0000 7f288359e700 1 --2- 172.21.15.81:0/3937095767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f288415d6c0 0x7f288406b1a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:38.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.993+0000 7f288359e700 1 --2- 172.21.15.81:0/3937095767 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2884159340 0x7f2884148310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:38.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.993+0000 7f288359e700 1 --2- 172.21.15.81:0/3937095767 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2864066f30 0x7f28640693e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:38.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.993+0000 7f288359e700 1 --2- 172.21.15.81:0/3937095767 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2884159710 0x7f288406ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:38.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.993+0000 7f288359e700 1 -- 172.21.15.81:0/3937095767 >> 172.21.15.81:0/3937095767 conn(0x7f288406db80 msgr2=0x7f2884158410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:38.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.994+0000 7f288359e700 1 -- 172.21.15.81:0/3937095767 shutdown_connections 2023-10-06T03:24:38.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:38.994+0000 7f288359e700 1 -- 172.21.15.81:0/3937095767 wait complete. 2023-10-06T03:24:39.012 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T03:24:39.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.191+0000 7f97ba5ff700 1 Processor -- start 2023-10-06T03:24:39.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.191+0000 7f97ba5ff700 1 -- start start 2023-10-06T03:24:39.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.193+0000 7f97ba5ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f97b41557f0 0x7f97b4156c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:39.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.193+0000 7f97ba5ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f97b4155bc0 0x7f97b40c6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:39.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.193+0000 7f97ba5ff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97b40c9c60 con 0x7f97b4069ee0 2023-10-06T03:24:39.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.193+0000 7f97ba5ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97b406df20 con 0x7f97b4155bc0 2023-10-06T03:24:39.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.193+0000 7f97ba5ff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97b40c74e0 con 0x7f97b41557f0 2023-10-06T03:24:39.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.193+0000 7f97abfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f97b4155bc0 0x7f97b40c6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:39.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.193+0000 7f97abfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f97b4155bc0 0x7f97b40c6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55806/0 (socket says 172.21.15.81:55806) 2023-10-06T03:24:39.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.193+0000 7f97abfff700 1 -- 172.21.15.81:0/3550616257 learned_addr learned my addr 172.21.15.81:0/3550616257 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:39.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.193+0000 7f97b3fff700 1 --2- 172.21.15.81:0/3550616257 >> v2:172.21.15.83:3300/0 conn(0x7f97b41557f0 0x7f97b4156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:39.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.194+0000 7f97abfff700 1 -- 172.21.15.81:0/3550616257 >> v2:172.21.15.83:3300/0 conn(0x7f97b41557f0 msgr2=0x7f97b4156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:39.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.194+0000 7f97abfff700 1 --2- 172.21.15.81:0/3550616257 >> v2:172.21.15.83:3300/0 conn(0x7f97b41557f0 0x7f97b4156c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:39.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.194+0000 7f97abfff700 1 -- 172.21.15.81:0/3550616257 >> v1:172.21.15.83:6789/0 conn(0x7f97b4069ee0 legacy=0x7f97b4159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:39.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.194+0000 7f97abfff700 1 -- 172.21.15.81:0/3550616257 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b406dc60 con 0x7f97b4155bc0 2023-10-06T03:24:39.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.194+0000 7f97abfff700 1 --2- 172.21.15.81:0/3550616257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97b4155bc0 0x7f97b40c6cb0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f97b406cb60 tx=0x7f979c00b4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a0c3e166b50246f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:39.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.194+0000 7f97b37fe700 1 -- 172.21.15.81:0/3550616257 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979c00da60 con 0x7f97b4155bc0 2023-10-06T03:24:39.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.194+0000 7f97b37fe700 1 -- 172.21.15.81:0/3550616257 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f979c00dbc0 con 0x7f97b4155bc0 2023-10-06T03:24:39.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.194+0000 7f97b37fe700 1 -- 172.21.15.81:0/3550616257 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979c017410 con 0x7f97b4155bc0 2023-10-06T03:24:39.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.195+0000 7f97ba5ff700 1 -- 172.21.15.81:0/3550616257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97b4155bc0 msgr2=0x7f97b40c6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:39.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.195+0000 7f97ba5ff700 1 --2- 172.21.15.81:0/3550616257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97b4155bc0 0x7f97b40c6cb0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f97b406cb60 tx=0x7f979c00b4e0 comp rx=0 tx=0).stop 2023-10-06T03:24:39.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.195+0000 7f97ba5ff700 1 -- 172.21.15.81:0/3550616257 shutdown_connections 2023-10-06T03:24:39.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.195+0000 7f97ba5ff700 1 --2- 172.21.15.81:0/3550616257 >> v2:172.21.15.83:3300/0 conn(0x7f97b41557f0 0x7f97b4156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:39.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.195+0000 7f97ba5ff700 1 --2- 172.21.15.81:0/3550616257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97b4155bc0 0x7f97b40c6cb0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:39.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.195+0000 7f97ba5ff700 1 -- 172.21.15.81:0/3550616257 >> 172.21.15.81:0/3550616257 conn(0x7f97b40cc090 msgr2=0x7f97b40cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:39.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.195+0000 7f97ba5ff700 1 -- 172.21.15.81:0/3550616257 shutdown_connections 2023-10-06T03:24:39.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.195+0000 7f97ba5ff700 1 -- 172.21.15.81:0/3550616257 wait complete. 2023-10-06T03:24:39.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.196+0000 7f97ba5ff700 1 Processor -- start 2023-10-06T03:24:39.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.196+0000 7f97ba5ff700 1 -- start start 2023-10-06T03:24:39.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.197+0000 7f97ba5ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97b4069ee0 0x7f97b40c5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:39.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.197+0000 7f97ba5ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f97b41557f0 0x7f97b40ad390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:39.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.197+0000 7f97ba5ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f97b4155bc0 0x7f97b4154bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:39.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.197+0000 7f97ba5ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b40ad8d0 con 0x7f97b4069ee0 2023-10-06T03:24:39.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.197+0000 7f97ba5ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b40a9840 con 0x7f97b41557f0 2023-10-06T03:24:39.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.197+0000 7f97ba5ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97b40adaf0 con 0x7f97b4155bc0 2023-10-06T03:24:39.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.197+0000 7f97b3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97b4069ee0 0x7f97b40c5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:39.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.197+0000 7f97b3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97b4069ee0 0x7f97b40c5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55810/0 (socket says 172.21.15.81:55810) 2023-10-06T03:24:39.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.197+0000 7f97b3fff700 1 -- 172.21.15.81:0/3279912053 learned_addr learned my addr 172.21.15.81:0/3279912053 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:39.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.198+0000 7f97b3fff700 1 -- 172.21.15.81:0/3279912053 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f97b4155bc0 msgr2=0x7f97b4154bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:39.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.198+0000 7f97b3fff700 1 --2- 172.21.15.81:0/3279912053 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f97b4155bc0 0x7f97b4154bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:39.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.198+0000 7f97b3fff700 1 -- 172.21.15.81:0/3279912053 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f97b41557f0 msgr2=0x7f97b40ad390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:39.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.198+0000 7f97b3fff700 1 --2- 172.21.15.81:0/3279912053 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f97b41557f0 0x7f97b40ad390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:39.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.198+0000 7f97b3fff700 1 -- 172.21.15.81:0/3279912053 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f979c00b780 con 0x7f97b4069ee0 2023-10-06T03:24:39.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.198+0000 7f97b3fff700 1 --2- 172.21.15.81:0/3279912053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97b4069ee0 0x7f97b40c5060 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f97a400ecb0 tx=0x7f97a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:39.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.198+0000 7f97b0ff9700 1 -- 172.21.15.81:0/3279912053 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a400c9d0 con 0x7f97b4069ee0 2023-10-06T03:24:39.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.198+0000 7f97b0ff9700 1 -- 172.21.15.81:0/3279912053 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a400cb30 con 0x7f97b4069ee0 2023-10-06T03:24:39.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.198+0000 7f97b0ff9700 1 -- 172.21.15.81:0/3279912053 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a400ced0 con 0x7f97b4069ee0 2023-10-06T03:24:39.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.198+0000 7f97ba5ff700 1 -- 172.21.15.81:0/3279912053 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97b40addd0 con 0x7f97b4069ee0 2023-10-06T03:24:39.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.198+0000 7f97ba5ff700 1 -- 172.21.15.81:0/3279912053 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97b40ae390 con 0x7f97b4069ee0 2023-10-06T03:24:39.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.199+0000 7f97ba5ff700 1 -- 172.21.15.81:0/3279912053 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97b40a9b20 con 0x7f97b4069ee0 2023-10-06T03:24:39.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.200+0000 7f97b0ff9700 1 -- 172.21.15.81:0/3279912053 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f97a4013680 con 0x7f97b4069ee0 2023-10-06T03:24:39.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.201+0000 7f97b0ff9700 1 --2- 172.21.15.81:0/3279912053 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f9794066f30 0x7f97940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:39.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.201+0000 7f97b0ff9700 1 -- 172.21.15.81:0/3279912053 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f97a4084e20 con 0x7f97b4069ee0 2023-10-06T03:24:39.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.201+0000 7f97abfff700 1 --2- 172.21.15.81:0/3279912053 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f9794066f30 0x7f97940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:39.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.202+0000 7f97abfff700 1 --2- 172.21.15.81:0/3279912053 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f9794066f30 0x7f97940693e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f97b406ed80 tx=0x7f979c019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:39.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.205+0000 7f97b0ff9700 1 -- 172.21.15.81:0/3279912053 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f97a4051b60 con 0x7f97b4069ee0 2023-10-06T03:24:39.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.438+0000 7f97ba5ff700 1 -- 172.21.15.81:0/3279912053 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f97b404c3c0 con 0x7f97b4069ee0 2023-10-06T03:24:39.439 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-10-06T03:24:39.439+0000 7f96a11f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T03:24:39.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.445+0000 7f97b0ff9700 1 -- 172.21.15.81:0/3279912053 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f97a4055180 con 0x7f97b4069ee0 2023-10-06T03:24:39.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.447+0000 7f97ba5ff700 1 -- 172.21.15.81:0/3279912053 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f9794066f30 msgr2=0x7f97940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:39.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.447+0000 7f97ba5ff700 1 --2- 172.21.15.81:0/3279912053 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f9794066f30 0x7f97940693e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f97b406ed80 tx=0x7f979c019000 comp rx=0 tx=0).stop 2023-10-06T03:24:39.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.447+0000 7f97ba5ff700 1 -- 172.21.15.81:0/3279912053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97b4069ee0 msgr2=0x7f97b40c5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:39.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.447+0000 7f97ba5ff700 1 --2- 172.21.15.81:0/3279912053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97b4069ee0 0x7f97b40c5060 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f97a400ecb0 tx=0x7f97a40091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:39.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.447+0000 7f97ba5ff700 1 -- 172.21.15.81:0/3279912053 shutdown_connections 2023-10-06T03:24:39.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.447+0000 7f97ba5ff700 1 --2- 172.21.15.81:0/3279912053 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f9794066f30 0x7f97940693e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:39.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.447+0000 7f97ba5ff700 1 --2- 172.21.15.81:0/3279912053 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f97b4155bc0 0x7f97b4154bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:39.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.447+0000 7f97ba5ff700 1 --2- 172.21.15.81:0/3279912053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97b4069ee0 0x7f97b40c5060 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:39.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.447+0000 7f97ba5ff700 1 --2- 172.21.15.81:0/3279912053 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f97b41557f0 0x7f97b40ad390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:39.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.447+0000 7f97ba5ff700 1 -- 172.21.15.81:0/3279912053 >> 172.21.15.81:0/3279912053 conn(0x7f97b40cc090 msgr2=0x7f97b40c1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:39.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.447+0000 7f97ba5ff700 1 -- 172.21.15.81:0/3279912053 shutdown_connections 2023-10-06T03:24:39.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.447+0000 7f97ba5ff700 1 -- 172.21.15.81:0/3279912053 wait complete. 2023-10-06T03:24:39.449 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T03:24:39.455 INFO:tasks.ceph.mds.b.smithi083.stderr: -4146> 2023-10-06T03:23:46.058+0000 7f0b72bf1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T03:24:39.465 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T03:24:39.501 INFO:tasks.ceph.mds.b.smithi083.stdout:starting mds.b at 2023-10-06T03:24:39.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.645+0000 7f6ffbdff700 1 Processor -- start 2023-10-06T03:24:39.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.646+0000 7f6ffbdff700 1 -- start start 2023-10-06T03:24:39.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.647+0000 7f6ffbdff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6ff40d0150 0x7f6ff40b55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:39.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.647+0000 7f6ffbdff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ff40ce9a0 con 0x7f6ff40b2520 2023-10-06T03:24:39.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.647+0000 7f6ffbdff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ff40b5c30 con 0x7f6ff40b2150 2023-10-06T03:24:39.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.647+0000 7f6ffbdff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ff40b5f10 con 0x7f6ff40d0150 2023-10-06T03:24:39.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.647+0000 7f6ff939a700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6ff40b2520 0x7f6ff4158eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39538/0 (socket says 172.21.15.81:39538) 2023-10-06T03:24:39.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.647+0000 7f6ff939a700 1 -- 172.21.15.81:0/4031889487 learned_addr learned my addr 172.21.15.81:0/4031889487 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:24:39.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.647+0000 7f6ff8b99700 1 -- 172.21.15.81:0/4031889487 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2266572757 0 0) 0x7f6ff40ce9a0 con 0x7f6ff40b2520 2023-10-06T03:24:39.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.647+0000 7f6ffa39c700 1 --2- 172.21.15.81:0/4031889487 >> v2:172.21.15.83:3300/0 conn(0x7f6ff40d0150 0x7f6ff40b55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:39.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.647+0000 7f6ff8b99700 1 -- 172.21.15.81:0/4031889487 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fe0003570 con 0x7f6ff40b2520 2023-10-06T03:24:39.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.648+0000 7f6ff8b99700 1 -- 172.21.15.81:0/4031889487 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 501588180 0 0) 0x7f6ff40b5c30 con 0x7f6ff40b2150 2023-10-06T03:24:39.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.648+0000 7f6ff8b99700 1 -- 172.21.15.81:0/4031889487 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ff40ce9a0 con 0x7f6ff40b2150 2023-10-06T03:24:39.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.648+0000 7f6ff8b99700 1 -- 172.21.15.81:0/4031889487 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3948599038 0 0) 0x7f6fe0003570 con 0x7f6ff40b2520 2023-10-06T03:24:39.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.648+0000 7f6ff8b99700 1 -- 172.21.15.81:0/4031889487 >> v2:172.21.15.83:3300/0 conn(0x7f6ff40d0150 msgr2=0x7f6ff40b55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:39.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.648+0000 7f6ff8b99700 1 --2- 172.21.15.81:0/4031889487 >> v2:172.21.15.83:3300/0 conn(0x7f6ff40d0150 0x7f6ff40b55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:39.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.648+0000 7f6ff8b99700 1 -- 172.21.15.81:0/4031889487 >> v1:172.21.15.83:6789/0 conn(0x7f6ff40b2150 legacy=0x7f6ff40b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:39.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.648+0000 7f6ff8b99700 1 -- 172.21.15.81:0/4031889487 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff40b61f0 con 0x7f6ff40b2520 2023-10-06T03:24:39.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.648+0000 7f6ff8b99700 1 -- 172.21.15.81:0/4031889487 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2513016936 0 0) 0x7f6fe4001470 con 0x7f6ff40b2520 2023-10-06T03:24:39.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.648+0000 7f6ff8b99700 1 -- 172.21.15.81:0/4031889487 >> v1:172.21.15.81:6789/0 conn(0x7f6ff40b2520 legacy=0x7f6ff4158eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:39.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.648+0000 7f6ff8b99700 1 --2- 172.21.15.81:0/4031889487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fe0003c40 0x7f6fe0004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:39.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.648+0000 7f6ff8b99700 1 --2- 172.21.15.81:0/4031889487 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6fe0004810 0x7f6fe0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:39.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.648+0000 7f6ff8b99700 1 --2- 172.21.15.81:0/4031889487 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6fe0005210 0x7f6fe000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:39.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.648+0000 7f6ff8b99700 1 -- 172.21.15.81:0/4031889487 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff40b5f10 con 0x7f6fe0003c40 2023-10-06T03:24:39.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.648+0000 7f6ff8b99700 1 -- 172.21.15.81:0/4031889487 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe000c130 con 0x7f6fe0005210 2023-10-06T03:24:39.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.648+0000 7f6ff8b99700 1 -- 172.21.15.81:0/4031889487 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe000c2c0 con 0x7f6fe0004810 2023-10-06T03:24:39.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.648+0000 7f6ff9b9b700 1 --2- 172.21.15.81:0/4031889487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fe0003c40 0x7f6fe0004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:39.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.648+0000 7f6ffa39c700 1 --2- 172.21.15.81:0/4031889487 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6fe0005210 0x7f6fe000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:39.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.648+0000 7f6ff939a700 1 --2- 172.21.15.81:0/4031889487 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6fe0004810 0x7f6fe0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:39.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.649+0000 7f6ff9b9b700 1 -- 172.21.15.81:0/4031889487 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6fe0004810 msgr2=0x7f6fe0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:39.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.649+0000 7f6ff9b9b700 1 --2- 172.21.15.81:0/4031889487 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6fe0004810 0x7f6fe0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:39.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.649+0000 7f6ff9b9b700 1 -- 172.21.15.81:0/4031889487 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6fe0005210 msgr2=0x7f6fe000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:39.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.649+0000 7f6ff9b9b700 1 --2- 172.21.15.81:0/4031889487 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6fe0005210 0x7f6fe000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:39.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.649+0000 7f6ff9b9b700 1 -- 172.21.15.81:0/4031889487 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe0003570 con 0x7f6fe0003c40 2023-10-06T03:24:39.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.649+0000 7f6ffa39c700 1 -- 172.21.15.81:0/4031889487 reap_dead start 2023-10-06T03:24:39.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.649+0000 7f6ff9b9b700 1 --2- 172.21.15.81:0/4031889487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fe0003c40 0x7f6fe0004030 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0001a60 tx=0x7f6ff0007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7340ed0b8a13264a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:39.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.649+0000 7f6ff8b99700 1 -- 172.21.15.81:0/4031889487 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff00013f0 con 0x7f6fe0003c40 2023-10-06T03:24:39.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.649+0000 7f6ff8b99700 1 -- 172.21.15.81:0/4031889487 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff000c590 con 0x7f6fe0003c40 2023-10-06T03:24:39.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.649+0000 7f6ff8b99700 1 -- 172.21.15.81:0/4031889487 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff000c950 con 0x7f6fe0003c40 2023-10-06T03:24:39.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.650+0000 7f6ffbdff700 1 -- 172.21.15.81:0/4031889487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fe0003c40 msgr2=0x7f6fe0004030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:39.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.650+0000 7f6ffbdff700 1 --2- 172.21.15.81:0/4031889487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fe0003c40 0x7f6fe0004030 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0001a60 tx=0x7f6ff0007d80 comp rx=0 tx=0).stop 2023-10-06T03:24:39.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.650+0000 7f6ffbdff700 1 -- 172.21.15.81:0/4031889487 shutdown_connections 2023-10-06T03:24:39.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.650+0000 7f6ffbdff700 1 --2- 172.21.15.81:0/4031889487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fe0003c40 0x7f6fe0004030 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:39.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.650+0000 7f6ffbdff700 1 -- 172.21.15.81:0/4031889487 >> 172.21.15.81:0/4031889487 conn(0x7f6ff406ed10 msgr2=0x7f6ff406f110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:39.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.650+0000 7f6ffbdff700 1 -- 172.21.15.81:0/4031889487 shutdown_connections 2023-10-06T03:24:39.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.650+0000 7f6ffbdff700 1 -- 172.21.15.81:0/4031889487 wait complete. 2023-10-06T03:24:39.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.651+0000 7f6ffbdff700 1 Processor -- start 2023-10-06T03:24:39.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.651+0000 7f6ffbdff700 1 -- start start 2023-10-06T03:24:39.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.652+0000 7f6ffbdff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6fe0003c40 0x7f6ff414e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:39.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.652+0000 7f6ffbdff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ff4159690 0x7f6ff4159b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:39.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.652+0000 7f6ffbdff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6ff41570b0 0x7f6ff4157520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:39.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.652+0000 7f6ffbdff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff4157a60 con 0x7f6ff4159690 2023-10-06T03:24:39.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.652+0000 7f6ffbdff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff416d9c0 con 0x7f6fe0003c40 2023-10-06T03:24:39.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.652+0000 7f6ffbdff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff416a5c0 con 0x7f6ff41570b0 2023-10-06T03:24:39.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.652+0000 7f6ff939a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ff4159690 0x7f6ff4159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:39.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.652+0000 7f6ff939a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ff4159690 0x7f6ff4159b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55828/0 (socket says 172.21.15.81:55828) 2023-10-06T03:24:39.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.652+0000 7f6ff939a700 1 -- 172.21.15.81:0/1219220299 learned_addr learned my addr 172.21.15.81:0/1219220299 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:39.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.653+0000 7f6ff9b9b700 1 --2- 172.21.15.81:0/1219220299 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6fe0003c40 0x7f6ff414e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:39.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.653+0000 7f6ffa39c700 1 --2- 172.21.15.81:0/1219220299 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6ff41570b0 0x7f6ff4157520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:39.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.653+0000 7f6ff939a700 1 -- 172.21.15.81:0/1219220299 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6ff41570b0 msgr2=0x7f6ff4157520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:39.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.653+0000 7f6ff939a700 1 --2- 172.21.15.81:0/1219220299 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6ff41570b0 0x7f6ff4157520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:39.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.653+0000 7f6ff939a700 1 -- 172.21.15.81:0/1219220299 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6fe0003c40 msgr2=0x7f6ff414e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:39.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.653+0000 7f6ff939a700 1 --2- 172.21.15.81:0/1219220299 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6fe0003c40 0x7f6ff414e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:39.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.653+0000 7f6ff939a700 1 -- 172.21.15.81:0/1219220299 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff416cdb0 con 0x7f6ff4159690 2023-10-06T03:24:39.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.653+0000 7f6ff939a700 1 --2- 172.21.15.81:0/1219220299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ff4159690 0x7f6ff4159b00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6fe40073c0 tx=0x7f6fe4001d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:39.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.653+0000 7f6fe9ffb700 1 -- 172.21.15.81:0/1219220299 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe4000c40 con 0x7f6ff4159690 2023-10-06T03:24:39.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.653+0000 7f6fe9ffb700 1 -- 172.21.15.81:0/1219220299 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe400f640 con 0x7f6ff4159690 2023-10-06T03:24:39.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.653+0000 7f6ffbdff700 1 -- 172.21.15.81:0/1219220299 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ff416d090 con 0x7f6ff4159690 2023-10-06T03:24:39.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.653+0000 7f6fe9ffb700 1 -- 172.21.15.81:0/1219220299 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe400f9e0 con 0x7f6ff4159690 2023-10-06T03:24:39.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.653+0000 7f6ffbdff700 1 -- 172.21.15.81:0/1219220299 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ff416d650 con 0x7f6ff4159690 2023-10-06T03:24:39.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.655+0000 7f6ffbdff700 1 -- 172.21.15.81:0/1219220299 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ff416db70 con 0x7f6ff4159690 2023-10-06T03:24:39.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.655+0000 7f6fe9ffb700 1 -- 172.21.15.81:0/1219220299 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6fe400fd90 con 0x7f6ff4159690 2023-10-06T03:24:39.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.656+0000 7f6fe9ffb700 1 --2- 172.21.15.81:0/1219220299 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f6fd8066f30 0x7f6fd80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:39.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.656+0000 7f6fe9ffb700 1 -- 172.21.15.81:0/1219220299 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6953+0+0 (secure 0 0 0) 0x7f6fe4084900 con 0x7f6ff4159690 2023-10-06T03:24:39.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.656+0000 7f6ff9b9b700 1 --2- 172.21.15.81:0/1219220299 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f6fd8066f30 0x7f6fd80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:39.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.657+0000 7f6ff9b9b700 1 --2- 172.21.15.81:0/1219220299 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f6fd8066f30 0x7f6fd80693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0000c00 tx=0x7f6ff0015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:39.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.660+0000 7f6fe9ffb700 1 -- 172.21.15.81:0/1219220299 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6ff416db70 con 0x7f6ff4159690 2023-10-06T03:24:39.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:39.896+0000 7f6ffbdff700 1 -- 172.21.15.81:0/1219220299 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6ff416d7e0 con 0x7f6ff4159690 2023-10-06T03:24:40.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.445+0000 7f6fe9ffb700 1 -- 172.21.15.81:0/1219220299 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6fe4051690 con 0x7f6ff4159690 2023-10-06T03:24:40.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.448+0000 7f6ffbdff700 1 -- 172.21.15.81:0/1219220299 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f6fd8066f30 msgr2=0x7f6fd80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:40.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.448+0000 7f6ffbdff700 1 --2- 172.21.15.81:0/1219220299 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f6fd8066f30 0x7f6fd80693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0000c00 tx=0x7f6ff0015000 comp rx=0 tx=0).stop 2023-10-06T03:24:40.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.448+0000 7f6ffbdff700 1 -- 172.21.15.81:0/1219220299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ff4159690 msgr2=0x7f6ff4159b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:40.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.448+0000 7f6ffbdff700 1 --2- 172.21.15.81:0/1219220299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ff4159690 0x7f6ff4159b00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6fe40073c0 tx=0x7f6fe4001d20 comp rx=0 tx=0).stop 2023-10-06T03:24:40.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.448+0000 7f6ffbdff700 1 -- 172.21.15.81:0/1219220299 shutdown_connections 2023-10-06T03:24:40.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.448+0000 7f6ffbdff700 1 --2- 172.21.15.81:0/1219220299 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f6fd8066f30 0x7f6fd80693e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:40.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.448+0000 7f6ffbdff700 1 --2- 172.21.15.81:0/1219220299 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6ff41570b0 0x7f6ff4157520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:40.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.448+0000 7f6ffbdff700 1 --2- 172.21.15.81:0/1219220299 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6fe0003c40 0x7f6ff414e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:40.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.448+0000 7f6ffbdff700 1 --2- 172.21.15.81:0/1219220299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ff4159690 0x7f6ff4159b00 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:40.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.448+0000 7f6ffbdff700 1 -- 172.21.15.81:0/1219220299 >> 172.21.15.81:0/1219220299 conn(0x7f6ff406ed10 msgr2=0x7f6ff40b4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:40.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.448+0000 7f6ffbdff700 1 -- 172.21.15.81:0/1219220299 shutdown_connections 2023-10-06T03:24:40.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.448+0000 7f6ffbdff700 1 -- 172.21.15.81:0/1219220299 wait complete. 2023-10-06T03:24:40.468 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T03:24:40.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.655+0000 7fcef5bff700 1 Processor -- start 2023-10-06T03:24:40.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.655+0000 7fcef5bff700 1 -- start start 2023-10-06T03:24:40.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.656+0000 7fcef5bff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcef00af5e0 0x7fcef00cfe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:40.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.656+0000 7fcef5bff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcef00cf980 con 0x7fcef00af9b0 2023-10-06T03:24:40.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.656+0000 7fcef5bff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcef00ced70 con 0x7fcef00ce820 2023-10-06T03:24:40.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.656+0000 7fcef5bff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcef00cf050 con 0x7fcef00af5e0 2023-10-06T03:24:40.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.656+0000 7fcee77fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcef00af5e0 0x7fcef00cfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:40.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.657+0000 7fcee77fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcef00af5e0 0x7fcef00cfe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49754/0 (socket says 172.21.15.81:49754) 2023-10-06T03:24:40.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.657+0000 7fcee77fe700 1 -- 172.21.15.81:0/2421339195 learned_addr learned my addr 172.21.15.81:0/2421339195 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:40.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.657+0000 7fcee77fe700 1 -- 172.21.15.81:0/2421339195 >> v1:172.21.15.83:6789/0 conn(0x7fcef00ce820 legacy=0x7fcef00ccca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:40.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.657+0000 7fcee77fe700 1 -- 172.21.15.81:0/2421339195 >> v1:172.21.15.81:6789/0 conn(0x7fcef00af9b0 legacy=0x7fcef015db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:40.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.657+0000 7fcee77fe700 1 -- 172.21.15.81:0/2421339195 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef00cf330 con 0x7fcef00af5e0 2023-10-06T03:24:40.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.657+0000 7fcee77fe700 1 --2- 172.21.15.81:0/2421339195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcef00af5e0 0x7fcef00cfe10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fcee00099b0 tx=0x7fcee0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd0562e8e52ea16e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:40.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.658+0000 7fceeeffd700 1 -- 172.21.15.81:0/2421339195 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee000b860 con 0x7fcef00af5e0 2023-10-06T03:24:40.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.658+0000 7fceeeffd700 1 -- 172.21.15.81:0/2421339195 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee000b9c0 con 0x7fcef00af5e0 2023-10-06T03:24:40.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.658+0000 7fceeeffd700 1 -- 172.21.15.81:0/2421339195 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee000bd60 con 0x7fcef00af5e0 2023-10-06T03:24:40.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.658+0000 7fcef5bff700 1 -- 172.21.15.81:0/2421339195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcef00af5e0 msgr2=0x7fcef00cfe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:40.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.658+0000 7fcef5bff700 1 --2- 172.21.15.81:0/2421339195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcef00af5e0 0x7fcef00cfe10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fcee00099b0 tx=0x7fcee0009250 comp rx=0 tx=0).stop 2023-10-06T03:24:40.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.658+0000 7fcef5bff700 1 -- 172.21.15.81:0/2421339195 shutdown_connections 2023-10-06T03:24:40.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.658+0000 7fcef5bff700 1 --2- 172.21.15.81:0/2421339195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcef00af5e0 0x7fcef00cfe10 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:40.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.658+0000 7fcef5bff700 1 -- 172.21.15.81:0/2421339195 >> 172.21.15.81:0/2421339195 conn(0x7fcef006ed10 msgr2=0x7fcef006f110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:40.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.658+0000 7fcef5bff700 1 -- 172.21.15.81:0/2421339195 shutdown_connections 2023-10-06T03:24:40.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.658+0000 7fcef5bff700 1 -- 172.21.15.81:0/2421339195 wait complete. 2023-10-06T03:24:40.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.660+0000 7fcef5bff700 1 Processor -- start 2023-10-06T03:24:40.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.660+0000 7fcef5bff700 1 -- start start 2023-10-06T03:24:40.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.661+0000 7fcef5bff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcef00af5e0 0x7fcef014e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:40.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.661+0000 7fcef5bff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcef00af9b0 0x7fcef00b1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:40.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.661+0000 7fcef5bff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcef00ce820 0x7fcef00b2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:40.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.661+0000 7fcef5bff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef016ae30 con 0x7fcef00ce820 2023-10-06T03:24:40.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.661+0000 7fcef5bff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef016a850 con 0x7fcef00af9b0 2023-10-06T03:24:40.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.661+0000 7fcef5bff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef0169f20 con 0x7fcef00af5e0 2023-10-06T03:24:40.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.661+0000 7fceeffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcef00ce820 0x7fcef00b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:40.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.661+0000 7fceeffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcef00ce820 0x7fcef00b2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49760/0 (socket says 172.21.15.81:49760) 2023-10-06T03:24:40.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.661+0000 7fceeffff700 1 -- 172.21.15.81:0/150810787 learned_addr learned my addr 172.21.15.81:0/150810787 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:40.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.661+0000 7fceef7fe700 1 --2- 172.21.15.81:0/150810787 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcef00af9b0 0x7fcef00b1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:40.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.661+0000 7fceeffff700 1 -- 172.21.15.81:0/150810787 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcef00af5e0 msgr2=0x7fcef014e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:40.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.661+0000 7fcee77fe700 1 --2- 172.21.15.81:0/150810787 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcef00af5e0 0x7fcef014e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:40.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.661+0000 7fceeffff700 1 --2- 172.21.15.81:0/150810787 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcef00af5e0 0x7fcef014e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:40.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.661+0000 7fceeffff700 1 -- 172.21.15.81:0/150810787 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcef00af9b0 msgr2=0x7fcef00b1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:40.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.661+0000 7fceeffff700 1 --2- 172.21.15.81:0/150810787 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcef00af9b0 0x7fcef00b1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:40.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.661+0000 7fceeffff700 1 -- 172.21.15.81:0/150810787 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee00094f0 con 0x7fcef00ce820 2023-10-06T03:24:40.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.661+0000 7fcee77fe700 1 --2- 172.21.15.81:0/150810787 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcef00af5e0 0x7fcef014e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:40.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.661+0000 7fceef7fe700 1 --2- 172.21.15.81:0/150810787 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcef00af9b0 0x7fcef00b1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:40.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.662+0000 7fceeffff700 1 --2- 172.21.15.81:0/150810787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcef00ce820 0x7fcef00b2210 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fcee800c8e0 tx=0x7fcee8001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:40.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.662+0000 7fcee7fff700 1 -- 172.21.15.81:0/150810787 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee800ce80 con 0x7fcef00ce820 2023-10-06T03:24:40.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.662+0000 7fcee7fff700 1 -- 172.21.15.81:0/150810787 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee800a7e0 con 0x7fcef00ce820 2023-10-06T03:24:40.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.662+0000 7fcee7fff700 1 -- 172.21.15.81:0/150810787 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee800ab80 con 0x7fcef00ce820 2023-10-06T03:24:40.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.662+0000 7fcef5bff700 1 -- 172.21.15.81:0/150810787 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcef016a200 con 0x7fcef00ce820 2023-10-06T03:24:40.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.662+0000 7fcef5bff700 1 -- 172.21.15.81:0/150810787 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcef0169c10 con 0x7fcef00ce820 2023-10-06T03:24:40.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.663+0000 7fcef5bff700 1 -- 172.21.15.81:0/150810787 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcef016a9c0 con 0x7fcef00ce820 2023-10-06T03:24:40.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.664+0000 7fcee7fff700 1 -- 172.21.15.81:0/150810787 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcee8012420 con 0x7fcef00ce820 2023-10-06T03:24:40.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.665+0000 7fcee7fff700 1 --2- 172.21.15.81:0/150810787 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fced0066f30 0x7fced00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:40.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.665+0000 7fcee7fff700 1 -- 172.21.15.81:0/150810787 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6953+0+0 (secure 0 0 0) 0x7fcee8084da0 con 0x7fcef00ce820 2023-10-06T03:24:40.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.665+0000 7fcee77fe700 1 --2- 172.21.15.81:0/150810787 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fced0066f30 0x7fced00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:40.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.665+0000 7fcee77fe700 1 --2- 172.21.15.81:0/150810787 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fced0066f30 0x7fced00693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcee00099b0 tx=0x7fcee0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:40.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.669+0000 7fcee7fff700 1 -- 172.21.15.81:0/150810787 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcee8051a90 con 0x7fcef00ce820 2023-10-06T03:24:40.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:40.862+0000 7fcef5bff700 1 -- 172.21.15.81:0/150810787 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcef004c3c0 con 0x7fcef00ce820 2023-10-06T03:24:41.469 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:24:41.474 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:24:41.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:41.831+0000 7fcee7fff700 1 -- 172.21.15.81:0/150810787 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) v1 ==== 181+0+0 (secure 0 0 0) 0x7fcee80550b0 con 0x7fcef00ce820 2023-10-06T03:24:41.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:41.834+0000 7fcef5bff700 1 -- 172.21.15.81:0/150810787 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fced0066f30 msgr2=0x7fced00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:41.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:41.834+0000 7fcef5bff700 1 --2- 172.21.15.81:0/150810787 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fced0066f30 0x7fced00693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcee00099b0 tx=0x7fcee0017000 comp rx=0 tx=0).stop 2023-10-06T03:24:41.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:41.834+0000 7fcef5bff700 1 -- 172.21.15.81:0/150810787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcef00ce820 msgr2=0x7fcef00b2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:41.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:41.834+0000 7fcef5bff700 1 --2- 172.21.15.81:0/150810787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcef00ce820 0x7fcef00b2210 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fcee800c8e0 tx=0x7fcee8001710 comp rx=0 tx=0).stop 2023-10-06T03:24:41.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:41.834+0000 7fcef5bff700 1 -- 172.21.15.81:0/150810787 shutdown_connections 2023-10-06T03:24:41.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:41.834+0000 7fcef5bff700 1 --2- 172.21.15.81:0/150810787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcef00ce820 0x7fcef00b2210 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:41.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:41.834+0000 7fcef5bff700 1 --2- 172.21.15.81:0/150810787 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fced0066f30 0x7fced00693e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:41.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:41.834+0000 7fcef5bff700 1 --2- 172.21.15.81:0/150810787 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcef00af5e0 0x7fcef014e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:41.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:41.834+0000 7fcef5bff700 1 --2- 172.21.15.81:0/150810787 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcef00af9b0 0x7fcef00b1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:41.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:41.834+0000 7fcef5bff700 1 -- 172.21.15.81:0/150810787 >> 172.21.15.81:0/150810787 conn(0x7fcef006ed10 msgr2=0x7fcef0069030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:41.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:41.834+0000 7fcef5bff700 1 -- 172.21.15.81:0/150810787 shutdown_connections 2023-10-06T03:24:41.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:41.834+0000 7fcef5bff700 1 -- 172.21.15.81:0/150810787 wait complete. 2023-10-06T03:24:41.837 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2023-10-06T03:24:41.855 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T03:24:42.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.038+0000 7f518f59e700 1 Processor -- start 2023-10-06T03:24:42.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.038+0000 7f518f59e700 1 -- start start 2023-10-06T03:24:42.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.039+0000 7f518f59e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f519013c280 0x7f51900ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:42.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.039+0000 7f518f59e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51900cea20 con 0x7f51900ce5c0 2023-10-06T03:24:42.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.039+0000 7f518f59e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f519006cc30 con 0x7f519013c650 2023-10-06T03:24:42.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.039+0000 7f518f59e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f519006ced0 con 0x7f519013c280 2023-10-06T03:24:42.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.040+0000 7f518ed9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f51900ce5c0 0x7f5190159980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41268/0 (socket says 172.21.15.81:41268) 2023-10-06T03:24:42.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.040+0000 7f518ed9d700 1 -- 172.21.15.81:0/2114656370 learned_addr learned my addr 172.21.15.81:0/2114656370 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:24:42.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.040+0000 7f518e59c700 1 --2- 172.21.15.81:0/2114656370 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f519013c280 0x7f51900ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:42.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.040+0000 7f518d59a700 1 -- 172.21.15.81:0/2114656370 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2349250695 0 0) 0x7f5188001490 con 0x7f51900ce5c0 2023-10-06T03:24:42.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.040+0000 7f518d59a700 1 -- 172.21.15.81:0/2114656370 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5178003570 con 0x7f51900ce5c0 2023-10-06T03:24:42.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.040+0000 7f518d59a700 1 -- 172.21.15.81:0/2114656370 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3557452885 0 0) 0x7f519006cc30 con 0x7f519013c650 2023-10-06T03:24:42.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.040+0000 7f518d59a700 1 -- 172.21.15.81:0/2114656370 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5188001490 con 0x7f519013c650 2023-10-06T03:24:42.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.040+0000 7f518d59a700 1 -- 172.21.15.81:0/2114656370 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1784376782 0 0) 0x7f5178003570 con 0x7f51900ce5c0 2023-10-06T03:24:42.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.040+0000 7f518d59a700 1 -- 172.21.15.81:0/2114656370 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f519013c280 msgr2=0x7f51900ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:42.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.040+0000 7f518d59a700 1 --2- 172.21.15.81:0/2114656370 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f519013c280 0x7f51900ce080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:42.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.040+0000 7f518d59a700 1 -- 172.21.15.81:0/2114656370 >> v1:172.21.15.83:6789/0 conn(0x7f519013c650 legacy=0x7f51900b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:42.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.040+0000 7f518d59a700 1 -- 172.21.15.81:0/2114656370 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519006d1b0 con 0x7f51900ce5c0 2023-10-06T03:24:42.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.040+0000 7f518d59a700 1 -- 172.21.15.81:0/2114656370 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2513016936 0 0) 0x7f5188001980 con 0x7f51900ce5c0 2023-10-06T03:24:42.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.040+0000 7f518d59a700 1 -- 172.21.15.81:0/2114656370 >> v1:172.21.15.81:6789/0 conn(0x7f51900ce5c0 legacy=0x7f5190159980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:42.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.040+0000 7f518d59a700 1 --2- 172.21.15.81:0/2114656370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5178003c20 0x7f5178004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:42.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.040+0000 7f518d59a700 1 --2- 172.21.15.81:0/2114656370 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5178004810 0x7f5178004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:42.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.040+0000 7f518d59a700 1 --2- 172.21.15.81:0/2114656370 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f519013c280 0x7f51780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:42.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.040+0000 7f518d59a700 1 -- 172.21.15.81:0/2114656370 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f519006ced0 con 0x7f5178003c20 2023-10-06T03:24:42.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.040+0000 7f518d59a700 1 -- 172.21.15.81:0/2114656370 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517800bb40 con 0x7f5178004810 2023-10-06T03:24:42.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.040+0000 7f518d59a700 1 -- 172.21.15.81:0/2114656370 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f517800bd00 con 0x7f519013c280 2023-10-06T03:24:42.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.041+0000 7f518e59c700 1 --2- 172.21.15.81:0/2114656370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5178003c20 0x7f5178004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:42.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.041+0000 7f518ed9d700 1 --2- 172.21.15.81:0/2114656370 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f519013c280 0x7f51780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:42.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.041+0000 7f518dd9b700 1 --2- 172.21.15.81:0/2114656370 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5178004810 0x7f5178004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:42.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.041+0000 7f518e59c700 1 -- 172.21.15.81:0/2114656370 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f519013c280 msgr2=0x7f51780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:42.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.041+0000 7f518e59c700 1 --2- 172.21.15.81:0/2114656370 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f519013c280 0x7f51780051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:42.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.041+0000 7f518e59c700 1 -- 172.21.15.81:0/2114656370 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5178004810 msgr2=0x7f5178004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:42.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.041+0000 7f518e59c700 1 --2- 172.21.15.81:0/2114656370 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5178004810 0x7f5178004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:42.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.041+0000 7f518e59c700 1 -- 172.21.15.81:0/2114656370 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5178003570 con 0x7f5178003c20 2023-10-06T03:24:42.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.041+0000 7f518dd9b700 1 --2- 172.21.15.81:0/2114656370 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5178004810 0x7f5178004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:42.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.041+0000 7f518e59c700 1 --2- 172.21.15.81:0/2114656370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5178003c20 0x7f5178004010 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5180009c00 tx=0x7f51800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59102c2e8549f2e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:42.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.041+0000 7f518d59a700 1 -- 172.21.15.81:0/2114656370 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518000e710 con 0x7f5178003c20 2023-10-06T03:24:42.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.041+0000 7f518d59a700 1 -- 172.21.15.81:0/2114656370 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f518000e870 con 0x7f5178003c20 2023-10-06T03:24:42.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.041+0000 7f518d59a700 1 -- 172.21.15.81:0/2114656370 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518000ec30 con 0x7f5178003c20 2023-10-06T03:24:42.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.042+0000 7f518f59e700 1 -- 172.21.15.81:0/2114656370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5178003c20 msgr2=0x7f5178004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:42.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.042+0000 7f518f59e700 1 --2- 172.21.15.81:0/2114656370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5178003c20 0x7f5178004010 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5180009c00 tx=0x7f51800091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:42.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.042+0000 7f518ed9d700 1 -- 172.21.15.81:0/2114656370 reap_dead start 2023-10-06T03:24:42.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.042+0000 7f518f59e700 1 -- 172.21.15.81:0/2114656370 shutdown_connections 2023-10-06T03:24:42.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.042+0000 7f518f59e700 1 -- 172.21.15.81:0/2114656370 >> 172.21.15.81:0/2114656370 conn(0x7f519006b550 msgr2=0x7f519006b950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:42.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.042+0000 7f518f59e700 1 -- 172.21.15.81:0/2114656370 shutdown_connections 2023-10-06T03:24:42.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.042+0000 7f518f59e700 1 -- 172.21.15.81:0/2114656370 wait complete. 2023-10-06T03:24:42.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.043+0000 7f518f59e700 1 Processor -- start 2023-10-06T03:24:42.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.044+0000 7f518f59e700 1 -- start start 2023-10-06T03:24:42.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.044+0000 7f518f59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5178003c20 0x7f5190137bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:42.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.044+0000 7f518f59e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f51901544a0 0x7f519015f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:42.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.044+0000 7f518f59e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5190155a20 0x7f519013df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:42.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.045+0000 7f518f59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5190154980 con 0x7f5178003c20 2023-10-06T03:24:42.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.045+0000 7f518f59e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5190154c60 con 0x7f5190155a20 2023-10-06T03:24:42.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.045+0000 7f518f59e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5190154f40 con 0x7f51901544a0 2023-10-06T03:24:42.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.045+0000 7f518e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5178003c20 0x7f5190137bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:42.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.045+0000 7f518e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5178003c20 0x7f5190137bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49778/0 (socket says 172.21.15.81:49778) 2023-10-06T03:24:42.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.045+0000 7f518e59c700 1 -- 172.21.15.81:0/3261627005 learned_addr learned my addr 172.21.15.81:0/3261627005 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:42.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.045+0000 7f518e59c700 1 -- 172.21.15.81:0/3261627005 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f51901544a0 msgr2=0x7f519015f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:42.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.045+0000 7f518e59c700 1 --2- 172.21.15.81:0/3261627005 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f51901544a0 0x7f519015f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:42.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.045+0000 7f518e59c700 1 -- 172.21.15.81:0/3261627005 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5190155a20 msgr2=0x7f519013df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:42.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.045+0000 7f518ed9d700 1 --2- 172.21.15.81:0/3261627005 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5190155a20 0x7f519013df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:42.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.045+0000 7f518e59c700 1 --2- 172.21.15.81:0/3261627005 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5190155a20 0x7f519013df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:42.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.045+0000 7f518e59c700 1 -- 172.21.15.81:0/3261627005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5190155220 con 0x7f5178003c20 2023-10-06T03:24:42.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.045+0000 7f518ed9d700 1 --2- 172.21.15.81:0/3261627005 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5190155a20 0x7f519013df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:42.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.045+0000 7f518e59c700 1 --2- 172.21.15.81:0/3261627005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5178003c20 0x7f5190137bb0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f517800bb10 tx=0x7f518001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:42.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.045+0000 7f517e7fc700 1 -- 172.21.15.81:0/3261627005 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5180022070 con 0x7f5178003c20 2023-10-06T03:24:42.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.046+0000 7f517e7fc700 1 -- 172.21.15.81:0/3261627005 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f518000ebf0 con 0x7f5178003c20 2023-10-06T03:24:42.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.046+0000 7f518f59e700 1 -- 172.21.15.81:0/3261627005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5190155500 con 0x7f5178003c20 2023-10-06T03:24:42.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.046+0000 7f517e7fc700 1 -- 172.21.15.81:0/3261627005 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518001c6a0 con 0x7f5178003c20 2023-10-06T03:24:42.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.046+0000 7f518f59e700 1 -- 172.21.15.81:0/3261627005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f519015fb00 con 0x7f5178003c20 2023-10-06T03:24:42.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.047+0000 7f518f59e700 1 -- 172.21.15.81:0/3261627005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f519004c3c0 con 0x7f5178003c20 2023-10-06T03:24:42.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.047+0000 7f517e7fc700 1 -- 172.21.15.81:0/3261627005 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f518001ca90 con 0x7f5178003c20 2023-10-06T03:24:42.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.048+0000 7f517e7fc700 1 --2- 172.21.15.81:0/3261627005 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f5170066f30 0x7f51700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:42.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.048+0000 7f517e7fc700 1 -- 172.21.15.81:0/3261627005 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6515+0+0 (secure 0 0 0) 0x7f5180086280 con 0x7f5178003c20 2023-10-06T03:24:42.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.049+0000 7f518dd9b700 1 --2- 172.21.15.81:0/3261627005 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f5170066f30 0x7f51700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:42.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.049+0000 7f518dd9b700 1 --2- 172.21.15.81:0/3261627005 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f5170066f30 0x7f51700693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5184001220 tx=0x7f5184009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:42.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.052+0000 7f517e7fc700 1 -- 172.21.15.81:0/3261627005 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5180053120 con 0x7f5178003c20 2023-10-06T03:24:42.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.250+0000 7f518f59e700 1 -- 172.21.15.81:0/3261627005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f51900b32e0 con 0x7f5178003c20 2023-10-06T03:24:42.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.839+0000 7f517e7fc700 1 -- 172.21.15.81:0/3261627005 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5180056740 con 0x7f5178003c20 2023-10-06T03:24:42.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.842+0000 7f518f59e700 1 -- 172.21.15.81:0/3261627005 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f5170066f30 msgr2=0x7f51700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:42.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.842+0000 7f518f59e700 1 --2- 172.21.15.81:0/3261627005 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f5170066f30 0x7f51700693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5184001220 tx=0x7f5184009040 comp rx=0 tx=0).stop 2023-10-06T03:24:42.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.842+0000 7f518f59e700 1 -- 172.21.15.81:0/3261627005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5178003c20 msgr2=0x7f5190137bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:42.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.842+0000 7f518f59e700 1 --2- 172.21.15.81:0/3261627005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5178003c20 0x7f5190137bb0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f517800bb10 tx=0x7f518001a000 comp rx=0 tx=0).stop 2023-10-06T03:24:42.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.842+0000 7f518f59e700 1 -- 172.21.15.81:0/3261627005 shutdown_connections 2023-10-06T03:24:42.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.842+0000 7f518f59e700 1 --2- 172.21.15.81:0/3261627005 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5190155a20 0x7f519013df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:42.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.842+0000 7f518f59e700 1 --2- 172.21.15.81:0/3261627005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5178003c20 0x7f5190137bb0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:42.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.842+0000 7f518f59e700 1 --2- 172.21.15.81:0/3261627005 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f5170066f30 0x7f51700693e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:42.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.842+0000 7f518f59e700 1 --2- 172.21.15.81:0/3261627005 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f51901544a0 0x7f519015f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:42.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.842+0000 7f518f59e700 1 -- 172.21.15.81:0/3261627005 >> 172.21.15.81:0/3261627005 conn(0x7f519006b550 msgr2=0x7f519015b980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:42.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.843+0000 7f518f59e700 1 -- 172.21.15.81:0/3261627005 shutdown_connections 2023-10-06T03:24:42.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:42.843+0000 7f518f59e700 1 -- 172.21.15.81:0/3261627005 wait complete. 2023-10-06T03:24:42.846 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2023-10-06T03:24:42.863 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-10-06T03:24:43.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.045+0000 7f7e8dbff700 1 Processor -- start 2023-10-06T03:24:43.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.045+0000 7f7e8dbff700 1 -- start start 2023-10-06T03:24:43.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.047+0000 7f7e8dbff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7e881557c0 0x7f7e8806da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:43.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.047+0000 7f7e8dbff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7e880c77b0 0x7f7e880c2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:43.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.047+0000 7f7e8dbff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e8806ed50 con 0x7f7e88155b90 2023-10-06T03:24:43.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.047+0000 7f7e8dbff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e880c6d10 con 0x7f7e881557c0 2023-10-06T03:24:43.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.047+0000 7f7e8dbff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e8806e140 con 0x7f7e880c77b0 2023-10-06T03:24:43.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.047+0000 7f7e877fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7e881557c0 0x7f7e8806da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:43.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.047+0000 7f7e877fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7e881557c0 0x7f7e8806da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49786/0 (socket says 172.21.15.81:49786) 2023-10-06T03:24:43.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.047+0000 7f7e877fe700 1 -- 172.21.15.81:0/1729623958 learned_addr learned my addr 172.21.15.81:0/1729623958 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:43.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.047+0000 7f7e87fff700 1 --2- 172.21.15.81:0/1729623958 >> v2:172.21.15.83:3300/0 conn(0x7f7e880c77b0 0x7f7e880c2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:43.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.047+0000 7f7e877fe700 1 -- 172.21.15.81:0/1729623958 >> v2:172.21.15.83:3300/0 conn(0x7f7e880c77b0 msgr2=0x7f7e880c2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:43.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.047+0000 7f7e877fe700 1 --2- 172.21.15.81:0/1729623958 >> v2:172.21.15.83:3300/0 conn(0x7f7e880c77b0 0x7f7e880c2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:43.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.047+0000 7f7e877fe700 1 -- 172.21.15.81:0/1729623958 >> v1:172.21.15.83:6789/0 conn(0x7f7e88155b90 legacy=0x7f7e880c70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:43.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.047+0000 7f7e877fe700 1 -- 172.21.15.81:0/1729623958 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e8806e420 con 0x7f7e881557c0 2023-10-06T03:24:43.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.048+0000 7f7e877fe700 1 --2- 172.21.15.81:0/1729623958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e881557c0 0x7f7e8806da60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7e8806ce50 tx=0x7f7e78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8779ff0996c7ebc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:43.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.048+0000 7f7e867fc700 1 -- 172.21.15.81:0/1729623958 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e78009e70 con 0x7f7e881557c0 2023-10-06T03:24:43.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.048+0000 7f7e867fc700 1 -- 172.21.15.81:0/1729623958 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e7800b860 con 0x7f7e881557c0 2023-10-06T03:24:43.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.048+0000 7f7e867fc700 1 -- 172.21.15.81:0/1729623958 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7800bc00 con 0x7f7e881557c0 2023-10-06T03:24:43.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.048+0000 7f7e8dbff700 1 -- 172.21.15.81:0/1729623958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e881557c0 msgr2=0x7f7e8806da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:43.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.048+0000 7f7e8dbff700 1 --2- 172.21.15.81:0/1729623958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e881557c0 0x7f7e8806da60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7e8806ce50 tx=0x7f7e78009250 comp rx=0 tx=0).stop 2023-10-06T03:24:43.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.049+0000 7f7e8dbff700 1 -- 172.21.15.81:0/1729623958 shutdown_connections 2023-10-06T03:24:43.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.049+0000 7f7e8dbff700 1 --2- 172.21.15.81:0/1729623958 >> v2:172.21.15.83:3300/0 conn(0x7f7e880c77b0 0x7f7e880c2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:43.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.049+0000 7f7e8dbff700 1 --2- 172.21.15.81:0/1729623958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e881557c0 0x7f7e8806da60 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:43.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.049+0000 7f7e8dbff700 1 -- 172.21.15.81:0/1729623958 >> 172.21.15.81:0/1729623958 conn(0x7f7e880cc050 msgr2=0x7f7e880cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:43.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.049+0000 7f7e8dbff700 1 -- 172.21.15.81:0/1729623958 shutdown_connections 2023-10-06T03:24:43.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.049+0000 7f7e8dbff700 1 -- 172.21.15.81:0/1729623958 wait complete. 2023-10-06T03:24:43.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.050+0000 7f7e8dbff700 1 Processor -- start 2023-10-06T03:24:43.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.050+0000 7f7e8dbff700 1 -- start start 2023-10-06T03:24:43.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.051+0000 7f7e8dbff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7e880c77b0 0x7f7e880a9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:43.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.051+0000 7f7e8dbff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e881557c0 0x7f7e881531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:43.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.051+0000 7f7e8dbff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e88155b90 0x7f7e88150950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:43.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.051+0000 7f7e8dbff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e88169ff0 con 0x7f7e88155b90 2023-10-06T03:24:43.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.051+0000 7f7e8dbff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8816a2d0 con 0x7f7e880c77b0 2023-10-06T03:24:43.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.051+0000 7f7e8dbff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8816a5b0 con 0x7f7e881557c0 2023-10-06T03:24:43.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.051+0000 7f7e87fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e88155b90 0x7f7e88150950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:43.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.052+0000 7f7e87fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e88155b90 0x7f7e88150950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49794/0 (socket says 172.21.15.81:49794) 2023-10-06T03:24:43.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.052+0000 7f7e87fff700 1 -- 172.21.15.81:0/1657001315 learned_addr learned my addr 172.21.15.81:0/1657001315 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:43.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.052+0000 7f7e877fe700 1 --2- 172.21.15.81:0/1657001315 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7e880c77b0 0x7f7e880a9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:43.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.052+0000 7f7e86ffd700 1 --2- 172.21.15.81:0/1657001315 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e881557c0 0x7f7e881531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:43.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.052+0000 7f7e87fff700 1 -- 172.21.15.81:0/1657001315 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e881557c0 msgr2=0x7f7e881531d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:43.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.052+0000 7f7e87fff700 1 --2- 172.21.15.81:0/1657001315 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e881557c0 0x7f7e881531d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:43.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.052+0000 7f7e87fff700 1 -- 172.21.15.81:0/1657001315 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7e880c77b0 msgr2=0x7f7e880a9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:43.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.052+0000 7f7e87fff700 1 --2- 172.21.15.81:0/1657001315 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7e880c77b0 0x7f7e880a9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:43.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.052+0000 7f7e87fff700 1 -- 172.21.15.81:0/1657001315 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e780094f0 con 0x7f7e88155b90 2023-10-06T03:24:43.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.052+0000 7f7e87fff700 1 --2- 172.21.15.81:0/1657001315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e88155b90 0x7f7e88150950 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7e80009ec0 tx=0x7f7e8000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:43.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.052+0000 7f7e6f7fe700 1 -- 172.21.15.81:0/1657001315 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8000cc20 con 0x7f7e88155b90 2023-10-06T03:24:43.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.052+0000 7f7e6f7fe700 1 -- 172.21.15.81:0/1657001315 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8000f040 con 0x7f7e88155b90 2023-10-06T03:24:43.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.052+0000 7f7e8dbff700 1 -- 172.21.15.81:0/1657001315 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e8816a890 con 0x7f7e88155b90 2023-10-06T03:24:43.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.052+0000 7f7e6f7fe700 1 -- 172.21.15.81:0/1657001315 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e80014480 con 0x7f7e88155b90 2023-10-06T03:24:43.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.053+0000 7f7e8dbff700 1 -- 172.21.15.81:0/1657001315 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e880ae870 con 0x7f7e88155b90 2023-10-06T03:24:43.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.053+0000 7f7e8dbff700 1 -- 172.21.15.81:0/1657001315 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e8804c3c0 con 0x7f7e88155b90 2023-10-06T03:24:43.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.054+0000 7f7e6f7fe700 1 -- 172.21.15.81:0/1657001315 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7e80014810 con 0x7f7e88155b90 2023-10-06T03:24:43.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.055+0000 7f7e6f7fe700 1 --2- 172.21.15.81:0/1657001315 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7e74066f60 0x7f7e74069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:43.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.056+0000 7f7e6f7fe700 1 -- 172.21.15.81:0/1657001315 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6043+0+0 (secure 0 0 0) 0x7f7e80085190 con 0x7f7e88155b90 2023-10-06T03:24:43.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.056+0000 7f7e877fe700 1 --2- 172.21.15.81:0/1657001315 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7e74066f60 0x7f7e74069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:43.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.056+0000 7f7e877fe700 1 --2- 172.21.15.81:0/1657001315 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7e74066f60 0x7f7e74069410 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7e8806ce50 tx=0x7f7e78017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:43.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.060+0000 7f7e6f7fe700 1 -- 172.21.15.81:0/1657001315 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7e80052210 con 0x7f7e88155b90 2023-10-06T03:24:43.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.249+0000 7f7e8dbff700 1 -- 172.21.15.81:0/1657001315 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7e8816a130 con 0x7f7e88155b90 2023-10-06T03:24:43.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.849+0000 7f7e6f7fe700 1 -- 172.21.15.81:0/1657001315 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) v1 ==== 178+0+0 (secure 0 0 0) 0x7f7e8816a130 con 0x7f7e88155b90 2023-10-06T03:24:43.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.852+0000 7f7e8dbff700 1 -- 172.21.15.81:0/1657001315 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7e74066f60 msgr2=0x7f7e74069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:43.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.852+0000 7f7e8dbff700 1 --2- 172.21.15.81:0/1657001315 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7e74066f60 0x7f7e74069410 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7e8806ce50 tx=0x7f7e78017000 comp rx=0 tx=0).stop 2023-10-06T03:24:43.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.852+0000 7f7e8dbff700 1 -- 172.21.15.81:0/1657001315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e88155b90 msgr2=0x7f7e88150950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:43.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.852+0000 7f7e8dbff700 1 --2- 172.21.15.81:0/1657001315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e88155b90 0x7f7e88150950 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7e80009ec0 tx=0x7f7e8000b040 comp rx=0 tx=0).stop 2023-10-06T03:24:43.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.852+0000 7f7e8dbff700 1 -- 172.21.15.81:0/1657001315 shutdown_connections 2023-10-06T03:24:43.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.852+0000 7f7e8dbff700 1 --2- 172.21.15.81:0/1657001315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e88155b90 0x7f7e88150950 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:43.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.852+0000 7f7e8dbff700 1 --2- 172.21.15.81:0/1657001315 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7e880c77b0 0x7f7e880a9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:43.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.852+0000 7f7e8dbff700 1 --2- 172.21.15.81:0/1657001315 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7e74066f60 0x7f7e74069410 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:43.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.852+0000 7f7e8dbff700 1 --2- 172.21.15.81:0/1657001315 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e881557c0 0x7f7e881531d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:43.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.852+0000 7f7e8dbff700 1 -- 172.21.15.81:0/1657001315 >> 172.21.15.81:0/1657001315 conn(0x7f7e880cc050 msgr2=0x7f7e8806f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:43.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.852+0000 7f7e8dbff700 1 -- 172.21.15.81:0/1657001315 shutdown_connections 2023-10-06T03:24:43.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:43.852+0000 7f7e8dbff700 1 -- 172.21.15.81:0/1657001315 wait complete. 2023-10-06T03:24:43.855 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data_ec' removed 2023-10-06T03:24:43.872 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T03:24:43.872 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T03:24:43.872 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T03:24:43.872 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:24:43.873 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T03:24:43.873 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T03:24:43.873 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T03:24:43.873 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:24:43.873 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T03:24:43.873 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T03:24:43.874 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T03:24:43.874 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:24:43.874 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T03:24:43.874 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T03:24:43.874 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T03:24:43.874 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:24:43.886 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T03:24:43.887 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T03:24:43.888 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T03:24:43.888 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T03:24:43.891 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T03:24:43.892 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T03:24:43.892 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T03:24:43.893 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T03:24:43.931 INFO:tasks.ceph.mds.a:Started 2023-10-06T03:24:43.932 DEBUG:teuthology.parallel:result is None 2023-10-06T03:24:43.934 INFO:tasks.ceph.mds.c:Started 2023-10-06T03:24:43.934 DEBUG:teuthology.parallel:result is None 2023-10-06T03:24:43.936 INFO:tasks.ceph.mds.b:Started 2023-10-06T03:24:43.937 DEBUG:teuthology.parallel:result is None 2023-10-06T03:24:43.939 INFO:tasks.ceph.mds.d:Started 2023-10-06T03:24:43.939 DEBUG:teuthology.parallel:result is None 2023-10-06T03:24:43.940 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T03:24:44.071 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2023-10-06T03:24:44.073 INFO:tasks.ceph.mds.d.smithi083.stdout:starting mds.d at 2023-10-06T03:24:44.073 INFO:tasks.ceph.mds.b.smithi083.stdout:starting mds.b at 2023-10-06T03:24:44.076 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2023-10-06T03:24:44.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.156+0000 7f61c63ff700 1 Processor -- start 2023-10-06T03:24:44.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.156+0000 7f61c63ff700 1 -- start start 2023-10-06T03:24:44.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.158+0000 7f61c63ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f61c00b2880 0x7f61c00d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:44.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.158+0000 7f61c63ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f61c00cb700 0x7f61c00cf300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:44.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.158+0000 7f61c63ff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61c00d06d0 con 0x7f61c015d140 2023-10-06T03:24:44.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.158+0000 7f61c63ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61c00cbb70 con 0x7f61c00cb700 2023-10-06T03:24:44.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.158+0000 7f61bf7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f61c00cb700 0x7f61c00cf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:44.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.158+0000 7f61c63ff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61c0159ab0 con 0x7f61c00b2880 2023-10-06T03:24:44.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.158+0000 7f61bf7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f61c00cb700 0x7f61c00cf300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49822/0 (socket says 172.21.15.81:49822) 2023-10-06T03:24:44.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.158+0000 7f61bf7fe700 1 -- 172.21.15.81:0/2051702102 learned_addr learned my addr 172.21.15.81:0/2051702102 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:44.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.158+0000 7f61bffff700 1 --2- 172.21.15.81:0/2051702102 >> v2:172.21.15.83:3300/0 conn(0x7f61c00b2880 0x7f61c00d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:44.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.158+0000 7f61bf7fe700 1 -- 172.21.15.81:0/2051702102 >> v2:172.21.15.83:3300/0 conn(0x7f61c00b2880 msgr2=0x7f61c00d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:44.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.158+0000 7f61bf7fe700 1 --2- 172.21.15.81:0/2051702102 >> v2:172.21.15.83:3300/0 conn(0x7f61c00b2880 0x7f61c00d0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:44.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.158+0000 7f61bf7fe700 1 -- 172.21.15.81:0/2051702102 >> v1:172.21.15.83:6789/0 conn(0x7f61c015d140 legacy=0x7f61c015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:44.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.158+0000 7f61bf7fe700 1 -- 172.21.15.81:0/2051702102 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c00cf840 con 0x7f61c00cb700 2023-10-06T03:24:44.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.159+0000 7f61bf7fe700 1 --2- 172.21.15.81:0/2051702102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61c00cb700 0x7f61c00cf300 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f61c0071730 tx=0x7f61b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bc593f8e1d5f196 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:44.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.159+0000 7f61beffd700 1 -- 172.21.15.81:0/2051702102 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b400b820 con 0x7f61c00cb700 2023-10-06T03:24:44.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.159+0000 7f61beffd700 1 -- 172.21.15.81:0/2051702102 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b400b980 con 0x7f61c00cb700 2023-10-06T03:24:44.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.159+0000 7f61beffd700 1 -- 172.21.15.81:0/2051702102 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b400bd20 con 0x7f61c00cb700 2023-10-06T03:24:44.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.159+0000 7f61c63ff700 1 -- 172.21.15.81:0/2051702102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61c00cb700 msgr2=0x7f61c00cf300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:44.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.159+0000 7f61c63ff700 1 --2- 172.21.15.81:0/2051702102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61c00cb700 0x7f61c00cf300 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f61c0071730 tx=0x7f61b4009250 comp rx=0 tx=0).stop 2023-10-06T03:24:44.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.160+0000 7f61c63ff700 1 -- 172.21.15.81:0/2051702102 shutdown_connections 2023-10-06T03:24:44.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.160+0000 7f61c63ff700 1 --2- 172.21.15.81:0/2051702102 >> v2:172.21.15.83:3300/0 conn(0x7f61c00b2880 0x7f61c00d0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:44.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.160+0000 7f61c63ff700 1 --2- 172.21.15.81:0/2051702102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61c00cb700 0x7f61c00cf300 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:44.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.160+0000 7f61c63ff700 1 -- 172.21.15.81:0/2051702102 >> 172.21.15.81:0/2051702102 conn(0x7f61c00698e0 msgr2=0x7f61c0069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:44.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.160+0000 7f61c63ff700 1 -- 172.21.15.81:0/2051702102 shutdown_connections 2023-10-06T03:24:44.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.160+0000 7f61c63ff700 1 -- 172.21.15.81:0/2051702102 wait complete. 2023-10-06T03:24:44.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.161+0000 7f61c63ff700 1 Processor -- start 2023-10-06T03:24:44.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.161+0000 7f61c63ff700 1 -- start start 2023-10-06T03:24:44.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.162+0000 7f61c63ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61c00b2880 0x7f61c00b31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:44.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.162+0000 7f61c63ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f61c00cb700 0x7f61c00b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:44.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.162+0000 7f61c63ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61c015d140 0x7f61c00c6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:44.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.162+0000 7f61c63ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c00b4670 con 0x7f61c00b2880 2023-10-06T03:24:44.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.162+0000 7f61c63ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c00b3a60 con 0x7f61c015d140 2023-10-06T03:24:44.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.162+0000 7f61c63ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61c00b3d40 con 0x7f61c00cb700 2023-10-06T03:24:44.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.162+0000 7f61bffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61c00b2880 0x7f61c00b31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:44.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.162+0000 7f61bffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61c00b2880 0x7f61c00b31a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49830/0 (socket says 172.21.15.81:49830) 2023-10-06T03:24:44.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.162+0000 7f61bffff700 1 -- 172.21.15.81:0/3308627363 learned_addr learned my addr 172.21.15.81:0/3308627363 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:44.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.163+0000 7f61bffff700 1 -- 172.21.15.81:0/3308627363 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f61c00cb700 msgr2=0x7f61c00b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:44.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.163+0000 7f61bffff700 1 --2- 172.21.15.81:0/3308627363 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f61c00cb700 0x7f61c00b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:44.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.163+0000 7f61bffff700 1 -- 172.21.15.81:0/3308627363 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61c015d140 msgr2=0x7f61c00c6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:44.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.163+0000 7f61bffff700 1 --2- 172.21.15.81:0/3308627363 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61c015d140 0x7f61c00c6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:44.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.163+0000 7f61bffff700 1 -- 172.21.15.81:0/3308627363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b40094f0 con 0x7f61c00b2880 2023-10-06T03:24:44.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.163+0000 7f61bffff700 1 --2- 172.21.15.81:0/3308627363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61c00b2880 0x7f61c00b31a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f61b000d890 tx=0x7f61b0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:44.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.163+0000 7f61a7fff700 1 -- 172.21.15.81:0/3308627363 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b000b600 con 0x7f61c00b2880 2023-10-06T03:24:44.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.163+0000 7f61a7fff700 1 -- 172.21.15.81:0/3308627363 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b000b760 con 0x7f61c00b2880 2023-10-06T03:24:44.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.163+0000 7f61c63ff700 1 -- 172.21.15.81:0/3308627363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61c00b4020 con 0x7f61c00b2880 2023-10-06T03:24:44.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.163+0000 7f61a7fff700 1 -- 172.21.15.81:0/3308627363 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b000bae0 con 0x7f61c00b2880 2023-10-06T03:24:44.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.164+0000 7f61c63ff700 1 -- 172.21.15.81:0/3308627363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61c00b36e0 con 0x7f61c00b2880 2023-10-06T03:24:44.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.164+0000 7f61c63ff700 1 -- 172.21.15.81:0/3308627363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61c004c3c0 con 0x7f61c00b2880 2023-10-06T03:24:44.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.165+0000 7f61a7fff700 1 -- 172.21.15.81:0/3308627363 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f61b001e460 con 0x7f61c00b2880 2023-10-06T03:24:44.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.166+0000 7f61a7fff700 1 --2- 172.21.15.81:0/3308627363 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f61ac066f30 0x7f61ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:44.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.166+0000 7f61a7fff700 1 -- 172.21.15.81:0/3308627363 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f61b0084c20 con 0x7f61c00b2880 2023-10-06T03:24:44.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.166+0000 7f61bf7fe700 1 --2- 172.21.15.81:0/3308627363 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f61ac066f30 0x7f61ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:44.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.167+0000 7f61bf7fe700 1 --2- 172.21.15.81:0/3308627363 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f61ac066f30 0x7f61ac0693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f61c0071730 tx=0x7f61b4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:44.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.170+0000 7f61a7fff700 1 -- 172.21.15.81:0/3308627363 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f61b0051e50 con 0x7f61c00b2880 2023-10-06T03:24:44.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.374+0000 7f61c63ff700 1 -- 172.21.15.81:0/3308627363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f61c00cfac0 con 0x7f61c00b2880 2023-10-06T03:24:44.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.861+0000 7f61a7fff700 1 -- 172.21.15.81:0/3308627363 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v32) v1 ==== 97+0+0 (secure 0 0 0) 0x7f61b0055470 con 0x7f61c00b2880 2023-10-06T03:24:44.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.864+0000 7f61c63ff700 1 -- 172.21.15.81:0/3308627363 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f61ac066f30 msgr2=0x7f61ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:44.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.864+0000 7f61c63ff700 1 --2- 172.21.15.81:0/3308627363 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f61ac066f30 0x7f61ac0693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f61c0071730 tx=0x7f61b4017000 comp rx=0 tx=0).stop 2023-10-06T03:24:44.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.864+0000 7f61c63ff700 1 -- 172.21.15.81:0/3308627363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61c00b2880 msgr2=0x7f61c00b31a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:44.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.864+0000 7f61c63ff700 1 --2- 172.21.15.81:0/3308627363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61c00b2880 0x7f61c00b31a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f61b000d890 tx=0x7f61b0008040 comp rx=0 tx=0).stop 2023-10-06T03:24:44.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.864+0000 7f61c63ff700 1 -- 172.21.15.81:0/3308627363 shutdown_connections 2023-10-06T03:24:44.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.864+0000 7f61c63ff700 1 --2- 172.21.15.81:0/3308627363 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61c015d140 0x7f61c00c6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:44.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.864+0000 7f61c63ff700 1 --2- 172.21.15.81:0/3308627363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61c00b2880 0x7f61c00b31a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:44.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.864+0000 7f61c63ff700 1 --2- 172.21.15.81:0/3308627363 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f61ac066f30 0x7f61ac0693e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:44.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.864+0000 7f61c63ff700 1 --2- 172.21.15.81:0/3308627363 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f61c00cb700 0x7f61c00b4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:44.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.864+0000 7f61c63ff700 1 -- 172.21.15.81:0/3308627363 >> 172.21.15.81:0/3308627363 conn(0x7f61c00698e0 msgr2=0x7f61c01589b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:44.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.865+0000 7f61c63ff700 1 -- 172.21.15.81:0/3308627363 shutdown_connections 2023-10-06T03:24:44.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:44.865+0000 7f61c63ff700 1 -- 172.21.15.81:0/3308627363 wait complete. 2023-10-06T03:24:44.867 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2023-10-06T03:24:44.884 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T03:24:45.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.063+0000 7ff29cbff700 1 Processor -- start 2023-10-06T03:24:45.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.063+0000 7ff29cbff700 1 -- start start 2023-10-06T03:24:45.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.065+0000 7ff29cbff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff298147260 0x7ff29806ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:45.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.065+0000 7ff29cbff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff298147630 0x7ff2980cad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:45.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.065+0000 7ff29cbff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff298069ae0 con 0x7ff2980cb290 2023-10-06T03:24:45.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.065+0000 7ff29cbff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff298069dc0 con 0x7ff298147260 2023-10-06T03:24:45.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.065+0000 7ff29cbff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff29806a0a0 con 0x7ff298147630 2023-10-06T03:24:45.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.065+0000 7ff29659c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff298147260 0x7ff29806ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:45.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.065+0000 7ff29659c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff298147260 0x7ff29806ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49846/0 (socket says 172.21.15.81:49846) 2023-10-06T03:24:45.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.065+0000 7ff29659c700 1 -- 172.21.15.81:0/2412423169 learned_addr learned my addr 172.21.15.81:0/2412423169 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:45.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.065+0000 7ff29659c700 1 -- 172.21.15.81:0/2412423169 >> v2:172.21.15.83:3300/0 conn(0x7ff298147630 msgr2=0x7ff2980cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:45.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.065+0000 7ff29659c700 1 --2- 172.21.15.81:0/2412423169 >> v2:172.21.15.83:3300/0 conn(0x7ff298147630 0x7ff2980cad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:45.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.065+0000 7ff29659c700 1 -- 172.21.15.81:0/2412423169 >> v1:172.21.15.83:6789/0 conn(0x7ff2980cb290 legacy=0x7ff2980c68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:45.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.065+0000 7ff29659c700 1 -- 172.21.15.81:0/2412423169 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff29806a380 con 0x7ff298147260 2023-10-06T03:24:45.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.066+0000 7ff29659c700 1 --2- 172.21.15.81:0/2412423169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff298147260 0x7ff29806ab80 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff29806b850 tx=0x7ff288009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15e68a144d4cbf8b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:45.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.066+0000 7ff29559a700 1 -- 172.21.15.81:0/2412423169 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28800b820 con 0x7ff298147260 2023-10-06T03:24:45.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.066+0000 7ff29559a700 1 -- 172.21.15.81:0/2412423169 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff28800b980 con 0x7ff298147260 2023-10-06T03:24:45.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.066+0000 7ff29559a700 1 -- 172.21.15.81:0/2412423169 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28800bd20 con 0x7ff298147260 2023-10-06T03:24:45.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.066+0000 7ff29cbff700 1 -- 172.21.15.81:0/2412423169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff298147260 msgr2=0x7ff29806ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:45.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.066+0000 7ff29cbff700 1 --2- 172.21.15.81:0/2412423169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff298147260 0x7ff29806ab80 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff29806b850 tx=0x7ff288009250 comp rx=0 tx=0).stop 2023-10-06T03:24:45.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.066+0000 7ff29cbff700 1 -- 172.21.15.81:0/2412423169 shutdown_connections 2023-10-06T03:24:45.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.066+0000 7ff29cbff700 1 --2- 172.21.15.81:0/2412423169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff298147260 0x7ff29806ab80 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:45.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.066+0000 7ff29cbff700 1 --2- 172.21.15.81:0/2412423169 >> v2:172.21.15.83:3300/0 conn(0x7ff298147630 0x7ff2980cad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:45.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.066+0000 7ff29cbff700 1 -- 172.21.15.81:0/2412423169 >> 172.21.15.81:0/2412423169 conn(0x7ff2980cc090 msgr2=0x7ff2980cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:45.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.066+0000 7ff29cbff700 1 -- 172.21.15.81:0/2412423169 shutdown_connections 2023-10-06T03:24:45.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.066+0000 7ff29cbff700 1 -- 172.21.15.81:0/2412423169 wait complete. 2023-10-06T03:24:45.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.068+0000 7ff29cbff700 1 Processor -- start 2023-10-06T03:24:45.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.068+0000 7ff29cbff700 1 -- start start 2023-10-06T03:24:45.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.069+0000 7ff29cbff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2980cb290 0x7ff29813b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:45.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.069+0000 7ff29cbff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff298147260 0x7ff298171b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:45.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.069+0000 7ff29cbff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff298147630 0x7ff2981601c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:45.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.069+0000 7ff29cbff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2980c4260 con 0x7ff298147630 2023-10-06T03:24:45.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.069+0000 7ff29cbff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff298145620 con 0x7ff298147260 2023-10-06T03:24:45.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.069+0000 7ff29cbff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff298172070 con 0x7ff2980cb290 2023-10-06T03:24:45.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.069+0000 7ff296d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff298147630 0x7ff2981601c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:45.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.069+0000 7ff296d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff298147630 0x7ff2981601c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49860/0 (socket says 172.21.15.81:49860) 2023-10-06T03:24:45.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.069+0000 7ff296d9d700 1 -- 172.21.15.81:0/1751797403 learned_addr learned my addr 172.21.15.81:0/1751797403 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:45.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.069+0000 7ff29659c700 1 --2- 172.21.15.81:0/1751797403 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2980cb290 0x7ff29813b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:45.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.069+0000 7ff295d9b700 1 --2- 172.21.15.81:0/1751797403 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff298147260 0x7ff298171b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:45.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.069+0000 7ff296d9d700 1 -- 172.21.15.81:0/1751797403 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2980cb290 msgr2=0x7ff29813b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:45.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.069+0000 7ff296d9d700 1 --2- 172.21.15.81:0/1751797403 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2980cb290 0x7ff29813b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:45.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.069+0000 7ff296d9d700 1 -- 172.21.15.81:0/1751797403 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff298147260 msgr2=0x7ff298171b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:45.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.069+0000 7ff296d9d700 1 --2- 172.21.15.81:0/1751797403 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff298147260 0x7ff298171b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:45.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.069+0000 7ff296d9d700 1 -- 172.21.15.81:0/1751797403 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2880094f0 con 0x7ff298147630 2023-10-06T03:24:45.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.070+0000 7ff296d9d700 1 --2- 172.21.15.81:0/1751797403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff298147630 0x7ff2981601c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff29000bbb0 tx=0x7ff290009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:45.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.070+0000 7ff2867fc700 1 -- 172.21.15.81:0/1751797403 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2900092e0 con 0x7ff298147630 2023-10-06T03:24:45.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.070+0000 7ff2867fc700 1 -- 172.21.15.81:0/1751797403 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff29000c7a0 con 0x7ff298147630 2023-10-06T03:24:45.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.070+0000 7ff2867fc700 1 -- 172.21.15.81:0/1751797403 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29000cb40 con 0x7ff298147630 2023-10-06T03:24:45.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.070+0000 7ff29cbff700 1 -- 172.21.15.81:0/1751797403 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2980acdb0 con 0x7ff298147630 2023-10-06T03:24:45.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.070+0000 7ff29cbff700 1 -- 172.21.15.81:0/1751797403 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2980c3f10 con 0x7ff298147630 2023-10-06T03:24:45.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.071+0000 7ff29cbff700 1 -- 172.21.15.81:0/1751797403 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2980c40a0 con 0x7ff298147630 2023-10-06T03:24:45.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.072+0000 7ff2867fc700 1 -- 172.21.15.81:0/1751797403 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff290012070 con 0x7ff298147630 2023-10-06T03:24:45.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.073+0000 7ff2867fc700 1 --2- 172.21.15.81:0/1751797403 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff278066f30 0x7ff2780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:45.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.073+0000 7ff2867fc700 1 -- 172.21.15.81:0/1751797403 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5526+0+0 (secure 0 0 0) 0x7ff290084060 con 0x7ff298147630 2023-10-06T03:24:45.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.073+0000 7ff29659c700 1 --2- 172.21.15.81:0/1751797403 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff278066f30 0x7ff2780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:45.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.074+0000 7ff29659c700 1 --2- 172.21.15.81:0/1751797403 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff278066f30 0x7ff2780693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff29806b850 tx=0x7ff288016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:45.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.077+0000 7ff2867fc700 1 -- 172.21.15.81:0/1751797403 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff2900512e0 con 0x7ff298147630 2023-10-06T03:24:45.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.339+0000 7ff29cbff700 1 -- 172.21.15.81:0/1751797403 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ff29806a660 con 0x7ff298147630 2023-10-06T03:24:45.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.339+0000 7ff2867fc700 1 -- 172.21.15.81:0/1751797403 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7ff290054900 con 0x7ff298147630 2023-10-06T03:24:45.340 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:24:45.340 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T03:24:45.340 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2023-10-06T03:24:45.341 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T03:24:45.341 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2023-10-06T03:24:45.341 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCEfR9lAjGXERAA+7LUsMjk9KJ93+18lZm5aQ==", 2023-10-06T03:24:45.341 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T03:24:45.341 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T03:24:45.341 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T03:24:45.341 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T03:24:45.341 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T03:24:45.341 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T03:24:45.341 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T03:24:45.342 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T03:24:45.342 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2023-10-06T03:24:45.342 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCEfR9lkHpCJhAAuB+BT/teSqCc1NJ0mEk4hA==", 2023-10-06T03:24:45.342 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T03:24:45.342 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T03:24:45.342 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T03:24:45.342 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T03:24:45.342 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T03:24:45.342 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T03:24:45.342 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T03:24:45.343 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T03:24:45.343 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2023-10-06T03:24:45.343 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCEfR9lH37sGxAAxY4R6GIDNumJk8VYoVwhRA==", 2023-10-06T03:24:45.343 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T03:24:45.343 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T03:24:45.343 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T03:24:45.343 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T03:24:45.343 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T03:24:45.343 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T03:24:45.343 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T03:24:45.343 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T03:24:45.343 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2023-10-06T03:24:45.343 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCEfR9l5iWsMBAAfyBSEUMZPujA6UgBdFN+fA==", 2023-10-06T03:24:45.344 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T03:24:45.344 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T03:24:45.344 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T03:24:45.344 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T03:24:45.344 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T03:24:45.344 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T03:24:45.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T03:24:45.344 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T03:24:45.344 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2023-10-06T03:24:45.344 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCIfR9lTcHdJhAA0eVdUm48/it3BmkczVlljg==", 2023-10-06T03:24:45.344 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T03:24:45.345 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T03:24:45.345 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T03:24:45.345 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T03:24:45.345 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T03:24:45.345 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T03:24:45.345 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T03:24:45.345 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2023-10-06T03:24:45.345 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCLfR9lplo0KhAAvqadP20cm4k5wvYY1RmBPg==", 2023-10-06T03:24:45.345 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T03:24:45.345 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T03:24:45.345 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T03:24:45.345 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T03:24:45.346 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T03:24:45.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T03:24:45.346 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T03:24:45.346 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2023-10-06T03:24:45.346 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCOfR9luUszLBAAGtT+YFfViyBmhVGYllP7Uw==", 2023-10-06T03:24:45.346 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T03:24:45.346 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T03:24:45.346 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T03:24:45.346 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T03:24:45.347 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T03:24:45.347 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T03:24:45.347 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T03:24:45.347 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2023-10-06T03:24:45.347 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCRfR9ltDb2MhAA5exrej1tY10faawm0yO7/A==", 2023-10-06T03:24:45.347 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T03:24:45.347 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T03:24:45.347 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T03:24:45.347 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T03:24:45.347 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T03:24:45.347 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T03:24:45.347 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T03:24:45.348 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2023-10-06T03:24:45.348 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCYfR9lvHTKBRAAiB70jUlv77eYZsdXW15BGQ==", 2023-10-06T03:24:45.348 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T03:24:45.348 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T03:24:45.348 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T03:24:45.348 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T03:24:45.348 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T03:24:45.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T03:24:45.348 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T03:24:45.348 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2023-10-06T03:24:45.348 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCbfR9lGfAtCBAAOA+EIqxcsj8ifR2cGPMb9A==", 2023-10-06T03:24:45.348 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T03:24:45.349 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T03:24:45.349 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T03:24:45.349 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T03:24:45.349 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T03:24:45.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T03:24:45.349 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T03:24:45.349 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2023-10-06T03:24:45.349 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCefR9lTwueChAAToelbRZrG6PZKXUHe2lcOw==", 2023-10-06T03:24:45.349 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T03:24:45.349 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T03:24:45.349 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T03:24:45.349 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T03:24:45.350 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T03:24:45.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T03:24:45.350 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T03:24:45.350 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2023-10-06T03:24:45.350 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQChfR9lssJzDBAAmdZqEcq8pZIAtRQ3Shb6dA==", 2023-10-06T03:24:45.350 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T03:24:45.350 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-06T03:24:45.350 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-06T03:24:45.350 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T03:24:45.350 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T03:24:45.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T03:24:45.351 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T03:24:45.351 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2023-10-06T03:24:45.351 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCEfR9lvC9rORAAEapIVaQt8uYuYc54lxyMSA==", 2023-10-06T03:24:45.351 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T03:24:45.351 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T03:24:45.351 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-06T03:24:45.351 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-06T03:24:45.351 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-06T03:24:45.351 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T03:24:45.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T03:24:45.352 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T03:24:45.352 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2023-10-06T03:24:45.352 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCFfR9lrz1UCxAAWpz2cFK0CeM591c1ZxPWdw==", 2023-10-06T03:24:45.352 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T03:24:45.352 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T03:24:45.352 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-06T03:24:45.352 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-06T03:24:45.352 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-06T03:24:45.352 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T03:24:45.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T03:24:45.352 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T03:24:45.352 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2023-10-06T03:24:45.352 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCFfR9lWC+aBBAAKAxIFUayi1py63P4L5kaEQ==", 2023-10-06T03:24:45.353 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T03:24:45.353 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T03:24:45.353 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-06T03:24:45.353 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-06T03:24:45.353 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-06T03:24:45.353 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T03:24:45.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T03:24:45.353 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T03:24:45.353 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2023-10-06T03:24:45.353 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCFfR9lPFb8ERAA4zlybKipwO35yitDisQIGA==", 2023-10-06T03:24:45.353 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T03:24:45.353 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-06T03:24:45.354 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-06T03:24:45.354 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-06T03:24:45.354 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-06T03:24:45.354 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T03:24:45.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T03:24:45.354 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T03:24:45.354 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2023-10-06T03:24:45.354 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCDfR9l0Q7/GxAAMeNESg8r3ygEEivUDhdxaw==", 2023-10-06T03:24:45.354 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T03:24:45.354 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-06T03:24:45.354 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-06T03:24:45.354 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-06T03:24:45.355 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T03:24:45.355 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T03:24:45.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T03:24:45.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T03:24:45.355 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-mds", 2023-10-06T03:24:45.355 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCofR9lWzcHMBAAzRxuZ/HkMjJDmqIkKhHgjg==", 2023-10-06T03:24:45.355 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T03:24:45.355 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-mds" 2023-10-06T03:24:45.355 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T03:24:45.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T03:24:45.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T03:24:45.355 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-mgr", 2023-10-06T03:24:45.355 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCofR9lqUQHMBAAduK4vbvjyU2gNNvM61M85g==", 2023-10-06T03:24:45.356 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T03:24:45.356 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-06T03:24:45.356 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T03:24:45.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T03:24:45.356 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T03:24:45.356 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-osd", 2023-10-06T03:24:45.356 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCofR9lHk0HMBAAOctd0HapSipDdG3qiSQekw==", 2023-10-06T03:24:45.356 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T03:24:45.356 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-osd" 2023-10-06T03:24:45.357 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T03:24:45.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T03:24:45.357 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T03:24:45.357 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-rbd", 2023-10-06T03:24:45.357 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCofR9leVUHMBAA3nQ+UO2fiTd0CHEfedZ+dg==", 2023-10-06T03:24:45.357 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T03:24:45.357 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-06T03:24:45.357 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T03:24:45.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T03:24:45.357 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T03:24:45.358 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-06T03:24:45.358 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCofR9l7l0HMBAA7KH5RYi0OV/XsvDqag8XjQ==", 2023-10-06T03:24:45.358 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T03:24:45.358 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-06T03:24:45.358 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T03:24:45.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T03:24:45.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T03:24:45.358 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-rgw", 2023-10-06T03:24:45.358 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCofR9lsmYHMBAAxSJAsWFMLceFm+a93MCJCQ==", 2023-10-06T03:24:45.358 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T03:24:45.358 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-06T03:24:45.359 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T03:24:45.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T03:24:45.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T03:24:45.359 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2023-10-06T03:24:45.359 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCEfR9lZDLGChAAV8lHi/WF1WnkkYkDlWmpRg==", 2023-10-06T03:24:45.359 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T03:24:45.359 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-06T03:24:45.359 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-10-06T03:24:45.359 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T03:24:45.360 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T03:24:45.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T03:24:45.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T03:24:45.360 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2023-10-06T03:24:45.360 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCEfR9lD2WjAxAAHDliqz+MLlnqVbsYxJfTxA==", 2023-10-06T03:24:45.360 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-06T03:24:45.360 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-06T03:24:45.360 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-10-06T03:24:45.360 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-06T03:24:45.360 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T03:24:45.361 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T03:24:45.361 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-06T03:24:45.361 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T03:24:45.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.341+0000 7ff29cbff700 1 -- 172.21.15.81:0/1751797403 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff278066f30 msgr2=0x7ff2780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:45.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.341+0000 7ff29cbff700 1 --2- 172.21.15.81:0/1751797403 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff278066f30 0x7ff2780693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff29806b850 tx=0x7ff288016000 comp rx=0 tx=0).stop 2023-10-06T03:24:45.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.341+0000 7ff29cbff700 1 -- 172.21.15.81:0/1751797403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff298147630 msgr2=0x7ff2981601c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:45.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.341+0000 7ff29cbff700 1 --2- 172.21.15.81:0/1751797403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff298147630 0x7ff2981601c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff29000bbb0 tx=0x7ff290009840 comp rx=0 tx=0).stop 2023-10-06T03:24:45.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.341+0000 7ff29cbff700 1 -- 172.21.15.81:0/1751797403 shutdown_connections 2023-10-06T03:24:45.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.341+0000 7ff29cbff700 1 --2- 172.21.15.81:0/1751797403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff298147630 0x7ff2981601c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:45.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.341+0000 7ff29cbff700 1 --2- 172.21.15.81:0/1751797403 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff278066f30 0x7ff2780693e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:45.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.341+0000 7ff29cbff700 1 --2- 172.21.15.81:0/1751797403 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2980cb290 0x7ff29813b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:45.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.341+0000 7ff29cbff700 1 --2- 172.21.15.81:0/1751797403 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff298147260 0x7ff298171b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:45.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.341+0000 7ff29cbff700 1 -- 172.21.15.81:0/1751797403 >> 172.21.15.81:0/1751797403 conn(0x7ff2980cc090 msgr2=0x7ff2980cb810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:45.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.342+0000 7ff29cbff700 1 -- 172.21.15.81:0/1751797403 shutdown_connections 2023-10-06T03:24:45.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.342+0000 7ff29cbff700 1 -- 172.21.15.81:0/1751797403 wait complete. 2023-10-06T03:24:45.364 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-06T03:24:45.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.545+0000 7f2bb8bff700 1 Processor -- start 2023-10-06T03:24:45.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.545+0000 7f2bb8bff700 1 -- start start 2023-10-06T03:24:45.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.547+0000 7f2bb8bff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2bb406d680 0x7f2bb40c6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:45.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.547+0000 7f2bb8bff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2bb406da50 0x7f2bb40c7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:45.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.547+0000 7f2bb8bff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2bb40aee50 0x7f2bb4140710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:45.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.547+0000 7f2bb8bff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bb4069650 con 0x7f2bb40aee50 2023-10-06T03:24:45.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.547+0000 7f2bb8bff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bb406a190 con 0x7f2bb406da50 2023-10-06T03:24:45.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.547+0000 7f2bb8bff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb4069860 con 0x7f2bb406d680 2023-10-06T03:24:45.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.547+0000 7f2bb2d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2bb40aee50 0x7f2bb4140710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:45.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.547+0000 7f2bb2d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2bb40aee50 0x7f2bb4140710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49870/0 (socket says 172.21.15.81:49870) 2023-10-06T03:24:45.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.547+0000 7f2bb2d9d700 1 -- 172.21.15.81:0/1159129258 learned_addr learned my addr 172.21.15.81:0/1159129258 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:45.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.547+0000 7f2bb259c700 1 --2- 172.21.15.81:0/1159129258 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2bb406d680 0x7f2bb40c6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:45.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.547+0000 7f2bb1d9b700 1 --2- 172.21.15.81:0/1159129258 >> v2:172.21.15.83:3300/0 conn(0x7f2bb406da50 0x7f2bb40c7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:45.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.547+0000 7f2bb2d9d700 1 -- 172.21.15.81:0/1159129258 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2bb406d680 msgr2=0x7f2bb40c6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:45.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.547+0000 7f2bb2d9d700 1 --2- 172.21.15.81:0/1159129258 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2bb406d680 0x7f2bb40c6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:45.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.547+0000 7f2bb2d9d700 1 -- 172.21.15.81:0/1159129258 >> v2:172.21.15.83:3300/0 conn(0x7f2bb406da50 msgr2=0x7f2bb40c7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:45.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.547+0000 7f2bb2d9d700 1 --2- 172.21.15.81:0/1159129258 >> v2:172.21.15.83:3300/0 conn(0x7f2bb406da50 0x7f2bb40c7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:45.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.547+0000 7f2bb2d9d700 1 -- 172.21.15.81:0/1159129258 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb4069b40 con 0x7f2bb40aee50 2023-10-06T03:24:45.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.547+0000 7f2bb1d9b700 1 --2- 172.21.15.81:0/1159129258 >> v2:172.21.15.83:3300/0 conn(0x7f2bb406da50 0x7f2bb40c7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:45.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.547+0000 7f2bb259c700 1 --2- 172.21.15.81:0/1159129258 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2bb406d680 0x7f2bb40c6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:45.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.548+0000 7f2bb2d9d700 1 --2- 172.21.15.81:0/1159129258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bb40aee50 0x7f2bb4140710 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2bb406d120 tx=0x7f2bac009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dca3a4b984b24c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:45.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.548+0000 7f2bb159a700 1 -- 172.21.15.81:0/1159129258 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bac00e070 con 0x7f2bb40aee50 2023-10-06T03:24:45.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.548+0000 7f2bb159a700 1 -- 172.21.15.81:0/1159129258 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bac00ba50 con 0x7f2bb40aee50 2023-10-06T03:24:45.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.548+0000 7f2bb159a700 1 -- 172.21.15.81:0/1159129258 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bac0092e0 con 0x7f2bb40aee50 2023-10-06T03:24:45.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.548+0000 7f2bb8bff700 1 -- 172.21.15.81:0/1159129258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bb40aee50 msgr2=0x7f2bb4140710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:45.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.548+0000 7f2bb8bff700 1 --2- 172.21.15.81:0/1159129258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bb40aee50 0x7f2bb4140710 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2bb406d120 tx=0x7f2bac009840 comp rx=0 tx=0).stop 2023-10-06T03:24:45.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.548+0000 7f2bb8bff700 1 -- 172.21.15.81:0/1159129258 shutdown_connections 2023-10-06T03:24:45.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.548+0000 7f2bb8bff700 1 --2- 172.21.15.81:0/1159129258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bb40aee50 0x7f2bb4140710 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:45.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.548+0000 7f2bb8bff700 1 --2- 172.21.15.81:0/1159129258 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2bb406d680 0x7f2bb40c6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:45.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.548+0000 7f2bb8bff700 1 --2- 172.21.15.81:0/1159129258 >> v2:172.21.15.83:3300/0 conn(0x7f2bb406da50 0x7f2bb40c7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:45.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.549+0000 7f2bb8bff700 1 -- 172.21.15.81:0/1159129258 >> 172.21.15.81:0/1159129258 conn(0x7f2bb40cc090 msgr2=0x7f2bb40cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:45.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.549+0000 7f2bb8bff700 1 -- 172.21.15.81:0/1159129258 shutdown_connections 2023-10-06T03:24:45.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.549+0000 7f2bb8bff700 1 -- 172.21.15.81:0/1159129258 wait complete. 2023-10-06T03:24:45.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.550+0000 7f2bb8bff700 1 Processor -- start 2023-10-06T03:24:45.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.550+0000 7f2bb8bff700 1 -- start start 2023-10-06T03:24:45.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.551+0000 7f2bb8bff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2bb406d680 0x7f2bb416d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:45.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.551+0000 7f2bb8bff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2bb406da50 0x7f2bb415c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:45.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.551+0000 7f2bb8bff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bb40aee50 0x7f2bb413cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:45.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.551+0000 7f2bb8bff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb413bf80 con 0x7f2bb40aee50 2023-10-06T03:24:45.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.551+0000 7f2bb8bff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb416da50 con 0x7f2bb406d680 2023-10-06T03:24:45.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.551+0000 7f2bb8bff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb413c220 con 0x7f2bb406da50 2023-10-06T03:24:45.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.551+0000 7f2bb2d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bb40aee50 0x7f2bb413cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:45.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.551+0000 7f2bb2d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bb40aee50 0x7f2bb413cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49872/0 (socket says 172.21.15.81:49872) 2023-10-06T03:24:45.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.551+0000 7f2bb2d9d700 1 -- 172.21.15.81:0/4178077941 learned_addr learned my addr 172.21.15.81:0/4178077941 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:45.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.551+0000 7f2bb1d9b700 1 --2- 172.21.15.81:0/4178077941 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2bb406da50 0x7f2bb415c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:45.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.551+0000 7f2bb259c700 1 --2- 172.21.15.81:0/4178077941 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2bb406d680 0x7f2bb416d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:45.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.552+0000 7f2bb2d9d700 1 -- 172.21.15.81:0/4178077941 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2bb406da50 msgr2=0x7f2bb415c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:45.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.552+0000 7f2bb2d9d700 1 --2- 172.21.15.81:0/4178077941 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2bb406da50 0x7f2bb415c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:45.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.552+0000 7f2bb2d9d700 1 -- 172.21.15.81:0/4178077941 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2bb406d680 msgr2=0x7f2bb416d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:45.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.552+0000 7f2bb2d9d700 1 --2- 172.21.15.81:0/4178077941 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2bb406d680 0x7f2bb416d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:45.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.552+0000 7f2bb2d9d700 1 -- 172.21.15.81:0/4178077941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bac009ae0 con 0x7f2bb40aee50 2023-10-06T03:24:45.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.552+0000 7f2bb2d9d700 1 --2- 172.21.15.81:0/4178077941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bb40aee50 0x7f2bb413cd00 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2bac009880 tx=0x7f2bac018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:45.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.552+0000 7f2ba27fc700 1 -- 172.21.15.81:0/4178077941 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bac0032f0 con 0x7f2bb40aee50 2023-10-06T03:24:45.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.552+0000 7f2ba27fc700 1 -- 172.21.15.81:0/4178077941 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bac008d20 con 0x7f2bb40aee50 2023-10-06T03:24:45.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.552+0000 7f2ba27fc700 1 -- 172.21.15.81:0/4178077941 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bac026690 con 0x7f2bb40aee50 2023-10-06T03:24:45.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.552+0000 7f2bb8bff700 1 -- 172.21.15.81:0/4178077941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bb413c500 con 0x7f2bb40aee50 2023-10-06T03:24:45.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.552+0000 7f2bb8bff700 1 -- 172.21.15.81:0/4178077941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bb40ae8b0 con 0x7f2bb40aee50 2023-10-06T03:24:45.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.553+0000 7f2bb8bff700 1 -- 172.21.15.81:0/4178077941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bb413ca20 con 0x7f2bb40aee50 2023-10-06T03:24:45.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.554+0000 7f2ba27fc700 1 -- 172.21.15.81:0/4178077941 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2bac003040 con 0x7f2bb40aee50 2023-10-06T03:24:45.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.555+0000 7f2ba27fc700 1 --2- 172.21.15.81:0/4178077941 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2b94066f30 0x7f2b940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:45.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.555+0000 7f2ba27fc700 1 -- 172.21.15.81:0/4178077941 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f2bac085e00 con 0x7f2bb40aee50 2023-10-06T03:24:45.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.555+0000 7f2bb259c700 1 --2- 172.21.15.81:0/4178077941 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2b94066f30 0x7f2b940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:45.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.556+0000 7f2bb259c700 1 --2- 172.21.15.81:0/4178077941 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2b94066f30 0x7f2b940693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4006f00 tx=0x7f2ba4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:45.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.559+0000 7f2ba27fc700 1 -- 172.21.15.81:0/4178077941 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2bb413ca20 con 0x7f2bb40aee50 2023-10-06T03:24:45.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.826+0000 7f2bb8bff700 1 -- 172.21.15.81:0/4178077941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f2bb413ca20 con 0x7f2bb40aee50 2023-10-06T03:24:45.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.831+0000 7f2ba27fc700 1 -- 172.21.15.81:0/4178077941 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f2bb413ca20 con 0x7f2bb40aee50 2023-10-06T03:24:45.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.833+0000 7f2bb8bff700 1 -- 172.21.15.81:0/4178077941 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2b94066f30 msgr2=0x7f2b940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:45.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.833+0000 7f2bb8bff700 1 --2- 172.21.15.81:0/4178077941 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2b94066f30 0x7f2b940693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4006f00 tx=0x7f2ba4008040 comp rx=0 tx=0).stop 2023-10-06T03:24:45.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.833+0000 7f2bb8bff700 1 -- 172.21.15.81:0/4178077941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bb40aee50 msgr2=0x7f2bb413cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:45.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.833+0000 7f2bb8bff700 1 --2- 172.21.15.81:0/4178077941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bb40aee50 0x7f2bb413cd00 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2bac009880 tx=0x7f2bac018000 comp rx=0 tx=0).stop 2023-10-06T03:24:45.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.833+0000 7f2bb8bff700 1 -- 172.21.15.81:0/4178077941 shutdown_connections 2023-10-06T03:24:45.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.833+0000 7f2bb8bff700 1 --2- 172.21.15.81:0/4178077941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bb40aee50 0x7f2bb413cd00 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:45.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.833+0000 7f2bb8bff700 1 --2- 172.21.15.81:0/4178077941 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2bb406d680 0x7f2bb416d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:45.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.833+0000 7f2bb8bff700 1 --2- 172.21.15.81:0/4178077941 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2b94066f30 0x7f2b940693e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:45.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.833+0000 7f2bb8bff700 1 --2- 172.21.15.81:0/4178077941 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2bb406da50 0x7f2bb415c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:45.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.833+0000 7f2bb8bff700 1 -- 172.21.15.81:0/4178077941 >> 172.21.15.81:0/4178077941 conn(0x7f2bb40cc090 msgr2=0x7f2bb40b15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:45.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.833+0000 7f2bb8bff700 1 -- 172.21.15.81:0/4178077941 shutdown_connections 2023-10-06T03:24:45.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:45.833+0000 7f2bb8bff700 1 -- 172.21.15.81:0/4178077941 wait complete. 2023-10-06T03:24:45.852 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-06T03:24:46.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.036+0000 7f0c4c99d700 1 Processor -- start 2023-10-06T03:24:46.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.036+0000 7f0c4c99d700 1 -- start start 2023-10-06T03:24:46.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.037+0000 7f0c4c99d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f0c480cc670 0x7f0c480ccd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:46.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.037+0000 7f0c4c99d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0c480b2420 0x7f0c4815a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:46.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.037+0000 7f0c4c99d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c480b4760 con 0x7f0c4815a450 2023-10-06T03:24:46.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.037+0000 7f0c4c99d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c480b60f0 con 0x7f0c480b2420 2023-10-06T03:24:46.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.037+0000 7f0c4c99d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c480cd320 con 0x7f0c480cc670 2023-10-06T03:24:46.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.038+0000 7f0c47fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0c480b2420 0x7f0c4815a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:46.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.038+0000 7f0c47fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0c480b2420 0x7f0c4815a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49880/0 (socket says 172.21.15.81:49880) 2023-10-06T03:24:46.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.038+0000 7f0c47fff700 1 -- 172.21.15.81:0/1474181469 learned_addr learned my addr 172.21.15.81:0/1474181469 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:46.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.038+0000 7f0c477fe700 1 --2- 172.21.15.81:0/1474181469 >> v2:172.21.15.83:3300/0 conn(0x7f0c480cc670 0x7f0c480ccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:46.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.038+0000 7f0c47fff700 1 -- 172.21.15.81:0/1474181469 >> v2:172.21.15.83:3300/0 conn(0x7f0c480cc670 msgr2=0x7f0c480ccd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:46.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.038+0000 7f0c47fff700 1 --2- 172.21.15.81:0/1474181469 >> v2:172.21.15.83:3300/0 conn(0x7f0c480cc670 0x7f0c480ccd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:46.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.038+0000 7f0c47fff700 1 -- 172.21.15.81:0/1474181469 >> v1:172.21.15.83:6789/0 conn(0x7f0c4815a450 legacy=0x7f0c480b1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:46.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.038+0000 7f0c47fff700 1 -- 172.21.15.81:0/1474181469 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c480b3e30 con 0x7f0c480b2420 2023-10-06T03:24:46.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.038+0000 7f0c477fe700 1 --2- 172.21.15.81:0/1474181469 >> v2:172.21.15.83:3300/0 conn(0x7f0c480cc670 0x7f0c480ccd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:46.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.038+0000 7f0c47fff700 1 --2- 172.21.15.81:0/1474181469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c480b2420 0x7f0c4815a8f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0c480d1420 tx=0x7f0c40009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9c0843b3553b92 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:46.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.038+0000 7f0c467fc700 1 -- 172.21.15.81:0/1474181469 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4000e070 con 0x7f0c480b2420 2023-10-06T03:24:46.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.039+0000 7f0c467fc700 1 -- 172.21.15.81:0/1474181469 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c4000ba10 con 0x7f0c480b2420 2023-10-06T03:24:46.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.039+0000 7f0c467fc700 1 -- 172.21.15.81:0/1474181469 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c400092e0 con 0x7f0c480b2420 2023-10-06T03:24:46.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.039+0000 7f0c4c99d700 1 -- 172.21.15.81:0/1474181469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c480b2420 msgr2=0x7f0c4815a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:46.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.039+0000 7f0c4c99d700 1 --2- 172.21.15.81:0/1474181469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c480b2420 0x7f0c4815a8f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0c480d1420 tx=0x7f0c40009840 comp rx=0 tx=0).stop 2023-10-06T03:24:46.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.039+0000 7f0c4c99d700 1 -- 172.21.15.81:0/1474181469 shutdown_connections 2023-10-06T03:24:46.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.039+0000 7f0c4c99d700 1 --2- 172.21.15.81:0/1474181469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c480b2420 0x7f0c4815a8f0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:46.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.039+0000 7f0c4c99d700 1 --2- 172.21.15.81:0/1474181469 >> v2:172.21.15.83:3300/0 conn(0x7f0c480cc670 0x7f0c480ccd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:46.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.039+0000 7f0c4c99d700 1 -- 172.21.15.81:0/1474181469 >> 172.21.15.81:0/1474181469 conn(0x7f0c4806ed10 msgr2=0x7f0c4806f110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:46.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.039+0000 7f0c4c99d700 1 -- 172.21.15.81:0/1474181469 shutdown_connections 2023-10-06T03:24:46.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.039+0000 7f0c4c99d700 1 -- 172.21.15.81:0/1474181469 wait complete. 2023-10-06T03:24:46.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.041+0000 7f0c4c99d700 1 Processor -- start 2023-10-06T03:24:46.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.041+0000 7f0c4c99d700 1 -- start start 2023-10-06T03:24:46.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.042+0000 7f0c4c99d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c480b2420 0x7f0c481694d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:46.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.042+0000 7f0c4c99d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0c480cc670 0x7f0c48157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:46.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.042+0000 7f0c4c99d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c4815a450 0x7f0c480c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:46.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.042+0000 7f0c4c99d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4816a6c0 con 0x7f0c480b2420 2023-10-06T03:24:46.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.042+0000 7f0c4c99d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c48169ab0 con 0x7f0c4815a450 2023-10-06T03:24:46.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.042+0000 7f0c4c99d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c48169d90 con 0x7f0c480cc670 2023-10-06T03:24:46.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.042+0000 7f0c477fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c480b2420 0x7f0c481694d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:46.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.042+0000 7f0c477fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c480b2420 0x7f0c481694d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49886/0 (socket says 172.21.15.81:49886) 2023-10-06T03:24:46.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.042+0000 7f0c477fe700 1 -- 172.21.15.81:0/2795248838 learned_addr learned my addr 172.21.15.81:0/2795248838 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:46.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.042+0000 7f0c477fe700 1 -- 172.21.15.81:0/2795248838 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0c480cc670 msgr2=0x7f0c48157fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:46.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.042+0000 7f0c47fff700 1 --2- 172.21.15.81:0/2795248838 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c4815a450 0x7f0c480c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:46.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.042+0000 7f0c46ffd700 1 --2- 172.21.15.81:0/2795248838 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0c480cc670 0x7f0c48157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:46.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.042+0000 7f0c477fe700 1 --2- 172.21.15.81:0/2795248838 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0c480cc670 0x7f0c48157fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:46.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.042+0000 7f0c477fe700 1 -- 172.21.15.81:0/2795248838 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c4815a450 msgr2=0x7f0c480c5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:46.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.042+0000 7f0c477fe700 1 --2- 172.21.15.81:0/2795248838 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c4815a450 0x7f0c480c5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:46.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.042+0000 7f0c477fe700 1 -- 172.21.15.81:0/2795248838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c40009ae0 con 0x7f0c480b2420 2023-10-06T03:24:46.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.042+0000 7f0c46ffd700 1 --2- 172.21.15.81:0/2795248838 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0c480cc670 0x7f0c48157fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:46.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.042+0000 7f0c47fff700 1 --2- 172.21.15.81:0/2795248838 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c4815a450 0x7f0c480c5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:46.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.043+0000 7f0c477fe700 1 --2- 172.21.15.81:0/2795248838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c480b2420 0x7f0c481694d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0c3800c830 tx=0x7f0c38008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:46.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.043+0000 7f0c2f7fe700 1 -- 172.21.15.81:0/2795248838 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c38011600 con 0x7f0c480b2420 2023-10-06T03:24:46.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.043+0000 7f0c2f7fe700 1 -- 172.21.15.81:0/2795248838 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c38011760 con 0x7f0c480b2420 2023-10-06T03:24:46.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.043+0000 7f0c2f7fe700 1 -- 172.21.15.81:0/2795248838 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c38011b20 con 0x7f0c480b2420 2023-10-06T03:24:46.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.043+0000 7f0c4c99d700 1 -- 172.21.15.81:0/2795248838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c4816a070 con 0x7f0c480b2420 2023-10-06T03:24:46.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.043+0000 7f0c4c99d700 1 -- 172.21.15.81:0/2795248838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c48158510 con 0x7f0c480b2420 2023-10-06T03:24:46.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.044+0000 7f0c4c99d700 1 -- 172.21.15.81:0/2795248838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c4804c3c0 con 0x7f0c480b2420 2023-10-06T03:24:46.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.045+0000 7f0c2f7fe700 1 -- 172.21.15.81:0/2795248838 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0c3800a3e0 con 0x7f0c480b2420 2023-10-06T03:24:46.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.046+0000 7f0c2f7fe700 1 --2- 172.21.15.81:0/2795248838 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0c34066f30 0x7f0c340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:46.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.046+0000 7f0c2f7fe700 1 -- 172.21.15.81:0/2795248838 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f0c38084a30 con 0x7f0c480b2420 2023-10-06T03:24:46.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.046+0000 7f0c46ffd700 1 --2- 172.21.15.81:0/2795248838 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0c34066f30 0x7f0c340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:46.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.047+0000 7f0c46ffd700 1 --2- 172.21.15.81:0/2795248838 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0c34066f30 0x7f0c340693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0c480cf7a0 tx=0x7f0c3c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:46.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.050+0000 7f0c2f7fe700 1 -- 172.21.15.81:0/2795248838 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0c38051cb0 con 0x7f0c480b2420 2023-10-06T03:24:46.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.314+0000 7f0c4c99d700 1 -- 172.21.15.81:0/2795248838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f0c4804bb80 con 0x7f0c480b2420 2023-10-06T03:24:46.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.318+0000 7f0c2f7fe700 1 -- 172.21.15.81:0/2795248838 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f0c380150a0 con 0x7f0c480b2420 2023-10-06T03:24:46.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.320+0000 7f0c4c99d700 1 -- 172.21.15.81:0/2795248838 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0c34066f30 msgr2=0x7f0c340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:46.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.320+0000 7f0c4c99d700 1 --2- 172.21.15.81:0/2795248838 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0c34066f30 0x7f0c340693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0c480cf7a0 tx=0x7f0c3c009040 comp rx=0 tx=0).stop 2023-10-06T03:24:46.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.320+0000 7f0c4c99d700 1 -- 172.21.15.81:0/2795248838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c480b2420 msgr2=0x7f0c481694d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:46.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.320+0000 7f0c4c99d700 1 --2- 172.21.15.81:0/2795248838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c480b2420 0x7f0c481694d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0c3800c830 tx=0x7f0c38008040 comp rx=0 tx=0).stop 2023-10-06T03:24:46.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.321+0000 7f0c4c99d700 1 -- 172.21.15.81:0/2795248838 shutdown_connections 2023-10-06T03:24:46.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.321+0000 7f0c4c99d700 1 --2- 172.21.15.81:0/2795248838 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c4815a450 0x7f0c480c5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:46.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.321+0000 7f0c4c99d700 1 --2- 172.21.15.81:0/2795248838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c480b2420 0x7f0c481694d0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:46.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.321+0000 7f0c4c99d700 1 --2- 172.21.15.81:0/2795248838 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0c34066f30 0x7f0c340693e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:46.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.321+0000 7f0c4c99d700 1 --2- 172.21.15.81:0/2795248838 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0c480cc670 0x7f0c48157fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:46.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.321+0000 7f0c4c99d700 1 -- 172.21.15.81:0/2795248838 >> 172.21.15.81:0/2795248838 conn(0x7f0c4806ed10 msgr2=0x7f0c480afbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:46.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.321+0000 7f0c4c99d700 1 -- 172.21.15.81:0/2795248838 shutdown_connections 2023-10-06T03:24:46.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.321+0000 7f0c4c99d700 1 -- 172.21.15.81:0/2795248838 wait complete. 2023-10-06T03:24:46.340 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-06T03:24:46.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.518+0000 7f472edff700 1 Processor -- start 2023-10-06T03:24:46.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.518+0000 7f472edff700 1 -- start start 2023-10-06T03:24:46.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.520+0000 7f472edff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f472815a5c0 0x7f4728161250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:46.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.520+0000 7f472edff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47280cad30 con 0x7f472813f9c0 2023-10-06T03:24:46.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.520+0000 7f472edff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47280cafe0 con 0x7f472813fd90 2023-10-06T03:24:46.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.520+0000 7f472edff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47280cb2c0 con 0x7f472815a5c0 2023-10-06T03:24:46.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.520+0000 7f472cb9b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f472813f9c0 0x7f47280ca620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41300/0 (socket says 172.21.15.81:41300) 2023-10-06T03:24:46.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.520+0000 7f472cb9b700 1 -- 172.21.15.81:0/2621926788 learned_addr learned my addr 172.21.15.81:0/2621926788 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:24:46.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.520+0000 7f472d39c700 1 --2- 172.21.15.81:0/2621926788 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f472815a5c0 0x7f4728161250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:46.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.520+0000 7f47277fe700 1 -- 172.21.15.81:0/2621926788 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3059590849 0 0) 0x7f47280cad30 con 0x7f472813f9c0 2023-10-06T03:24:46.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.520+0000 7f47277fe700 1 -- 172.21.15.81:0/2621926788 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4718003570 con 0x7f472813f9c0 2023-10-06T03:24:46.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.521+0000 7f47277fe700 1 -- 172.21.15.81:0/2621926788 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3687138907 0 0) 0x7f47280cafe0 con 0x7f472813fd90 2023-10-06T03:24:46.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.521+0000 7f47277fe700 1 -- 172.21.15.81:0/2621926788 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47280cad30 con 0x7f472813fd90 2023-10-06T03:24:46.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.521+0000 7f47277fe700 1 -- 172.21.15.81:0/2621926788 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1214877977 0 0) 0x7f4718003570 con 0x7f472813f9c0 2023-10-06T03:24:46.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.521+0000 7f47277fe700 1 -- 172.21.15.81:0/2621926788 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f472815a5c0 msgr2=0x7f4728161250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:46.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.521+0000 7f47277fe700 1 --2- 172.21.15.81:0/2621926788 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f472815a5c0 0x7f4728161250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:46.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.521+0000 7f47277fe700 1 -- 172.21.15.81:0/2621926788 >> v1:172.21.15.83:6789/0 conn(0x7f472813fd90 legacy=0x7f4728159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:46.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.521+0000 7f47277fe700 1 -- 172.21.15.81:0/2621926788 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47280cb5a0 con 0x7f472813f9c0 2023-10-06T03:24:46.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.521+0000 7f47277fe700 1 -- 172.21.15.81:0/2621926788 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2513016936 0 0) 0x7f471c001470 con 0x7f472813f9c0 2023-10-06T03:24:46.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.521+0000 7f47277fe700 1 -- 172.21.15.81:0/2621926788 >> v1:172.21.15.81:6789/0 conn(0x7f472813f9c0 legacy=0x7f47280ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:46.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.521+0000 7f47277fe700 1 --2- 172.21.15.81:0/2621926788 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4718003c20 0x7f4718004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:46.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.521+0000 7f47277fe700 1 --2- 172.21.15.81:0/2621926788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4718004810 0x7f4718004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:46.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.521+0000 7f47277fe700 1 --2- 172.21.15.81:0/2621926788 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47180051c0 0x7f471800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:46.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.521+0000 7f47277fe700 1 -- 172.21.15.81:0/2621926788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47280cb2c0 con 0x7f4718004810 2023-10-06T03:24:46.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.521+0000 7f47277fe700 1 -- 172.21.15.81:0/2621926788 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f471800c020 con 0x7f4718003c20 2023-10-06T03:24:46.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.521+0000 7f47277fe700 1 -- 172.21.15.81:0/2621926788 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f471800c1e0 con 0x7f47180051c0 2023-10-06T03:24:46.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.521+0000 7f472d39c700 1 --2- 172.21.15.81:0/2621926788 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f472815a5c0 0x7f4728161250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:24:46.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.521+0000 7f4727fff700 1 --2- 172.21.15.81:0/2621926788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4718004810 0x7f4718004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:46.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.521+0000 7f472cb9b700 1 --2- 172.21.15.81:0/2621926788 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4718003c20 0x7f4718004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:46.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.521+0000 7f472d39c700 1 --2- 172.21.15.81:0/2621926788 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47180051c0 0x7f471800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:46.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.521+0000 7f4727fff700 1 -- 172.21.15.81:0/2621926788 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47180051c0 msgr2=0x7f471800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:46.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.521+0000 7f4727fff700 1 --2- 172.21.15.81:0/2621926788 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47180051c0 0x7f471800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:46.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.521+0000 7f4727fff700 1 -- 172.21.15.81:0/2621926788 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4718003c20 msgr2=0x7f4718004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:46.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.521+0000 7f4727fff700 1 --2- 172.21.15.81:0/2621926788 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4718003c20 0x7f4718004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:46.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.521+0000 7f4727fff700 1 -- 172.21.15.81:0/2621926788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4718003570 con 0x7f4718004810 2023-10-06T03:24:46.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.521+0000 7f472cb9b700 1 --2- 172.21.15.81:0/2621926788 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4718003c20 0x7f4718004010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:46.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.522+0000 7f4727fff700 1 --2- 172.21.15.81:0/2621926788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4718004810 0x7f4718004c80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4714001a10 tx=0x7f4714007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=581072f3df957776 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:46.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.522+0000 7f47277fe700 1 -- 172.21.15.81:0/2621926788 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471400c5d0 con 0x7f4718004810 2023-10-06T03:24:46.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.522+0000 7f47277fe700 1 -- 172.21.15.81:0/2621926788 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f471400c730 con 0x7f4718004810 2023-10-06T03:24:46.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.522+0000 7f47277fe700 1 -- 172.21.15.81:0/2621926788 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471400cad0 con 0x7f4718004810 2023-10-06T03:24:46.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.522+0000 7f472edff700 1 -- 172.21.15.81:0/2621926788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4718004810 msgr2=0x7f4718004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:46.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.522+0000 7f472edff700 1 --2- 172.21.15.81:0/2621926788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4718004810 0x7f4718004c80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4714001a10 tx=0x7f4714007d30 comp rx=0 tx=0).stop 2023-10-06T03:24:46.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.522+0000 7f472d39c700 1 -- 172.21.15.81:0/2621926788 reap_dead start 2023-10-06T03:24:46.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.522+0000 7f472edff700 1 -- 172.21.15.81:0/2621926788 shutdown_connections 2023-10-06T03:24:46.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.522+0000 7f472edff700 1 -- 172.21.15.81:0/2621926788 >> 172.21.15.81:0/2621926788 conn(0x7f47280cc090 msgr2=0x7f47280cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:46.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.523+0000 7f472edff700 1 -- 172.21.15.81:0/2621926788 shutdown_connections 2023-10-06T03:24:46.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.523+0000 7f472edff700 1 -- 172.21.15.81:0/2621926788 wait complete. 2023-10-06T03:24:46.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.524+0000 7f472edff700 1 Processor -- start 2023-10-06T03:24:46.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.524+0000 7f472edff700 1 -- start start 2023-10-06T03:24:46.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.525+0000 7f472edff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4718004810 0x7f4728159610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:46.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.525+0000 7f472edff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47280c3220 0x7f47280c38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:46.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.525+0000 7f472edff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4728136f10 0x7f47281373b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:46.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.525+0000 7f472edff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47280c4ab0 con 0x7f4728136f10 2023-10-06T03:24:46.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.525+0000 7f472edff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47281378f0 con 0x7f4718004810 2023-10-06T03:24:46.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.525+0000 7f472edff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4728159b50 con 0x7f47280c3220 2023-10-06T03:24:46.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.525+0000 7f472d39c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4728136f10 0x7f47281373b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:46.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.525+0000 7f472d39c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4728136f10 0x7f47281373b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49910/0 (socket says 172.21.15.81:49910) 2023-10-06T03:24:46.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.525+0000 7f472d39c700 1 -- 172.21.15.81:0/1900301086 learned_addr learned my addr 172.21.15.81:0/1900301086 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:46.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.525+0000 7f472cb9b700 1 --2- 172.21.15.81:0/1900301086 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4718004810 0x7f4728159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:46.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.525+0000 7f4727fff700 1 --2- 172.21.15.81:0/1900301086 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47280c3220 0x7f47280c38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:46.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.526+0000 7f472d39c700 1 -- 172.21.15.81:0/1900301086 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47280c3220 msgr2=0x7f47280c38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:46.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.526+0000 7f472d39c700 1 --2- 172.21.15.81:0/1900301086 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47280c3220 0x7f47280c38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:46.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.526+0000 7f472d39c700 1 -- 172.21.15.81:0/1900301086 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4718004810 msgr2=0x7f4728159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:46.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.526+0000 7f472d39c700 1 --2- 172.21.15.81:0/1900301086 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4718004810 0x7f4728159610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:46.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.526+0000 7f472d39c700 1 -- 172.21.15.81:0/1900301086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47280b0610 con 0x7f4728136f10 2023-10-06T03:24:46.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.526+0000 7f472d39c700 1 --2- 172.21.15.81:0/1900301086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4728136f10 0x7f47281373b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f472806ce20 tx=0x7f472000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:46.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.526+0000 7f4724ff9700 1 -- 172.21.15.81:0/1900301086 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472000e070 con 0x7f4728136f10 2023-10-06T03:24:46.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.526+0000 7f4724ff9700 1 -- 172.21.15.81:0/1900301086 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4720011c50 con 0x7f4728136f10 2023-10-06T03:24:46.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.526+0000 7f472edff700 1 -- 172.21.15.81:0/1900301086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47280c4210 con 0x7f4728136f10 2023-10-06T03:24:46.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.526+0000 7f4724ff9700 1 -- 172.21.15.81:0/1900301086 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4720016470 con 0x7f4728136f10 2023-10-06T03:24:46.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.527+0000 7f472edff700 1 -- 172.21.15.81:0/1900301086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47280c47d0 con 0x7f4728136f10 2023-10-06T03:24:46.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.527+0000 7f472edff700 1 -- 172.21.15.81:0/1900301086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f472804c3c0 con 0x7f4728136f10 2023-10-06T03:24:46.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.528+0000 7f4724ff9700 1 -- 172.21.15.81:0/1900301086 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4720016860 con 0x7f4728136f10 2023-10-06T03:24:46.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.529+0000 7f4724ff9700 1 --2- 172.21.15.81:0/1900301086 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f470c066f30 0x7f470c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:46.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.529+0000 7f4724ff9700 1 -- 172.21.15.81:0/1900301086 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f4720084fe0 con 0x7f4728136f10 2023-10-06T03:24:46.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.530+0000 7f472cb9b700 1 --2- 172.21.15.81:0/1900301086 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f470c066f30 0x7f470c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:46.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.530+0000 7f472cb9b700 1 --2- 172.21.15.81:0/1900301086 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f470c066f30 0x7f470c0693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f471c000ff0 tx=0x7f471c007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:46.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.533+0000 7f4724ff9700 1 -- 172.21.15.81:0/1900301086 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f47200522a0 con 0x7f4728136f10 2023-10-06T03:24:46.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.797+0000 7f472edff700 1 -- 172.21.15.81:0/1900301086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f47280cb880 con 0x7f4728136f10 2023-10-06T03:24:46.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.801+0000 7f4724ff9700 1 -- 172.21.15.81:0/1900301086 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f47200558c0 con 0x7f4728136f10 2023-10-06T03:24:46.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.804+0000 7f472edff700 1 -- 172.21.15.81:0/1900301086 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f470c066f30 msgr2=0x7f470c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:46.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.804+0000 7f472edff700 1 --2- 172.21.15.81:0/1900301086 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f470c066f30 0x7f470c0693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f471c000ff0 tx=0x7f471c007040 comp rx=0 tx=0).stop 2023-10-06T03:24:46.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.804+0000 7f472edff700 1 -- 172.21.15.81:0/1900301086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4728136f10 msgr2=0x7f47281373b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:46.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.804+0000 7f472edff700 1 --2- 172.21.15.81:0/1900301086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4728136f10 0x7f47281373b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f472806ce20 tx=0x7f472000b040 comp rx=0 tx=0).stop 2023-10-06T03:24:46.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.804+0000 7f472edff700 1 -- 172.21.15.81:0/1900301086 shutdown_connections 2023-10-06T03:24:46.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.804+0000 7f472edff700 1 --2- 172.21.15.81:0/1900301086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4728136f10 0x7f47281373b0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:46.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.804+0000 7f472edff700 1 --2- 172.21.15.81:0/1900301086 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4718004810 0x7f4728159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:46.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.804+0000 7f472edff700 1 --2- 172.21.15.81:0/1900301086 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f470c066f30 0x7f470c0693e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:46.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.804+0000 7f472edff700 1 --2- 172.21.15.81:0/1900301086 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47280c3220 0x7f47280c38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:46.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.804+0000 7f472edff700 1 -- 172.21.15.81:0/1900301086 >> 172.21.15.81:0/1900301086 conn(0x7f47280cc090 msgr2=0x7f47280ca080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:46.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.804+0000 7f472edff700 1 -- 172.21.15.81:0/1900301086 shutdown_connections 2023-10-06T03:24:46.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:46.804+0000 7f472edff700 1 -- 172.21.15.81:0/1900301086 wait complete. 2023-10-06T03:24:46.823 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-06T03:24:47.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.001+0000 7f2756dff700 1 Processor -- start 2023-10-06T03:24:47.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.001+0000 7f2756dff700 1 -- start start 2023-10-06T03:24:47.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.002+0000 7f2756dff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2750142d70 0x7f2750069730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:47.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.002+0000 7f2756dff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f27500cc570 0x7f27500c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:47.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.002+0000 7f2756dff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27500c8a00 con 0x7f2750069c70 2023-10-06T03:24:47.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.003+0000 7f2756dff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f275006bbc0 con 0x7f27500cc570 2023-10-06T03:24:47.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.003+0000 7f2756dff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f275006bea0 con 0x7f2750142d70 2023-10-06T03:24:47.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.003+0000 7f274ffff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2750069c70 0x7f27500cbe60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41306/0 (socket says 172.21.15.81:41306) 2023-10-06T03:24:47.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.003+0000 7f274ffff700 1 -- 172.21.15.81:0/504861789 learned_addr learned my addr 172.21.15.81:0/504861789 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:24:47.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.003+0000 7f2754b9b700 1 --2- 172.21.15.81:0/504861789 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2750142d70 0x7f2750069730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:47.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.003+0000 7f275539c700 1 --2- 172.21.15.81:0/504861789 >> v2:172.21.15.83:3300/0 conn(0x7f27500cc570 0x7f27500c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:47.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.003+0000 7f274f7fe700 1 -- 172.21.15.81:0/504861789 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1415909920 0 0) 0x7f27500c8a00 con 0x7f2750069c70 2023-10-06T03:24:47.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.003+0000 7f274f7fe700 1 -- 172.21.15.81:0/504861789 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2740003570 con 0x7f2750069c70 2023-10-06T03:24:47.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.003+0000 7f2754b9b700 1 -- 172.21.15.81:0/504861789 >> v2:172.21.15.83:3300/0 conn(0x7f27500cc570 msgr2=0x7f27500c8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:47.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.003+0000 7f2754b9b700 1 --2- 172.21.15.81:0/504861789 >> v2:172.21.15.83:3300/0 conn(0x7f27500cc570 0x7f27500c8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:47.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.003+0000 7f2754b9b700 1 -- 172.21.15.81:0/504861789 >> v1:172.21.15.81:6789/0 conn(0x7f2750069c70 legacy=0x7f27500cbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:47.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.003+0000 7f2754b9b700 1 -- 172.21.15.81:0/504861789 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f275006c180 con 0x7f2750142d70 2023-10-06T03:24:47.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.004+0000 7f2754b9b700 1 --2- 172.21.15.81:0/504861789 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2750142d70 0x7f2750069730 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f27440098e0 tx=0x7f27440091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10b60b267c543f6c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:47.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.004+0000 7f274f7fe700 1 -- 172.21.15.81:0/504861789 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2744011630 con 0x7f2750142d70 2023-10-06T03:24:47.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.004+0000 7f274f7fe700 1 -- 172.21.15.81:0/504861789 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2744011790 con 0x7f2750142d70 2023-10-06T03:24:47.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.004+0000 7f274f7fe700 1 -- 172.21.15.81:0/504861789 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2744011b30 con 0x7f2750142d70 2023-10-06T03:24:47.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.005+0000 7f2756dff700 1 -- 172.21.15.81:0/504861789 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2750142d70 msgr2=0x7f2750069730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:47.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.005+0000 7f2756dff700 1 --2- 172.21.15.81:0/504861789 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2750142d70 0x7f2750069730 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f27440098e0 tx=0x7f27440091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:47.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.005+0000 7f2756dff700 1 -- 172.21.15.81:0/504861789 shutdown_connections 2023-10-06T03:24:47.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.005+0000 7f2756dff700 1 --2- 172.21.15.81:0/504861789 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2750142d70 0x7f2750069730 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:47.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.005+0000 7f2756dff700 1 --2- 172.21.15.81:0/504861789 >> v2:172.21.15.83:3300/0 conn(0x7f27500cc570 0x7f27500c8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:47.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.005+0000 7f2756dff700 1 -- 172.21.15.81:0/504861789 >> 172.21.15.81:0/504861789 conn(0x7f27500ce290 msgr2=0x7f27500ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:47.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.005+0000 7f2756dff700 1 -- 172.21.15.81:0/504861789 shutdown_connections 2023-10-06T03:24:47.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.005+0000 7f2756dff700 1 -- 172.21.15.81:0/504861789 wait complete. 2023-10-06T03:24:47.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.006+0000 7f2756dff700 1 Processor -- start 2023-10-06T03:24:47.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.006+0000 7f2756dff700 1 -- start start 2023-10-06T03:24:47.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.007+0000 7f2756dff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2750069c70 0x7f275013e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:47.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.007+0000 7f2756dff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f27500cc570 0x7f275015aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:47.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.007+0000 7f2756dff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2750142d70 0x7f27500ca7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:47.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.007+0000 7f2756dff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2750169b80 con 0x7f2750142d70 2023-10-06T03:24:47.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.007+0000 7f2756dff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275015b6d0 con 0x7f2750069c70 2023-10-06T03:24:47.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.007+0000 7f2756dff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f275016a3c0 con 0x7f27500cc570 2023-10-06T03:24:47.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.008+0000 7f275539c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2750142d70 0x7f27500ca7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:47.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.008+0000 7f275539c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2750142d70 0x7f27500ca7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49916/0 (socket says 172.21.15.81:49916) 2023-10-06T03:24:47.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.008+0000 7f275539c700 1 -- 172.21.15.81:0/2593460063 learned_addr learned my addr 172.21.15.81:0/2593460063 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:47.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.008+0000 7f274ffff700 1 --2- 172.21.15.81:0/2593460063 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f27500cc570 0x7f275015aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:47.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.008+0000 7f2754b9b700 1 --2- 172.21.15.81:0/2593460063 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2750069c70 0x7f275013e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:47.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.008+0000 7f275539c700 1 -- 172.21.15.81:0/2593460063 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f27500cc570 msgr2=0x7f275015aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:47.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.008+0000 7f275539c700 1 --2- 172.21.15.81:0/2593460063 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f27500cc570 0x7f275015aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:47.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.008+0000 7f275539c700 1 -- 172.21.15.81:0/2593460063 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2750069c70 msgr2=0x7f275013e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:47.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.008+0000 7f275539c700 1 --2- 172.21.15.81:0/2593460063 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2750069c70 0x7f275013e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:47.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.008+0000 7f275539c700 1 -- 172.21.15.81:0/2593460063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2744009420 con 0x7f2750142d70 2023-10-06T03:24:47.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.008+0000 7f275539c700 1 --2- 172.21.15.81:0/2593460063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2750142d70 0x7f27500ca7f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2748009ec0 tx=0x7f274800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:47.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.008+0000 7f274cff9700 1 -- 172.21.15.81:0/2593460063 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274800cb70 con 0x7f2750142d70 2023-10-06T03:24:47.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.009+0000 7f274cff9700 1 -- 172.21.15.81:0/2593460063 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f274800f040 con 0x7f2750142d70 2023-10-06T03:24:47.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.009+0000 7f2756dff700 1 -- 172.21.15.81:0/2593460063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f275015b3f0 con 0x7f2750142d70 2023-10-06T03:24:47.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.009+0000 7f274cff9700 1 -- 172.21.15.81:0/2593460063 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2748014480 con 0x7f2750142d70 2023-10-06T03:24:47.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.009+0000 7f2756dff700 1 -- 172.21.15.81:0/2593460063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f275016a050 con 0x7f2750142d70 2023-10-06T03:24:47.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.010+0000 7f2756dff700 1 -- 172.21.15.81:0/2593460063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f275004c3c0 con 0x7f2750142d70 2023-10-06T03:24:47.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.010+0000 7f274cff9700 1 -- 172.21.15.81:0/2593460063 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f27480147f0 con 0x7f2750142d70 2023-10-06T03:24:47.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.011+0000 7f274cff9700 1 --2- 172.21.15.81:0/2593460063 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2734066f30 0x7f27340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:47.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.011+0000 7f274cff9700 1 -- 172.21.15.81:0/2593460063 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f2748085160 con 0x7f2750142d70 2023-10-06T03:24:47.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.011+0000 7f2754b9b700 1 --2- 172.21.15.81:0/2593460063 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2734066f30 0x7f27340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:47.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.012+0000 7f2754b9b700 1 --2- 172.21.15.81:0/2593460063 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2734066f30 0x7f27340693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f27440091e0 tx=0x7f2744017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:47.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.015+0000 7f274cff9700 1 -- 172.21.15.81:0/2593460063 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f27480523e0 con 0x7f2750142d70 2023-10-06T03:24:47.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.280+0000 7f2756dff700 1 -- 172.21.15.81:0/2593460063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f275016a500 con 0x7f2750142d70 2023-10-06T03:24:47.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.284+0000 7f274cff9700 1 -- 172.21.15.81:0/2593460063 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f2748055a00 con 0x7f2750142d70 2023-10-06T03:24:47.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.287+0000 7f2756dff700 1 -- 172.21.15.81:0/2593460063 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2734066f30 msgr2=0x7f27340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:47.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.287+0000 7f2756dff700 1 --2- 172.21.15.81:0/2593460063 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2734066f30 0x7f27340693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f27440091e0 tx=0x7f2744017000 comp rx=0 tx=0).stop 2023-10-06T03:24:47.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.287+0000 7f2756dff700 1 -- 172.21.15.81:0/2593460063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2750142d70 msgr2=0x7f27500ca7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:47.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.287+0000 7f2756dff700 1 --2- 172.21.15.81:0/2593460063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2750142d70 0x7f27500ca7f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2748009ec0 tx=0x7f274800b040 comp rx=0 tx=0).stop 2023-10-06T03:24:47.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.287+0000 7f2756dff700 1 -- 172.21.15.81:0/2593460063 shutdown_connections 2023-10-06T03:24:47.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.287+0000 7f2756dff700 1 --2- 172.21.15.81:0/2593460063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2750142d70 0x7f27500ca7f0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:47.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.287+0000 7f2756dff700 1 --2- 172.21.15.81:0/2593460063 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2750069c70 0x7f275013e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:47.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.287+0000 7f2756dff700 1 --2- 172.21.15.81:0/2593460063 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2734066f30 0x7f27340693e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:47.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.287+0000 7f2756dff700 1 --2- 172.21.15.81:0/2593460063 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f27500cc570 0x7f275015aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:47.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.287+0000 7f2756dff700 1 -- 172.21.15.81:0/2593460063 >> 172.21.15.81:0/2593460063 conn(0x7f27500ce290 msgr2=0x7f27500686f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:47.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.287+0000 7f2756dff700 1 -- 172.21.15.81:0/2593460063 shutdown_connections 2023-10-06T03:24:47.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.287+0000 7f2756dff700 1 -- 172.21.15.81:0/2593460063 wait complete. 2023-10-06T03:24:47.306 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-06T03:24:47.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.485+0000 7f54ebfff700 1 Processor -- start 2023-10-06T03:24:47.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.485+0000 7f54ebfff700 1 -- start start 2023-10-06T03:24:47.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.487+0000 7f54ebfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f54ec0ab7b0 0x7f54ec156910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:47.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.487+0000 7f54ebfff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54ec0ac5f0 con 0x7f54ec0ace00 2023-10-06T03:24:47.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.487+0000 7f54ebfff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54ec156e50 con 0x7f54ec06d2d0 2023-10-06T03:24:47.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.487+0000 7f54ebfff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54ec0ae330 con 0x7f54ec0ab7b0 2023-10-06T03:24:47.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.487+0000 7f54eaffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f54ec0ab7b0 0x7f54ec156910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:47.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.487+0000 7f54ea7fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f54ec0ace00 0x7f54ec0abb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41322/0 (socket says 172.21.15.81:41322) 2023-10-06T03:24:47.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.487+0000 7f54eaffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f54ec0ab7b0 0x7f54ec156910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49918/0 (socket says 172.21.15.81:49918) 2023-10-06T03:24:47.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.487+0000 7f54ea7fc700 1 -- 172.21.15.81:0/727227696 learned_addr learned my addr 172.21.15.81:0/727227696 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:24:47.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.487+0000 7f54eaffd700 1 -- 172.21.15.81:0/727227696 >> v1:172.21.15.83:6789/0 conn(0x7f54ec06d2d0 legacy=0x7f54ec06d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:47.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.487+0000 7f54eaffd700 1 -- 172.21.15.81:0/727227696 >> v1:172.21.15.81:6789/0 conn(0x7f54ec0ace00 legacy=0x7f54ec0abb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:47.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.487+0000 7f54eaffd700 1 -- 172.21.15.81:0/727227696 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54ec0ad290 con 0x7f54ec0ab7b0 2023-10-06T03:24:47.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.487+0000 7f54e9ffb700 1 -- 172.21.15.81:0/727227696 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3447718525 0 0) 0x7f54ec0ac5f0 con 0x7f54ec0ace00 2023-10-06T03:24:47.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.488+0000 7f54eaffd700 1 --2- 172.21.15.81:0/727227696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54ec0ab7b0 0x7f54ec156910 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f54dc0098e0 tx=0x7f54dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39e5fb71ec26c3a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:47.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.488+0000 7f54e9ffb700 1 -- 172.21.15.81:0/727227696 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54dc009e80 con 0x7f54ec0ab7b0 2023-10-06T03:24:47.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.488+0000 7f54e9ffb700 1 -- 172.21.15.81:0/727227696 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54dc00b820 con 0x7f54ec0ab7b0 2023-10-06T03:24:47.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.488+0000 7f54e9ffb700 1 -- 172.21.15.81:0/727227696 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54dc00bba0 con 0x7f54ec0ab7b0 2023-10-06T03:24:47.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.488+0000 7f54ebfff700 1 -- 172.21.15.81:0/727227696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54ec0ab7b0 msgr2=0x7f54ec156910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:47.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.488+0000 7f54ebfff700 1 --2- 172.21.15.81:0/727227696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54ec0ab7b0 0x7f54ec156910 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f54dc0098e0 tx=0x7f54dc0091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:47.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.488+0000 7f54ebfff700 1 -- 172.21.15.81:0/727227696 shutdown_connections 2023-10-06T03:24:47.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.488+0000 7f54ebfff700 1 --2- 172.21.15.81:0/727227696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54ec0ab7b0 0x7f54ec156910 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:47.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.488+0000 7f54ebfff700 1 -- 172.21.15.81:0/727227696 >> 172.21.15.81:0/727227696 conn(0x7f54ec0cbef0 msgr2=0x7f54ec0cc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:47.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.488+0000 7f54ebfff700 1 -- 172.21.15.81:0/727227696 shutdown_connections 2023-10-06T03:24:47.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.488+0000 7f54ebfff700 1 -- 172.21.15.81:0/727227696 wait complete. 2023-10-06T03:24:47.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.490+0000 7f54ebfff700 1 Processor -- start 2023-10-06T03:24:47.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.490+0000 7f54ebfff700 1 -- start start 2023-10-06T03:24:47.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.491+0000 7f54ebfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54ec06d2d0 0x7f54ec13e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:47.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.491+0000 7f54ebfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f54ec0ab7b0 0x7f54ec069310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:47.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.491+0000 7f54ebfff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54ec0ace00 0x7f54ec069850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:47.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.491+0000 7f54ebfff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ec149260 con 0x7f54ec06d2d0 2023-10-06T03:24:47.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.491+0000 7f54ebfff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ec13ede0 con 0x7f54ec0ab7b0 2023-10-06T03:24:47.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.491+0000 7f54ebfff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54ec13f0c0 con 0x7f54ec0ace00 2023-10-06T03:24:47.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.491+0000 7f54eaffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54ec06d2d0 0x7f54ec13e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:47.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.491+0000 7f54eaffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54ec06d2d0 0x7f54ec13e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49922/0 (socket says 172.21.15.81:49922) 2023-10-06T03:24:47.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.491+0000 7f54eaffd700 1 -- 172.21.15.81:0/453445134 learned_addr learned my addr 172.21.15.81:0/453445134 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:47.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.491+0000 7f54ea7fc700 1 --2- 172.21.15.81:0/453445134 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f54ec0ab7b0 0x7f54ec069310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:47.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.491+0000 7f54eb7fe700 1 --2- 172.21.15.81:0/453445134 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54ec0ace00 0x7f54ec069850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:47.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.491+0000 7f54eaffd700 1 -- 172.21.15.81:0/453445134 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54ec0ace00 msgr2=0x7f54ec069850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:47.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.491+0000 7f54eaffd700 1 --2- 172.21.15.81:0/453445134 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54ec0ace00 0x7f54ec069850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:47.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.491+0000 7f54eaffd700 1 -- 172.21.15.81:0/453445134 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f54ec0ab7b0 msgr2=0x7f54ec069310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:47.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.491+0000 7f54eaffd700 1 --2- 172.21.15.81:0/453445134 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f54ec0ab7b0 0x7f54ec069310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:47.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.491+0000 7f54eaffd700 1 -- 172.21.15.81:0/453445134 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54dc009420 con 0x7f54ec06d2d0 2023-10-06T03:24:47.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.492+0000 7f54eaffd700 1 --2- 172.21.15.81:0/453445134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54ec06d2d0 0x7f54ec13e390 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f54dc0030c0 tx=0x7f54dc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:47.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.492+0000 7f54d2ffd700 1 -- 172.21.15.81:0/453445134 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54dc00bae0 con 0x7f54ec06d2d0 2023-10-06T03:24:47.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.492+0000 7f54d2ffd700 1 -- 172.21.15.81:0/453445134 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54dc020070 con 0x7f54ec06d2d0 2023-10-06T03:24:47.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.492+0000 7f54ebfff700 1 -- 172.21.15.81:0/453445134 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54ec13f3a0 con 0x7f54ec06d2d0 2023-10-06T03:24:47.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.492+0000 7f54d2ffd700 1 -- 172.21.15.81:0/453445134 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54dc01b6a0 con 0x7f54ec06d2d0 2023-10-06T03:24:47.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.492+0000 7f54ebfff700 1 -- 172.21.15.81:0/453445134 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54ec13f960 con 0x7f54ec06d2d0 2023-10-06T03:24:47.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.493+0000 7f54ebfff700 1 -- 172.21.15.81:0/453445134 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54ec13fb50 con 0x7f54ec06d2d0 2023-10-06T03:24:47.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.494+0000 7f54d2ffd700 1 -- 172.21.15.81:0/453445134 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f54dc022030 con 0x7f54ec06d2d0 2023-10-06T03:24:47.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.495+0000 7f54d2ffd700 1 --2- 172.21.15.81:0/453445134 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f54d8066f30 0x7f54d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:47.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.495+0000 7f54d2ffd700 1 -- 172.21.15.81:0/453445134 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f54dc0865a0 con 0x7f54ec06d2d0 2023-10-06T03:24:47.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.495+0000 7f54ea7fc700 1 --2- 172.21.15.81:0/453445134 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f54d8066f30 0x7f54d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:47.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.496+0000 7f54ea7fc700 1 --2- 172.21.15.81:0/453445134 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f54d8066f30 0x7f54d80693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f54e000c8f0 tx=0x7f54e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:47.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.499+0000 7f54d2ffd700 1 -- 172.21.15.81:0/453445134 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f54dc053820 con 0x7f54ec06d2d0 2023-10-06T03:24:47.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.766+0000 7f54ebfff700 1 -- 172.21.15.81:0/453445134 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f54ec13fb50 con 0x7f54ec06d2d0 2023-10-06T03:24:47.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.770+0000 7f54d2ffd700 1 -- 172.21.15.81:0/453445134 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f54dc056e40 con 0x7f54ec06d2d0 2023-10-06T03:24:47.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.772+0000 7f54ebfff700 1 -- 172.21.15.81:0/453445134 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f54d8066f30 msgr2=0x7f54d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:47.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.772+0000 7f54ebfff700 1 --2- 172.21.15.81:0/453445134 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f54d8066f30 0x7f54d80693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f54e000c8f0 tx=0x7f54e0009040 comp rx=0 tx=0).stop 2023-10-06T03:24:47.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.772+0000 7f54ebfff700 1 -- 172.21.15.81:0/453445134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54ec06d2d0 msgr2=0x7f54ec13e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:47.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.772+0000 7f54ebfff700 1 --2- 172.21.15.81:0/453445134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54ec06d2d0 0x7f54ec13e390 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f54dc0030c0 tx=0x7f54dc016000 comp rx=0 tx=0).stop 2023-10-06T03:24:47.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.772+0000 7f54ebfff700 1 -- 172.21.15.81:0/453445134 shutdown_connections 2023-10-06T03:24:47.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.772+0000 7f54ebfff700 1 --2- 172.21.15.81:0/453445134 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f54d8066f30 0x7f54d80693e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:47.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.772+0000 7f54ebfff700 1 --2- 172.21.15.81:0/453445134 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54ec0ace00 0x7f54ec069850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:47.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.772+0000 7f54ebfff700 1 --2- 172.21.15.81:0/453445134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54ec06d2d0 0x7f54ec13e390 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:47.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.772+0000 7f54ebfff700 1 --2- 172.21.15.81:0/453445134 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f54ec0ab7b0 0x7f54ec069310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:47.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.772+0000 7f54ebfff700 1 -- 172.21.15.81:0/453445134 >> 172.21.15.81:0/453445134 conn(0x7f54ec0cbef0 msgr2=0x7f54ec152830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:47.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.772+0000 7f54ebfff700 1 -- 172.21.15.81:0/453445134 shutdown_connections 2023-10-06T03:24:47.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.772+0000 7f54ebfff700 1 -- 172.21.15.81:0/453445134 wait complete. 2023-10-06T03:24:47.791 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-06T03:24:47.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.970+0000 7fb933fff700 1 Processor -- start 2023-10-06T03:24:47.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.970+0000 7fb933fff700 1 -- start start 2023-10-06T03:24:47.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.971+0000 7fb933fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb9340cc670 0x7fb9340ccd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:47.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.971+0000 7fb933fff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb9340b2420 0x7fb93415a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:47.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.971+0000 7fb933fff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9340b4760 con 0x7fb93415a450 2023-10-06T03:24:47.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.971+0000 7fb933fff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9340b60f0 con 0x7fb9340cc670 2023-10-06T03:24:47.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.971+0000 7fb933fff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9340cd320 con 0x7fb9340b2420 2023-10-06T03:24:47.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.971+0000 7fb932ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb9340cc670 0x7fb9340ccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:47.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.971+0000 7fb932ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb9340cc670 0x7fb9340ccd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49928/0 (socket says 172.21.15.81:49928) 2023-10-06T03:24:47.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.971+0000 7fb932ffd700 1 -- 172.21.15.81:0/2506139461 learned_addr learned my addr 172.21.15.81:0/2506139461 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:47.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.972+0000 7fb9337fe700 1 --2- 172.21.15.81:0/2506139461 >> v2:172.21.15.83:3300/0 conn(0x7fb9340b2420 0x7fb93415a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:47.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.972+0000 7fb932ffd700 1 -- 172.21.15.81:0/2506139461 >> v2:172.21.15.83:3300/0 conn(0x7fb9340b2420 msgr2=0x7fb93415a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:47.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.972+0000 7fb932ffd700 1 --2- 172.21.15.81:0/2506139461 >> v2:172.21.15.83:3300/0 conn(0x7fb9340b2420 0x7fb93415a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:47.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.972+0000 7fb932ffd700 1 -- 172.21.15.81:0/2506139461 >> v1:172.21.15.83:6789/0 conn(0x7fb93415a450 legacy=0x7fb9340b1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:47.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.972+0000 7fb932ffd700 1 -- 172.21.15.81:0/2506139461 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9340b3e30 con 0x7fb9340cc670 2023-10-06T03:24:47.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.972+0000 7fb932ffd700 1 --2- 172.21.15.81:0/2506139461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9340cc670 0x7fb9340ccd40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb934150ad0 tx=0x7fb924009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aebf4e7468907c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:47.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.972+0000 7fb9327fc700 1 -- 172.21.15.81:0/2506139461 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92400b860 con 0x7fb9340cc670 2023-10-06T03:24:47.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.972+0000 7fb9327fc700 1 -- 172.21.15.81:0/2506139461 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb92400b9c0 con 0x7fb9340cc670 2023-10-06T03:24:47.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.972+0000 7fb9327fc700 1 -- 172.21.15.81:0/2506139461 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92400bd60 con 0x7fb9340cc670 2023-10-06T03:24:47.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.973+0000 7fb933fff700 1 -- 172.21.15.81:0/2506139461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9340cc670 msgr2=0x7fb9340ccd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:47.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.973+0000 7fb933fff700 1 --2- 172.21.15.81:0/2506139461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9340cc670 0x7fb9340ccd40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb934150ad0 tx=0x7fb924009250 comp rx=0 tx=0).stop 2023-10-06T03:24:47.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.973+0000 7fb933fff700 1 -- 172.21.15.81:0/2506139461 shutdown_connections 2023-10-06T03:24:47.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.973+0000 7fb933fff700 1 --2- 172.21.15.81:0/2506139461 >> v2:172.21.15.83:3300/0 conn(0x7fb9340b2420 0x7fb93415a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:47.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.973+0000 7fb933fff700 1 --2- 172.21.15.81:0/2506139461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9340cc670 0x7fb9340ccd40 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:47.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.973+0000 7fb933fff700 1 -- 172.21.15.81:0/2506139461 >> 172.21.15.81:0/2506139461 conn(0x7fb93406ed10 msgr2=0x7fb93406f110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:47.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.973+0000 7fb933fff700 1 -- 172.21.15.81:0/2506139461 shutdown_connections 2023-10-06T03:24:47.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.973+0000 7fb933fff700 1 -- 172.21.15.81:0/2506139461 wait complete. 2023-10-06T03:24:47.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.974+0000 7fb933fff700 1 Processor -- start 2023-10-06T03:24:47.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.975+0000 7fb933fff700 1 -- start start 2023-10-06T03:24:47.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.975+0000 7fb933fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb9340b2420 0x7fb93414d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:47.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.975+0000 7fb933fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9340cc670 0x7fb93413c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:47.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.975+0000 7fb933fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb93415a450 0x7fb934154040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:47.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.975+0000 7fb933fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb934157090 con 0x7fb9340cc670 2023-10-06T03:24:47.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.975+0000 7fb933fff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb934156480 con 0x7fb93415a450 2023-10-06T03:24:47.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.975+0000 7fb933fff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb934156760 con 0x7fb9340b2420 2023-10-06T03:24:47.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.976+0000 7fb92bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9340cc670 0x7fb93413c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:47.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.976+0000 7fb92bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9340cc670 0x7fb93413c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49932/0 (socket says 172.21.15.81:49932) 2023-10-06T03:24:47.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.976+0000 7fb92bfff700 1 -- 172.21.15.81:0/1251839870 learned_addr learned my addr 172.21.15.81:0/1251839870 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:47.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.976+0000 7fb9337fe700 1 --2- 172.21.15.81:0/1251839870 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb93415a450 0x7fb934154040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:47.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.976+0000 7fb932ffd700 1 --2- 172.21.15.81:0/1251839870 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb9340b2420 0x7fb93414d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:47.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.976+0000 7fb92bfff700 1 -- 172.21.15.81:0/1251839870 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb9340b2420 msgr2=0x7fb93414d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:47.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.976+0000 7fb92bfff700 1 --2- 172.21.15.81:0/1251839870 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb9340b2420 0x7fb93414d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:47.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.976+0000 7fb92bfff700 1 -- 172.21.15.81:0/1251839870 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb93415a450 msgr2=0x7fb934154040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:47.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.976+0000 7fb92bfff700 1 --2- 172.21.15.81:0/1251839870 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb93415a450 0x7fb934154040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:47.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.976+0000 7fb92bfff700 1 -- 172.21.15.81:0/1251839870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9240094f0 con 0x7fb9340cc670 2023-10-06T03:24:47.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.976+0000 7fb92bfff700 1 --2- 172.21.15.81:0/1251839870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9340cc670 0x7fb93413c0e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb91c00c590 tx=0x7fb91c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:47.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.977+0000 7fb92affd700 1 -- 172.21.15.81:0/1251839870 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91c011590 con 0x7fb9340cc670 2023-10-06T03:24:47.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.977+0000 7fb92affd700 1 -- 172.21.15.81:0/1251839870 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb91c011710 con 0x7fb9340cc670 2023-10-06T03:24:47.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.977+0000 7fb92affd700 1 -- 172.21.15.81:0/1251839870 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91c011ad0 con 0x7fb9340cc670 2023-10-06T03:24:47.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.977+0000 7fb933fff700 1 -- 172.21.15.81:0/1251839870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb934156a40 con 0x7fb9340cc670 2023-10-06T03:24:47.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.977+0000 7fb933fff700 1 -- 172.21.15.81:0/1251839870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb93414ddc0 con 0x7fb9340cc670 2023-10-06T03:24:47.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.978+0000 7fb933fff700 1 -- 172.21.15.81:0/1251839870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb934156ee0 con 0x7fb9340cc670 2023-10-06T03:24:47.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.979+0000 7fb92affd700 1 -- 172.21.15.81:0/1251839870 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb91c01b3b0 con 0x7fb9340cc670 2023-10-06T03:24:47.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.980+0000 7fb92affd700 1 --2- 172.21.15.81:0/1251839870 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb914066f30 0x7fb9140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:47.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.980+0000 7fb92affd700 1 -- 172.21.15.81:0/1251839870 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fb91c083890 con 0x7fb9340cc670 2023-10-06T03:24:47.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.980+0000 7fb932ffd700 1 --2- 172.21.15.81:0/1251839870 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb914066f30 0x7fb9140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:47.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.980+0000 7fb932ffd700 1 --2- 172.21.15.81:0/1251839870 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb914066f30 0x7fb9140693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb934150ad0 tx=0x7fb924017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:47.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:47.983+0000 7fb92affd700 1 -- 172.21.15.81:0/1251839870 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb91c050bb0 con 0x7fb9340cc670 2023-10-06T03:24:48.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.252+0000 7fb933fff700 1 -- 172.21.15.81:0/1251839870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fb9340b2260 con 0x7fb9340cc670 2023-10-06T03:24:48.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.256+0000 7fb92affd700 1 -- 172.21.15.81:0/1251839870 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb91c017070 con 0x7fb9340cc670 2023-10-06T03:24:48.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.258+0000 7fb933fff700 1 -- 172.21.15.81:0/1251839870 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb914066f30 msgr2=0x7fb9140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:48.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.258+0000 7fb933fff700 1 --2- 172.21.15.81:0/1251839870 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb914066f30 0x7fb9140693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb934150ad0 tx=0x7fb924017000 comp rx=0 tx=0).stop 2023-10-06T03:24:48.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.258+0000 7fb933fff700 1 -- 172.21.15.81:0/1251839870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9340cc670 msgr2=0x7fb93413c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:48.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.258+0000 7fb933fff700 1 --2- 172.21.15.81:0/1251839870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9340cc670 0x7fb93413c0e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb91c00c590 tx=0x7fb91c00c8a0 comp rx=0 tx=0).stop 2023-10-06T03:24:48.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.259+0000 7fb933fff700 1 -- 172.21.15.81:0/1251839870 shutdown_connections 2023-10-06T03:24:48.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.259+0000 7fb933fff700 1 --2- 172.21.15.81:0/1251839870 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb93415a450 0x7fb934154040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:48.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.259+0000 7fb933fff700 1 --2- 172.21.15.81:0/1251839870 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb914066f30 0x7fb9140693e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:48.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.259+0000 7fb933fff700 1 --2- 172.21.15.81:0/1251839870 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb9340b2420 0x7fb93414d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:48.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.259+0000 7fb933fff700 1 --2- 172.21.15.81:0/1251839870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9340cc670 0x7fb93413c0e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:48.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.259+0000 7fb933fff700 1 -- 172.21.15.81:0/1251839870 >> 172.21.15.81:0/1251839870 conn(0x7fb93406ed10 msgr2=0x7fb9340afc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:48.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.259+0000 7fb933fff700 1 -- 172.21.15.81:0/1251839870 shutdown_connections 2023-10-06T03:24:48.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.259+0000 7fb933fff700 1 -- 172.21.15.81:0/1251839870 wait complete. 2023-10-06T03:24:48.278 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:24:48.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.455+0000 7fa7d37ff700 1 Processor -- start 2023-10-06T03:24:48.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.455+0000 7fa7d37ff700 1 -- start start 2023-10-06T03:24:48.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.457+0000 7fa7d37ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa7cc13fd90 0x7fa7cc159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:48.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.457+0000 7fa7d37ff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7cc0cad30 con 0x7fa7cc13f9c0 2023-10-06T03:24:48.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.457+0000 7fa7d37ff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7cc0cafe0 con 0x7fa7cc15a3f0 2023-10-06T03:24:48.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.457+0000 7fa7d37ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7cc15a870 con 0x7fa7cc13fd90 2023-10-06T03:24:48.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.457+0000 7fa7d0d9a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa7cc13fd90 0x7fa7cc159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:48.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.457+0000 7fa7d0d9a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa7cc13fd90 0x7fa7cc159eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49942/0 (socket says 172.21.15.81:49942) 2023-10-06T03:24:48.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.457+0000 7fa7d0d9a700 1 -- 172.21.15.81:0/513878204 learned_addr learned my addr 172.21.15.81:0/513878204 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:48.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.457+0000 7fa7d159b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa7cc13f9c0 0x7fa7cc0ca620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41328/0 (socket says 172.21.15.81:41328) 2023-10-06T03:24:48.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.457+0000 7fa7d0d9a700 1 -- 172.21.15.81:0/513878204 >> v1:172.21.15.83:6789/0 conn(0x7fa7cc15a3f0 legacy=0x7fa7cc0c6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:48.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.457+0000 7fa7d0d9a700 1 -- 172.21.15.81:0/513878204 >> v1:172.21.15.81:6789/0 conn(0x7fa7cc13f9c0 legacy=0x7fa7cc0ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:48.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.457+0000 7fa7d0d9a700 1 -- 172.21.15.81:0/513878204 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7cc0cb2c0 con 0x7fa7cc13fd90 2023-10-06T03:24:48.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.457+0000 7fa7c3fff700 1 -- 172.21.15.81:0/513878204 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3112107573 0 0) 0x7fa7cc0cad30 con 0x7fa7cc13f9c0 2023-10-06T03:24:48.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.458+0000 7fa7d0d9a700 1 --2- 172.21.15.81:0/513878204 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7cc13fd90 0x7fa7cc159eb0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc00bc50 tx=0x7fa7bc00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4da10109d413c11e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:48.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.458+0000 7fa7c3fff700 1 -- 172.21.15.81:0/513878204 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc00be60 con 0x7fa7cc13fd90 2023-10-06T03:24:48.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.458+0000 7fa7c3fff700 1 -- 172.21.15.81:0/513878204 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7bc00de00 con 0x7fa7cc13fd90 2023-10-06T03:24:48.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.458+0000 7fa7c3fff700 1 -- 172.21.15.81:0/513878204 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc0196b0 con 0x7fa7cc13fd90 2023-10-06T03:24:48.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.458+0000 7fa7d37ff700 1 -- 172.21.15.81:0/513878204 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7cc13fd90 msgr2=0x7fa7cc159eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:48.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.458+0000 7fa7d37ff700 1 --2- 172.21.15.81:0/513878204 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7cc13fd90 0x7fa7cc159eb0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc00bc50 tx=0x7fa7bc00b4f0 comp rx=0 tx=0).stop 2023-10-06T03:24:48.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.459+0000 7fa7d37ff700 1 -- 172.21.15.81:0/513878204 shutdown_connections 2023-10-06T03:24:48.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.459+0000 7fa7d37ff700 1 --2- 172.21.15.81:0/513878204 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7cc13fd90 0x7fa7cc159eb0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:48.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.459+0000 7fa7d37ff700 1 -- 172.21.15.81:0/513878204 >> 172.21.15.81:0/513878204 conn(0x7fa7cc0cc090 msgr2=0x7fa7cc0cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:48.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.459+0000 7fa7d37ff700 1 -- 172.21.15.81:0/513878204 shutdown_connections 2023-10-06T03:24:48.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.459+0000 7fa7d37ff700 1 -- 172.21.15.81:0/513878204 wait complete. 2023-10-06T03:24:48.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.460+0000 7fa7d37ff700 1 Processor -- start 2023-10-06T03:24:48.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.460+0000 7fa7d37ff700 1 -- start start 2023-10-06T03:24:48.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.461+0000 7fa7d37ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa7cc13f9c0 0x7fa7cc0aee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:48.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.461+0000 7fa7d37ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7cc13fd90 0x7fa7cc0b0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:48.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.461+0000 7fa7d37ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa7cc15a3f0 0x7fa7cc0c5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:48.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.461+0000 7fa7d37ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7cc166560 con 0x7fa7cc13fd90 2023-10-06T03:24:48.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.461+0000 7fa7d37ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7cc165620 con 0x7fa7cc13f9c0 2023-10-06T03:24:48.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.461+0000 7fa7d37ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7cc1658e0 con 0x7fa7cc15a3f0 2023-10-06T03:24:48.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.461+0000 7fa7d0d9a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7cc13fd90 0x7fa7cc0b0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:48.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.461+0000 7fa7d0d9a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7cc13fd90 0x7fa7cc0b0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49944/0 (socket says 172.21.15.81:49944) 2023-10-06T03:24:48.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.461+0000 7fa7d0d9a700 1 -- 172.21.15.81:0/743827770 learned_addr learned my addr 172.21.15.81:0/743827770 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:48.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.461+0000 7fa7d159b700 1 --2- 172.21.15.81:0/743827770 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa7cc13f9c0 0x7fa7cc0aee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:48.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.462+0000 7fa7d1d9c700 1 --2- 172.21.15.81:0/743827770 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa7cc15a3f0 0x7fa7cc0c5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:48.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.462+0000 7fa7d0d9a700 1 -- 172.21.15.81:0/743827770 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa7cc15a3f0 msgr2=0x7fa7cc0c5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:48.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.462+0000 7fa7d0d9a700 1 --2- 172.21.15.81:0/743827770 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa7cc15a3f0 0x7fa7cc0c5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:48.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.462+0000 7fa7d0d9a700 1 -- 172.21.15.81:0/743827770 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa7cc13f9c0 msgr2=0x7fa7cc0aee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:48.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.462+0000 7fa7d0d9a700 1 --2- 172.21.15.81:0/743827770 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa7cc13f9c0 0x7fa7cc0aee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:48.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.462+0000 7fa7d0d9a700 1 -- 172.21.15.81:0/743827770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7bc00b790 con 0x7fa7cc13fd90 2023-10-06T03:24:48.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.462+0000 7fa7d0d9a700 1 --2- 172.21.15.81:0/743827770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7cc13fd90 0x7fa7cc0b0f50 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc0690e0 tx=0x7fa7bc01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:48.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.462+0000 7fa7c17fa700 1 -- 172.21.15.81:0/743827770 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc010540 con 0x7fa7cc13fd90 2023-10-06T03:24:48.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.462+0000 7fa7c17fa700 1 -- 172.21.15.81:0/743827770 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7bc0106e0 con 0x7fa7cc13fd90 2023-10-06T03:24:48.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.462+0000 7fa7d37ff700 1 -- 172.21.15.81:0/743827770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7cc165bc0 con 0x7fa7cc13fd90 2023-10-06T03:24:48.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.462+0000 7fa7c17fa700 1 -- 172.21.15.81:0/743827770 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc010aa0 con 0x7fa7cc13fd90 2023-10-06T03:24:48.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.462+0000 7fa7d37ff700 1 -- 172.21.15.81:0/743827770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7cc166180 con 0x7fa7cc13fd90 2023-10-06T03:24:48.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.463+0000 7fa7d37ff700 1 -- 172.21.15.81:0/743827770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7cc168c20 con 0x7fa7cc13fd90 2023-10-06T03:24:48.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.464+0000 7fa7c17fa700 1 -- 172.21.15.81:0/743827770 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa7bc022030 con 0x7fa7cc13fd90 2023-10-06T03:24:48.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.465+0000 7fa7c17fa700 1 --2- 172.21.15.81:0/743827770 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa7b0066f30 0x7fa7b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:48.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.465+0000 7fa7c17fa700 1 -- 172.21.15.81:0/743827770 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fa7bc014070 con 0x7fa7cc13fd90 2023-10-06T03:24:48.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.465+0000 7fa7d159b700 1 --2- 172.21.15.81:0/743827770 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa7b0066f30 0x7fa7b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:48.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.466+0000 7fa7d159b700 1 --2- 172.21.15.81:0/743827770 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa7b0066f30 0x7fa7b00693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc069e50 tx=0x7fa7c8007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:48.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.469+0000 7fa7c17fa700 1 -- 172.21.15.81:0/743827770 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa7cc168c20 con 0x7fa7cc13fd90 2023-10-06T03:24:48.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.663+0000 7fa7d37ff700 1 -- 172.21.15.81:0/743827770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa7cc168c20 con 0x7fa7cc13fd90 2023-10-06T03:24:48.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.664+0000 7fa7c17fa700 1 -- 172.21.15.81:0/743827770 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+13807 (secure 0 0 0) 0x7fa7cc168c20 con 0x7fa7cc13fd90 2023-10-06T03:24:48.666 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:24:48.666 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":34,"fsid":"1807b5d7-9be8-43ad-aaf8-99a4273430b3","created":"2023-10-06T03:23:20.805306+0000","modified":"2023-10-06T03:24:44.866195+0000","last_up_change":"2023-10-06T03:23:32.735796+0000","last_in_change":"2023-10-06T03:23:24.109024+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:33.198850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:33.606744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"14fb667d-a677-4978-a477-80027f889d36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":85563},{"type":"v1","addr":"172.21.15.81:6818","nonce":85563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":85563},{"type":"v1","addr":"172.21.15.81:6822","nonce":85563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":85563},{"type":"v1","addr":"172.21.15.81:6830","nonce":85563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":85563},{"type":"v1","addr":"172.21.15.81:6826","nonce":85563}]},"public_addr":"172.21.15.81:6818/85563","cluster_addr":"172.21.15.81:6822/85563","heartbeat_back_addr":"172.21.15.81:6830/85563","heartbeat_front_addr":"172.21.15.81:6826/85563","state":["exists","up"]},{"osd":1,"uuid":"974d8a86-1829-4176-89ce-18e6038857f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":85561},{"type":"v1","addr":"172.21.15.81:6801","nonce":85561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":85561},{"type":"v1","addr":"172.21.15.81:6803","nonce":85561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":85561},{"type":"v1","addr":"172.21.15.81:6807","nonce":85561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":85561},{"type":"v1","addr":"172.21.15.81:6805","nonce":85561}]},"public_addr":"172.21.15.81:6801/85561","cluster_addr":"172.21.15.81:6803/85561","heartbeat_back_addr":"172.21.15.81:6807/85561","heartbeat_front_addr":"172.21.15.81:6805/85561","state":["exists","up"]},{"osd":2,"uuid":"ffbfe056-46bc-46e0-bf49-4d8f8650e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":85564},{"type":"v1","addr":"172.21.15.81:6809","nonce":85564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":85564},{"type":"v1","addr":"172.21.15.81:6811","nonce":85564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":85564},{"type":"v1","addr":"172.21.15.81:6815","nonce":85564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":85564},{"type":"v1","addr":"172.21.15.81:6813","nonce":85564}]},"public_addr":"172.21.15.81:6809/85564","cluster_addr":"172.21.15.81:6811/85564","heartbeat_back_addr":"172.21.15.81:6815/85564","heartbeat_front_addr":"172.21.15.81:6813/85564","state":["exists","up"]},{"osd":3,"uuid":"ef9a8314-3d37-4ea1-858a-e704d5695002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":85562},{"type":"v1","addr":"172.21.15.81:6819","nonce":85562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":85562},{"type":"v1","addr":"172.21.15.81:6823","nonce":85562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":85562},{"type":"v1","addr":"172.21.15.81:6831","nonce":85562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":85562},{"type":"v1","addr":"172.21.15.81:6827","nonce":85562}]},"public_addr":"172.21.15.81:6819/85562","cluster_addr":"172.21.15.81:6823/85562","heartbeat_back_addr":"172.21.15.81:6831/85562","heartbeat_front_addr":"172.21.15.81:6827/85562","state":["exists","up"]},{"osd":4,"uuid":"d83506a0-2c96-4bcb-a9fa-05e43dc329df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":85785},{"type":"v1","addr":"172.21.15.83:6801","nonce":85785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":85785},{"type":"v1","addr":"172.21.15.83:6803","nonce":85785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":85785},{"type":"v1","addr":"172.21.15.83:6807","nonce":85785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":85785},{"type":"v1","addr":"172.21.15.83:6805","nonce":85785}]},"public_addr":"172.21.15.83:6801/85785","cluster_addr":"172.21.15.83:6803/85785","heartbeat_back_addr":"172.21.15.83:6807/85785","heartbeat_front_addr":"172.21.15.83:6805/85785","state":["exists","up"]},{"osd":5,"uuid":"10687c63-a3d5-472f-acc0-4f61847b6e0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":85818},{"type":"v1","addr":"172.21.15.83:6825","nonce":85818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":85818},{"type":"v1","addr":"172.21.15.83:6827","nonce":85818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":85818},{"type":"v1","addr":"172.21.15.83:6831","nonce":85818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":85818},{"type":"v1","addr":"172.21.15.83:6829","nonce":85818}]},"public_addr":"172.21.15.83:6825/85818","cluster_addr":"172.21.15.83:6827/85818","heartbeat_back_addr":"172.21.15.83:6831/85818","heartbeat_front_addr":"172.21.15.83:6829/85818","state":["exists","up"]},{"osd":6,"uuid":"2e9daf76-5607-4a29-9a58-6e270700d223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":85787},{"type":"v1","addr":"172.21.15.83:6811","nonce":85787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":85787},{"type":"v1","addr":"172.21.15.83:6815","nonce":85787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":85787},{"type":"v1","addr":"172.21.15.83:6823","nonce":85787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6817","nonce":85787},{"type":"v1","addr":"172.21.15.83:6819","nonce":85787}]},"public_addr":"172.21.15.83:6811/85787","cluster_addr":"172.21.15.83:6815/85787","heartbeat_back_addr":"172.21.15.83:6823/85787","heartbeat_front_addr":"172.21.15.83:6819/85787","state":["exists","up"]},{"osd":7,"uuid":"5019e1ff-233a-4a5a-91ca-8afccb7ab6e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":85786},{"type":"v1","addr":"172.21.15.83:6810","nonce":85786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":85786},{"type":"v1","addr":"172.21.15.83:6814","nonce":85786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":85786},{"type":"v1","addr":"172.21.15.83:6822","nonce":85786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":85786},{"type":"v1","addr":"172.21.15.83:6818","nonce":85786}]},"public_addr":"172.21.15.83:6810/85786","cluster_addr":"172.21.15.83:6814/85786","heartbeat_back_addr":"172.21.15.83:6822/85786","heartbeat_front_addr":"172.21.15.83:6818/85786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.393431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.360031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.407428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.391613+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.403211+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.438142+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.496181+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.472323+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:24:48.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.667+0000 7fa7d37ff700 1 -- 172.21.15.81:0/743827770 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa7b0066f30 msgr2=0x7fa7b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:48.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.667+0000 7fa7d37ff700 1 --2- 172.21.15.81:0/743827770 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa7b0066f30 0x7fa7b00693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc069e50 tx=0x7fa7c8007d30 comp rx=0 tx=0).stop 2023-10-06T03:24:48.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.667+0000 7fa7d37ff700 1 -- 172.21.15.81:0/743827770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7cc13fd90 msgr2=0x7fa7cc0b0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:48.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.667+0000 7fa7d37ff700 1 --2- 172.21.15.81:0/743827770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7cc13fd90 0x7fa7cc0b0f50 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc0690e0 tx=0x7fa7bc01b000 comp rx=0 tx=0).stop 2023-10-06T03:24:48.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.667+0000 7fa7d37ff700 1 -- 172.21.15.81:0/743827770 shutdown_connections 2023-10-06T03:24:48.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.667+0000 7fa7d37ff700 1 --2- 172.21.15.81:0/743827770 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa7b0066f30 0x7fa7b00693e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:48.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.667+0000 7fa7d37ff700 1 --2- 172.21.15.81:0/743827770 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa7cc15a3f0 0x7fa7cc0c5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:48.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.667+0000 7fa7d37ff700 1 --2- 172.21.15.81:0/743827770 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa7cc13f9c0 0x7fa7cc0aee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:48.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.667+0000 7fa7d37ff700 1 --2- 172.21.15.81:0/743827770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7cc13fd90 0x7fa7cc0b0f50 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:48.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.667+0000 7fa7d37ff700 1 -- 172.21.15.81:0/743827770 >> 172.21.15.81:0/743827770 conn(0x7fa7cc0cc090 msgr2=0x7fa7cc069ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:48.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.667+0000 7fa7d37ff700 1 -- 172.21.15.81:0/743827770 shutdown_connections 2023-10-06T03:24:48.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.667+0000 7fa7d37ff700 1 -- 172.21.15.81:0/743827770 wait complete. 2023-10-06T03:24:48.687 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:23:33.198850+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:23:33.606744+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T03:24:48.688 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:24:48.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.869+0000 7fec1b59d700 1 Processor -- start 2023-10-06T03:24:48.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.869+0000 7fec1b59d700 1 -- start start 2023-10-06T03:24:48.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.871+0000 7fec1b59d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fec14156400 0x7fec140c6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:48.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.871+0000 7fec1b59d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fec140c7340 0x7fec1406a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:48.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.871+0000 7fec1b59d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec1406e080 con 0x7fec14156030 2023-10-06T03:24:48.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.871+0000 7fec1b59d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec1406d1b0 con 0x7fec14156400 2023-10-06T03:24:48.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.871+0000 7fec1b59d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec1406ec20 con 0x7fec140c7340 2023-10-06T03:24:48.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.871+0000 7fec19d9a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fec14156400 0x7fec140c6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:48.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.871+0000 7fec1a59b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fec14156030 0x7fec1406e510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41332/0 (socket says 172.21.15.81:41332) 2023-10-06T03:24:48.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.871+0000 7fec1a59b700 1 -- 172.21.15.81:0/745066166 learned_addr learned my addr 172.21.15.81:0/745066166 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:24:48.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.871+0000 7fec1ad9c700 1 --2- 172.21.15.81:0/745066166 >> v2:172.21.15.83:3300/0 conn(0x7fec140c7340 0x7fec1406a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:48.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.871+0000 7fec19599700 1 -- 172.21.15.81:0/745066166 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3530178527 0 0) 0x7fec1406e080 con 0x7fec14156030 2023-10-06T03:24:48.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.871+0000 7fec19d9a700 1 -- 172.21.15.81:0/745066166 >> v2:172.21.15.83:3300/0 conn(0x7fec140c7340 msgr2=0x7fec1406a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:48.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.871+0000 7fec19d9a700 1 --2- 172.21.15.81:0/745066166 >> v2:172.21.15.83:3300/0 conn(0x7fec140c7340 0x7fec1406a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:48.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.871+0000 7fec19d9a700 1 -- 172.21.15.81:0/745066166 >> v1:172.21.15.81:6789/0 conn(0x7fec14156030 legacy=0x7fec1406e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:48.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.871+0000 7fec19d9a700 1 -- 172.21.15.81:0/745066166 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec1406d470 con 0x7fec14156400 2023-10-06T03:24:48.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.871+0000 7fec1ad9c700 1 --2- 172.21.15.81:0/745066166 >> v2:172.21.15.83:3300/0 conn(0x7fec140c7340 0x7fec1406a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:48.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.872+0000 7fec19d9a700 1 --2- 172.21.15.81:0/745066166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec14156400 0x7fec140c6e00 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fec140cc870 tx=0x7fec040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a53799dd35d5e54 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:48.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.872+0000 7fec19599700 1 -- 172.21.15.81:0/745066166 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0400b6b0 con 0x7fec14156400 2023-10-06T03:24:48.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.872+0000 7fec19599700 1 -- 172.21.15.81:0/745066166 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec0400b810 con 0x7fec14156400 2023-10-06T03:24:48.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.872+0000 7fec19599700 1 -- 172.21.15.81:0/745066166 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0400bbb0 con 0x7fec14156400 2023-10-06T03:24:48.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.872+0000 7fec1b59d700 1 -- 172.21.15.81:0/745066166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec14156400 msgr2=0x7fec140c6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:48.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.872+0000 7fec1b59d700 1 --2- 172.21.15.81:0/745066166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec14156400 0x7fec140c6e00 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fec140cc870 tx=0x7fec040091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:48.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.872+0000 7fec1b59d700 1 -- 172.21.15.81:0/745066166 shutdown_connections 2023-10-06T03:24:48.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.872+0000 7fec1b59d700 1 --2- 172.21.15.81:0/745066166 >> v2:172.21.15.83:3300/0 conn(0x7fec140c7340 0x7fec1406a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:48.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.872+0000 7fec1b59d700 1 --2- 172.21.15.81:0/745066166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec14156400 0x7fec140c6e00 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:48.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.872+0000 7fec1b59d700 1 -- 172.21.15.81:0/745066166 >> 172.21.15.81:0/745066166 conn(0x7fec140680b0 msgr2=0x7fec140cbeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:48.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.872+0000 7fec1b59d700 1 -- 172.21.15.81:0/745066166 shutdown_connections 2023-10-06T03:24:48.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.872+0000 7fec1b59d700 1 -- 172.21.15.81:0/745066166 wait complete. 2023-10-06T03:24:48.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.874+0000 7fec1b59d700 1 Processor -- start 2023-10-06T03:24:48.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.874+0000 7fec1b59d700 1 -- start start 2023-10-06T03:24:48.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.875+0000 7fec1b59d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fec140c7340 0x7fec14159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:48.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.875+0000 7fec1b59d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fec14156030 0x7fec140af550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:48.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.875+0000 7fec1b59d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec14156400 0x7fec140c0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:48.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.875+0000 7fec1b59d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec140b0a40 con 0x7fec14156400 2023-10-06T03:24:48.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.875+0000 7fec1b59d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec140afe30 con 0x7fec14156030 2023-10-06T03:24:48.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.875+0000 7fec1b59d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec140b0110 con 0x7fec140c7340 2023-10-06T03:24:48.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.875+0000 7fec1ad9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec14156400 0x7fec140c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:48.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.875+0000 7fec1ad9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec14156400 0x7fec140c0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49962/0 (socket says 172.21.15.81:49962) 2023-10-06T03:24:48.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.875+0000 7fec1ad9c700 1 -- 172.21.15.81:0/1420437574 learned_addr learned my addr 172.21.15.81:0/1420437574 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:48.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.876+0000 7fec1a59b700 1 --2- 172.21.15.81:0/1420437574 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fec140c7340 0x7fec14159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:48.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.876+0000 7fec19d9a700 1 --2- 172.21.15.81:0/1420437574 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fec14156030 0x7fec140af550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:48.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.876+0000 7fec1ad9c700 1 -- 172.21.15.81:0/1420437574 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fec140c7340 msgr2=0x7fec14159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:48.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.876+0000 7fec1ad9c700 1 --2- 172.21.15.81:0/1420437574 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fec140c7340 0x7fec14159dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:48.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.876+0000 7fec1ad9c700 1 -- 172.21.15.81:0/1420437574 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fec14156030 msgr2=0x7fec140af550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:48.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.876+0000 7fec1ad9c700 1 --2- 172.21.15.81:0/1420437574 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fec14156030 0x7fec140af550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:48.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.876+0000 7fec1ad9c700 1 -- 172.21.15.81:0/1420437574 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec04009420 con 0x7fec14156400 2023-10-06T03:24:48.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.876+0000 7fec1ad9c700 1 --2- 172.21.15.81:0/1420437574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec14156400 0x7fec140c0900 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fec0c00cef0 tx=0x7fec0c007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:48.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.876+0000 7fec0a7fc700 1 -- 172.21.15.81:0/1420437574 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c00ae00 con 0x7fec14156400 2023-10-06T03:24:48.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.876+0000 7fec0a7fc700 1 -- 172.21.15.81:0/1420437574 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec0c016420 con 0x7fec14156400 2023-10-06T03:24:48.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.876+0000 7fec0a7fc700 1 -- 172.21.15.81:0/1420437574 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c0167e0 con 0x7fec14156400 2023-10-06T03:24:48.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.876+0000 7fec1b59d700 1 -- 172.21.15.81:0/1420437574 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec140b03f0 con 0x7fec14156400 2023-10-06T03:24:48.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.876+0000 7fec1b59d700 1 -- 172.21.15.81:0/1420437574 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec1415a300 con 0x7fec14156400 2023-10-06T03:24:48.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.877+0000 7fec1b59d700 1 -- 172.21.15.81:0/1420437574 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec140b0bf0 con 0x7fec14156400 2023-10-06T03:24:48.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.878+0000 7fec0a7fc700 1 -- 172.21.15.81:0/1420437574 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fec0c016b90 con 0x7fec14156400 2023-10-06T03:24:48.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.879+0000 7fec0a7fc700 1 --2- 172.21.15.81:0/1420437574 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7febf8066f30 0x7febf80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:48.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.879+0000 7fec0a7fc700 1 -- 172.21.15.81:0/1420437574 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fec0c012070 con 0x7fec14156400 2023-10-06T03:24:48.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.879+0000 7fec1a59b700 1 --2- 172.21.15.81:0/1420437574 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7febf8066f30 0x7febf80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:48.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.880+0000 7fec1a59b700 1 --2- 172.21.15.81:0/1420437574 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7febf8066f30 0x7febf80693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fec100011e0 tx=0x7fec10009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:48.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:48.883+0000 7fec0a7fc700 1 -- 172.21.15.81:0/1420437574 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fec0c04e5a0 con 0x7fec14156400 2023-10-06T03:24:49.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.074+0000 7fec1b59d700 1 -- 172.21.15.81:0/1420437574 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fec1404c3c0 con 0x7fec14156400 2023-10-06T03:24:49.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.074+0000 7fec0a7fc700 1 -- 172.21.15.81:0/1420437574 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v34) v1 ==== 92+0+10 (secure 0 0 0) 0x7fec140b0bf0 con 0x7fec14156400 2023-10-06T03:24:49.077 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-10-06T03:24:49.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.077+0000 7fec1b59d700 1 -- 172.21.15.81:0/1420437574 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7febf8066f30 msgr2=0x7febf80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:49.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.077+0000 7fec1b59d700 1 --2- 172.21.15.81:0/1420437574 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7febf8066f30 0x7febf80693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fec100011e0 tx=0x7fec10009040 comp rx=0 tx=0).stop 2023-10-06T03:24:49.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.077+0000 7fec1b59d700 1 -- 172.21.15.81:0/1420437574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec14156400 msgr2=0x7fec140c0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:49.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.077+0000 7fec1b59d700 1 --2- 172.21.15.81:0/1420437574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec14156400 0x7fec140c0900 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fec0c00cef0 tx=0x7fec0c007860 comp rx=0 tx=0).stop 2023-10-06T03:24:49.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.077+0000 7fec1b59d700 1 -- 172.21.15.81:0/1420437574 shutdown_connections 2023-10-06T03:24:49.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.077+0000 7fec1b59d700 1 --2- 172.21.15.81:0/1420437574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec14156400 0x7fec140c0900 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:49.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.077+0000 7fec1b59d700 1 --2- 172.21.15.81:0/1420437574 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7febf8066f30 0x7febf80693e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:49.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.077+0000 7fec1b59d700 1 --2- 172.21.15.81:0/1420437574 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fec140c7340 0x7fec14159dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:49.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.077+0000 7fec1b59d700 1 --2- 172.21.15.81:0/1420437574 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fec14156030 0x7fec140af550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:49.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.077+0000 7fec1b59d700 1 -- 172.21.15.81:0/1420437574 >> 172.21.15.81:0/1420437574 conn(0x7fec140680b0 msgr2=0x7fec140cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:49.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.077+0000 7fec1b59d700 1 -- 172.21.15.81:0/1420437574 shutdown_connections 2023-10-06T03:24:49.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.077+0000 7fec1b59d700 1 -- 172.21.15.81:0/1420437574 wait complete. 2023-10-06T03:24:49.096 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:24:49.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.278+0000 7fdb0179d700 1 Processor -- start 2023-10-06T03:24:49.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.278+0000 7fdb0179d700 1 -- start start 2023-10-06T03:24:49.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.279+0000 7fdb0179d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fdafc156030 0x7fdafc156400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:49.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.279+0000 7fdb0179d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdafc06e510 0x7fdafc0c6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:49.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.279+0000 7fdb0179d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdafc06e080 con 0x7fdafc06e990 2023-10-06T03:24:49.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.279+0000 7fdb0179d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdafc06d1b0 con 0x7fdafc06e510 2023-10-06T03:24:49.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.279+0000 7fdb0179d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdafc06d470 con 0x7fdafc156030 2023-10-06T03:24:49.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.279+0000 7fdafb7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdafc06e510 0x7fdafc0c6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:49.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.279+0000 7fdb00f9c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fdafc06e990 0x7fdafc06a3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41346/0 (socket says 172.21.15.81:41346) 2023-10-06T03:24:49.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.279+0000 7fdb00f9c700 1 -- 172.21.15.81:0/147787473 learned_addr learned my addr 172.21.15.81:0/147787473 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:24:49.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.279+0000 7fdafbfff700 1 --2- 172.21.15.81:0/147787473 >> v2:172.21.15.83:3300/0 conn(0x7fdafc156030 0x7fdafc156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:49.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.280+0000 7fdafaffd700 1 -- 172.21.15.81:0/147787473 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3507354375 0 0) 0x7fdafc06e080 con 0x7fdafc06e990 2023-10-06T03:24:49.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.280+0000 7fdafaffd700 1 -- 172.21.15.81:0/147787473 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdae4003570 con 0x7fdafc06e990 2023-10-06T03:24:49.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.280+0000 7fdafb7fe700 1 -- 172.21.15.81:0/147787473 >> v2:172.21.15.83:3300/0 conn(0x7fdafc156030 msgr2=0x7fdafc156400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:49.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.280+0000 7fdafb7fe700 1 --2- 172.21.15.81:0/147787473 >> v2:172.21.15.83:3300/0 conn(0x7fdafc156030 0x7fdafc156400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:49.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.280+0000 7fdafb7fe700 1 -- 172.21.15.81:0/147787473 >> v1:172.21.15.81:6789/0 conn(0x7fdafc06e990 legacy=0x7fdafc06a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:49.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.280+0000 7fdafb7fe700 1 -- 172.21.15.81:0/147787473 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdafc06d750 con 0x7fdafc06e510 2023-10-06T03:24:49.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.280+0000 7fdafb7fe700 1 --2- 172.21.15.81:0/147787473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdafc06e510 0x7fdafc0c6e00 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fdafc068590 tx=0x7fdaf00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bd8455998022cc4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:49.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.280+0000 7fdafaffd700 1 -- 172.21.15.81:0/147787473 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf0011630 con 0x7fdafc06e510 2023-10-06T03:24:49.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.280+0000 7fdafaffd700 1 -- 172.21.15.81:0/147787473 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf00117b0 con 0x7fdafc06e510 2023-10-06T03:24:49.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.280+0000 7fdafaffd700 1 -- 172.21.15.81:0/147787473 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf0011b30 con 0x7fdafc06e510 2023-10-06T03:24:49.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.281+0000 7fdb0179d700 1 -- 172.21.15.81:0/147787473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdafc06e510 msgr2=0x7fdafc0c6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:49.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.281+0000 7fdb0179d700 1 --2- 172.21.15.81:0/147787473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdafc06e510 0x7fdafc0c6e00 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fdafc068590 tx=0x7fdaf00091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:49.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.281+0000 7fdb0179d700 1 -- 172.21.15.81:0/147787473 shutdown_connections 2023-10-06T03:24:49.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.281+0000 7fdb0179d700 1 --2- 172.21.15.81:0/147787473 >> v2:172.21.15.83:3300/0 conn(0x7fdafc156030 0x7fdafc156400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:49.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.281+0000 7fdb0179d700 1 --2- 172.21.15.81:0/147787473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdafc06e510 0x7fdafc0c6e00 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:49.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.281+0000 7fdb0179d700 1 -- 172.21.15.81:0/147787473 >> 172.21.15.81:0/147787473 conn(0x7fdafc0680b0 msgr2=0x7fdafc0cbeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:49.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.281+0000 7fdb0179d700 1 -- 172.21.15.81:0/147787473 shutdown_connections 2023-10-06T03:24:49.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.281+0000 7fdb0179d700 1 -- 172.21.15.81:0/147787473 wait complete. 2023-10-06T03:24:49.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.282+0000 7fdb0179d700 1 Processor -- start 2023-10-06T03:24:49.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.282+0000 7fdb0179d700 1 -- start start 2023-10-06T03:24:49.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.283+0000 7fdb0179d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdafc06e510 0x7fdafc0bfd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:49.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.283+0000 7fdb0179d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdafc06e990 0x7fdafc14e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:49.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.283+0000 7fdb0179d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdafc156030 0x7fdafc14ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:49.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.283+0000 7fdb0179d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdafc0c2500 con 0x7fdafc06e510 2023-10-06T03:24:49.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.283+0000 7fdb0179d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdafc0c0290 con 0x7fdafc156030 2023-10-06T03:24:49.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.283+0000 7fdb0179d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdafc0c04c0 con 0x7fdafc06e990 2023-10-06T03:24:49.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.283+0000 7fdafbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdafc06e510 0x7fdafc0bfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:49.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.283+0000 7fdafbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdafc06e510 0x7fdafc0bfd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49980/0 (socket says 172.21.15.81:49980) 2023-10-06T03:24:49.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.283+0000 7fdafbfff700 1 -- 172.21.15.81:0/3524759692 learned_addr learned my addr 172.21.15.81:0/3524759692 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:49.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.284+0000 7fdafbfff700 1 -- 172.21.15.81:0/3524759692 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdafc06e990 msgr2=0x7fdafc14e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:49.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.284+0000 7fdafb7fe700 1 --2- 172.21.15.81:0/3524759692 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdafc06e990 0x7fdafc14e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:49.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.284+0000 7fdb00f9c700 1 --2- 172.21.15.81:0/3524759692 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdafc156030 0x7fdafc14ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:49.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.284+0000 7fdafbfff700 1 --2- 172.21.15.81:0/3524759692 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdafc06e990 0x7fdafc14e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:49.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.284+0000 7fdafbfff700 1 -- 172.21.15.81:0/3524759692 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdafc156030 msgr2=0x7fdafc14ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:49.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.284+0000 7fdafbfff700 1 --2- 172.21.15.81:0/3524759692 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdafc156030 0x7fdafc14ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:49.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.284+0000 7fdafbfff700 1 -- 172.21.15.81:0/3524759692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf0009420 con 0x7fdafc06e510 2023-10-06T03:24:49.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.284+0000 7fdafbfff700 1 --2- 172.21.15.81:0/3524759692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdafc06e510 0x7fdafc0bfd50 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fdaec00e930 tx=0x7fdaec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:49.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.284+0000 7fdae3fff700 1 -- 172.21.15.81:0/3524759692 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaec00eed0 con 0x7fdafc06e510 2023-10-06T03:24:49.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.284+0000 7fdae3fff700 1 -- 172.21.15.81:0/3524759692 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaec00c850 con 0x7fdafc06e510 2023-10-06T03:24:49.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.284+0000 7fdae3fff700 1 -- 172.21.15.81:0/3524759692 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaec00cbf0 con 0x7fdafc06e510 2023-10-06T03:24:49.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.284+0000 7fdb0179d700 1 -- 172.21.15.81:0/3524759692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdafc0c0800 con 0x7fdafc06e510 2023-10-06T03:24:49.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.284+0000 7fdb0179d700 1 -- 172.21.15.81:0/3524759692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdafc151e30 con 0x7fdafc06e510 2023-10-06T03:24:49.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.285+0000 7fdb0179d700 1 -- 172.21.15.81:0/3524759692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdafc152280 con 0x7fdafc06e510 2023-10-06T03:24:49.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.286+0000 7fdae3fff700 1 -- 172.21.15.81:0/3524759692 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdaec013470 con 0x7fdafc06e510 2023-10-06T03:24:49.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.287+0000 7fdae3fff700 1 --2- 172.21.15.81:0/3524759692 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fdae8066f30 0x7fdae80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:49.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.287+0000 7fdae3fff700 1 -- 172.21.15.81:0/3524759692 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fdaec084750 con 0x7fdafc06e510 2023-10-06T03:24:49.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.287+0000 7fdafb7fe700 1 --2- 172.21.15.81:0/3524759692 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fdae8066f30 0x7fdae80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:49.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.288+0000 7fdafb7fe700 1 --2- 172.21.15.81:0/3524759692 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fdae8066f30 0x7fdae80693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fdafc068590 tx=0x7fdaf0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:49.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.291+0000 7fdae3fff700 1 -- 172.21.15.81:0/3524759692 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdaec0519d0 con 0x7fdafc06e510 2023-10-06T03:24:49.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.481+0000 7fdb0179d700 1 -- 172.21.15.81:0/3524759692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdafc1520b0 con 0x7fdafc06e510 2023-10-06T03:24:49.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.481+0000 7fdae3fff700 1 -- 172.21.15.81:0/3524759692 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdaec054ff0 con 0x7fdafc06e510 2023-10-06T03:24:49.483 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-06T03:24:49.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.483+0000 7fdb0179d700 1 -- 172.21.15.81:0/3524759692 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fdae8066f30 msgr2=0x7fdae80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:49.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.483+0000 7fdb0179d700 1 --2- 172.21.15.81:0/3524759692 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fdae8066f30 0x7fdae80693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fdafc068590 tx=0x7fdaf0017000 comp rx=0 tx=0).stop 2023-10-06T03:24:49.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.483+0000 7fdb0179d700 1 -- 172.21.15.81:0/3524759692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdafc06e510 msgr2=0x7fdafc0bfd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:49.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.483+0000 7fdb0179d700 1 --2- 172.21.15.81:0/3524759692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdafc06e510 0x7fdafc0bfd50 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fdaec00e930 tx=0x7fdaec0091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:49.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.483+0000 7fdb0179d700 1 -- 172.21.15.81:0/3524759692 shutdown_connections 2023-10-06T03:24:49.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.483+0000 7fdb0179d700 1 --2- 172.21.15.81:0/3524759692 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdafc156030 0x7fdafc14ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:49.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.483+0000 7fdb0179d700 1 --2- 172.21.15.81:0/3524759692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdafc06e510 0x7fdafc0bfd50 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:49.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.483+0000 7fdb0179d700 1 --2- 172.21.15.81:0/3524759692 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fdae8066f30 0x7fdae80693e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:49.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.483+0000 7fdb0179d700 1 --2- 172.21.15.81:0/3524759692 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdafc06e990 0x7fdafc14e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:49.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.483+0000 7fdb0179d700 1 -- 172.21.15.81:0/3524759692 >> 172.21.15.81:0/3524759692 conn(0x7fdafc0680b0 msgr2=0x7fdafc0692b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:49.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.483+0000 7fdb0179d700 1 -- 172.21.15.81:0/3524759692 shutdown_connections 2023-10-06T03:24:49.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.484+0000 7fdb0179d700 1 -- 172.21.15.81:0/3524759692 wait complete. 2023-10-06T03:24:49.503 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T03:24:49.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.680+0000 7f7d543ff700 1 Processor -- start 2023-10-06T03:24:49.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.680+0000 7f7d543ff700 1 -- start start 2023-10-06T03:24:49.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.682+0000 7f7d543ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7d4c13fd90 0x7f7d4c159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:49.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.682+0000 7f7d543ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7d4c15a3f0 0x7f7d4c0c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:49.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.682+0000 7f7d543ff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d4c0cad30 con 0x7f7d4c13f9c0 2023-10-06T03:24:49.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.682+0000 7f7d543ff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d4c15a870 con 0x7f7d4c15a3f0 2023-10-06T03:24:49.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.682+0000 7f7d543ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c0cafe0 con 0x7f7d4c13fd90 2023-10-06T03:24:49.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.682+0000 7f7d5219b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7d4c13f9c0 0x7f7d4c0ca620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41354/0 (socket says 172.21.15.81:41354) 2023-10-06T03:24:49.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.682+0000 7f7d5219b700 1 -- 172.21.15.81:0/887644999 learned_addr learned my addr 172.21.15.81:0/887644999 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:24:49.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.682+0000 7f7d5199a700 1 --2- 172.21.15.81:0/887644999 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7d4c13fd90 0x7f7d4c159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:49.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.682+0000 7f7d5299c700 1 --2- 172.21.15.81:0/887644999 >> v2:172.21.15.83:3300/0 conn(0x7f7d4c15a3f0 0x7f7d4c0c6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:49.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.682+0000 7f7d51199700 1 -- 172.21.15.81:0/887644999 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2838184294 0 0) 0x7f7d4c0cad30 con 0x7f7d4c13f9c0 2023-10-06T03:24:49.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.682+0000 7f7d51199700 1 -- 172.21.15.81:0/887644999 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d38003570 con 0x7f7d4c13f9c0 2023-10-06T03:24:49.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.683+0000 7f7d51199700 1 -- 172.21.15.81:0/887644999 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3378824284 0 0) 0x7f7d38003570 con 0x7f7d4c13f9c0 2023-10-06T03:24:49.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.683+0000 7f7d5299c700 1 -- 172.21.15.81:0/887644999 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7d4c13fd90 msgr2=0x7f7d4c159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:49.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.683+0000 7f7d5299c700 1 --2- 172.21.15.81:0/887644999 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7d4c13fd90 0x7f7d4c159eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:49.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.683+0000 7f7d5299c700 1 -- 172.21.15.81:0/887644999 >> v1:172.21.15.81:6789/0 conn(0x7f7d4c13f9c0 legacy=0x7f7d4c0ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:49.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.683+0000 7f7d5299c700 1 -- 172.21.15.81:0/887644999 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4c0cb2c0 con 0x7f7d4c15a3f0 2023-10-06T03:24:49.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.683+0000 7f7d5299c700 1 --2- 172.21.15.81:0/887644999 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d4c15a3f0 0x7f7d4c0c6ab0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7d44009e60 tx=0x7f7d44009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b322b6728b6f07 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:49.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.683+0000 7f7d51199700 1 -- 172.21.15.81:0/887644999 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4400e070 con 0x7f7d4c15a3f0 2023-10-06T03:24:49.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.683+0000 7f7d51199700 1 -- 172.21.15.81:0/887644999 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4400b7a0 con 0x7f7d4c15a3f0 2023-10-06T03:24:49.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.683+0000 7f7d51199700 1 -- 172.21.15.81:0/887644999 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d48001470 con 0x7f7d4c15a3f0 2023-10-06T03:24:49.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.684+0000 7f7d543ff700 1 -- 172.21.15.81:0/887644999 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d4c15a3f0 msgr2=0x7f7d4c0c6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:49.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.684+0000 7f7d543ff700 1 --2- 172.21.15.81:0/887644999 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d4c15a3f0 0x7f7d4c0c6ab0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7d44009e60 tx=0x7f7d44009780 comp rx=0 tx=0).stop 2023-10-06T03:24:49.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.684+0000 7f7d543ff700 1 -- 172.21.15.81:0/887644999 shutdown_connections 2023-10-06T03:24:49.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.684+0000 7f7d543ff700 1 --2- 172.21.15.81:0/887644999 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d4c15a3f0 0x7f7d4c0c6ab0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:49.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.684+0000 7f7d543ff700 1 --2- 172.21.15.81:0/887644999 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7d4c13fd90 0x7f7d4c159eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:49.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.684+0000 7f7d543ff700 1 -- 172.21.15.81:0/887644999 >> 172.21.15.81:0/887644999 conn(0x7f7d4c0cc090 msgr2=0x7f7d4c0cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:49.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.684+0000 7f7d543ff700 1 -- 172.21.15.81:0/887644999 shutdown_connections 2023-10-06T03:24:49.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.684+0000 7f7d543ff700 1 -- 172.21.15.81:0/887644999 wait complete. 2023-10-06T03:24:49.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.685+0000 7f7d543ff700 1 Processor -- start 2023-10-06T03:24:49.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.686+0000 7f7d543ff700 1 -- start start 2023-10-06T03:24:49.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.686+0000 7f7d543ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d4c13f9c0 0x7f7d4c16a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:49.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.686+0000 7f7d543ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7d4c13fd90 0x7f7d4c156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:49.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.687+0000 7f7d543ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d4c15a3f0 0x7f7d4c13d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:49.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.687+0000 7f7d543ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c0b0150 con 0x7f7d4c13f9c0 2023-10-06T03:24:49.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.687+0000 7f7d543ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c0afe00 con 0x7f7d4c15a3f0 2023-10-06T03:24:49.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.687+0000 7f7d543ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c154850 con 0x7f7d4c13fd90 2023-10-06T03:24:49.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.687+0000 7f7d5219b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d4c13f9c0 0x7f7d4c16a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:49.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.687+0000 7f7d5219b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d4c13f9c0 0x7f7d4c16a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49984/0 (socket says 172.21.15.81:49984) 2023-10-06T03:24:49.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.687+0000 7f7d5219b700 1 -- 172.21.15.81:0/3572891058 learned_addr learned my addr 172.21.15.81:0/3572891058 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:49.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.687+0000 7f7d5199a700 1 --2- 172.21.15.81:0/3572891058 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7d4c13fd90 0x7f7d4c156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:49.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.687+0000 7f7d5299c700 1 --2- 172.21.15.81:0/3572891058 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d4c15a3f0 0x7f7d4c13d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:49.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.687+0000 7f7d5219b700 1 -- 172.21.15.81:0/3572891058 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7d4c13fd90 msgr2=0x7f7d4c156fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:49.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.687+0000 7f7d5219b700 1 --2- 172.21.15.81:0/3572891058 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7d4c13fd90 0x7f7d4c156fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:49.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.687+0000 7f7d5219b700 1 -- 172.21.15.81:0/3572891058 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d4c15a3f0 msgr2=0x7f7d4c13d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:49.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.687+0000 7f7d5219b700 1 --2- 172.21.15.81:0/3572891058 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d4c15a3f0 0x7f7d4c13d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:49.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.687+0000 7f7d5219b700 1 -- 172.21.15.81:0/3572891058 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d44009a20 con 0x7f7d4c13f9c0 2023-10-06T03:24:49.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.687+0000 7f7d5199a700 1 --2- 172.21.15.81:0/3572891058 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7d4c13fd90 0x7f7d4c156fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:49.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.687+0000 7f7d5299c700 1 --2- 172.21.15.81:0/3572891058 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d4c15a3f0 0x7f7d4c13d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:49.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.687+0000 7f7d5219b700 1 --2- 172.21.15.81:0/3572891058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d4c13f9c0 0x7f7d4c16a190 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7d4800cbf0 tx=0x7f7d48001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:49.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.688+0000 7f7d427fc700 1 -- 172.21.15.81:0/3572891058 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d48007360 con 0x7f7d4c13f9c0 2023-10-06T03:24:49.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.688+0000 7f7d427fc700 1 -- 172.21.15.81:0/3572891058 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d480074e0 con 0x7f7d4c13f9c0 2023-10-06T03:24:49.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.688+0000 7f7d543ff700 1 -- 172.21.15.81:0/3572891058 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d4c154ff0 con 0x7f7d4c13f9c0 2023-10-06T03:24:49.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.688+0000 7f7d427fc700 1 -- 172.21.15.81:0/3572891058 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d48004830 con 0x7f7d4c13f9c0 2023-10-06T03:24:49.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.688+0000 7f7d543ff700 1 -- 172.21.15.81:0/3572891058 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d4c1555b0 con 0x7f7d4c13f9c0 2023-10-06T03:24:49.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.689+0000 7f7d543ff700 1 -- 172.21.15.81:0/3572891058 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d4c04c3c0 con 0x7f7d4c13f9c0 2023-10-06T03:24:49.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.689+0000 7f7d427fc700 1 -- 172.21.15.81:0/3572891058 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7d48004bc0 con 0x7f7d4c13f9c0 2023-10-06T03:24:49.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.690+0000 7f7d427fc700 1 --2- 172.21.15.81:0/3572891058 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7d30066f30 0x7f7d300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:49.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.690+0000 7f7d427fc700 1 -- 172.21.15.81:0/3572891058 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f7d48083e50 con 0x7f7d4c13f9c0 2023-10-06T03:24:49.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.691+0000 7f7d5199a700 1 --2- 172.21.15.81:0/3572891058 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7d30066f30 0x7f7d300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:49.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.691+0000 7f7d5199a700 1 --2- 172.21.15.81:0/3572891058 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7d30066f30 0x7f7d300693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c006f00 tx=0x7f7d3c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:49.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.694+0000 7f7d427fc700 1 -- 172.21.15.81:0/3572891058 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7d48051150 con 0x7f7d4c13f9c0 2023-10-06T03:24:49.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.889+0000 7f7d543ff700 1 -- 172.21.15.81:0/3572891058 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7d4c0cb5a0 con 0x7f7d4c13f9c0 2023-10-06T03:24:49.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.890+0000 7f7d427fc700 1 -- 172.21.15.81:0/3572891058 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v34) v1 ==== 84+0+126 (secure 0 0 0) 0x7f7d48018020 con 0x7f7d4c13f9c0 2023-10-06T03:24:49.892 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:24:49.892 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2023-10-06T03:24:49.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T03:24:49.892 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2023-10-06T03:24:49.892 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": "rbd" 2023-10-06T03:24:49.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-06T03:24:49.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-06T03:24:49.893 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 2, 2023-10-06T03:24:49.893 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2023-10-06T03:24:49.893 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-06T03:24:49.893 INFO:teuthology.orchestra.run.smithi081.stdout:] 2023-10-06T03:24:49.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.892+0000 7f7d543ff700 1 -- 172.21.15.81:0/3572891058 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7d30066f30 msgr2=0x7f7d300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:49.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.892+0000 7f7d543ff700 1 --2- 172.21.15.81:0/3572891058 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7d30066f30 0x7f7d300693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c006f00 tx=0x7f7d3c008040 comp rx=0 tx=0).stop 2023-10-06T03:24:49.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.892+0000 7f7d543ff700 1 -- 172.21.15.81:0/3572891058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d4c13f9c0 msgr2=0x7f7d4c16a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:49.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.892+0000 7f7d543ff700 1 --2- 172.21.15.81:0/3572891058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d4c13f9c0 0x7f7d4c16a190 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7d4800cbf0 tx=0x7f7d48001b50 comp rx=0 tx=0).stop 2023-10-06T03:24:49.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.892+0000 7f7d543ff700 1 -- 172.21.15.81:0/3572891058 shutdown_connections 2023-10-06T03:24:49.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.892+0000 7f7d543ff700 1 --2- 172.21.15.81:0/3572891058 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d4c15a3f0 0x7f7d4c13d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:49.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.892+0000 7f7d543ff700 1 --2- 172.21.15.81:0/3572891058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d4c13f9c0 0x7f7d4c16a190 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:49.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.892+0000 7f7d543ff700 1 --2- 172.21.15.81:0/3572891058 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7d30066f30 0x7f7d300693e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:49.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.892+0000 7f7d543ff700 1 --2- 172.21.15.81:0/3572891058 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7d4c13fd90 0x7f7d4c156fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:49.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.892+0000 7f7d543ff700 1 -- 172.21.15.81:0/3572891058 >> 172.21.15.81:0/3572891058 conn(0x7f7d4c0cc090 msgr2=0x7f7d4c069ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:49.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.892+0000 7f7d543ff700 1 -- 172.21.15.81:0/3572891058 shutdown_connections 2023-10-06T03:24:49.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:49.892+0000 7f7d543ff700 1 -- 172.21.15.81:0/3572891058 wait complete. 2023-10-06T03:24:49.911 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T03:24:49.911 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T03:24:50.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.095+0000 7fee767ff700 1 Processor -- start 2023-10-06T03:24:50.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.095+0000 7fee767ff700 1 -- start start 2023-10-06T03:24:50.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.096+0000 7fee767ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fee700c77b0 0x7fee7006da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:50.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.096+0000 7fee767ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fee70155b90 0x7fee700c2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:50.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.096+0000 7fee767ff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee7006ed50 con 0x7fee701557c0 2023-10-06T03:24:50.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.096+0000 7fee767ff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee700c6d10 con 0x7fee700c77b0 2023-10-06T03:24:50.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.096+0000 7fee767ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee7006e140 con 0x7fee70155b90 2023-10-06T03:24:50.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.097+0000 7fee6ffff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fee701557c0 0x7fee700c70a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41958/0 (socket says 172.21.15.81:41958) 2023-10-06T03:24:50.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.097+0000 7fee6ffff700 1 -- 172.21.15.81:0/1111406345 learned_addr learned my addr 172.21.15.81:0/1111406345 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:24:50.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.097+0000 7fee6effd700 1 -- 172.21.15.81:0/1111406345 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 743344600 0 0) 0x7fee7006ed50 con 0x7fee701557c0 2023-10-06T03:24:50.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.097+0000 7fee6effd700 1 -- 172.21.15.81:0/1111406345 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee58003570 con 0x7fee701557c0 2023-10-06T03:24:50.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.097+0000 7fee6f7fe700 1 --2- 172.21.15.81:0/1111406345 >> v2:172.21.15.83:3300/0 conn(0x7fee700c77b0 0x7fee7006da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:50.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.097+0000 7fee74d9c700 1 --2- 172.21.15.81:0/1111406345 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fee70155b90 0x7fee700c2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:50.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.097+0000 7fee6effd700 1 -- 172.21.15.81:0/1111406345 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1546875756 0 0) 0x7fee58003570 con 0x7fee701557c0 2023-10-06T03:24:50.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.097+0000 7fee6effd700 1 -- 172.21.15.81:0/1111406345 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fee70155b90 msgr2=0x7fee700c2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:50.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.097+0000 7fee6effd700 1 --2- 172.21.15.81:0/1111406345 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fee70155b90 0x7fee700c2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:50.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.097+0000 7fee6effd700 1 -- 172.21.15.81:0/1111406345 >> v2:172.21.15.83:3300/0 conn(0x7fee700c77b0 msgr2=0x7fee7006da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:50.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.097+0000 7fee6effd700 1 --2- 172.21.15.81:0/1111406345 >> v2:172.21.15.83:3300/0 conn(0x7fee700c77b0 0x7fee7006da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:50.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.097+0000 7fee6effd700 1 -- 172.21.15.81:0/1111406345 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee7006e420 con 0x7fee701557c0 2023-10-06T03:24:50.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.098+0000 7fee6effd700 1 -- 172.21.15.81:0/1111406345 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2513016936 0 0) 0x7fee60001470 con 0x7fee701557c0 2023-10-06T03:24:50.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.098+0000 7fee6effd700 1 -- 172.21.15.81:0/1111406345 >> v1:172.21.15.81:6789/0 conn(0x7fee701557c0 legacy=0x7fee700c70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:50.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.098+0000 7fee6effd700 1 --2- 172.21.15.81:0/1111406345 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fee58003a60 0x7fee58003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:50.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.098+0000 7fee6effd700 1 --2- 172.21.15.81:0/1111406345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee58004810 0x7fee58004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:50.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.098+0000 7fee6effd700 1 --2- 172.21.15.81:0/1111406345 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fee70155b90 0x7fee580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:50.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.098+0000 7fee6effd700 1 -- 172.21.15.81:0/1111406345 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee700c6d10 con 0x7fee58004810 2023-10-06T03:24:50.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.098+0000 7fee6effd700 1 -- 172.21.15.81:0/1111406345 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7006e140 con 0x7fee58003a60 2023-10-06T03:24:50.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.098+0000 7fee6effd700 1 -- 172.21.15.81:0/1111406345 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee5800ba60 con 0x7fee70155b90 2023-10-06T03:24:50.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.098+0000 7fee6f7fe700 1 --2- 172.21.15.81:0/1111406345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee58004810 0x7fee58004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:50.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.098+0000 7fee6ffff700 1 --2- 172.21.15.81:0/1111406345 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fee58003a60 0x7fee58003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:50.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.098+0000 7fee74d9c700 1 --2- 172.21.15.81:0/1111406345 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fee70155b90 0x7fee580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:50.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.098+0000 7fee6f7fe700 1 -- 172.21.15.81:0/1111406345 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fee70155b90 msgr2=0x7fee580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:50.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.098+0000 7fee6f7fe700 1 --2- 172.21.15.81:0/1111406345 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fee70155b90 0x7fee580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:50.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.098+0000 7fee6f7fe700 1 -- 172.21.15.81:0/1111406345 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fee58003a60 msgr2=0x7fee58003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:50.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.098+0000 7fee6f7fe700 1 --2- 172.21.15.81:0/1111406345 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fee58003a60 0x7fee58003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:50.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.098+0000 7fee6f7fe700 1 -- 172.21.15.81:0/1111406345 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee58003570 con 0x7fee58004810 2023-10-06T03:24:50.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.099+0000 7fee6f7fe700 1 --2- 172.21.15.81:0/1111406345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee58004810 0x7fee58004c80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fee64009c30 tx=0x7fee640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b5fda2d165ac7cc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:50.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.099+0000 7fee6effd700 1 -- 172.21.15.81:0/1111406345 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6400e710 con 0x7fee58004810 2023-10-06T03:24:50.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.099+0000 7fee6effd700 1 -- 172.21.15.81:0/1111406345 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee6400e870 con 0x7fee58004810 2023-10-06T03:24:50.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.099+0000 7fee6effd700 1 -- 172.21.15.81:0/1111406345 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6400ec30 con 0x7fee58004810 2023-10-06T03:24:50.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.099+0000 7fee767ff700 1 -- 172.21.15.81:0/1111406345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee58004810 msgr2=0x7fee58004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:50.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.099+0000 7fee767ff700 1 --2- 172.21.15.81:0/1111406345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee58004810 0x7fee58004c80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fee64009c30 tx=0x7fee640091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:50.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.099+0000 7fee74d9c700 1 -- 172.21.15.81:0/1111406345 reap_dead start 2023-10-06T03:24:50.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.099+0000 7fee767ff700 1 -- 172.21.15.81:0/1111406345 shutdown_connections 2023-10-06T03:24:50.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.099+0000 7fee767ff700 1 -- 172.21.15.81:0/1111406345 >> 172.21.15.81:0/1111406345 conn(0x7fee700cc050 msgr2=0x7fee700cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:50.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.099+0000 7fee767ff700 1 -- 172.21.15.81:0/1111406345 shutdown_connections 2023-10-06T03:24:50.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.099+0000 7fee767ff700 1 -- 172.21.15.81:0/1111406345 wait complete. 2023-10-06T03:24:50.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.101+0000 7fee767ff700 1 Processor -- start 2023-10-06T03:24:50.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.101+0000 7fee767ff700 1 -- start start 2023-10-06T03:24:50.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.102+0000 7fee767ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fee58004810 0x7fee700b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:50.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.102+0000 7fee767ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee70150cd0 0x7fee701510d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:50.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.102+0000 7fee767ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fee700b1510 0x7fee70151610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:50.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.102+0000 7fee767ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee700b0b40 con 0x7fee70150cd0 2023-10-06T03:24:50.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.102+0000 7fee767ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee700a98e0 con 0x7fee58004810 2023-10-06T03:24:50.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.102+0000 7fee767ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee700a9b50 con 0x7fee700b1510 2023-10-06T03:24:50.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.102+0000 7fee6f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee70150cd0 0x7fee701510d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:50.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.102+0000 7fee6f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee70150cd0 0x7fee701510d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42100/0 (socket says 172.21.15.81:42100) 2023-10-06T03:24:50.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.102+0000 7fee6f7fe700 1 -- 172.21.15.81:0/1756074515 learned_addr learned my addr 172.21.15.81:0/1756074515 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:50.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.102+0000 7fee74d9c700 1 --2- 172.21.15.81:0/1756074515 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fee700b1510 0x7fee70151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:50.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.102+0000 7fee6ffff700 1 --2- 172.21.15.81:0/1756074515 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fee58004810 0x7fee700b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:50.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.103+0000 7fee6f7fe700 1 -- 172.21.15.81:0/1756074515 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fee700b1510 msgr2=0x7fee70151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:50.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.103+0000 7fee6f7fe700 1 --2- 172.21.15.81:0/1756074515 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fee700b1510 0x7fee70151610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:50.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.103+0000 7fee6f7fe700 1 -- 172.21.15.81:0/1756074515 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fee58004810 msgr2=0x7fee700b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:50.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.103+0000 7fee6f7fe700 1 --2- 172.21.15.81:0/1756074515 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fee58004810 0x7fee700b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:50.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.103+0000 7fee6f7fe700 1 -- 172.21.15.81:0/1756074515 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee700a9e30 con 0x7fee70150cd0 2023-10-06T03:24:50.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.103+0000 7fee74d9c700 1 --2- 172.21.15.81:0/1756074515 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fee700b1510 0x7fee70151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:50.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.103+0000 7fee6f7fe700 1 --2- 172.21.15.81:0/1756074515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee70150cd0 0x7fee701510d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fee6400e4b0 tx=0x7fee6401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:50.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.103+0000 7fee57fff700 1 -- 172.21.15.81:0/1756074515 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee64022070 con 0x7fee70150cd0 2023-10-06T03:24:50.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.103+0000 7fee57fff700 1 -- 172.21.15.81:0/1756074515 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee6400e9e0 con 0x7fee70150cd0 2023-10-06T03:24:50.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.103+0000 7fee767ff700 1 -- 172.21.15.81:0/1756074515 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee700b0780 con 0x7fee70150cd0 2023-10-06T03:24:50.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.103+0000 7fee57fff700 1 -- 172.21.15.81:0/1756074515 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6401c450 con 0x7fee70150cd0 2023-10-06T03:24:50.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.103+0000 7fee767ff700 1 -- 172.21.15.81:0/1756074515 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee700c56d0 con 0x7fee70150cd0 2023-10-06T03:24:50.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.104+0000 7fee767ff700 1 -- 172.21.15.81:0/1756074515 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee700b0cf0 con 0x7fee70150cd0 2023-10-06T03:24:50.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.105+0000 7fee57fff700 1 -- 172.21.15.81:0/1756074515 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fee6401c800 con 0x7fee70150cd0 2023-10-06T03:24:50.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.106+0000 7fee57fff700 1 --2- 172.21.15.81:0/1756074515 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fee5c066f30 0x7fee5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:50.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.107+0000 7fee57fff700 1 -- 172.21.15.81:0/1756074515 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fee64085d60 con 0x7fee70150cd0 2023-10-06T03:24:50.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.107+0000 7fee6ffff700 1 --2- 172.21.15.81:0/1756074515 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fee5c066f30 0x7fee5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:50.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.107+0000 7fee6ffff700 1 --2- 172.21.15.81:0/1756074515 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fee5c066f30 0x7fee5c0693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fee700aaf50 tx=0x7fee7006ecc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:50.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.111+0000 7fee57fff700 1 -- 172.21.15.81:0/1756074515 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fee700b0cf0 con 0x7fee70150cd0 2023-10-06T03:24:50.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.301+0000 7fee767ff700 1 -- 172.21.15.81:0/1756074515 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fee700b0cf0 con 0x7fee70150cd0 2023-10-06T03:24:50.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.865+0000 7fee57fff700 1 -- 172.21.15.81:0/1756074515 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v35) v1 ==== 138+0+0 (secure 0 0 0) 0x7fee700b0cf0 con 0x7fee70150cd0 2023-10-06T03:24:50.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.868+0000 7fee767ff700 1 -- 172.21.15.81:0/1756074515 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fee5c066f30 msgr2=0x7fee5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:50.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.868+0000 7fee767ff700 1 --2- 172.21.15.81:0/1756074515 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fee5c066f30 0x7fee5c0693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fee700aaf50 tx=0x7fee7006ecc0 comp rx=0 tx=0).stop 2023-10-06T03:24:50.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.868+0000 7fee767ff700 1 -- 172.21.15.81:0/1756074515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee70150cd0 msgr2=0x7fee701510d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:50.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.868+0000 7fee767ff700 1 --2- 172.21.15.81:0/1756074515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee70150cd0 0x7fee701510d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fee6400e4b0 tx=0x7fee6401a000 comp rx=0 tx=0).stop 2023-10-06T03:24:50.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.868+0000 7fee767ff700 1 -- 172.21.15.81:0/1756074515 shutdown_connections 2023-10-06T03:24:50.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.868+0000 7fee767ff700 1 --2- 172.21.15.81:0/1756074515 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fee5c066f30 0x7fee5c0693e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:50.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.868+0000 7fee767ff700 1 --2- 172.21.15.81:0/1756074515 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fee700b1510 0x7fee70151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:50.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.868+0000 7fee767ff700 1 --2- 172.21.15.81:0/1756074515 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fee58004810 0x7fee700b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:50.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.868+0000 7fee767ff700 1 --2- 172.21.15.81:0/1756074515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee70150cd0 0x7fee701510d0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:50.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.868+0000 7fee767ff700 1 -- 172.21.15.81:0/1756074515 >> 172.21.15.81:0/1756074515 conn(0x7fee700cc050 msgr2=0x7fee7006b160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:50.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.869+0000 7fee767ff700 1 -- 172.21.15.81:0/1756074515 shutdown_connections 2023-10-06T03:24:50.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:50.869+0000 7fee767ff700 1 -- 172.21.15.81:0/1756074515 wait complete. 2023-10-06T03:24:50.872 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2023-10-06T03:24:50.896 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T03:24:51.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.089+0000 7fea3bdff700 1 Processor -- start 2023-10-06T03:24:51.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.089+0000 7fea3bdff700 1 -- start start 2023-10-06T03:24:51.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.091+0000 7fea3bdff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fea340ca640 0x7fea3415a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:51.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.091+0000 7fea3bdff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea340cb580 con 0x7fea3415ad10 2023-10-06T03:24:51.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.091+0000 7fea3bdff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea340c6800 con 0x7fea3413fd70 2023-10-06T03:24:51.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.091+0000 7fea3bdff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea340caac0 con 0x7fea340ca640 2023-10-06T03:24:51.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.091+0000 7fea3a39c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fea3415ad10 0x7fea340c6c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41964/0 (socket says 172.21.15.81:41964) 2023-10-06T03:24:51.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.091+0000 7fea3a39c700 1 -- 172.21.15.81:0/3214665486 learned_addr learned my addr 172.21.15.81:0/3214665486 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:24:51.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.091+0000 7fea3939a700 1 --2- 172.21.15.81:0/3214665486 >> v2:172.21.15.83:3300/0 conn(0x7fea340ca640 0x7fea3415a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:51.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.091+0000 7fea38b99700 1 -- 172.21.15.81:0/3214665486 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3479574024 0 0) 0x7fea340cb580 con 0x7fea3415ad10 2023-10-06T03:24:51.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.092+0000 7fea38b99700 1 -- 172.21.15.81:0/3214665486 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea20003570 con 0x7fea3415ad10 2023-10-06T03:24:51.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.092+0000 7fea3939a700 1 -- 172.21.15.81:0/3214665486 >> v1:172.21.15.83:6789/0 conn(0x7fea3413fd70 legacy=0x7fea3415a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:51.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.092+0000 7fea3939a700 1 -- 172.21.15.81:0/3214665486 >> v1:172.21.15.81:6789/0 conn(0x7fea3415ad10 legacy=0x7fea340c6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:51.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.092+0000 7fea3939a700 1 -- 172.21.15.81:0/3214665486 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea34069880 con 0x7fea340ca640 2023-10-06T03:24:51.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.092+0000 7fea3939a700 1 --2- 172.21.15.81:0/3214665486 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea340ca640 0x7fea3415a7d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fea240098e0 tx=0x7fea240091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d8a0a0ecd0e4df1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:51.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.092+0000 7fea38b99700 1 -- 172.21.15.81:0/3214665486 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2400b640 con 0x7fea340ca640 2023-10-06T03:24:51.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.092+0000 7fea38b99700 1 -- 172.21.15.81:0/3214665486 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea2400b7a0 con 0x7fea340ca640 2023-10-06T03:24:51.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.092+0000 7fea38b99700 1 -- 172.21.15.81:0/3214665486 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2400bb40 con 0x7fea340ca640 2023-10-06T03:24:51.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.093+0000 7fea3bdff700 1 -- 172.21.15.81:0/3214665486 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea340ca640 msgr2=0x7fea3415a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:51.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.093+0000 7fea3bdff700 1 --2- 172.21.15.81:0/3214665486 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea340ca640 0x7fea3415a7d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fea240098e0 tx=0x7fea240091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:51.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.093+0000 7fea3bdff700 1 -- 172.21.15.81:0/3214665486 shutdown_connections 2023-10-06T03:24:51.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.093+0000 7fea3bdff700 1 --2- 172.21.15.81:0/3214665486 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea340ca640 0x7fea3415a7d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:51.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.093+0000 7fea3bdff700 1 -- 172.21.15.81:0/3214665486 >> 172.21.15.81:0/3214665486 conn(0x7fea340cc090 msgr2=0x7fea340cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:51.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.093+0000 7fea3bdff700 1 -- 172.21.15.81:0/3214665486 shutdown_connections 2023-10-06T03:24:51.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.093+0000 7fea3bdff700 1 -- 172.21.15.81:0/3214665486 wait complete. 2023-10-06T03:24:51.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.094+0000 7fea3bdff700 1 Processor -- start 2023-10-06T03:24:51.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.094+0000 7fea3bdff700 1 -- start start 2023-10-06T03:24:51.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.095+0000 7fea3bdff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea340ca640 0x7fea3413ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:51.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.095+0000 7fea3bdff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea3413fd70 0x7fea34155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:51.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.095+0000 7fea3bdff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea3415ad10 0x7fea340c4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:51.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.095+0000 7fea3bdff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea3413dc80 con 0x7fea3415ad10 2023-10-06T03:24:51.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.095+0000 7fea3bdff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea34156020 con 0x7fea340ca640 2023-10-06T03:24:51.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.095+0000 7fea3bdff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea3413d070 con 0x7fea3413fd70 2023-10-06T03:24:51.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.096+0000 7fea3a39c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea3415ad10 0x7fea340c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:51.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.096+0000 7fea3a39c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea3415ad10 0x7fea340c4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42108/0 (socket says 172.21.15.81:42108) 2023-10-06T03:24:51.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.096+0000 7fea3a39c700 1 -- 172.21.15.81:0/1545777125 learned_addr learned my addr 172.21.15.81:0/1545777125 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:51.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.096+0000 7fea3a39c700 1 -- 172.21.15.81:0/1545777125 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea3413fd70 msgr2=0x7fea34155ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:51.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.096+0000 7fea3a39c700 1 --2- 172.21.15.81:0/1545777125 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea3413fd70 0x7fea34155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:51.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.096+0000 7fea39b9b700 1 --2- 172.21.15.81:0/1545777125 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea340ca640 0x7fea3413ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:51.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.096+0000 7fea3a39c700 1 -- 172.21.15.81:0/1545777125 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea340ca640 msgr2=0x7fea3413ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:51.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.096+0000 7fea3a39c700 1 --2- 172.21.15.81:0/1545777125 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea340ca640 0x7fea3413ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:51.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.096+0000 7fea3a39c700 1 -- 172.21.15.81:0/1545777125 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea24009420 con 0x7fea3415ad10 2023-10-06T03:24:51.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.096+0000 7fea39b9b700 1 --2- 172.21.15.81:0/1545777125 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea340ca640 0x7fea3413ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:51.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.096+0000 7fea3a39c700 1 --2- 172.21.15.81:0/1545777125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea3415ad10 0x7fea340c4590 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fea2c001460 tx=0x7fea2c0019e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:51.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.096+0000 7fea29ffb700 1 -- 172.21.15.81:0/1545777125 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2c00a930 con 0x7fea3415ad10 2023-10-06T03:24:51.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.096+0000 7fea29ffb700 1 -- 172.21.15.81:0/1545777125 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea2c00aa90 con 0x7fea3415ad10 2023-10-06T03:24:51.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.096+0000 7fea29ffb700 1 -- 172.21.15.81:0/1545777125 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2c00ae10 con 0x7fea3415ad10 2023-10-06T03:24:51.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.096+0000 7fea3bdff700 1 -- 172.21.15.81:0/1545777125 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea3413d350 con 0x7fea3415ad10 2023-10-06T03:24:51.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.097+0000 7fea3bdff700 1 -- 172.21.15.81:0/1545777125 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea3413d910 con 0x7fea3415ad10 2023-10-06T03:24:51.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.097+0000 7fea3bdff700 1 -- 172.21.15.81:0/1545777125 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea3413ddf0 con 0x7fea3415ad10 2023-10-06T03:24:51.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.099+0000 7fea29ffb700 1 -- 172.21.15.81:0/1545777125 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fea2c007300 con 0x7fea3415ad10 2023-10-06T03:24:51.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.099+0000 7fea29ffb700 1 --2- 172.21.15.81:0/1545777125 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fea18066f30 0x7fea180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:51.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.100+0000 7fea29ffb700 1 -- 172.21.15.81:0/1545777125 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5896+0+0 (secure 0 0 0) 0x7fea2c084a10 con 0x7fea3415ad10 2023-10-06T03:24:51.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.100+0000 7fea39b9b700 1 --2- 172.21.15.81:0/1545777125 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fea18066f30 0x7fea180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:51.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.100+0000 7fea39b9b700 1 --2- 172.21.15.81:0/1545777125 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fea18066f30 0x7fea180693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fea30001870 tx=0x7fea30009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:51.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.105+0000 7fea29ffb700 1 -- 172.21.15.81:0/1545777125 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fea2c051ba0 con 0x7fea3415ad10 2023-10-06T03:24:51.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.295+0000 7fea3bdff700 1 -- 172.21.15.81:0/1545777125 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fea3404c3c0 con 0x7fea3415ad10 2023-10-06T03:24:51.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.871+0000 7fea29ffb700 1 -- 172.21.15.81:0/1545777125 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v36) v1 ==== 170+0+0 (secure 0 0 0) 0x7fea2c0551c0 con 0x7fea3415ad10 2023-10-06T03:24:51.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.877+0000 7fea3bdff700 1 -- 172.21.15.81:0/1545777125 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fea18066f30 msgr2=0x7fea180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:51.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.877+0000 7fea3bdff700 1 --2- 172.21.15.81:0/1545777125 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fea18066f30 0x7fea180693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fea30001870 tx=0x7fea30009040 comp rx=0 tx=0).stop 2023-10-06T03:24:51.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.877+0000 7fea3bdff700 1 -- 172.21.15.81:0/1545777125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea3415ad10 msgr2=0x7fea340c4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:51.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.877+0000 7fea3bdff700 1 --2- 172.21.15.81:0/1545777125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea3415ad10 0x7fea340c4590 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fea2c001460 tx=0x7fea2c0019e0 comp rx=0 tx=0).stop 2023-10-06T03:24:51.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.878+0000 7fea3bdff700 1 -- 172.21.15.81:0/1545777125 shutdown_connections 2023-10-06T03:24:51.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.878+0000 7fea3bdff700 1 --2- 172.21.15.81:0/1545777125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea3415ad10 0x7fea340c4590 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:51.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.878+0000 7fea3bdff700 1 --2- 172.21.15.81:0/1545777125 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea340ca640 0x7fea3413ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:51.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.878+0000 7fea3bdff700 1 --2- 172.21.15.81:0/1545777125 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fea18066f30 0x7fea180693e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:51.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.878+0000 7fea3bdff700 1 --2- 172.21.15.81:0/1545777125 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea3413fd70 0x7fea34155ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:51.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.878+0000 7fea3bdff700 1 -- 172.21.15.81:0/1545777125 >> 172.21.15.81:0/1545777125 conn(0x7fea340cc090 msgr2=0x7fea3413b590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:51.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.879+0000 7fea3bdff700 1 -- 172.21.15.81:0/1545777125 shutdown_connections 2023-10-06T03:24:51.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:51.879+0000 7fea3bdff700 1 -- 172.21.15.81:0/1545777125 wait complete. 2023-10-06T03:24:51.888 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2023-10-06T03:24:51.911 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T03:24:52.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.092+0000 7f977bfff700 1 Processor -- start 2023-10-06T03:24:52.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.092+0000 7f977bfff700 1 -- start start 2023-10-06T03:24:52.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.093+0000 7f977bfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f977c1535a0 0x7f977c15ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:52.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.093+0000 7f977bfff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f977c157670 0x7f977c0b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:52.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.093+0000 7f977bfff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f977c15bef0 con 0x7f977c15a560 2023-10-06T03:24:52.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.093+0000 7f977bfff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f977c0d1160 con 0x7f977c1535a0 2023-10-06T03:24:52.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.093+0000 7f977bfff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f977c15a9e0 con 0x7f977c157670 2023-10-06T03:24:52.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.094+0000 7f977affd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f977c1535a0 0x7f977c15ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:52.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.094+0000 7f977affd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f977c1535a0 0x7f977c15ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42114/0 (socket says 172.21.15.81:42114) 2023-10-06T03:24:52.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.094+0000 7f977affd700 1 -- 172.21.15.81:0/4127614717 learned_addr learned my addr 172.21.15.81:0/4127614717 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:52.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.094+0000 7f977a7fc700 1 --1- 172.21.15.81:0/4127614717 >> v1:172.21.15.81:6789/0 conn(0x7f977c15a560 0x7f977c153970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41980/0 (socket says 172.21.15.81:41980) 2023-10-06T03:24:52.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.094+0000 7f977b7fe700 1 --2- 172.21.15.81:0/4127614717 >> v2:172.21.15.83:3300/0 conn(0x7f977c157670 0x7f977c0b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:52.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.094+0000 7f9779ffb700 1 -- 172.21.15.81:0/4127614717 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1995032139 0 0) 0x7f977c15bef0 con 0x7f977c15a560 2023-10-06T03:24:52.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.094+0000 7f9779ffb700 1 -- 172.21.15.81:0/4127614717 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9764003570 con 0x7f977c15a560 2023-10-06T03:24:52.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.094+0000 7f977affd700 1 -- 172.21.15.81:0/4127614717 >> v2:172.21.15.83:3300/0 conn(0x7f977c157670 msgr2=0x7f977c0b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:52.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.094+0000 7f977affd700 1 --2- 172.21.15.81:0/4127614717 >> v2:172.21.15.83:3300/0 conn(0x7f977c157670 0x7f977c0b1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:52.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.094+0000 7f977affd700 1 -- 172.21.15.81:0/4127614717 >> v1:172.21.15.81:6789/0 conn(0x7f977c15a560 legacy=0x7f977c153970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:52.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.094+0000 7f977affd700 1 -- 172.21.15.81:0/4127614717 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f977c15b2e0 con 0x7f977c1535a0 2023-10-06T03:24:52.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.094+0000 7f977b7fe700 1 --2- 172.21.15.81:0/4127614717 >> v2:172.21.15.83:3300/0 conn(0x7f977c157670 0x7f977c0b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:52.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.094+0000 7f977affd700 1 --2- 172.21.15.81:0/4127614717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f977c1535a0 0x7f977c15ac00 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f977c0b38d0 tx=0x7f976c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ca8d3ea8d3f9684 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:52.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.095+0000 7f9779ffb700 1 -- 172.21.15.81:0/4127614717 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c009e70 con 0x7f977c1535a0 2023-10-06T03:24:52.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.095+0000 7f9779ffb700 1 -- 172.21.15.81:0/4127614717 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976c00b860 con 0x7f977c1535a0 2023-10-06T03:24:52.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.095+0000 7f9779ffb700 1 -- 172.21.15.81:0/4127614717 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c00bc00 con 0x7f977c1535a0 2023-10-06T03:24:52.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.095+0000 7f977bfff700 1 -- 172.21.15.81:0/4127614717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f977c1535a0 msgr2=0x7f977c15ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:52.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.095+0000 7f977bfff700 1 --2- 172.21.15.81:0/4127614717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f977c1535a0 0x7f977c15ac00 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f977c0b38d0 tx=0x7f976c009250 comp rx=0 tx=0).stop 2023-10-06T03:24:52.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.095+0000 7f977bfff700 1 -- 172.21.15.81:0/4127614717 shutdown_connections 2023-10-06T03:24:52.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.095+0000 7f977bfff700 1 --2- 172.21.15.81:0/4127614717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f977c1535a0 0x7f977c15ac00 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:52.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.095+0000 7f977bfff700 1 --2- 172.21.15.81:0/4127614717 >> v2:172.21.15.83:3300/0 conn(0x7f977c157670 0x7f977c0b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:52.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.095+0000 7f977bfff700 1 -- 172.21.15.81:0/4127614717 >> 172.21.15.81:0/4127614717 conn(0x7f977c068230 msgr2=0x7f977c068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:52.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.095+0000 7f977bfff700 1 -- 172.21.15.81:0/4127614717 shutdown_connections 2023-10-06T03:24:52.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.095+0000 7f977bfff700 1 -- 172.21.15.81:0/4127614717 wait complete. 2023-10-06T03:24:52.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.097+0000 7f977bfff700 1 Processor -- start 2023-10-06T03:24:52.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.097+0000 7f977bfff700 1 -- start start 2023-10-06T03:24:52.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.098+0000 7f977bfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f977c1535a0 0x7f977c16ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:52.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.098+0000 7f977bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f977c157670 0x7f977c16c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:52.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.098+0000 7f977bfff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f977c15a560 0x7f977c0a9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:52.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.098+0000 7f977bfff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977c0a7020 con 0x7f977c157670 2023-10-06T03:24:52.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.098+0000 7f977bfff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977c1540e0 con 0x7f977c1535a0 2023-10-06T03:24:52.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.098+0000 7f977bfff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f977c0a88c0 con 0x7f977c15a560 2023-10-06T03:24:52.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.098+0000 7f977a7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f977c157670 0x7f977c16c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:52.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.098+0000 7f977a7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f977c157670 0x7f977c16c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42120/0 (socket says 172.21.15.81:42120) 2023-10-06T03:24:52.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.098+0000 7f977a7fc700 1 -- 172.21.15.81:0/4013496456 learned_addr learned my addr 172.21.15.81:0/4013496456 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:52.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.098+0000 7f977affd700 1 --2- 172.21.15.81:0/4013496456 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f977c1535a0 0x7f977c16ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:52.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.098+0000 7f977b7fe700 1 --2- 172.21.15.81:0/4013496456 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f977c15a560 0x7f977c0a9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:52.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.098+0000 7f977a7fc700 1 -- 172.21.15.81:0/4013496456 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f977c15a560 msgr2=0x7f977c0a9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:52.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.098+0000 7f977a7fc700 1 --2- 172.21.15.81:0/4013496456 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f977c15a560 0x7f977c0a9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:52.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.098+0000 7f977a7fc700 1 -- 172.21.15.81:0/4013496456 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f977c1535a0 msgr2=0x7f977c16ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:52.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.098+0000 7f977a7fc700 1 --2- 172.21.15.81:0/4013496456 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f977c1535a0 0x7f977c16ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:52.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.098+0000 7f977a7fc700 1 -- 172.21.15.81:0/4013496456 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f976c0094f0 con 0x7f977c157670 2023-10-06T03:24:52.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.098+0000 7f977b7fe700 1 --2- 172.21.15.81:0/4013496456 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f977c15a560 0x7f977c0a9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:52.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.099+0000 7f977a7fc700 1 --2- 172.21.15.81:0/4013496456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f977c157670 0x7f977c16c920 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f977000c590 tx=0x7f9770007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:52.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.099+0000 7f9762ffd700 1 -- 172.21.15.81:0/4013496456 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9770005a70 con 0x7f977c157670 2023-10-06T03:24:52.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.099+0000 7f9762ffd700 1 -- 172.21.15.81:0/4013496456 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9770005bf0 con 0x7f977c157670 2023-10-06T03:24:52.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.099+0000 7f9762ffd700 1 -- 172.21.15.81:0/4013496456 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97700070d0 con 0x7f977c157670 2023-10-06T03:24:52.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.099+0000 7f977bfff700 1 -- 172.21.15.81:0/4013496456 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f977c1542f0 con 0x7f977c157670 2023-10-06T03:24:52.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.099+0000 7f977bfff700 1 -- 172.21.15.81:0/4013496456 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f977c1548b0 con 0x7f977c157670 2023-10-06T03:24:52.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.100+0000 7f977bfff700 1 -- 172.21.15.81:0/4013496456 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f977c153ae0 con 0x7f977c157670 2023-10-06T03:24:52.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.101+0000 7f9762ffd700 1 -- 172.21.15.81:0/4013496456 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f97700074c0 con 0x7f977c157670 2023-10-06T03:24:52.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.102+0000 7f9762ffd700 1 --2- 172.21.15.81:0/4013496456 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f9768066f30 0x7f97680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:52.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.103+0000 7f9762ffd700 1 -- 172.21.15.81:0/4013496456 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6278+0+0 (secure 0 0 0) 0x7f9770083dc0 con 0x7f977c157670 2023-10-06T03:24:52.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.103+0000 7f977affd700 1 --2- 172.21.15.81:0/4013496456 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f9768066f30 0x7f97680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:52.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.103+0000 7f977affd700 1 --2- 172.21.15.81:0/4013496456 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f9768066f30 0x7f97680693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f977c0b38d0 tx=0x7f976c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:52.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.107+0000 7f9762ffd700 1 -- 172.21.15.81:0/4013496456 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9770050d50 con 0x7f977c157670 2023-10-06T03:24:52.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.343+0000 7f977bfff700 1 -- 172.21.15.81:0/4013496456 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f977c04c3c0 con 0x7f977c157670 2023-10-06T03:24:52.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.875+0000 7f9762ffd700 1 -- 172.21.15.81:0/4013496456 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f9770017020 con 0x7f977c157670 2023-10-06T03:24:52.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.892+0000 7f977bfff700 1 -- 172.21.15.81:0/4013496456 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f9768066f30 msgr2=0x7f97680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:52.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.892+0000 7f977bfff700 1 --2- 172.21.15.81:0/4013496456 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f9768066f30 0x7f97680693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f977c0b38d0 tx=0x7f976c017000 comp rx=0 tx=0).stop 2023-10-06T03:24:52.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.892+0000 7f977bfff700 1 -- 172.21.15.81:0/4013496456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f977c157670 msgr2=0x7f977c16c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:52.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.892+0000 7f977bfff700 1 --2- 172.21.15.81:0/4013496456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f977c157670 0x7f977c16c920 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f977000c590 tx=0x7f9770007e00 comp rx=0 tx=0).stop 2023-10-06T03:24:52.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.898+0000 7f977bfff700 1 -- 172.21.15.81:0/4013496456 shutdown_connections 2023-10-06T03:24:52.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.898+0000 7f977bfff700 1 --2- 172.21.15.81:0/4013496456 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f9768066f30 0x7f97680693e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:52.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.898+0000 7f977bfff700 1 --2- 172.21.15.81:0/4013496456 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f977c15a560 0x7f977c0a9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:52.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.898+0000 7f977bfff700 1 --2- 172.21.15.81:0/4013496456 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f977c1535a0 0x7f977c16ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:52.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.898+0000 7f977bfff700 1 --2- 172.21.15.81:0/4013496456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f977c157670 0x7f977c16c920 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:52.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.898+0000 7f977bfff700 1 -- 172.21.15.81:0/4013496456 >> 172.21.15.81:0/4013496456 conn(0x7f977c068230 msgr2=0x7f977c152da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:52.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.899+0000 7f977bfff700 1 -- 172.21.15.81:0/4013496456 shutdown_connections 2023-10-06T03:24:52.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:52.899+0000 7f977bfff700 1 -- 172.21.15.81:0/4013496456 wait complete. 2023-10-06T03:24:52.911 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 6 and data pool 7 2023-10-06T03:24:52.929 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:24:53.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.109+0000 7ffb889ff700 1 Processor -- start 2023-10-06T03:24:53.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.109+0000 7ffb889ff700 1 -- start start 2023-10-06T03:24:53.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.111+0000 7ffb889ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ffb8413fd90 0x7ffb84159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:53.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.111+0000 7ffb889ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb8415a3f0 0x7ffb840c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:53.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.111+0000 7ffb889ff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb840cad30 con 0x7ffb8413f9c0 2023-10-06T03:24:53.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.111+0000 7ffb889ff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb8415a870 con 0x7ffb8413fd90 2023-10-06T03:24:53.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.111+0000 7ffb889ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb840cafe0 con 0x7ffb8415a3f0 2023-10-06T03:24:53.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.111+0000 7ffb82d9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb8415a3f0 0x7ffb840c6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:53.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.111+0000 7ffb81d9b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ffb8413fd90 0x7ffb84159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:53.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.111+0000 7ffb81d9b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ffb8413fd90 0x7ffb84159eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:36796/0 (socket says 172.21.15.81:36796) 2023-10-06T03:24:53.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.111+0000 7ffb81d9b700 1 -- 172.21.15.81:0/3155554276 learned_addr learned my addr 172.21.15.81:0/3155554276 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:53.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.112+0000 7ffb8159a700 1 -- 172.21.15.81:0/3155554276 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 864689990 0 0) 0x7ffb840cad30 con 0x7ffb8413f9c0 2023-10-06T03:24:53.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.112+0000 7ffb8159a700 1 -- 172.21.15.81:0/3155554276 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb6c003570 con 0x7ffb8413f9c0 2023-10-06T03:24:53.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.112+0000 7ffb82d9d700 1 -- 172.21.15.81:0/3155554276 >> v2:172.21.15.83:3300/0 conn(0x7ffb8413fd90 msgr2=0x7ffb84159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:53.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.112+0000 7ffb82d9d700 1 --2- 172.21.15.81:0/3155554276 >> v2:172.21.15.83:3300/0 conn(0x7ffb8413fd90 0x7ffb84159eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:53.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.112+0000 7ffb82d9d700 1 -- 172.21.15.81:0/3155554276 >> v1:172.21.15.83:6789/0 conn(0x7ffb8413f9c0 legacy=0x7ffb840ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:53.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.112+0000 7ffb82d9d700 1 -- 172.21.15.81:0/3155554276 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb840cb2c0 con 0x7ffb8415a3f0 2023-10-06T03:24:53.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.112+0000 7ffb81d9b700 1 --2- 172.21.15.81:0/3155554276 >> v2:172.21.15.83:3300/0 conn(0x7ffb8413fd90 0x7ffb84159eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:24:53.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.112+0000 7ffb82d9d700 1 --2- 172.21.15.81:0/3155554276 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb8415a3f0 0x7ffb840c6ab0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c009e60 tx=0x7ffb7c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da8c488675ad3b0b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:53.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.112+0000 7ffb8159a700 1 -- 172.21.15.81:0/3155554276 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c00e070 con 0x7ffb8415a3f0 2023-10-06T03:24:53.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.112+0000 7ffb8159a700 1 -- 172.21.15.81:0/3155554276 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb7c00bab0 con 0x7ffb8415a3f0 2023-10-06T03:24:53.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.112+0000 7ffb8159a700 1 -- 172.21.15.81:0/3155554276 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c00be70 con 0x7ffb8415a3f0 2023-10-06T03:24:53.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.113+0000 7ffb889ff700 1 -- 172.21.15.81:0/3155554276 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb8415a3f0 msgr2=0x7ffb840c6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:53.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.113+0000 7ffb889ff700 1 --2- 172.21.15.81:0/3155554276 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb8415a3f0 0x7ffb840c6ab0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c009e60 tx=0x7ffb7c009780 comp rx=0 tx=0).stop 2023-10-06T03:24:53.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.113+0000 7ffb889ff700 1 -- 172.21.15.81:0/3155554276 shutdown_connections 2023-10-06T03:24:53.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.113+0000 7ffb889ff700 1 --2- 172.21.15.81:0/3155554276 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb8415a3f0 0x7ffb840c6ab0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:53.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.113+0000 7ffb889ff700 1 --2- 172.21.15.81:0/3155554276 >> v2:172.21.15.83:3300/0 conn(0x7ffb8413fd90 0x7ffb84159eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:53.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.113+0000 7ffb889ff700 1 -- 172.21.15.81:0/3155554276 >> 172.21.15.81:0/3155554276 conn(0x7ffb840cc090 msgr2=0x7ffb840cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:53.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.113+0000 7ffb889ff700 1 -- 172.21.15.81:0/3155554276 shutdown_connections 2023-10-06T03:24:53.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.113+0000 7ffb889ff700 1 -- 172.21.15.81:0/3155554276 wait complete. 2023-10-06T03:24:53.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.114+0000 7ffb889ff700 1 Processor -- start 2023-10-06T03:24:53.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.114+0000 7ffb889ff700 1 -- start start 2023-10-06T03:24:53.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.115+0000 7ffb889ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb8413f9c0 0x7ffb8415f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:53.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.115+0000 7ffb889ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb8413fd90 0x7ffb8415cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:53.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.115+0000 7ffb889ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb8415a3f0 0x7ffb840af6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:53.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.115+0000 7ffb889ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb840c41b0 con 0x7ffb8413fd90 2023-10-06T03:24:53.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.115+0000 7ffb889ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb840c4420 con 0x7ffb8415a3f0 2023-10-06T03:24:53.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.115+0000 7ffb889ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb840c4700 con 0x7ffb8413f9c0 2023-10-06T03:24:53.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.116+0000 7ffb81d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb8413fd90 0x7ffb8415cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:53.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.116+0000 7ffb81d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb8413fd90 0x7ffb8415cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42132/0 (socket says 172.21.15.81:42132) 2023-10-06T03:24:53.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.116+0000 7ffb81d9b700 1 -- 172.21.15.81:0/2478365443 learned_addr learned my addr 172.21.15.81:0/2478365443 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:53.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.116+0000 7ffb82d9d700 1 --2- 172.21.15.81:0/2478365443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb8415a3f0 0x7ffb840af6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:53.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.116+0000 7ffb8259c700 1 --2- 172.21.15.81:0/2478365443 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb8413f9c0 0x7ffb8415f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:53.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.116+0000 7ffb81d9b700 1 -- 172.21.15.81:0/2478365443 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb8413f9c0 msgr2=0x7ffb8415f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:53.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.116+0000 7ffb81d9b700 1 --2- 172.21.15.81:0/2478365443 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb8413f9c0 0x7ffb8415f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:53.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.116+0000 7ffb81d9b700 1 -- 172.21.15.81:0/2478365443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb8415a3f0 msgr2=0x7ffb840af6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:53.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.116+0000 7ffb81d9b700 1 --2- 172.21.15.81:0/2478365443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb8415a3f0 0x7ffb840af6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:53.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.116+0000 7ffb81d9b700 1 -- 172.21.15.81:0/2478365443 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb780094f0 con 0x7ffb8413fd90 2023-10-06T03:24:53.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.116+0000 7ffb8259c700 1 --2- 172.21.15.81:0/2478365443 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb8413f9c0 0x7ffb8415f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:53.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.116+0000 7ffb81d9b700 1 --2- 172.21.15.81:0/2478365443 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb8413fd90 0x7ffb8415cf70 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ffb7800ec50 tx=0x7ffb78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:53.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.116+0000 7ffb727fc700 1 -- 172.21.15.81:0/2478365443 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7800c9d0 con 0x7ffb8413fd90 2023-10-06T03:24:53.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.117+0000 7ffb727fc700 1 -- 172.21.15.81:0/2478365443 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb7800cb30 con 0x7ffb8413fd90 2023-10-06T03:24:53.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.117+0000 7ffb889ff700 1 -- 172.21.15.81:0/2478365443 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb7c009a20 con 0x7ffb8413fd90 2023-10-06T03:24:53.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.117+0000 7ffb727fc700 1 -- 172.21.15.81:0/2478365443 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb78013470 con 0x7ffb8413fd90 2023-10-06T03:24:53.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.117+0000 7ffb889ff700 1 -- 172.21.15.81:0/2478365443 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb840c4a90 con 0x7ffb8413fd90 2023-10-06T03:24:53.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.118+0000 7ffb889ff700 1 -- 172.21.15.81:0/2478365443 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb8415fff0 con 0x7ffb8413fd90 2023-10-06T03:24:53.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.119+0000 7ffb727fc700 1 -- 172.21.15.81:0/2478365443 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffb78013860 con 0x7ffb8413fd90 2023-10-06T03:24:53.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.120+0000 7ffb727fc700 1 --2- 172.21.15.81:0/2478365443 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ffb64066f30 0x7ffb640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:53.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.121+0000 7ffb727fc700 1 -- 172.21.15.81:0/2478365443 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ffb78084f60 con 0x7ffb8413fd90 2023-10-06T03:24:53.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.121+0000 7ffb8259c700 1 --2- 172.21.15.81:0/2478365443 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ffb64066f30 0x7ffb640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:53.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.121+0000 7ffb8259c700 1 --2- 172.21.15.81:0/2478365443 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ffb64066f30 0x7ffb640693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ffb74007fd0 tx=0x7ffb74009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:53.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.125+0000 7ffb727fc700 1 -- 172.21.15.81:0/2478365443 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffb78051f30 con 0x7ffb8413fd90 2023-10-06T03:24:53.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.315+0000 7ffb889ff700 1 -- 172.21.15.81:0/2478365443 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffb8404c3c0 con 0x7ffb8413fd90 2023-10-06T03:24:53.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.316+0000 7ffb727fc700 1 -- 172.21.15.81:0/2478365443 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+17036 (secure 0 0 0) 0x7ffb78055550 con 0x7ffb8413fd90 2023-10-06T03:24:53.318 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:24:53.318 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":37,"fsid":"1807b5d7-9be8-43ad-aaf8-99a4273430b3","created":"2023-10-06T03:23:20.805306+0000","modified":"2023-10-06T03:24:52.345496+0000","last_up_change":"2023-10-06T03:23:32.735796+0000","last_in_change":"2023-10-06T03:23:24.109024+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:33.198850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:33.606744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:24:50.339463+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T03:24:51.333980+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"14fb667d-a677-4978-a477-80027f889d36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":85563},{"type":"v1","addr":"172.21.15.81:6818","nonce":85563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":85563},{"type":"v1","addr":"172.21.15.81:6822","nonce":85563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":85563},{"type":"v1","addr":"172.21.15.81:6830","nonce":85563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":85563},{"type":"v1","addr":"172.21.15.81:6826","nonce":85563}]},"public_addr":"172.21.15.81:6818/85563","cluster_addr":"172.21.15.81:6822/85563","heartbeat_back_addr":"172.21.15.81:6830/85563","heartbeat_front_addr":"172.21.15.81:6826/85563","state":["exists","up"]},{"osd":1,"uuid":"974d8a86-1829-4176-89ce-18e6038857f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":85561},{"type":"v1","addr":"172.21.15.81:6801","nonce":85561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":85561},{"type":"v1","addr":"172.21.15.81:6803","nonce":85561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":85561},{"type":"v1","addr":"172.21.15.81:6807","nonce":85561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":85561},{"type":"v1","addr":"172.21.15.81:6805","nonce":85561}]},"public_addr":"172.21.15.81:6801/85561","cluster_addr":"172.21.15.81:6803/85561","heartbeat_back_addr":"172.21.15.81:6807/85561","heartbeat_front_addr":"172.21.15.81:6805/85561","state":["exists","up"]},{"osd":2,"uuid":"ffbfe056-46bc-46e0-bf49-4d8f8650e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":85564},{"type":"v1","addr":"172.21.15.81:6809","nonce":85564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":85564},{"type":"v1","addr":"172.21.15.81:6811","nonce":85564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":85564},{"type":"v1","addr":"172.21.15.81:6815","nonce":85564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":85564},{"type":"v1","addr":"172.21.15.81:6813","nonce":85564}]},"public_addr":"172.21.15.81:6809/85564","cluster_addr":"172.21.15.81:6811/85564","heartbeat_back_addr":"172.21.15.81:6815/85564","heartbeat_front_addr":"172.21.15.81:6813/85564","state":["exists","up"]},{"osd":3,"uuid":"ef9a8314-3d37-4ea1-858a-e704d5695002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":85562},{"type":"v1","addr":"172.21.15.81:6819","nonce":85562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":85562},{"type":"v1","addr":"172.21.15.81:6823","nonce":85562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":85562},{"type":"v1","addr":"172.21.15.81:6831","nonce":85562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":85562},{"type":"v1","addr":"172.21.15.81:6827","nonce":85562}]},"public_addr":"172.21.15.81:6819/85562","cluster_addr":"172.21.15.81:6823/85562","heartbeat_back_addr":"172.21.15.81:6831/85562","heartbeat_front_addr":"172.21.15.81:6827/85562","state":["exists","up"]},{"osd":4,"uuid":"d83506a0-2c96-4bcb-a9fa-05e43dc329df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":85785},{"type":"v1","addr":"172.21.15.83:6801","nonce":85785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":85785},{"type":"v1","addr":"172.21.15.83:6803","nonce":85785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":85785},{"type":"v1","addr":"172.21.15.83:6807","nonce":85785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":85785},{"type":"v1","addr":"172.21.15.83:6805","nonce":85785}]},"public_addr":"172.21.15.83:6801/85785","cluster_addr":"172.21.15.83:6803/85785","heartbeat_back_addr":"172.21.15.83:6807/85785","heartbeat_front_addr":"172.21.15.83:6805/85785","state":["exists","up"]},{"osd":5,"uuid":"10687c63-a3d5-472f-acc0-4f61847b6e0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":85818},{"type":"v1","addr":"172.21.15.83:6825","nonce":85818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":85818},{"type":"v1","addr":"172.21.15.83:6827","nonce":85818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":85818},{"type":"v1","addr":"172.21.15.83:6831","nonce":85818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":85818},{"type":"v1","addr":"172.21.15.83:6829","nonce":85818}]},"public_addr":"172.21.15.83:6825/85818","cluster_addr":"172.21.15.83:6827/85818","heartbeat_back_addr":"172.21.15.83:6831/85818","heartbeat_front_addr":"172.21.15.83:6829/85818","state":["exists","up"]},{"osd":6,"uuid":"2e9daf76-5607-4a29-9a58-6e270700d223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":85787},{"type":"v1","addr":"172.21.15.83:6811","nonce":85787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":85787},{"type":"v1","addr":"172.21.15.83:6815","nonce":85787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":85787},{"type":"v1","addr":"172.21.15.83:6823","nonce":85787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6817","nonce":85787},{"type":"v1","addr":"172.21.15.83:6819","nonce":85787}]},"public_addr":"172.21.15.83:6811/85787","cluster_addr":"172.21.15.83:6815/85787","heartbeat_back_addr":"172.21.15.83:6823/85787","heartbeat_front_addr":"172.21.15.83:6819/85787","state":["exists","up"]},{"osd":7,"uuid":"5019e1ff-233a-4a5a-91ca-8afccb7ab6e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":85786},{"type":"v1","addr":"172.21.15.83:6810","nonce":85786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":85786},{"type":"v1","addr":"172.21.15.83:6814","nonce":85786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":85786},{"type":"v1","addr":"172.21.15.83:6822","nonce":85786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":85786},{"type":"v1","addr":"172.21.15.83:6818","nonce":85786}]},"public_addr":"172.21.15.83:6810/85786","cluster_addr":"172.21.15.83:6814/85786","heartbeat_back_addr":"172.21.15.83:6822/85786","heartbeat_front_addr":"172.21.15.83:6818/85786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.393431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.360031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.407428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.391613+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.403211+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.438142+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.496181+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.472323+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:24:53.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.318+0000 7ffb889ff700 1 -- 172.21.15.81:0/2478365443 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ffb64066f30 msgr2=0x7ffb640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:53.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.318+0000 7ffb889ff700 1 --2- 172.21.15.81:0/2478365443 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ffb64066f30 0x7ffb640693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ffb74007fd0 tx=0x7ffb74009040 comp rx=0 tx=0).stop 2023-10-06T03:24:53.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.318+0000 7ffb889ff700 1 -- 172.21.15.81:0/2478365443 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb8413fd90 msgr2=0x7ffb8415cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:53.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.318+0000 7ffb889ff700 1 --2- 172.21.15.81:0/2478365443 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb8413fd90 0x7ffb8415cf70 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ffb7800ec50 tx=0x7ffb78009250 comp rx=0 tx=0).stop 2023-10-06T03:24:53.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.318+0000 7ffb889ff700 1 -- 172.21.15.81:0/2478365443 shutdown_connections 2023-10-06T03:24:53.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.318+0000 7ffb889ff700 1 --2- 172.21.15.81:0/2478365443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb8415a3f0 0x7ffb840af6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:53.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.318+0000 7ffb889ff700 1 --2- 172.21.15.81:0/2478365443 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ffb64066f30 0x7ffb640693e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:53.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.318+0000 7ffb889ff700 1 --2- 172.21.15.81:0/2478365443 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb8413f9c0 0x7ffb8415f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:53.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.318+0000 7ffb889ff700 1 --2- 172.21.15.81:0/2478365443 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb8413fd90 0x7ffb8415cf70 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:53.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.318+0000 7ffb889ff700 1 -- 172.21.15.81:0/2478365443 >> 172.21.15.81:0/2478365443 conn(0x7ffb840cc090 msgr2=0x7ffb840cc460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:53.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.318+0000 7ffb889ff700 1 -- 172.21.15.81:0/2478365443 shutdown_connections 2023-10-06T03:24:53.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.318+0000 7ffb889ff700 1 -- 172.21.15.81:0/2478365443 wait complete. 2023-10-06T03:24:53.338 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:24:53.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.515+0000 7f0f5c5ff700 1 Processor -- start 2023-10-06T03:24:53.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.515+0000 7f0f5c5ff700 1 -- start start 2023-10-06T03:24:53.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.517+0000 7f0f5c5ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0f5413f9c0 0x7f0f540ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:53.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.517+0000 7f0f5c5ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0f5415a5c0 0x7f0f540c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:53.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.517+0000 7f0f5c5ff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f540cafe0 con 0x7f0f540cab60 2023-10-06T03:24:53.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.517+0000 7f0f5c5ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f540cb2c0 con 0x7f0f5413f9c0 2023-10-06T03:24:53.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.517+0000 7f0f5c5ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f540cb5a0 con 0x7f0f5415a5c0 2023-10-06T03:24:53.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.517+0000 7f0f5a39b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0f5413f9c0 0x7f0f540ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:53.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.517+0000 7f0f5a39b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0f5413f9c0 0x7f0f540ca620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42144/0 (socket says 172.21.15.81:42144) 2023-10-06T03:24:53.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.517+0000 7f0f5a39b700 1 -- 172.21.15.81:0/3383096038 learned_addr learned my addr 172.21.15.81:0/3383096038 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:53.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.517+0000 7f0f5ab9c700 1 --2- 172.21.15.81:0/3383096038 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0f5415a5c0 0x7f0f540c6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:53.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.518+0000 7f0f5a39b700 1 -- 172.21.15.81:0/3383096038 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0f5415a5c0 msgr2=0x7f0f540c6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:53.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.518+0000 7f0f5a39b700 1 --2- 172.21.15.81:0/3383096038 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0f5415a5c0 0x7f0f540c6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:53.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.518+0000 7f0f5a39b700 1 -- 172.21.15.81:0/3383096038 >> v1:172.21.15.83:6789/0 conn(0x7f0f540cab60 legacy=0x7f0f54159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:53.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.518+0000 7f0f5a39b700 1 -- 172.21.15.81:0/3383096038 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f540cb880 con 0x7f0f5413f9c0 2023-10-06T03:24:53.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.518+0000 7f0f59399700 1 -- 172.21.15.81:0/3383096038 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4226003557 0 0) 0x7f0f540cafe0 con 0x7f0f540cab60 2023-10-06T03:24:53.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.518+0000 7f0f5a39b700 1 --2- 172.21.15.81:0/3383096038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f5413f9c0 0x7f0f540ca620 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0f500099b0 tx=0x7f0f50009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54d0f835736c7d90 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:53.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.518+0000 7f0f59399700 1 -- 172.21.15.81:0/3383096038 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f50009ea0 con 0x7f0f5413f9c0 2023-10-06T03:24:53.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.518+0000 7f0f59399700 1 -- 172.21.15.81:0/3383096038 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5000b860 con 0x7f0f5413f9c0 2023-10-06T03:24:53.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.518+0000 7f0f59399700 1 -- 172.21.15.81:0/3383096038 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5000bc00 con 0x7f0f5413f9c0 2023-10-06T03:24:53.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.519+0000 7f0f5c5ff700 1 -- 172.21.15.81:0/3383096038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f5413f9c0 msgr2=0x7f0f540ca620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:53.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.519+0000 7f0f5c5ff700 1 --2- 172.21.15.81:0/3383096038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f5413f9c0 0x7f0f540ca620 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0f500099b0 tx=0x7f0f50009250 comp rx=0 tx=0).stop 2023-10-06T03:24:53.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.519+0000 7f0f5c5ff700 1 -- 172.21.15.81:0/3383096038 shutdown_connections 2023-10-06T03:24:53.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.519+0000 7f0f5c5ff700 1 --2- 172.21.15.81:0/3383096038 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0f5415a5c0 0x7f0f540c6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:53.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.519+0000 7f0f5c5ff700 1 --2- 172.21.15.81:0/3383096038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f5413f9c0 0x7f0f540ca620 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:53.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.519+0000 7f0f5c5ff700 1 -- 172.21.15.81:0/3383096038 >> 172.21.15.81:0/3383096038 conn(0x7f0f540cc090 msgr2=0x7f0f540cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:53.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.519+0000 7f0f5c5ff700 1 -- 172.21.15.81:0/3383096038 shutdown_connections 2023-10-06T03:24:53.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.519+0000 7f0f5c5ff700 1 -- 172.21.15.81:0/3383096038 wait complete. 2023-10-06T03:24:53.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.520+0000 7f0f5c5ff700 1 Processor -- start 2023-10-06T03:24:53.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.520+0000 7f0f5c5ff700 1 -- start start 2023-10-06T03:24:53.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.521+0000 7f0f5c5ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0f5413f9c0 0x7f0f5413d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:53.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.521+0000 7f0f5c5ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0f5415a5c0 0x7f0f540b0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:53.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.521+0000 7f0f5c5ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f540b14c0 0x7f0f540a9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:53.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.521+0000 7f0f5c5ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f540b1940 con 0x7f0f540b14c0 2023-10-06T03:24:53.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.521+0000 7f0f5c5ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f540aa700 con 0x7f0f5413f9c0 2023-10-06T03:24:53.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.521+0000 7f0f5c5ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f540c1800 con 0x7f0f5415a5c0 2023-10-06T03:24:53.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.521+0000 7f0f5ab9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f540b14c0 0x7f0f540a9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:53.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.521+0000 7f0f5ab9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f540b14c0 0x7f0f540a9960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42158/0 (socket says 172.21.15.81:42158) 2023-10-06T03:24:53.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.521+0000 7f0f5ab9c700 1 -- 172.21.15.81:0/3168935409 learned_addr learned my addr 172.21.15.81:0/3168935409 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:53.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.522+0000 7f0f5a39b700 1 --2- 172.21.15.81:0/3168935409 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0f5413f9c0 0x7f0f5413d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:53.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.522+0000 7f0f59b9a700 1 --2- 172.21.15.81:0/3168935409 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0f5415a5c0 0x7f0f540b0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:53.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.522+0000 7f0f5ab9c700 1 -- 172.21.15.81:0/3168935409 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0f5415a5c0 msgr2=0x7f0f540b0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:53.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.522+0000 7f0f5ab9c700 1 --2- 172.21.15.81:0/3168935409 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0f5415a5c0 0x7f0f540b0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:53.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.522+0000 7f0f5ab9c700 1 -- 172.21.15.81:0/3168935409 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0f5413f9c0 msgr2=0x7f0f5413d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:53.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.522+0000 7f0f5ab9c700 1 --2- 172.21.15.81:0/3168935409 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0f5413f9c0 0x7f0f5413d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:53.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.522+0000 7f0f5ab9c700 1 -- 172.21.15.81:0/3168935409 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f500094f0 con 0x7f0f540b14c0 2023-10-06T03:24:53.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.522+0000 7f0f5ab9c700 1 --2- 172.21.15.81:0/3168935409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f540b14c0 0x7f0f540a9960 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c009da0 tx=0x7f0f4c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:53.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.522+0000 7f0f4a7fc700 1 -- 172.21.15.81:0/3168935409 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c00caa0 con 0x7f0f540b14c0 2023-10-06T03:24:53.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.522+0000 7f0f4a7fc700 1 -- 172.21.15.81:0/3168935409 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f4c00f040 con 0x7f0f540b14c0 2023-10-06T03:24:53.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.522+0000 7f0f4a7fc700 1 -- 172.21.15.81:0/3168935409 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c00ce50 con 0x7f0f540b14c0 2023-10-06T03:24:53.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.522+0000 7f0f5c5ff700 1 -- 172.21.15.81:0/3168935409 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f540c0ed0 con 0x7f0f540b14c0 2023-10-06T03:24:53.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.523+0000 7f0f5c5ff700 1 -- 172.21.15.81:0/3168935409 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f540c1490 con 0x7f0f540b14c0 2023-10-06T03:24:53.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.523+0000 7f0f5c5ff700 1 -- 172.21.15.81:0/3168935409 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f540c1990 con 0x7f0f540b14c0 2023-10-06T03:24:53.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.524+0000 7f0f4a7fc700 1 -- 172.21.15.81:0/3168935409 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0f4c014690 con 0x7f0f540b14c0 2023-10-06T03:24:53.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.526+0000 7f0f4a7fc700 1 --2- 172.21.15.81:0/3168935409 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0f38066f30 0x7f0f380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:53.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.526+0000 7f0f4a7fc700 1 -- 172.21.15.81:0/3168935409 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f0f4c085300 con 0x7f0f540b14c0 2023-10-06T03:24:53.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.526+0000 7f0f5a39b700 1 --2- 172.21.15.81:0/3168935409 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0f38066f30 0x7f0f380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:53.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.526+0000 7f0f5a39b700 1 --2- 172.21.15.81:0/3168935409 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0f38066f30 0x7f0f380693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0f500099b0 tx=0x7f0f50017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:53.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.530+0000 7f0f4a7fc700 1 -- 172.21.15.81:0/3168935409 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0f4c052230 con 0x7f0f540b14c0 2023-10-06T03:24:53.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.724+0000 7f0f5c5ff700 1 -- 172.21.15.81:0/3168935409 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0f5404c3c0 con 0x7f0f540b14c0 2023-10-06T03:24:53.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.725+0000 7f0f4a7fc700 1 -- 172.21.15.81:0/3168935409 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+17036 (secure 0 0 0) 0x7f0f4c055850 con 0x7f0f540b14c0 2023-10-06T03:24:53.728 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:24:53.728 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":37,"fsid":"1807b5d7-9be8-43ad-aaf8-99a4273430b3","created":"2023-10-06T03:23:20.805306+0000","modified":"2023-10-06T03:24:52.345496+0000","last_up_change":"2023-10-06T03:23:32.735796+0000","last_in_change":"2023-10-06T03:23:24.109024+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:33.198850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:33.606744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:24:50.339463+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T03:24:51.333980+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"14fb667d-a677-4978-a477-80027f889d36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":85563},{"type":"v1","addr":"172.21.15.81:6818","nonce":85563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":85563},{"type":"v1","addr":"172.21.15.81:6822","nonce":85563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":85563},{"type":"v1","addr":"172.21.15.81:6830","nonce":85563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":85563},{"type":"v1","addr":"172.21.15.81:6826","nonce":85563}]},"public_addr":"172.21.15.81:6818/85563","cluster_addr":"172.21.15.81:6822/85563","heartbeat_back_addr":"172.21.15.81:6830/85563","heartbeat_front_addr":"172.21.15.81:6826/85563","state":["exists","up"]},{"osd":1,"uuid":"974d8a86-1829-4176-89ce-18e6038857f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":85561},{"type":"v1","addr":"172.21.15.81:6801","nonce":85561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":85561},{"type":"v1","addr":"172.21.15.81:6803","nonce":85561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":85561},{"type":"v1","addr":"172.21.15.81:6807","nonce":85561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":85561},{"type":"v1","addr":"172.21.15.81:6805","nonce":85561}]},"public_addr":"172.21.15.81:6801/85561","cluster_addr":"172.21.15.81:6803/85561","heartbeat_back_addr":"172.21.15.81:6807/85561","heartbeat_front_addr":"172.21.15.81:6805/85561","state":["exists","up"]},{"osd":2,"uuid":"ffbfe056-46bc-46e0-bf49-4d8f8650e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":85564},{"type":"v1","addr":"172.21.15.81:6809","nonce":85564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":85564},{"type":"v1","addr":"172.21.15.81:6811","nonce":85564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":85564},{"type":"v1","addr":"172.21.15.81:6815","nonce":85564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":85564},{"type":"v1","addr":"172.21.15.81:6813","nonce":85564}]},"public_addr":"172.21.15.81:6809/85564","cluster_addr":"172.21.15.81:6811/85564","heartbeat_back_addr":"172.21.15.81:6815/85564","heartbeat_front_addr":"172.21.15.81:6813/85564","state":["exists","up"]},{"osd":3,"uuid":"ef9a8314-3d37-4ea1-858a-e704d5695002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":85562},{"type":"v1","addr":"172.21.15.81:6819","nonce":85562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":85562},{"type":"v1","addr":"172.21.15.81:6823","nonce":85562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":85562},{"type":"v1","addr":"172.21.15.81:6831","nonce":85562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":85562},{"type":"v1","addr":"172.21.15.81:6827","nonce":85562}]},"public_addr":"172.21.15.81:6819/85562","cluster_addr":"172.21.15.81:6823/85562","heartbeat_back_addr":"172.21.15.81:6831/85562","heartbeat_front_addr":"172.21.15.81:6827/85562","state":["exists","up"]},{"osd":4,"uuid":"d83506a0-2c96-4bcb-a9fa-05e43dc329df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":85785},{"type":"v1","addr":"172.21.15.83:6801","nonce":85785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":85785},{"type":"v1","addr":"172.21.15.83:6803","nonce":85785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":85785},{"type":"v1","addr":"172.21.15.83:6807","nonce":85785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":85785},{"type":"v1","addr":"172.21.15.83:6805","nonce":85785}]},"public_addr":"172.21.15.83:6801/85785","cluster_addr":"172.21.15.83:6803/85785","heartbeat_back_addr":"172.21.15.83:6807/85785","heartbeat_front_addr":"172.21.15.83:6805/85785","state":["exists","up"]},{"osd":5,"uuid":"10687c63-a3d5-472f-acc0-4f61847b6e0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":85818},{"type":"v1","addr":"172.21.15.83:6825","nonce":85818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":85818},{"type":"v1","addr":"172.21.15.83:6827","nonce":85818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":85818},{"type":"v1","addr":"172.21.15.83:6831","nonce":85818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":85818},{"type":"v1","addr":"172.21.15.83:6829","nonce":85818}]},"public_addr":"172.21.15.83:6825/85818","cluster_addr":"172.21.15.83:6827/85818","heartbeat_back_addr":"172.21.15.83:6831/85818","heartbeat_front_addr":"172.21.15.83:6829/85818","state":["exists","up"]},{"osd":6,"uuid":"2e9daf76-5607-4a29-9a58-6e270700d223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":85787},{"type":"v1","addr":"172.21.15.83:6811","nonce":85787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":85787},{"type":"v1","addr":"172.21.15.83:6815","nonce":85787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":85787},{"type":"v1","addr":"172.21.15.83:6823","nonce":85787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6817","nonce":85787},{"type":"v1","addr":"172.21.15.83:6819","nonce":85787}]},"public_addr":"172.21.15.83:6811/85787","cluster_addr":"172.21.15.83:6815/85787","heartbeat_back_addr":"172.21.15.83:6823/85787","heartbeat_front_addr":"172.21.15.83:6819/85787","state":["exists","up"]},{"osd":7,"uuid":"5019e1ff-233a-4a5a-91ca-8afccb7ab6e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":85786},{"type":"v1","addr":"172.21.15.83:6810","nonce":85786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":85786},{"type":"v1","addr":"172.21.15.83:6814","nonce":85786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":85786},{"type":"v1","addr":"172.21.15.83:6822","nonce":85786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":85786},{"type":"v1","addr":"172.21.15.83:6818","nonce":85786}]},"public_addr":"172.21.15.83:6810/85786","cluster_addr":"172.21.15.83:6814/85786","heartbeat_back_addr":"172.21.15.83:6822/85786","heartbeat_front_addr":"172.21.15.83:6818/85786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.393431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.360031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.407428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.391613+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.403211+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.438142+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.496181+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.472323+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:24:53.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.728+0000 7f0f5c5ff700 1 -- 172.21.15.81:0/3168935409 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0f38066f30 msgr2=0x7f0f380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:53.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.728+0000 7f0f5c5ff700 1 --2- 172.21.15.81:0/3168935409 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0f38066f30 0x7f0f380693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0f500099b0 tx=0x7f0f50017000 comp rx=0 tx=0).stop 2023-10-06T03:24:53.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.728+0000 7f0f5c5ff700 1 -- 172.21.15.81:0/3168935409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f540b14c0 msgr2=0x7f0f540a9960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:53.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.728+0000 7f0f5c5ff700 1 --2- 172.21.15.81:0/3168935409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f540b14c0 0x7f0f540a9960 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c009da0 tx=0x7f0f4c00b040 comp rx=0 tx=0).stop 2023-10-06T03:24:53.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.728+0000 7f0f5c5ff700 1 -- 172.21.15.81:0/3168935409 shutdown_connections 2023-10-06T03:24:53.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.728+0000 7f0f5c5ff700 1 --2- 172.21.15.81:0/3168935409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f540b14c0 0x7f0f540a9960 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:53.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.728+0000 7f0f5c5ff700 1 --2- 172.21.15.81:0/3168935409 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0f5413f9c0 0x7f0f5413d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:53.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.728+0000 7f0f5c5ff700 1 --2- 172.21.15.81:0/3168935409 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0f38066f30 0x7f0f380693e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:53.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.728+0000 7f0f5c5ff700 1 --2- 172.21.15.81:0/3168935409 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0f5415a5c0 0x7f0f540b0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:53.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.728+0000 7f0f5c5ff700 1 -- 172.21.15.81:0/3168935409 >> 172.21.15.81:0/3168935409 conn(0x7f0f540cc090 msgr2=0x7f0f540c7340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:53.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.728+0000 7f0f5c5ff700 1 -- 172.21.15.81:0/3168935409 shutdown_connections 2023-10-06T03:24:53.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.728+0000 7f0f5c5ff700 1 -- 172.21.15.81:0/3168935409 wait complete. 2023-10-06T03:24:53.748 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T03:24:53.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.931+0000 7f895139d700 1 Processor -- start 2023-10-06T03:24:53.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.932+0000 7f895139d700 1 -- start start 2023-10-06T03:24:53.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.933+0000 7f895139d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f894c156030 0x7f894c156400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:53.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.933+0000 7f895139d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f894c06e960 0x7f894c06a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:53.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.933+0000 7f895139d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f894c06e080 con 0x7f894c06e510 2023-10-06T03:24:53.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.933+0000 7f895139d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f894c06d1b0 con 0x7f894c06e960 2023-10-06T03:24:53.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.933+0000 7f895139d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f894c06d470 con 0x7f894c156030 2023-10-06T03:24:53.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.933+0000 7f894bfff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f894c156030 0x7f894c156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:53.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.933+0000 7f8950b9c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f894c06e960 0x7f894c06a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:53.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.934+0000 7f894bfff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f894c156030 0x7f894c156400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:40216/0 (socket says 172.21.15.81:40216) 2023-10-06T03:24:53.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.934+0000 7f8950b9c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f894c06e960 0x7f894c06a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:36832/0 (socket says 172.21.15.81:36832) 2023-10-06T03:24:53.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.934+0000 7f894bfff700 1 -- 172.21.15.81:0/3350978601 learned_addr learned my addr 172.21.15.81:0/3350978601 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:53.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.934+0000 7f894bfff700 1 -- 172.21.15.81:0/3350978601 >> v2:172.21.15.83:3300/0 conn(0x7f894c06e960 msgr2=0x7f894c06a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:53.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.934+0000 7f894bfff700 1 --2- 172.21.15.81:0/3350978601 >> v2:172.21.15.83:3300/0 conn(0x7f894c06e960 0x7f894c06a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:53.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.934+0000 7f894bfff700 1 -- 172.21.15.81:0/3350978601 >> v1:172.21.15.83:6789/0 conn(0x7f894c06e510 legacy=0x7f894c0c6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:53.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.934+0000 7f894bfff700 1 -- 172.21.15.81:0/3350978601 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f894c06d750 con 0x7f894c156030 2023-10-06T03:24:53.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.934+0000 7f894bfff700 1 --2- 172.21.15.81:0/3350978601 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f894c156030 0x7f894c156400 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f893c0099b0 tx=0x7f893c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34dbdb92c8ea6b03 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:53.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.935+0000 7f894b7fe700 1 -- 172.21.15.81:0/3350978601 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c009ea0 con 0x7f894c156030 2023-10-06T03:24:53.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.935+0000 7f894b7fe700 1 -- 172.21.15.81:0/3350978601 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f893c00b860 con 0x7f894c156030 2023-10-06T03:24:53.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.935+0000 7f894b7fe700 1 -- 172.21.15.81:0/3350978601 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c00bc00 con 0x7f894c156030 2023-10-06T03:24:53.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.935+0000 7f895139d700 1 -- 172.21.15.81:0/3350978601 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f894c156030 msgr2=0x7f894c156400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:53.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.935+0000 7f895139d700 1 --2- 172.21.15.81:0/3350978601 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f894c156030 0x7f894c156400 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f893c0099b0 tx=0x7f893c009250 comp rx=0 tx=0).stop 2023-10-06T03:24:53.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.935+0000 7f895139d700 1 -- 172.21.15.81:0/3350978601 shutdown_connections 2023-10-06T03:24:53.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.935+0000 7f895139d700 1 --2- 172.21.15.81:0/3350978601 >> v2:172.21.15.83:3300/0 conn(0x7f894c06e960 0x7f894c06a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:53.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.935+0000 7f895139d700 1 --2- 172.21.15.81:0/3350978601 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f894c156030 0x7f894c156400 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:53.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.935+0000 7f895139d700 1 -- 172.21.15.81:0/3350978601 >> 172.21.15.81:0/3350978601 conn(0x7f894c0680b0 msgr2=0x7f894c0cbeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:53.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.935+0000 7f895139d700 1 -- 172.21.15.81:0/3350978601 shutdown_connections 2023-10-06T03:24:53.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.935+0000 7f895139d700 1 -- 172.21.15.81:0/3350978601 wait complete. 2023-10-06T03:24:53.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.937+0000 7f895139d700 1 Processor -- start 2023-10-06T03:24:53.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.937+0000 7f895139d700 1 -- start start 2023-10-06T03:24:53.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.938+0000 7f895139d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f894c06e510 0x7f894c0b1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:53.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.938+0000 7f895139d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f894c06e960 0x7f894c156400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:53.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.938+0000 7f895139d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f894c156030 0x7f894c157c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:53.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.938+0000 7f895139d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f894c156940 con 0x7f894c06e960 2023-10-06T03:24:53.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.938+0000 7f895139d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f894c157780 con 0x7f894c156030 2023-10-06T03:24:53.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.938+0000 7f895139d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f894c156b70 con 0x7f894c06e510 2023-10-06T03:24:53.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.938+0000 7f8943fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f894c06e960 0x7f894c156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:53.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.938+0000 7f8943fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f894c06e960 0x7f894c156400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42168/0 (socket says 172.21.15.81:42168) 2023-10-06T03:24:53.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.938+0000 7f8943fff700 1 -- 172.21.15.81:0/2454975094 learned_addr learned my addr 172.21.15.81:0/2454975094 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:53.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.938+0000 7f894bfff700 1 --2- 172.21.15.81:0/2454975094 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f894c06e510 0x7f894c0b1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:53.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.938+0000 7f8950b9c700 1 --2- 172.21.15.81:0/2454975094 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f894c156030 0x7f894c157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:53.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.938+0000 7f8943fff700 1 -- 172.21.15.81:0/2454975094 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f894c06e510 msgr2=0x7f894c0b1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:53.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.938+0000 7f8943fff700 1 --2- 172.21.15.81:0/2454975094 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f894c06e510 0x7f894c0b1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:53.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.938+0000 7f8943fff700 1 -- 172.21.15.81:0/2454975094 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f894c156030 msgr2=0x7f894c157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:53.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.938+0000 7f8943fff700 1 --2- 172.21.15.81:0/2454975094 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f894c156030 0x7f894c157c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:53.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.938+0000 7f8943fff700 1 -- 172.21.15.81:0/2454975094 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f893c0094f0 con 0x7f894c06e960 2023-10-06T03:24:53.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.939+0000 7f8943fff700 1 --2- 172.21.15.81:0/2454975094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f894c06e960 0x7f894c156400 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f893400c4e0 tx=0x7f893400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:53.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.939+0000 7f8948ff9700 1 -- 172.21.15.81:0/2454975094 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8934011590 con 0x7f894c06e960 2023-10-06T03:24:53.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.939+0000 7f8948ff9700 1 -- 172.21.15.81:0/2454975094 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8934011710 con 0x7f894c06e960 2023-10-06T03:24:53.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.939+0000 7f895139d700 1 -- 172.21.15.81:0/2454975094 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f894c156eb0 con 0x7f894c06e960 2023-10-06T03:24:53.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.939+0000 7f8948ff9700 1 -- 172.21.15.81:0/2454975094 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8934011ad0 con 0x7f894c06e960 2023-10-06T03:24:53.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.939+0000 7f895139d700 1 -- 172.21.15.81:0/2454975094 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f894c158150 con 0x7f894c06e960 2023-10-06T03:24:53.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.940+0000 7f895139d700 1 -- 172.21.15.81:0/2454975094 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f894c1578f0 con 0x7f894c06e960 2023-10-06T03:24:53.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.941+0000 7f8948ff9700 1 -- 172.21.15.81:0/2454975094 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f893401b3b0 con 0x7f894c06e960 2023-10-06T03:24:53.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.942+0000 7f8948ff9700 1 --2- 172.21.15.81:0/2454975094 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f892c066f30 0x7f892c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:53.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.942+0000 7f8948ff9700 1 -- 172.21.15.81:0/2454975094 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f8934083c30 con 0x7f894c06e960 2023-10-06T03:24:53.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.942+0000 7f894bfff700 1 --2- 172.21.15.81:0/2454975094 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f892c066f30 0x7f892c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:53.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.943+0000 7f894bfff700 1 --2- 172.21.15.81:0/2454975094 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f892c066f30 0x7f892c0693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f893c0099b0 tx=0x7f893c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:53.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:53.946+0000 7f8948ff9700 1 -- 172.21.15.81:0/2454975094 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8934050b60 con 0x7f894c06e960 2023-10-06T03:24:54.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:54.187+0000 7f895139d700 1 -- 172.21.15.81:0/2454975094 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f894c04c3c0 con 0x7f894c06e960 2023-10-06T03:24:54.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:54.899+0000 7f8948ff9700 1 -- 172.21.15.81:0/2454975094 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8934017070 con 0x7f894c06e960 2023-10-06T03:24:54.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:54.902+0000 7f895139d700 1 -- 172.21.15.81:0/2454975094 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f892c066f30 msgr2=0x7f892c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:54.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:54.902+0000 7f895139d700 1 --2- 172.21.15.81:0/2454975094 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f892c066f30 0x7f892c0693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f893c0099b0 tx=0x7f893c017000 comp rx=0 tx=0).stop 2023-10-06T03:24:54.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:54.902+0000 7f895139d700 1 -- 172.21.15.81:0/2454975094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f894c06e960 msgr2=0x7f894c156400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:54.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:54.902+0000 7f895139d700 1 --2- 172.21.15.81:0/2454975094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f894c06e960 0x7f894c156400 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f893400c4e0 tx=0x7f893400c7f0 comp rx=0 tx=0).stop 2023-10-06T03:24:54.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:54.902+0000 7f895139d700 1 -- 172.21.15.81:0/2454975094 shutdown_connections 2023-10-06T03:24:54.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:54.902+0000 7f895139d700 1 --2- 172.21.15.81:0/2454975094 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f894c156030 0x7f894c157c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:54.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:54.902+0000 7f895139d700 1 --2- 172.21.15.81:0/2454975094 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f892c066f30 0x7f892c0693e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:54.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:54.902+0000 7f895139d700 1 --2- 172.21.15.81:0/2454975094 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f894c06e510 0x7f894c0b1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:54.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:54.902+0000 7f895139d700 1 --2- 172.21.15.81:0/2454975094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f894c06e960 0x7f894c156400 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:54.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:54.902+0000 7f895139d700 1 -- 172.21.15.81:0/2454975094 >> 172.21.15.81:0/2454975094 conn(0x7f894c0680b0 msgr2=0x7f894c069570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:54.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:54.902+0000 7f895139d700 1 -- 172.21.15.81:0/2454975094 shutdown_connections 2023-10-06T03:24:54.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:54.902+0000 7f895139d700 1 -- 172.21.15.81:0/2454975094 wait complete. 2023-10-06T03:24:54.923 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T03:24:55.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.106+0000 7f907f59e700 1 Processor -- start 2023-10-06T03:24:55.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.106+0000 7f907f59e700 1 -- start start 2023-10-06T03:24:55.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.107+0000 7f907f59e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9080156030 0x7f9080156400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:55.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.107+0000 7f907f59e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f908006e080 con 0x7f908006e990 2023-10-06T03:24:55.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.107+0000 7f907f59e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f908006d1b0 con 0x7f908006e510 2023-10-06T03:24:55.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.107+0000 7f907f59e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f908006d470 con 0x7f9080156030 2023-10-06T03:24:55.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.107+0000 7f907ed9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f908006e990 0x7f908006a3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41996/0 (socket says 172.21.15.81:41996) 2023-10-06T03:24:55.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.107+0000 7f907ed9d700 1 -- 172.21.15.81:0/2153453627 learned_addr learned my addr 172.21.15.81:0/2153453627 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:24:55.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.107+0000 7f907e59c700 1 --2- 172.21.15.81:0/2153453627 >> v2:172.21.15.83:3300/0 conn(0x7f9080156030 0x7f9080156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:55.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.108+0000 7f907d59a700 1 -- 172.21.15.81:0/2153453627 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3006808959 0 0) 0x7f908006e080 con 0x7f908006e990 2023-10-06T03:24:55.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.108+0000 7f907d59a700 1 -- 172.21.15.81:0/2153453627 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9068003570 con 0x7f908006e990 2023-10-06T03:24:55.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.108+0000 7f907e59c700 1 -- 172.21.15.81:0/2153453627 >> v1:172.21.15.83:6789/0 conn(0x7f908006e510 legacy=0x7f90800c6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:55.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.108+0000 7f907d59a700 1 -- 172.21.15.81:0/2153453627 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3015219439 0 0) 0x7f9068003570 con 0x7f908006e990 2023-10-06T03:24:55.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.108+0000 7f907e59c700 1 -- 172.21.15.81:0/2153453627 >> v1:172.21.15.81:6789/0 conn(0x7f908006e990 legacy=0x7f908006a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:55.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.108+0000 7f907e59c700 1 -- 172.21.15.81:0/2153453627 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f908006d750 con 0x7f9080156030 2023-10-06T03:24:55.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.108+0000 7f907e59c700 1 --2- 172.21.15.81:0/2153453627 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9080156030 0x7f9080156400 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9070009e60 tx=0x7f9070009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79c4e6c9f505d98a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:55.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.109+0000 7f907d59a700 1 -- 172.21.15.81:0/2153453627 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907000e070 con 0x7f9080156030 2023-10-06T03:24:55.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.109+0000 7f907d59a700 1 -- 172.21.15.81:0/2153453627 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f907000b850 con 0x7f9080156030 2023-10-06T03:24:55.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.109+0000 7f907d59a700 1 -- 172.21.15.81:0/2153453627 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9078001470 con 0x7f9080156030 2023-10-06T03:24:55.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.109+0000 7f907f59e700 1 -- 172.21.15.81:0/2153453627 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9080156030 msgr2=0x7f9080156400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:55.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.109+0000 7f907f59e700 1 --2- 172.21.15.81:0/2153453627 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9080156030 0x7f9080156400 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9070009e60 tx=0x7f9070009780 comp rx=0 tx=0).stop 2023-10-06T03:24:55.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.109+0000 7f907f59e700 1 -- 172.21.15.81:0/2153453627 shutdown_connections 2023-10-06T03:24:55.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.109+0000 7f907f59e700 1 --2- 172.21.15.81:0/2153453627 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9080156030 0x7f9080156400 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:55.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.109+0000 7f907f59e700 1 -- 172.21.15.81:0/2153453627 >> 172.21.15.81:0/2153453627 conn(0x7f90800680b0 msgr2=0x7f90800cbeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:55.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.109+0000 7f907f59e700 1 -- 172.21.15.81:0/2153453627 shutdown_connections 2023-10-06T03:24:55.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.109+0000 7f907f59e700 1 -- 172.21.15.81:0/2153453627 wait complete. 2023-10-06T03:24:55.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.111+0000 7f907f59e700 1 Processor -- start 2023-10-06T03:24:55.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.111+0000 7f907f59e700 1 -- start start 2023-10-06T03:24:55.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.112+0000 7f907f59e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f908006e510 0x7f90800c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:55.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.112+0000 7f907f59e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f908006e990 0x7f908016d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:55.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.112+0000 7f907f59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9080156030 0x7f9080159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:55.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.112+0000 7f907f59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9080167b80 con 0x7f9080156030 2023-10-06T03:24:55.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.112+0000 7f907f59e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9080167e60 con 0x7f908006e990 2023-10-06T03:24:55.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.112+0000 7f907f59e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90800c1c40 con 0x7f908006e510 2023-10-06T03:24:55.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.112+0000 7f907ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9080156030 0x7f9080159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:55.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.112+0000 7f907ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9080156030 0x7f9080159b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42182/0 (socket says 172.21.15.81:42182) 2023-10-06T03:24:55.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.112+0000 7f907ed9d700 1 -- 172.21.15.81:0/751059567 learned_addr learned my addr 172.21.15.81:0/751059567 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:55.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.112+0000 7f907e59c700 1 --2- 172.21.15.81:0/751059567 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f908006e510 0x7f90800c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:55.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.112+0000 7f907dd9b700 1 --2- 172.21.15.81:0/751059567 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f908006e990 0x7f908016d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:55.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.112+0000 7f907ed9d700 1 -- 172.21.15.81:0/751059567 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f908006e510 msgr2=0x7f90800c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:55.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.112+0000 7f907ed9d700 1 --2- 172.21.15.81:0/751059567 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f908006e510 0x7f90800c13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:55.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.112+0000 7f907ed9d700 1 -- 172.21.15.81:0/751059567 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f908006e990 msgr2=0x7f908016d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:55.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.112+0000 7f907ed9d700 1 --2- 172.21.15.81:0/751059567 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f908006e990 0x7f908016d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:55.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.112+0000 7f907ed9d700 1 -- 172.21.15.81:0/751059567 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9070009a20 con 0x7f9080156030 2023-10-06T03:24:55.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.113+0000 7f907ed9d700 1 --2- 172.21.15.81:0/751059567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9080156030 0x7f9080159b20 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f907800cb60 tx=0x7f9078001aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:55.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.113+0000 7f906e7fc700 1 -- 172.21.15.81:0/751059567 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9078001d30 con 0x7f9080156030 2023-10-06T03:24:55.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.113+0000 7f906e7fc700 1 -- 172.21.15.81:0/751059567 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9078007360 con 0x7f9080156030 2023-10-06T03:24:55.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.113+0000 7f907f59e700 1 -- 172.21.15.81:0/751059567 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90800c1f20 con 0x7f9080156030 2023-10-06T03:24:55.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.113+0000 7f906e7fc700 1 -- 172.21.15.81:0/751059567 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9078004830 con 0x7f9080156030 2023-10-06T03:24:55.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.113+0000 7f907f59e700 1 -- 172.21.15.81:0/751059567 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90800c18f0 con 0x7f9080156030 2023-10-06T03:24:55.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.114+0000 7f907f59e700 1 -- 172.21.15.81:0/751059567 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9080168010 con 0x7f9080156030 2023-10-06T03:24:55.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.115+0000 7f906e7fc700 1 -- 172.21.15.81:0/751059567 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9078004c20 con 0x7f9080156030 2023-10-06T03:24:55.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.115+0000 7f906e7fc700 1 --2- 172.21.15.81:0/751059567 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f9060066f30 0x7f90600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:55.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.116+0000 7f906e7fc700 1 -- 172.21.15.81:0/751059567 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f9078083ef0 con 0x7f9080156030 2023-10-06T03:24:55.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.116+0000 7f907e59c700 1 --2- 172.21.15.81:0/751059567 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f9060066f30 0x7f90600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:55.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.116+0000 7f907e59c700 1 --2- 172.21.15.81:0/751059567 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f9060066f30 0x7f90600693e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f90700099f0 tx=0x7f9070017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:55.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.120+0000 7f906e7fc700 1 -- 172.21.15.81:0/751059567 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9080168010 con 0x7f9080156030 2023-10-06T03:24:55.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.355+0000 7f907f59e700 1 -- 172.21.15.81:0/751059567 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f9080167fd0 con 0x7f9080156030 2023-10-06T03:24:55.862 INFO:tasks.ceph.mds.a.smithi081.stderr:2023-10-06T03:24:55.860+0000 7f0a317f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T03:24:55.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.906+0000 7f906e7fc700 1 -- 172.21.15.81:0/751059567 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9078018020 con 0x7f9080156030 2023-10-06T03:24:55.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.909+0000 7f907f59e700 1 -- 172.21.15.81:0/751059567 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f9060066f30 msgr2=0x7f90600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:55.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.909+0000 7f907f59e700 1 --2- 172.21.15.81:0/751059567 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f9060066f30 0x7f90600693e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f90700099f0 tx=0x7f9070017000 comp rx=0 tx=0).stop 2023-10-06T03:24:55.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.909+0000 7f907f59e700 1 -- 172.21.15.81:0/751059567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9080156030 msgr2=0x7f9080159b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:55.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.909+0000 7f907f59e700 1 --2- 172.21.15.81:0/751059567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9080156030 0x7f9080159b20 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f907800cb60 tx=0x7f9078001aa0 comp rx=0 tx=0).stop 2023-10-06T03:24:55.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.909+0000 7f907f59e700 1 -- 172.21.15.81:0/751059567 shutdown_connections 2023-10-06T03:24:55.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.909+0000 7f907f59e700 1 --2- 172.21.15.81:0/751059567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9080156030 0x7f9080159b20 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:55.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.909+0000 7f907f59e700 1 --2- 172.21.15.81:0/751059567 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f9060066f30 0x7f90600693e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:55.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.909+0000 7f907f59e700 1 --2- 172.21.15.81:0/751059567 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f908006e510 0x7f90800c13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:55.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.909+0000 7f907f59e700 1 --2- 172.21.15.81:0/751059567 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f908006e990 0x7f908016d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:55.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.909+0000 7f907f59e700 1 -- 172.21.15.81:0/751059567 >> 172.21.15.81:0/751059567 conn(0x7f90800680b0 msgr2=0x7f90800b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:55.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.909+0000 7f907f59e700 1 -- 172.21.15.81:0/751059567 shutdown_connections 2023-10-06T03:24:55.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:55.909+0000 7f907f59e700 1 -- 172.21.15.81:0/751059567 wait complete. 2023-10-06T03:24:55.931 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:24:56.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.112+0000 7fc7d89fe700 1 Processor -- start 2023-10-06T03:24:56.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.113+0000 7fc7d89fe700 1 -- start start 2023-10-06T03:24:56.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.114+0000 7fc7d89fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc7d4156220 0x7fc7d40ab7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:56.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.114+0000 7fc7d89fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc7d406eaf0 0x7fc7d41565f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:56.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.114+0000 7fc7d89fe700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7d40b0910 con 0x7fc7d40a6730 2023-10-06T03:24:56.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.114+0000 7fc7d89fe700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7d40b0390 con 0x7fc7d4156220 2023-10-06T03:24:56.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.114+0000 7fc7d89fe700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7d4157800 con 0x7fc7d406eaf0 2023-10-06T03:24:56.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.114+0000 7fc7d2d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc7d4156220 0x7fc7d40ab7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:56.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.114+0000 7fc7d2d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc7d4156220 0x7fc7d40ab7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42198/0 (socket says 172.21.15.81:42198) 2023-10-06T03:24:56.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.114+0000 7fc7d2d9d700 1 -- 172.21.15.81:0/1671208284 learned_addr learned my addr 172.21.15.81:0/1671208284 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:56.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.114+0000 7fc7d2d9d700 1 -- 172.21.15.81:0/1671208284 >> v2:172.21.15.83:3300/0 conn(0x7fc7d406eaf0 msgr2=0x7fc7d41565f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:56.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.114+0000 7fc7d359e700 1 --2- 172.21.15.81:0/1671208284 >> v2:172.21.15.83:3300/0 conn(0x7fc7d406eaf0 0x7fc7d41565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:56.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.114+0000 7fc7d2d9d700 1 --2- 172.21.15.81:0/1671208284 >> v2:172.21.15.83:3300/0 conn(0x7fc7d406eaf0 0x7fc7d41565f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:56.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.115+0000 7fc7d2d9d700 1 -- 172.21.15.81:0/1671208284 >> v1:172.21.15.83:6789/0 conn(0x7fc7d40a6730 legacy=0x7fc7d406e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:56.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.115+0000 7fc7d2d9d700 1 -- 172.21.15.81:0/1671208284 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d4157240 con 0x7fc7d4156220 2023-10-06T03:24:56.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.115+0000 7fc7d359e700 1 --2- 172.21.15.81:0/1671208284 >> v2:172.21.15.83:3300/0 conn(0x7fc7d406eaf0 0x7fc7d41565f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:56.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.115+0000 7fc7d2d9d700 1 --2- 172.21.15.81:0/1671208284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7d4156220 0x7fc7d40ab7b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4068bf0 tx=0x7fc7c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be78047cf90013b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:56.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.115+0000 7fc7d1d9b700 1 -- 172.21.15.81:0/1671208284 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c400b820 con 0x7fc7d4156220 2023-10-06T03:24:56.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.115+0000 7fc7d1d9b700 1 -- 172.21.15.81:0/1671208284 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c400b980 con 0x7fc7d4156220 2023-10-06T03:24:56.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.115+0000 7fc7d1d9b700 1 -- 172.21.15.81:0/1671208284 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c400bd20 con 0x7fc7d4156220 2023-10-06T03:24:56.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.116+0000 7fc7d89fe700 1 -- 172.21.15.81:0/1671208284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7d4156220 msgr2=0x7fc7d40ab7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:56.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.116+0000 7fc7d89fe700 1 --2- 172.21.15.81:0/1671208284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7d4156220 0x7fc7d40ab7b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4068bf0 tx=0x7fc7c4009250 comp rx=0 tx=0).stop 2023-10-06T03:24:56.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.116+0000 7fc7d89fe700 1 -- 172.21.15.81:0/1671208284 shutdown_connections 2023-10-06T03:24:56.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.116+0000 7fc7d89fe700 1 --2- 172.21.15.81:0/1671208284 >> v2:172.21.15.83:3300/0 conn(0x7fc7d406eaf0 0x7fc7d41565f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:56.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.116+0000 7fc7d89fe700 1 --2- 172.21.15.81:0/1671208284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7d4156220 0x7fc7d40ab7b0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:56.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.116+0000 7fc7d89fe700 1 -- 172.21.15.81:0/1671208284 >> 172.21.15.81:0/1671208284 conn(0x7fc7d40cbef0 msgr2=0x7fc7d40cc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:56.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.116+0000 7fc7d89fe700 1 -- 172.21.15.81:0/1671208284 shutdown_connections 2023-10-06T03:24:56.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.116+0000 7fc7d89fe700 1 -- 172.21.15.81:0/1671208284 wait complete. 2023-10-06T03:24:56.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.117+0000 7fc7d89fe700 1 Processor -- start 2023-10-06T03:24:56.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.117+0000 7fc7d89fe700 1 -- start start 2023-10-06T03:24:56.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.118+0000 7fc7d89fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7d406eaf0 0x7fc7d4157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:56.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.118+0000 7fc7d89fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7d40a6730 0x7fc7d416e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:56.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.118+0000 7fc7d89fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc7d4156220 0x7fc7d40abe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:56.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.118+0000 7fc7d89fe700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d414a2c0 con 0x7fc7d40a6730 2023-10-06T03:24:56.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.119+0000 7fc7d89fe700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d4171510 con 0x7fc7d406eaf0 2023-10-06T03:24:56.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.119+0000 7fc7d89fe700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d4172090 con 0x7fc7d4156220 2023-10-06T03:24:56.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.119+0000 7fc7d259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7d40a6730 0x7fc7d416e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:56.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.119+0000 7fc7d259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7d40a6730 0x7fc7d416e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42200/0 (socket says 172.21.15.81:42200) 2023-10-06T03:24:56.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.119+0000 7fc7d259c700 1 -- 172.21.15.81:0/4004635621 learned_addr learned my addr 172.21.15.81:0/4004635621 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:56.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.119+0000 7fc7d2d9d700 1 --2- 172.21.15.81:0/4004635621 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7d406eaf0 0x7fc7d4157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:56.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.119+0000 7fc7d359e700 1 --2- 172.21.15.81:0/4004635621 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc7d4156220 0x7fc7d40abe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:56.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.119+0000 7fc7d259c700 1 -- 172.21.15.81:0/4004635621 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc7d4156220 msgr2=0x7fc7d40abe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:56.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.119+0000 7fc7d259c700 1 --2- 172.21.15.81:0/4004635621 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc7d4156220 0x7fc7d40abe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:56.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.119+0000 7fc7d259c700 1 -- 172.21.15.81:0/4004635621 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7d406eaf0 msgr2=0x7fc7d4157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:56.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.119+0000 7fc7d259c700 1 --2- 172.21.15.81:0/4004635621 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7d406eaf0 0x7fc7d4157ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:56.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.119+0000 7fc7d259c700 1 -- 172.21.15.81:0/4004635621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c40094f0 con 0x7fc7d40a6730 2023-10-06T03:24:56.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.119+0000 7fc7d259c700 1 --2- 172.21.15.81:0/4004635621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7d40a6730 0x7fc7d416e630 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc7c800c590 tx=0x7fc7c8007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:56.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.120+0000 7fc7baffd700 1 -- 172.21.15.81:0/4004635621 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c8011590 con 0x7fc7d40a6730 2023-10-06T03:24:56.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.120+0000 7fc7baffd700 1 -- 172.21.15.81:0/4004635621 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c8011730 con 0x7fc7d40a6730 2023-10-06T03:24:56.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.120+0000 7fc7baffd700 1 -- 172.21.15.81:0/4004635621 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c8011af0 con 0x7fc7d40a6730 2023-10-06T03:24:56.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.120+0000 7fc7d89fe700 1 -- 172.21.15.81:0/4004635621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7d4171760 con 0x7fc7d40a6730 2023-10-06T03:24:56.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.120+0000 7fc7d89fe700 1 -- 172.21.15.81:0/4004635621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7d4171d20 con 0x7fc7d40a6730 2023-10-06T03:24:56.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.121+0000 7fc7d89fe700 1 -- 172.21.15.81:0/4004635621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7d4172240 con 0x7fc7d40a6730 2023-10-06T03:24:56.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.122+0000 7fc7baffd700 1 -- 172.21.15.81:0/4004635621 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc7c801c460 con 0x7fc7d40a6730 2023-10-06T03:24:56.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.123+0000 7fc7baffd700 1 --2- 172.21.15.81:0/4004635621 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc7c0066f30 0x7fc7c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:56.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.123+0000 7fc7baffd700 1 -- 172.21.15.81:0/4004635621 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fc7c8084620 con 0x7fc7d40a6730 2023-10-06T03:24:56.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.123+0000 7fc7d2d9d700 1 --2- 172.21.15.81:0/4004635621 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc7c0066f30 0x7fc7c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:56.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.123+0000 7fc7d2d9d700 1 --2- 172.21.15.81:0/4004635621 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc7c0066f30 0x7fc7c00693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4068bf0 tx=0x7fc7c4016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:56.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.126+0000 7fc7baffd700 1 -- 172.21.15.81:0/4004635621 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc7d4172240 con 0x7fc7d40a6730 2023-10-06T03:24:56.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.358+0000 7fc7d89fe700 1 -- 172.21.15.81:0/4004635621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc7d4172420 con 0x7fc7d40a6730 2023-10-06T03:24:56.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.359+0000 7fc7baffd700 1 -- 172.21.15.81:0/4004635621 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4594 (secure 0 0 0) 0x7fc7c8051550 con 0x7fc7d40a6730 2023-10-06T03:24:56.361 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:24:56.361 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5065,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6834/822949628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":822949628},{"type":"v1","addr":"172.21.15.83:6834","nonce":822949628}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5068,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3024690603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6833","nonce":3024690603},{"type":"v1","addr":"172.21.15.83:6835","nonce":3024690603}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5074,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2638072815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2638072815},{"type":"v1","addr":"172.21.15.81:6837","nonce":2638072815}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:24:52.345868+0000","modified":"2023-10-06T03:24:55.900366+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5121},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5121":{"gid":5121,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6835/2789471208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2789471208},{"type":"v1","addr":"172.21.15.81:6835","nonce":2789471208}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T03:24:56.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.361+0000 7fc7d89fe700 1 -- 172.21.15.81:0/4004635621 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc7c0066f30 msgr2=0x7fc7c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:56.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.361+0000 7fc7d89fe700 1 --2- 172.21.15.81:0/4004635621 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc7c0066f30 0x7fc7c00693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4068bf0 tx=0x7fc7c4016000 comp rx=0 tx=0).stop 2023-10-06T03:24:56.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.361+0000 7fc7d89fe700 1 -- 172.21.15.81:0/4004635621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7d40a6730 msgr2=0x7fc7d416e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:56.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.361+0000 7fc7d89fe700 1 --2- 172.21.15.81:0/4004635621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7d40a6730 0x7fc7d416e630 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc7c800c590 tx=0x7fc7c8007f30 comp rx=0 tx=0).stop 2023-10-06T03:24:56.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.361+0000 7fc7d89fe700 1 -- 172.21.15.81:0/4004635621 shutdown_connections 2023-10-06T03:24:56.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.361+0000 7fc7d89fe700 1 --2- 172.21.15.81:0/4004635621 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc7c0066f30 0x7fc7c00693e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:56.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.361+0000 7fc7d89fe700 1 --2- 172.21.15.81:0/4004635621 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc7d4156220 0x7fc7d40abe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:56.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.361+0000 7fc7d89fe700 1 --2- 172.21.15.81:0/4004635621 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7d406eaf0 0x7fc7d4157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:56.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.361+0000 7fc7d89fe700 1 --2- 172.21.15.81:0/4004635621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7d40a6730 0x7fc7d416e630 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:56.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.361+0000 7fc7d89fe700 1 -- 172.21.15.81:0/4004635621 >> 172.21.15.81:0/4004635621 conn(0x7fc7d40cbef0 msgr2=0x7fc7d406d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:56.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.361+0000 7fc7d89fe700 1 -- 172.21.15.81:0/4004635621 shutdown_connections 2023-10-06T03:24:56.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.361+0000 7fc7d89fe700 1 -- 172.21.15.81:0/4004635621 wait complete. 2023-10-06T03:24:56.364 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 18 2023-10-06T03:24:56.381 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:24:56.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.559+0000 7fc9ae1ff700 1 Processor -- start 2023-10-06T03:24:56.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.559+0000 7fc9ae1ff700 1 -- start start 2023-10-06T03:24:56.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.560+0000 7fc9ae1ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9a813f9c0 0x7fc9a80ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:56.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.560+0000 7fc9ae1ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc9a80cab60 0x7fc9a8159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:56.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.561+0000 7fc9ae1ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc9a813fd90 0x7fc9a815a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:56.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.561+0000 7fc9ae1ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9a80cafe0 con 0x7fc9a813fd90 2023-10-06T03:24:56.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.561+0000 7fc9ae1ff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9a80cb2c0 con 0x7fc9a80cab60 2023-10-06T03:24:56.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.561+0000 7fc9ae1ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a80cb5a0 con 0x7fc9a813f9c0 2023-10-06T03:24:56.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.561+0000 7fc9a7fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc9a813fd90 0x7fc9a815a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:56.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.561+0000 7fc9a7fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc9a813fd90 0x7fc9a815a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42204/0 (socket says 172.21.15.81:42204) 2023-10-06T03:24:56.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.561+0000 7fc9a7fff700 1 -- 172.21.15.81:0/2535900715 learned_addr learned my addr 172.21.15.81:0/2535900715 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:56.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.561+0000 7fc9a77fe700 1 --2- 172.21.15.81:0/2535900715 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9a813f9c0 0x7fc9a80ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:56.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.561+0000 7fc99ffff700 1 --2- 172.21.15.81:0/2535900715 >> v2:172.21.15.83:3300/0 conn(0x7fc9a80cab60 0x7fc9a8159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:56.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.561+0000 7fc9a7fff700 1 -- 172.21.15.81:0/2535900715 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9a813f9c0 msgr2=0x7fc9a80ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:56.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.561+0000 7fc9a7fff700 1 --2- 172.21.15.81:0/2535900715 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9a813f9c0 0x7fc9a80ca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:56.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.561+0000 7fc9a7fff700 1 -- 172.21.15.81:0/2535900715 >> v2:172.21.15.83:3300/0 conn(0x7fc9a80cab60 msgr2=0x7fc9a8159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:56.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.561+0000 7fc9a7fff700 1 --2- 172.21.15.81:0/2535900715 >> v2:172.21.15.83:3300/0 conn(0x7fc9a80cab60 0x7fc9a8159eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:56.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.561+0000 7fc9a7fff700 1 -- 172.21.15.81:0/2535900715 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a80cb880 con 0x7fc9a813fd90 2023-10-06T03:24:56.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.562+0000 7fc9a7fff700 1 --2- 172.21.15.81:0/2535900715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9a813fd90 0x7fc9a815a3f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc9a80c9ba0 tx=0x7fc9a0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97f07fa2fcd7b583 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:56.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.562+0000 7fc9a6ffd700 1 -- 172.21.15.81:0/2535900715 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a000e070 con 0x7fc9a813fd90 2023-10-06T03:24:56.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.562+0000 7fc9a6ffd700 1 -- 172.21.15.81:0/2535900715 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a000ba50 con 0x7fc9a813fd90 2023-10-06T03:24:56.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.562+0000 7fc9a6ffd700 1 -- 172.21.15.81:0/2535900715 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a00092e0 con 0x7fc9a813fd90 2023-10-06T03:24:56.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.562+0000 7fc9ae1ff700 1 -- 172.21.15.81:0/2535900715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9a813fd90 msgr2=0x7fc9a815a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:56.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.562+0000 7fc9ae1ff700 1 --2- 172.21.15.81:0/2535900715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9a813fd90 0x7fc9a815a3f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc9a80c9ba0 tx=0x7fc9a0009840 comp rx=0 tx=0).stop 2023-10-06T03:24:56.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.562+0000 7fc9ae1ff700 1 -- 172.21.15.81:0/2535900715 shutdown_connections 2023-10-06T03:24:56.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.562+0000 7fc9ae1ff700 1 --2- 172.21.15.81:0/2535900715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9a813fd90 0x7fc9a815a3f0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:56.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.562+0000 7fc9ae1ff700 1 --2- 172.21.15.81:0/2535900715 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9a813f9c0 0x7fc9a80ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:56.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.562+0000 7fc9ae1ff700 1 --2- 172.21.15.81:0/2535900715 >> v2:172.21.15.83:3300/0 conn(0x7fc9a80cab60 0x7fc9a8159eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:56.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.562+0000 7fc9ae1ff700 1 -- 172.21.15.81:0/2535900715 >> 172.21.15.81:0/2535900715 conn(0x7fc9a80cc090 msgr2=0x7fc9a80cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:56.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.563+0000 7fc9ae1ff700 1 -- 172.21.15.81:0/2535900715 shutdown_connections 2023-10-06T03:24:56.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.563+0000 7fc9ae1ff700 1 -- 172.21.15.81:0/2535900715 wait complete. 2023-10-06T03:24:56.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.564+0000 7fc9ae1ff700 1 Processor -- start 2023-10-06T03:24:56.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.564+0000 7fc9ae1ff700 1 -- start start 2023-10-06T03:24:56.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.565+0000 7fc9ae1ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9a813f9c0 0x7fc9a8159400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:56.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.565+0000 7fc9ae1ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9a813fd90 0x7fc9a80c3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:56.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.565+0000 7fc9ae1ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9a80c4040 0x7fc9a80c1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:56.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.565+0000 7fc9ae1ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a8159940 con 0x7fc9a80c4040 2023-10-06T03:24:56.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.565+0000 7fc9ae1ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a80c1a40 con 0x7fc9a813f9c0 2023-10-06T03:24:56.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.565+0000 7fc9ae1ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a80c0e30 con 0x7fc9a813fd90 2023-10-06T03:24:56.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.565+0000 7fc9a7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9a80c4040 0x7fc9a80c1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:56.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.565+0000 7fc9a7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9a80c4040 0x7fc9a80c1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42214/0 (socket says 172.21.15.81:42214) 2023-10-06T03:24:56.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.565+0000 7fc9a7fff700 1 -- 172.21.15.81:0/1123032753 learned_addr learned my addr 172.21.15.81:0/1123032753 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:56.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.565+0000 7fc9a77fe700 1 --2- 172.21.15.81:0/1123032753 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9a813f9c0 0x7fc9a8159400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:56.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.565+0000 7fc99ffff700 1 --2- 172.21.15.81:0/1123032753 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9a813fd90 0x7fc9a80c3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:56.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.566+0000 7fc9a7fff700 1 -- 172.21.15.81:0/1123032753 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9a813fd90 msgr2=0x7fc9a80c3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:56.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.566+0000 7fc9a7fff700 1 --2- 172.21.15.81:0/1123032753 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9a813fd90 0x7fc9a80c3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:56.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.566+0000 7fc9a7fff700 1 -- 172.21.15.81:0/1123032753 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9a813f9c0 msgr2=0x7fc9a8159400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:56.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.566+0000 7fc9a7fff700 1 --2- 172.21.15.81:0/1123032753 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9a813f9c0 0x7fc9a8159400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:56.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.566+0000 7fc9a7fff700 1 -- 172.21.15.81:0/1123032753 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a0009ae0 con 0x7fc9a80c4040 2023-10-06T03:24:56.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.566+0000 7fc9a7fff700 1 --2- 172.21.15.81:0/1123032753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9a80c4040 0x7fc9a80c1ed0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc9a80690e0 tx=0x7fc9a0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:56.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.566+0000 7fc99f7fe700 1 -- 172.21.15.81:0/1123032753 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a00032f0 con 0x7fc9a80c4040 2023-10-06T03:24:56.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.566+0000 7fc99f7fe700 1 -- 172.21.15.81:0/1123032753 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a0008ce0 con 0x7fc9a80c4040 2023-10-06T03:24:56.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.566+0000 7fc9ae1ff700 1 -- 172.21.15.81:0/1123032753 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9a80c1110 con 0x7fc9a80c4040 2023-10-06T03:24:56.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.566+0000 7fc99f7fe700 1 -- 172.21.15.81:0/1123032753 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a00256b0 con 0x7fc9a80c4040 2023-10-06T03:24:56.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.566+0000 7fc9ae1ff700 1 -- 172.21.15.81:0/1123032753 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9a80c16d0 con 0x7fc9a80c4040 2023-10-06T03:24:56.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.567+0000 7fc9ae1ff700 1 -- 172.21.15.81:0/1123032753 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9a804c3c0 con 0x7fc9a80c4040 2023-10-06T03:24:56.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.568+0000 7fc99f7fe700 1 -- 172.21.15.81:0/1123032753 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc9a0003040 con 0x7fc9a80c4040 2023-10-06T03:24:56.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.569+0000 7fc99f7fe700 1 --2- 172.21.15.81:0/1123032753 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc988066f30 0x7fc9880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:56.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.569+0000 7fc99f7fe700 1 -- 172.21.15.81:0/1123032753 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fc9a0085dd0 con 0x7fc9a80c4040 2023-10-06T03:24:56.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.569+0000 7fc9a77fe700 1 --2- 172.21.15.81:0/1123032753 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc988066f30 0x7fc9880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:56.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.570+0000 7fc9a77fe700 1 --2- 172.21.15.81:0/1123032753 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc988066f30 0x7fc9880693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc998006fd0 tx=0x7fc998008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:56.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.574+0000 7fc99f7fe700 1 -- 172.21.15.81:0/1123032753 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc9a0052d00 con 0x7fc9a80c4040 2023-10-06T03:24:56.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.764+0000 7fc9ae1ff700 1 -- 172.21.15.81:0/1123032753 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9a80c1b80 con 0x7fc9a80c4040 2023-10-06T03:24:56.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.765+0000 7fc99f7fe700 1 -- 172.21.15.81:0/1123032753 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+17023 (secure 0 0 0) 0x7fc9a0009940 con 0x7fc9a80c4040 2023-10-06T03:24:56.768 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:24:56.768 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":38,"fsid":"1807b5d7-9be8-43ad-aaf8-99a4273430b3","created":"2023-10-06T03:23:20.805306+0000","modified":"2023-10-06T03:24:53.885414+0000","last_up_change":"2023-10-06T03:23:32.735796+0000","last_in_change":"2023-10-06T03:23:24.109024+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:33.198850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:33.606744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:24:50.339463+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T03:24:51.333980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"14fb667d-a677-4978-a477-80027f889d36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":85563},{"type":"v1","addr":"172.21.15.81:6818","nonce":85563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":85563},{"type":"v1","addr":"172.21.15.81:6822","nonce":85563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":85563},{"type":"v1","addr":"172.21.15.81:6830","nonce":85563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":85563},{"type":"v1","addr":"172.21.15.81:6826","nonce":85563}]},"public_addr":"172.21.15.81:6818/85563","cluster_addr":"172.21.15.81:6822/85563","heartbeat_back_addr":"172.21.15.81:6830/85563","heartbeat_front_addr":"172.21.15.81:6826/85563","state":["exists","up"]},{"osd":1,"uuid":"974d8a86-1829-4176-89ce-18e6038857f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":85561},{"type":"v1","addr":"172.21.15.81:6801","nonce":85561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":85561},{"type":"v1","addr":"172.21.15.81:6803","nonce":85561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":85561},{"type":"v1","addr":"172.21.15.81:6807","nonce":85561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":85561},{"type":"v1","addr":"172.21.15.81:6805","nonce":85561}]},"public_addr":"172.21.15.81:6801/85561","cluster_addr":"172.21.15.81:6803/85561","heartbeat_back_addr":"172.21.15.81:6807/85561","heartbeat_front_addr":"172.21.15.81:6805/85561","state":["exists","up"]},{"osd":2,"uuid":"ffbfe056-46bc-46e0-bf49-4d8f8650e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":85564},{"type":"v1","addr":"172.21.15.81:6809","nonce":85564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":85564},{"type":"v1","addr":"172.21.15.81:6811","nonce":85564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":85564},{"type":"v1","addr":"172.21.15.81:6815","nonce":85564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":85564},{"type":"v1","addr":"172.21.15.81:6813","nonce":85564}]},"public_addr":"172.21.15.81:6809/85564","cluster_addr":"172.21.15.81:6811/85564","heartbeat_back_addr":"172.21.15.81:6815/85564","heartbeat_front_addr":"172.21.15.81:6813/85564","state":["exists","up"]},{"osd":3,"uuid":"ef9a8314-3d37-4ea1-858a-e704d5695002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":85562},{"type":"v1","addr":"172.21.15.81:6819","nonce":85562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":85562},{"type":"v1","addr":"172.21.15.81:6823","nonce":85562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":85562},{"type":"v1","addr":"172.21.15.81:6831","nonce":85562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":85562},{"type":"v1","addr":"172.21.15.81:6827","nonce":85562}]},"public_addr":"172.21.15.81:6819/85562","cluster_addr":"172.21.15.81:6823/85562","heartbeat_back_addr":"172.21.15.81:6831/85562","heartbeat_front_addr":"172.21.15.81:6827/85562","state":["exists","up"]},{"osd":4,"uuid":"d83506a0-2c96-4bcb-a9fa-05e43dc329df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":85785},{"type":"v1","addr":"172.21.15.83:6801","nonce":85785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":85785},{"type":"v1","addr":"172.21.15.83:6803","nonce":85785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":85785},{"type":"v1","addr":"172.21.15.83:6807","nonce":85785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":85785},{"type":"v1","addr":"172.21.15.83:6805","nonce":85785}]},"public_addr":"172.21.15.83:6801/85785","cluster_addr":"172.21.15.83:6803/85785","heartbeat_back_addr":"172.21.15.83:6807/85785","heartbeat_front_addr":"172.21.15.83:6805/85785","state":["exists","up"]},{"osd":5,"uuid":"10687c63-a3d5-472f-acc0-4f61847b6e0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":85818},{"type":"v1","addr":"172.21.15.83:6825","nonce":85818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":85818},{"type":"v1","addr":"172.21.15.83:6827","nonce":85818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":85818},{"type":"v1","addr":"172.21.15.83:6831","nonce":85818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":85818},{"type":"v1","addr":"172.21.15.83:6829","nonce":85818}]},"public_addr":"172.21.15.83:6825/85818","cluster_addr":"172.21.15.83:6827/85818","heartbeat_back_addr":"172.21.15.83:6831/85818","heartbeat_front_addr":"172.21.15.83:6829/85818","state":["exists","up"]},{"osd":6,"uuid":"2e9daf76-5607-4a29-9a58-6e270700d223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":85787},{"type":"v1","addr":"172.21.15.83:6811","nonce":85787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":85787},{"type":"v1","addr":"172.21.15.83:6815","nonce":85787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":85787},{"type":"v1","addr":"172.21.15.83:6823","nonce":85787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6817","nonce":85787},{"type":"v1","addr":"172.21.15.83:6819","nonce":85787}]},"public_addr":"172.21.15.83:6811/85787","cluster_addr":"172.21.15.83:6815/85787","heartbeat_back_addr":"172.21.15.83:6823/85787","heartbeat_front_addr":"172.21.15.83:6819/85787","state":["exists","up"]},{"osd":7,"uuid":"5019e1ff-233a-4a5a-91ca-8afccb7ab6e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":85786},{"type":"v1","addr":"172.21.15.83:6810","nonce":85786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":85786},{"type":"v1","addr":"172.21.15.83:6814","nonce":85786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":85786},{"type":"v1","addr":"172.21.15.83:6822","nonce":85786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":85786},{"type":"v1","addr":"172.21.15.83:6818","nonce":85786}]},"public_addr":"172.21.15.83:6810/85786","cluster_addr":"172.21.15.83:6814/85786","heartbeat_back_addr":"172.21.15.83:6822/85786","heartbeat_front_addr":"172.21.15.83:6818/85786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.393431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.360031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.407428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.391613+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.403211+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.438142+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.496181+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.472323+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:24:56.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.768+0000 7fc9ae1ff700 1 -- 172.21.15.81:0/1123032753 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc988066f30 msgr2=0x7fc9880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:56.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.768+0000 7fc9ae1ff700 1 --2- 172.21.15.81:0/1123032753 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc988066f30 0x7fc9880693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc998006fd0 tx=0x7fc998008040 comp rx=0 tx=0).stop 2023-10-06T03:24:56.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.768+0000 7fc9ae1ff700 1 -- 172.21.15.81:0/1123032753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9a80c4040 msgr2=0x7fc9a80c1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:56.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.768+0000 7fc9ae1ff700 1 --2- 172.21.15.81:0/1123032753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9a80c4040 0x7fc9a80c1ed0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc9a80690e0 tx=0x7fc9a0018000 comp rx=0 tx=0).stop 2023-10-06T03:24:56.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.768+0000 7fc9ae1ff700 1 -- 172.21.15.81:0/1123032753 shutdown_connections 2023-10-06T03:24:56.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.768+0000 7fc9ae1ff700 1 --2- 172.21.15.81:0/1123032753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9a80c4040 0x7fc9a80c1ed0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:56.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.768+0000 7fc9ae1ff700 1 --2- 172.21.15.81:0/1123032753 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9a813f9c0 0x7fc9a8159400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:56.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.768+0000 7fc9ae1ff700 1 --2- 172.21.15.81:0/1123032753 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc988066f30 0x7fc9880693e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:56.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.768+0000 7fc9ae1ff700 1 --2- 172.21.15.81:0/1123032753 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9a813fd90 0x7fc9a80c3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:56.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.768+0000 7fc9ae1ff700 1 -- 172.21.15.81:0/1123032753 >> 172.21.15.81:0/1123032753 conn(0x7fc9a80cc090 msgr2=0x7fc9a813ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:56.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.768+0000 7fc9ae1ff700 1 -- 172.21.15.81:0/1123032753 shutdown_connections 2023-10-06T03:24:56.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.768+0000 7fc9ae1ff700 1 -- 172.21.15.81:0/1123032753 wait complete. 2023-10-06T03:24:56.787 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T03:24:56.788 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:24:56.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.969+0000 7f07a9d9d700 1 Processor -- start 2023-10-06T03:24:56.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.969+0000 7f07a9d9d700 1 -- start start 2023-10-06T03:24:56.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.970+0000 7f07a9d9d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f07a40cdc00 0x7f07a406cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:56.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.970+0000 7f07a9d9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f07a413c570 0x7f07a406d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:56.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.970+0000 7f07a9d9d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07a4069430 con 0x7f07a413c1a0 2023-10-06T03:24:56.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.970+0000 7f07a9d9d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07a40cc490 con 0x7f07a40cdc00 2023-10-06T03:24:56.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.970+0000 7f07a9d9d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07a4068820 con 0x7f07a413c570 2023-10-06T03:24:56.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.971+0000 7f07a3fff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f07a40cdc00 0x7f07a406cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:56.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.971+0000 7f07a959c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f07a413c570 0x7f07a406d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:56.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.971+0000 7f07a3fff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f07a40cdc00 0x7f07a406cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:36914/0 (socket says 172.21.15.81:36914) 2023-10-06T03:24:56.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.971+0000 7f07a959c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f07a413c570 0x7f07a406d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:40256/0 (socket says 172.21.15.81:40256) 2023-10-06T03:24:56.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.971+0000 7f07a3fff700 1 -- 172.21.15.81:0/4218026181 learned_addr learned my addr 172.21.15.81:0/4218026181 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:56.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.971+0000 7f07a959c700 1 -- 172.21.15.81:0/4218026181 >> v2:172.21.15.83:3300/0 conn(0x7f07a40cdc00 msgr2=0x7f07a406cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:56.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.971+0000 7f07a959c700 1 --2- 172.21.15.81:0/4218026181 >> v2:172.21.15.83:3300/0 conn(0x7f07a40cdc00 0x7f07a406cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:56.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.971+0000 7f07a959c700 1 -- 172.21.15.81:0/4218026181 >> v1:172.21.15.83:6789/0 conn(0x7f07a413c1a0 legacy=0x7f07a40cbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:56.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.971+0000 7f07a959c700 1 -- 172.21.15.81:0/4218026181 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a4068b00 con 0x7f07a413c570 2023-10-06T03:24:56.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.971+0000 7f07a3fff700 1 --2- 172.21.15.81:0/4218026181 >> v2:172.21.15.83:3300/0 conn(0x7f07a40cdc00 0x7f07a406cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:24:56.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.971+0000 7f07a959c700 1 --2- 172.21.15.81:0/4218026181 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f07a413c570 0x7f07a406d070 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f079c0098e0 tx=0x7f079c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=705efc561696ae5e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:56.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.972+0000 7f07a37fe700 1 -- 172.21.15.81:0/4218026181 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079c00b640 con 0x7f07a413c570 2023-10-06T03:24:56.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.972+0000 7f07a37fe700 1 -- 172.21.15.81:0/4218026181 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f079c00b7a0 con 0x7f07a413c570 2023-10-06T03:24:56.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.972+0000 7f07a37fe700 1 -- 172.21.15.81:0/4218026181 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079c00bb40 con 0x7f07a413c570 2023-10-06T03:24:56.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.972+0000 7f07a9d9d700 1 -- 172.21.15.81:0/4218026181 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f07a413c570 msgr2=0x7f07a406d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:56.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.972+0000 7f07a9d9d700 1 --2- 172.21.15.81:0/4218026181 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f07a413c570 0x7f07a406d070 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f079c0098e0 tx=0x7f079c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:56.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.972+0000 7f07a9d9d700 1 -- 172.21.15.81:0/4218026181 shutdown_connections 2023-10-06T03:24:56.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.972+0000 7f07a9d9d700 1 --2- 172.21.15.81:0/4218026181 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f07a413c570 0x7f07a406d070 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:56.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.972+0000 7f07a9d9d700 1 --2- 172.21.15.81:0/4218026181 >> v2:172.21.15.83:3300/0 conn(0x7f07a40cdc00 0x7f07a406cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:56.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.972+0000 7f07a9d9d700 1 -- 172.21.15.81:0/4218026181 >> 172.21.15.81:0/4218026181 conn(0x7f07a406b520 msgr2=0x7f07a406b920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:56.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.972+0000 7f07a9d9d700 1 -- 172.21.15.81:0/4218026181 shutdown_connections 2023-10-06T03:24:56.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.972+0000 7f07a9d9d700 1 -- 172.21.15.81:0/4218026181 wait complete. 2023-10-06T03:24:56.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.974+0000 7f07a9d9d700 1 Processor -- start 2023-10-06T03:24:56.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.974+0000 7f07a9d9d700 1 -- start start 2023-10-06T03:24:56.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.975+0000 7f07a9d9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07a40cdc00 0x7f07a40c5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:56.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.975+0000 7f07a9d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07a413c1a0 0x7f07a40b2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:56.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.975+0000 7f07a9d9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f07a413c570 0x7f07a40c8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:56.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.975+0000 7f07a9d9d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a40b0ed0 con 0x7f07a413c1a0 2023-10-06T03:24:56.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.975+0000 7f07a9d9d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a40b3140 con 0x7f07a40cdc00 2023-10-06T03:24:56.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.975+0000 7f07a9d9d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07a40c93e0 con 0x7f07a413c570 2023-10-06T03:24:56.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.975+0000 7f07a3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07a413c1a0 0x7f07a40b2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:56.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.975+0000 7f07a3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07a413c1a0 0x7f07a40b2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42216/0 (socket says 172.21.15.81:42216) 2023-10-06T03:24:56.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.975+0000 7f07a3fff700 1 -- 172.21.15.81:0/3074993402 learned_addr learned my addr 172.21.15.81:0/3074993402 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:56.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.975+0000 7f07a8d9b700 1 --2- 172.21.15.81:0/3074993402 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07a40cdc00 0x7f07a40c5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:56.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.975+0000 7f07a959c700 1 --2- 172.21.15.81:0/3074993402 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f07a413c570 0x7f07a40c8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:56.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.975+0000 7f07a3fff700 1 -- 172.21.15.81:0/3074993402 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f07a413c570 msgr2=0x7f07a40c8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:56.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.976+0000 7f07a3fff700 1 --2- 172.21.15.81:0/3074993402 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f07a413c570 0x7f07a40c8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:56.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.976+0000 7f07a3fff700 1 -- 172.21.15.81:0/3074993402 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07a40cdc00 msgr2=0x7f07a40c5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:56.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.976+0000 7f07a3fff700 1 --2- 172.21.15.81:0/3074993402 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07a40cdc00 0x7f07a40c5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:56.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.976+0000 7f07a3fff700 1 -- 172.21.15.81:0/3074993402 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07900094f0 con 0x7f07a413c1a0 2023-10-06T03:24:56.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.976+0000 7f07a959c700 1 --2- 172.21.15.81:0/3074993402 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f07a413c570 0x7f07a40c8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:56.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.976+0000 7f07a3fff700 1 --2- 172.21.15.81:0/3074993402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07a413c1a0 0x7f07a40b2c00 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f079000ec50 tx=0x7f0790009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:56.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.976+0000 7f07a0ff9700 1 -- 172.21.15.81:0/3074993402 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079000c9d0 con 0x7f07a413c1a0 2023-10-06T03:24:56.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.976+0000 7f07a0ff9700 1 -- 172.21.15.81:0/3074993402 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f079000cb30 con 0x7f07a413c1a0 2023-10-06T03:24:56.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.976+0000 7f07a9d9d700 1 -- 172.21.15.81:0/3074993402 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f079c009420 con 0x7f07a413c1a0 2023-10-06T03:24:56.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.976+0000 7f07a0ff9700 1 -- 172.21.15.81:0/3074993402 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0790013470 con 0x7f07a413c1a0 2023-10-06T03:24:56.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.976+0000 7f07a9d9d700 1 -- 172.21.15.81:0/3074993402 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07a40c59e0 con 0x7f07a413c1a0 2023-10-06T03:24:56.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.977+0000 7f07a9d9d700 1 -- 172.21.15.81:0/3074993402 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07a40b1080 con 0x7f07a413c1a0 2023-10-06T03:24:56.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.978+0000 7f07a0ff9700 1 -- 172.21.15.81:0/3074993402 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0790013860 con 0x7f07a413c1a0 2023-10-06T03:24:56.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.979+0000 7f07a0ff9700 1 --2- 172.21.15.81:0/3074993402 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0788066f30 0x7f07880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:56.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.979+0000 7f07a0ff9700 1 -- 172.21.15.81:0/3074993402 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f0790084b40 con 0x7f07a413c1a0 2023-10-06T03:24:56.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.979+0000 7f07a8d9b700 1 --2- 172.21.15.81:0/3074993402 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0788066f30 0x7f07880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:56.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.980+0000 7f07a8d9b700 1 --2- 172.21.15.81:0/3074993402 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0788066f30 0x7f07880693e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0798007fd0 tx=0x7f0798009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:56.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:56.983+0000 7f07a0ff9700 1 -- 172.21.15.81:0/3074993402 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f07a40b1080 con 0x7f07a413c1a0 2023-10-06T03:24:57.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.172+0000 7f07a9d9d700 1 -- 172.21.15.81:0/3074993402 --> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f07a40b1010 con 0x7f0788066f30 2023-10-06T03:24:57.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.182+0000 7f07a0ff9700 1 -- 172.21.15.81:0/3074993402 <== mgr.4100 v2:172.21.15.81:6832/85286 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311471 (secure 0 0 0) 0x7f07a40b1010 con 0x7f0788066f30 2023-10-06T03:24:57.188 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:24:57.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.186+0000 7f07a9d9d700 1 -- 172.21.15.81:0/3074993402 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0788066f30 msgr2=0x7f07880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:57.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.186+0000 7f07a9d9d700 1 --2- 172.21.15.81:0/3074993402 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0788066f30 0x7f07880693e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0798007fd0 tx=0x7f0798009040 comp rx=0 tx=0).stop 2023-10-06T03:24:57.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.186+0000 7f07a9d9d700 1 -- 172.21.15.81:0/3074993402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07a413c1a0 msgr2=0x7f07a40b2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:57.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.186+0000 7f07a9d9d700 1 --2- 172.21.15.81:0/3074993402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07a413c1a0 0x7f07a40b2c00 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f079000ec50 tx=0x7f0790009250 comp rx=0 tx=0).stop 2023-10-06T03:24:57.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.186+0000 7f07a9d9d700 1 -- 172.21.15.81:0/3074993402 shutdown_connections 2023-10-06T03:24:57.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.186+0000 7f07a9d9d700 1 --2- 172.21.15.81:0/3074993402 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0788066f30 0x7f07880693e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:57.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.186+0000 7f07a9d9d700 1 --2- 172.21.15.81:0/3074993402 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f07a413c570 0x7f07a40c8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:57.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.186+0000 7f07a9d9d700 1 --2- 172.21.15.81:0/3074993402 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07a40cdc00 0x7f07a40c5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:57.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.186+0000 7f07a9d9d700 1 --2- 172.21.15.81:0/3074993402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07a413c1a0 0x7f07a40b2c00 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:57.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.186+0000 7f07a9d9d700 1 -- 172.21.15.81:0/3074993402 >> 172.21.15.81:0/3074993402 conn(0x7f07a406b520 msgr2=0x7f07a415ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:57.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.186+0000 7f07a9d9d700 1 -- 172.21.15.81:0/3074993402 shutdown_connections 2023-10-06T03:24:57.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.186+0000 7f07a9d9d700 1 -- 172.21.15.81:0/3074993402 wait complete. 2023-10-06T03:24:57.191 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-06T03:24:57.206 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":72,"stamp":"2023-10-06T03:24:55.569307+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":125,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382800,"kb_used_data":4496,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752591920,"statfs":{"total":773094113280,"available":770654126080,"internally_reserved":0,"allocated":4603904,"data_stored":2687131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.703750"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.897461+0000","last_change":"2023-10-06T03:24:52.897461+0000","last_active":"2023-10-06T03:24:52.897461+0000","last_peered":"2023-10-06T03:24:52.897461+0000","last_clean":"2023-10-06T03:24:52.897461+0000","last_became_active":"2023-10-06T03:24:52.897152+0000","last_became_peered":"2023-10-06T03:24:52.897152+0000","last_unstale":"2023-10-06T03:24:52.897461+0000","last_undegraded":"2023-10-06T03:24:52.897461+0000","last_fullsized":"2023-10-06T03:24:52.897461+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:21:41.768629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.898209+0000","last_change":"2023-10-06T03:24:52.898209+0000","last_active":"2023-10-06T03:24:52.898209+0000","last_peered":"2023-10-06T03:24:52.898209+0000","last_clean":"2023-10-06T03:24:52.898209+0000","last_became_active":"2023-10-06T03:24:52.897942+0000","last_became_peered":"2023-10-06T03:24:52.897942+0000","last_unstale":"2023-10-06T03:24:52.898209+0000","last_undegraded":"2023-10-06T03:24:52.898209+0000","last_fullsized":"2023-10-06T03:24:52.898209+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:19:38.234484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.911044+0000","last_change":"2023-10-06T03:24:52.911044+0000","last_active":"2023-10-06T03:24:52.911044+0000","last_peered":"2023-10-06T03:24:52.911044+0000","last_clean":"2023-10-06T03:24:52.911044+0000","last_became_active":"2023-10-06T03:24:52.910768+0000","last_became_peered":"2023-10-06T03:24:52.910768+0000","last_unstale":"2023-10-06T03:24:52.911044+0000","last_undegraded":"2023-10-06T03:24:52.911044+0000","last_fullsized":"2023-10-06T03:24:52.911044+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:55:10.923774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.906642+0000","last_change":"2023-10-06T03:24:52.906642+0000","last_active":"2023-10-06T03:24:52.906642+0000","last_peered":"2023-10-06T03:24:52.906642+0000","last_clean":"2023-10-06T03:24:52.906642+0000","last_became_active":"2023-10-06T03:24:52.906258+0000","last_became_peered":"2023-10-06T03:24:52.906258+0000","last_unstale":"2023-10-06T03:24:52.906642+0000","last_undegraded":"2023-10-06T03:24:52.906642+0000","last_fullsized":"2023-10-06T03:24:52.906642+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:07:33.466087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.899906+0000","last_change":"2023-10-06T03:24:52.899906+0000","last_active":"2023-10-06T03:24:52.899906+0000","last_peered":"2023-10-06T03:24:52.899906+0000","last_clean":"2023-10-06T03:24:52.899906+0000","last_became_active":"2023-10-06T03:24:52.898552+0000","last_became_peered":"2023-10-06T03:24:52.898552+0000","last_unstale":"2023-10-06T03:24:52.899906+0000","last_undegraded":"2023-10-06T03:24:52.899906+0000","last_fullsized":"2023-10-06T03:24:52.899906+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:25:53.153625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.902889+0000","last_change":"2023-10-06T03:24:52.902889+0000","last_active":"2023-10-06T03:24:52.902889+0000","last_peered":"2023-10-06T03:24:52.902889+0000","last_clean":"2023-10-06T03:24:52.902889+0000","last_became_active":"2023-10-06T03:24:52.902326+0000","last_became_peered":"2023-10-06T03:24:52.902326+0000","last_unstale":"2023-10-06T03:24:52.902889+0000","last_undegraded":"2023-10-06T03:24:52.902889+0000","last_fullsized":"2023-10-06T03:24:52.902889+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:23:00.964971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.904345+0000","last_change":"2023-10-06T03:24:52.904345+0000","last_active":"2023-10-06T03:24:52.904345+0000","last_peered":"2023-10-06T03:24:52.904345+0000","last_clean":"2023-10-06T03:24:52.904345+0000","last_became_active":"2023-10-06T03:24:52.904090+0000","last_became_peered":"2023-10-06T03:24:52.904090+0000","last_unstale":"2023-10-06T03:24:52.904345+0000","last_undegraded":"2023-10-06T03:24:52.904345+0000","last_fullsized":"2023-10-06T03:24:52.904345+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:39:39.788711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.907518+0000","last_change":"2023-10-06T03:24:52.907518+0000","last_active":"2023-10-06T03:24:52.907518+0000","last_peered":"2023-10-06T03:24:52.907518+0000","last_clean":"2023-10-06T03:24:52.907518+0000","last_became_active":"2023-10-06T03:24:52.907099+0000","last_became_peered":"2023-10-06T03:24:52.907099+0000","last_unstale":"2023-10-06T03:24:52.907518+0000","last_undegraded":"2023-10-06T03:24:52.907518+0000","last_fullsized":"2023-10-06T03:24:52.907518+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:55:10.923774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.907375+0000","last_change":"2023-10-06T03:24:52.907375+0000","last_active":"2023-10-06T03:24:52.907375+0000","last_peered":"2023-10-06T03:24:52.907375+0000","last_clean":"2023-10-06T03:24:52.907375+0000","last_became_active":"2023-10-06T03:24:52.906566+0000","last_became_peered":"2023-10-06T03:24:52.906566+0000","last_unstale":"2023-10-06T03:24:52.907375+0000","last_undegraded":"2023-10-06T03:24:52.907375+0000","last_fullsized":"2023-10-06T03:24:52.907375+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:37.077847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.906894+0000","last_change":"2023-10-06T03:24:52.906894+0000","last_active":"2023-10-06T03:24:52.906894+0000","last_peered":"2023-10-06T03:24:52.906894+0000","last_clean":"2023-10-06T03:24:52.906894+0000","last_became_active":"2023-10-06T03:24:52.906619+0000","last_became_peered":"2023-10-06T03:24:52.906619+0000","last_unstale":"2023-10-06T03:24:52.906894+0000","last_undegraded":"2023-10-06T03:24:52.906894+0000","last_fullsized":"2023-10-06T03:24:52.906894+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:57.998695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.909562+0000","last_change":"2023-10-06T03:24:52.909562+0000","last_active":"2023-10-06T03:24:52.909562+0000","last_peered":"2023-10-06T03:24:52.909562+0000","last_clean":"2023-10-06T03:24:52.909562+0000","last_became_active":"2023-10-06T03:24:52.909289+0000","last_became_peered":"2023-10-06T03:24:52.909289+0000","last_unstale":"2023-10-06T03:24:52.909562+0000","last_undegraded":"2023-10-06T03:24:52.909562+0000","last_fullsized":"2023-10-06T03:24:52.909562+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:13:28.806646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.900489+0000","last_change":"2023-10-06T03:24:52.900489+0000","last_active":"2023-10-06T03:24:52.900489+0000","last_peered":"2023-10-06T03:24:52.900489+0000","last_clean":"2023-10-06T03:24:52.900489+0000","last_became_active":"2023-10-06T03:24:52.900121+0000","last_became_peered":"2023-10-06T03:24:52.900121+0000","last_unstale":"2023-10-06T03:24:52.900489+0000","last_undegraded":"2023-10-06T03:24:52.900489+0000","last_fullsized":"2023-10-06T03:24:52.900489+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:13:34.088412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.903126+0000","last_change":"2023-10-06T03:24:52.903126+0000","last_active":"2023-10-06T03:24:52.903126+0000","last_peered":"2023-10-06T03:24:52.903126+0000","last_clean":"2023-10-06T03:24:52.903126+0000","last_became_active":"2023-10-06T03:24:52.902882+0000","last_became_peered":"2023-10-06T03:24:52.902882+0000","last_unstale":"2023-10-06T03:24:52.903126+0000","last_undegraded":"2023-10-06T03:24:52.903126+0000","last_fullsized":"2023-10-06T03:24:52.903126+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:07:34.668603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.905927+0000","last_change":"2023-10-06T03:24:52.905927+0000","last_active":"2023-10-06T03:24:52.905927+0000","last_peered":"2023-10-06T03:24:52.905927+0000","last_clean":"2023-10-06T03:24:52.905927+0000","last_became_active":"2023-10-06T03:24:52.905675+0000","last_became_peered":"2023-10-06T03:24:52.905675+0000","last_unstale":"2023-10-06T03:24:52.905927+0000","last_undegraded":"2023-10-06T03:24:52.905927+0000","last_fullsized":"2023-10-06T03:24:52.905927+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:09:31.423278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.902002+0000","last_change":"2023-10-06T03:24:52.902002+0000","last_active":"2023-10-06T03:24:52.902002+0000","last_peered":"2023-10-06T03:24:52.902002+0000","last_clean":"2023-10-06T03:24:52.902002+0000","last_became_active":"2023-10-06T03:24:52.901518+0000","last_became_peered":"2023-10-06T03:24:52.901518+0000","last_unstale":"2023-10-06T03:24:52.902002+0000","last_undegraded":"2023-10-06T03:24:52.902002+0000","last_fullsized":"2023-10-06T03:24:52.902002+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:16:25.142515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.903138+0000","last_change":"2023-10-06T03:24:52.903138+0000","last_active":"2023-10-06T03:24:52.903138+0000","last_peered":"2023-10-06T03:24:52.903138+0000","last_clean":"2023-10-06T03:24:52.903138+0000","last_became_active":"2023-10-06T03:24:52.902865+0000","last_became_peered":"2023-10-06T03:24:52.902865+0000","last_unstale":"2023-10-06T03:24:52.903138+0000","last_undegraded":"2023-10-06T03:24:52.903138+0000","last_fullsized":"2023-10-06T03:24:52.903138+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:20.294316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.890961+0000","last_change":"2023-10-06T03:24:52.890961+0000","last_active":"2023-10-06T03:24:52.890961+0000","last_peered":"2023-10-06T03:24:52.890961+0000","last_clean":"2023-10-06T03:24:52.890961+0000","last_became_active":"2023-10-06T03:24:52.890503+0000","last_became_peered":"2023-10-06T03:24:52.890503+0000","last_unstale":"2023-10-06T03:24:52.890961+0000","last_undegraded":"2023-10-06T03:24:52.890961+0000","last_fullsized":"2023-10-06T03:24:52.890961+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:16:25.142515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.898060+0000","last_change":"2023-10-06T03:24:52.898060+0000","last_active":"2023-10-06T03:24:52.898060+0000","last_peered":"2023-10-06T03:24:52.898060+0000","last_clean":"2023-10-06T03:24:52.898060+0000","last_became_active":"2023-10-06T03:24:52.897632+0000","last_became_peered":"2023-10-06T03:24:52.897632+0000","last_unstale":"2023-10-06T03:24:52.898060+0000","last_undegraded":"2023-10-06T03:24:52.898060+0000","last_fullsized":"2023-10-06T03:24:52.898060+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:29:27.289344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.901825+0000","last_change":"2023-10-06T03:24:52.901825+0000","last_active":"2023-10-06T03:24:52.901825+0000","last_peered":"2023-10-06T03:24:52.901825+0000","last_clean":"2023-10-06T03:24:52.901825+0000","last_became_active":"2023-10-06T03:24:52.901542+0000","last_became_peered":"2023-10-06T03:24:52.901542+0000","last_unstale":"2023-10-06T03:24:52.901825+0000","last_undegraded":"2023-10-06T03:24:52.901825+0000","last_fullsized":"2023-10-06T03:24:52.901825+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:21.156326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.899212+0000","last_change":"2023-10-06T03:24:52.899212+0000","last_active":"2023-10-06T03:24:52.899212+0000","last_peered":"2023-10-06T03:24:52.899212+0000","last_clean":"2023-10-06T03:24:52.899212+0000","last_became_active":"2023-10-06T03:24:52.898943+0000","last_became_peered":"2023-10-06T03:24:52.898943+0000","last_unstale":"2023-10-06T03:24:52.899212+0000","last_undegraded":"2023-10-06T03:24:52.899212+0000","last_fullsized":"2023-10-06T03:24:52.899212+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:14.189954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.902183+0000","last_change":"2023-10-06T03:24:52.902183+0000","last_active":"2023-10-06T03:24:52.902183+0000","last_peered":"2023-10-06T03:24:52.902183+0000","last_clean":"2023-10-06T03:24:52.902183+0000","last_became_active":"2023-10-06T03:24:52.901811+0000","last_became_peered":"2023-10-06T03:24:52.901811+0000","last_unstale":"2023-10-06T03:24:52.902183+0000","last_undegraded":"2023-10-06T03:24:52.902183+0000","last_fullsized":"2023-10-06T03:24:52.902183+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:15:18.163195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.906447+0000","last_change":"2023-10-06T03:24:52.906447+0000","last_active":"2023-10-06T03:24:52.906447+0000","last_peered":"2023-10-06T03:24:52.906447+0000","last_clean":"2023-10-06T03:24:52.906447+0000","last_became_active":"2023-10-06T03:24:52.906165+0000","last_became_peered":"2023-10-06T03:24:52.906165+0000","last_unstale":"2023-10-06T03:24:52.906447+0000","last_undegraded":"2023-10-06T03:24:52.906447+0000","last_fullsized":"2023-10-06T03:24:52.906447+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:04:27.035319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.895400+0000","last_change":"2023-10-06T03:24:52.895400+0000","last_active":"2023-10-06T03:24:52.895400+0000","last_peered":"2023-10-06T03:24:52.895400+0000","last_clean":"2023-10-06T03:24:52.895400+0000","last_became_active":"2023-10-06T03:24:52.895092+0000","last_became_peered":"2023-10-06T03:24:52.895092+0000","last_unstale":"2023-10-06T03:24:52.895400+0000","last_undegraded":"2023-10-06T03:24:52.895400+0000","last_fullsized":"2023-10-06T03:24:52.895400+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:14.189954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.892004+0000","last_change":"2023-10-06T03:24:52.892004+0000","last_active":"2023-10-06T03:24:52.892004+0000","last_peered":"2023-10-06T03:24:52.892004+0000","last_clean":"2023-10-06T03:24:52.892004+0000","last_became_active":"2023-10-06T03:24:52.891503+0000","last_became_peered":"2023-10-06T03:24:52.891503+0000","last_unstale":"2023-10-06T03:24:52.892004+0000","last_undegraded":"2023-10-06T03:24:52.892004+0000","last_fullsized":"2023-10-06T03:24:52.892004+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:28:59.340879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.905563+0000","last_change":"2023-10-06T03:24:52.905563+0000","last_active":"2023-10-06T03:24:52.905563+0000","last_peered":"2023-10-06T03:24:52.905563+0000","last_clean":"2023-10-06T03:24:52.905563+0000","last_became_active":"2023-10-06T03:24:52.905295+0000","last_became_peered":"2023-10-06T03:24:52.905295+0000","last_unstale":"2023-10-06T03:24:52.905563+0000","last_undegraded":"2023-10-06T03:24:52.905563+0000","last_fullsized":"2023-10-06T03:24:52.905563+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:47.477738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.893673+0000","last_change":"2023-10-06T03:24:52.893673+0000","last_active":"2023-10-06T03:24:52.893673+0000","last_peered":"2023-10-06T03:24:52.893673+0000","last_clean":"2023-10-06T03:24:52.893673+0000","last_became_active":"2023-10-06T03:24:52.893145+0000","last_became_peered":"2023-10-06T03:24:52.893145+0000","last_unstale":"2023-10-06T03:24:52.893673+0000","last_undegraded":"2023-10-06T03:24:52.893673+0000","last_fullsized":"2023-10-06T03:24:52.893673+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:31:32.821603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.902609+0000","last_change":"2023-10-06T03:24:52.902609+0000","last_active":"2023-10-06T03:24:52.902609+0000","last_peered":"2023-10-06T03:24:52.902609+0000","last_clean":"2023-10-06T03:24:52.902609+0000","last_became_active":"2023-10-06T03:24:52.902417+0000","last_became_peered":"2023-10-06T03:24:52.902417+0000","last_unstale":"2023-10-06T03:24:52.902609+0000","last_undegraded":"2023-10-06T03:24:52.902609+0000","last_fullsized":"2023-10-06T03:24:52.902609+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:23:00.964971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.900662+0000","last_change":"2023-10-06T03:24:52.900662+0000","last_active":"2023-10-06T03:24:52.900662+0000","last_peered":"2023-10-06T03:24:52.900662+0000","last_clean":"2023-10-06T03:24:52.900662+0000","last_became_active":"2023-10-06T03:24:52.899346+0000","last_became_peered":"2023-10-06T03:24:52.899346+0000","last_unstale":"2023-10-06T03:24:52.900662+0000","last_undegraded":"2023-10-06T03:24:52.900662+0000","last_fullsized":"2023-10-06T03:24:52.900662+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:37:21.626452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.906006+0000","last_change":"2023-10-06T03:24:52.906006+0000","last_active":"2023-10-06T03:24:52.906006+0000","last_peered":"2023-10-06T03:24:52.906006+0000","last_clean":"2023-10-06T03:24:52.906006+0000","last_became_active":"2023-10-06T03:24:52.905646+0000","last_became_peered":"2023-10-06T03:24:52.905646+0000","last_unstale":"2023-10-06T03:24:52.906006+0000","last_undegraded":"2023-10-06T03:24:52.906006+0000","last_fullsized":"2023-10-06T03:24:52.906006+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:15.569212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.893426+0000","last_change":"2023-10-06T03:24:52.893426+0000","last_active":"2023-10-06T03:24:52.893426+0000","last_peered":"2023-10-06T03:24:52.893426+0000","last_clean":"2023-10-06T03:24:52.893426+0000","last_became_active":"2023-10-06T03:24:52.892685+0000","last_became_peered":"2023-10-06T03:24:52.892685+0000","last_unstale":"2023-10-06T03:24:52.893426+0000","last_undegraded":"2023-10-06T03:24:52.893426+0000","last_fullsized":"2023-10-06T03:24:52.893426+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:51:58.806411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.901813+0000","last_change":"2023-10-06T03:24:52.901813+0000","last_active":"2023-10-06T03:24:52.901813+0000","last_peered":"2023-10-06T03:24:52.901813+0000","last_clean":"2023-10-06T03:24:52.901813+0000","last_became_active":"2023-10-06T03:24:52.901237+0000","last_became_peered":"2023-10-06T03:24:52.901237+0000","last_unstale":"2023-10-06T03:24:52.901813+0000","last_undegraded":"2023-10-06T03:24:52.901813+0000","last_fullsized":"2023-10-06T03:24:52.901813+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:51:58.806411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.894898+0000","last_change":"2023-10-06T03:24:52.894898+0000","last_active":"2023-10-06T03:24:52.894898+0000","last_peered":"2023-10-06T03:24:52.894898+0000","last_clean":"2023-10-06T03:24:52.894898+0000","last_became_active":"2023-10-06T03:24:52.894641+0000","last_became_peered":"2023-10-06T03:24:52.894641+0000","last_unstale":"2023-10-06T03:24:52.894898+0000","last_undegraded":"2023-10-06T03:24:52.894898+0000","last_fullsized":"2023-10-06T03:24:52.894898+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:43.207997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.914664+0000","last_change":"2023-10-06T03:24:52.914664+0000","last_active":"2023-10-06T03:24:52.914664+0000","last_peered":"2023-10-06T03:24:52.914664+0000","last_clean":"2023-10-06T03:24:52.914664+0000","last_became_active":"2023-10-06T03:24:52.914377+0000","last_became_peered":"2023-10-06T03:24:52.914377+0000","last_unstale":"2023-10-06T03:24:52.914664+0000","last_undegraded":"2023-10-06T03:24:52.914664+0000","last_fullsized":"2023-10-06T03:24:52.914664+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:20.294316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"37'4","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.910011+0000","last_change":"2023-10-06T03:24:51.897948+0000","last_active":"2023-10-06T03:24:52.910011+0000","last_peered":"2023-10-06T03:24:52.910011+0000","last_clean":"2023-10-06T03:24:52.910011+0000","last_became_active":"2023-10-06T03:24:51.897756+0000","last_became_peered":"2023-10-06T03:24:51.897756+0000","last_unstale":"2023-10-06T03:24:52.910011+0000","last_undegraded":"2023-10-06T03:24:52.910011+0000","last_fullsized":"2023-10-06T03:24:52.910011+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:39:38.780100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.898059+0000","last_change":"2023-10-06T03:24:52.898059+0000","last_active":"2023-10-06T03:24:52.898059+0000","last_peered":"2023-10-06T03:24:52.898059+0000","last_clean":"2023-10-06T03:24:52.898059+0000","last_became_active":"2023-10-06T03:24:52.897720+0000","last_became_peered":"2023-10-06T03:24:52.897720+0000","last_unstale":"2023-10-06T03:24:52.898059+0000","last_undegraded":"2023-10-06T03:24:52.898059+0000","last_fullsized":"2023-10-06T03:24:52.898059+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:22:50.462269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"37'1","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.889060+0000","last_change":"2023-10-06T03:24:51.897018+0000","last_active":"2023-10-06T03:24:52.889060+0000","last_peered":"2023-10-06T03:24:52.889060+0000","last_clean":"2023-10-06T03:24:52.889060+0000","last_became_active":"2023-10-06T03:24:51.896761+0000","last_became_peered":"2023-10-06T03:24:51.896761+0000","last_unstale":"2023-10-06T03:24:52.889060+0000","last_undegraded":"2023-10-06T03:24:52.889060+0000","last_fullsized":"2023-10-06T03:24:52.889060+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:30:12.116091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.905335+0000","last_change":"2023-10-06T03:24:52.905335+0000","last_active":"2023-10-06T03:24:52.905335+0000","last_peered":"2023-10-06T03:24:52.905335+0000","last_clean":"2023-10-06T03:24:52.905335+0000","last_became_active":"2023-10-06T03:24:52.904837+0000","last_became_peered":"2023-10-06T03:24:52.904837+0000","last_unstale":"2023-10-06T03:24:52.905335+0000","last_undegraded":"2023-10-06T03:24:52.905335+0000","last_fullsized":"2023-10-06T03:24:52.905335+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:29:39.027777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"37'2","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.914509+0000","last_change":"2023-10-06T03:24:51.895311+0000","last_active":"2023-10-06T03:24:52.914509+0000","last_peered":"2023-10-06T03:24:52.914509+0000","last_clean":"2023-10-06T03:24:52.914509+0000","last_became_active":"2023-10-06T03:24:51.894793+0000","last_became_peered":"2023-10-06T03:24:51.894793+0000","last_unstale":"2023-10-06T03:24:52.914509+0000","last_undegraded":"2023-10-06T03:24:52.914509+0000","last_fullsized":"2023-10-06T03:24:52.914509+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:33:45.228338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.898600+0000","last_change":"2023-10-06T03:24:52.898600+0000","last_active":"2023-10-06T03:24:52.898600+0000","last_peered":"2023-10-06T03:24:52.898600+0000","last_clean":"2023-10-06T03:24:52.898600+0000","last_became_active":"2023-10-06T03:24:52.898146+0000","last_became_peered":"2023-10-06T03:24:52.898146+0000","last_unstale":"2023-10-06T03:24:52.898600+0000","last_undegraded":"2023-10-06T03:24:52.898600+0000","last_fullsized":"2023-10-06T03:24:52.898600+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:21.156326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"37'2","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.910881+0000","last_change":"2023-10-06T03:24:51.895167+0000","last_active":"2023-10-06T03:24:52.910881+0000","last_peered":"2023-10-06T03:24:52.910881+0000","last_clean":"2023-10-06T03:24:52.910881+0000","last_became_active":"2023-10-06T03:24:51.894885+0000","last_became_peered":"2023-10-06T03:24:51.894885+0000","last_unstale":"2023-10-06T03:24:52.910881+0000","last_undegraded":"2023-10-06T03:24:52.910881+0000","last_fullsized":"2023-10-06T03:24:52.910881+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:20.147715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.908109+0000","last_change":"2023-10-06T03:24:52.908109+0000","last_active":"2023-10-06T03:24:52.908109+0000","last_peered":"2023-10-06T03:24:52.908109+0000","last_clean":"2023-10-06T03:24:52.908109+0000","last_became_active":"2023-10-06T03:24:52.907857+0000","last_became_peered":"2023-10-06T03:24:52.907857+0000","last_unstale":"2023-10-06T03:24:52.908109+0000","last_undegraded":"2023-10-06T03:24:52.908109+0000","last_fullsized":"2023-10-06T03:24:52.908109+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:45.950298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"37'1","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.883967+0000","last_change":"2023-10-06T03:24:51.888611+0000","last_active":"2023-10-06T03:24:52.883967+0000","last_peered":"2023-10-06T03:24:52.883967+0000","last_clean":"2023-10-06T03:24:52.883967+0000","last_became_active":"2023-10-06T03:24:51.888339+0000","last_became_peered":"2023-10-06T03:24:51.888339+0000","last_unstale":"2023-10-06T03:24:52.883967+0000","last_undegraded":"2023-10-06T03:24:52.883967+0000","last_fullsized":"2023-10-06T03:24:52.883967+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:13:33.079801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.896461+0000","last_change":"2023-10-06T03:24:52.896461+0000","last_active":"2023-10-06T03:24:52.896461+0000","last_peered":"2023-10-06T03:24:52.896461+0000","last_clean":"2023-10-06T03:24:52.896461+0000","last_became_active":"2023-10-06T03:24:52.895898+0000","last_became_peered":"2023-10-06T03:24:52.895898+0000","last_unstale":"2023-10-06T03:24:52.896461+0000","last_undegraded":"2023-10-06T03:24:52.896461+0000","last_fullsized":"2023-10-06T03:24:52.896461+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:36:59.402104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"37'1","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.883974+0000","last_change":"2023-10-06T03:24:51.896182+0000","last_active":"2023-10-06T03:24:52.883974+0000","last_peered":"2023-10-06T03:24:52.883974+0000","last_clean":"2023-10-06T03:24:52.883974+0000","last_became_active":"2023-10-06T03:24:51.895884+0000","last_became_peered":"2023-10-06T03:24:51.895884+0000","last_unstale":"2023-10-06T03:24:52.883974+0000","last_undegraded":"2023-10-06T03:24:52.883974+0000","last_fullsized":"2023-10-06T03:24:52.883974+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:37:20.617840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.907351+0000","last_change":"2023-10-06T03:24:52.907351+0000","last_active":"2023-10-06T03:24:52.907351+0000","last_peered":"2023-10-06T03:24:52.907351+0000","last_clean":"2023-10-06T03:24:52.907351+0000","last_became_active":"2023-10-06T03:24:52.906756+0000","last_became_peered":"2023-10-06T03:24:52.906756+0000","last_unstale":"2023-10-06T03:24:52.907351+0000","last_undegraded":"2023-10-06T03:24:52.907351+0000","last_fullsized":"2023-10-06T03:24:52.907351+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:47:01.894746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T03:24:51.898802+0000","last_change":"2023-10-06T03:24:51.893866+0000","last_active":"2023-10-06T03:24:51.898802+0000","last_peered":"2023-10-06T03:24:51.898802+0000","last_clean":"2023-10-06T03:24:51.898802+0000","last_became_active":"2023-10-06T03:24:51.893462+0000","last_became_peered":"2023-10-06T03:24:51.893462+0000","last_unstale":"2023-10-06T03:24:51.898802+0000","last_undegraded":"2023-10-06T03:24:51.898802+0000","last_fullsized":"2023-10-06T03:24:51.898802+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:47.768751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.887852+0000","last_change":"2023-10-06T03:24:52.887852+0000","last_active":"2023-10-06T03:24:52.887852+0000","last_peered":"2023-10-06T03:24:52.887852+0000","last_clean":"2023-10-06T03:24:52.887852+0000","last_became_active":"2023-10-06T03:24:52.887530+0000","last_became_peered":"2023-10-06T03:24:52.887530+0000","last_unstale":"2023-10-06T03:24:52.887852+0000","last_undegraded":"2023-10-06T03:24:52.887852+0000","last_fullsized":"2023-10-06T03:24:52.887852+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:33:46.236949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T03:24:51.901296+0000","last_change":"2023-10-06T03:24:51.897111+0000","last_active":"2023-10-06T03:24:51.901296+0000","last_peered":"2023-10-06T03:24:51.901296+0000","last_clean":"2023-10-06T03:24:51.901296+0000","last_became_active":"2023-10-06T03:24:51.896826+0000","last_became_peered":"2023-10-06T03:24:51.896826+0000","last_unstale":"2023-10-06T03:24:51.901296+0000","last_undegraded":"2023-10-06T03:24:51.901296+0000","last_fullsized":"2023-10-06T03:24:51.901296+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:47.768751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.897893+0000","last_change":"2023-10-06T03:24:52.897893+0000","last_active":"2023-10-06T03:24:52.897893+0000","last_peered":"2023-10-06T03:24:52.897893+0000","last_clean":"2023-10-06T03:24:52.897893+0000","last_became_active":"2023-10-06T03:24:52.897300+0000","last_became_peered":"2023-10-06T03:24:52.897300+0000","last_unstale":"2023-10-06T03:24:52.897893+0000","last_undegraded":"2023-10-06T03:24:52.897893+0000","last_fullsized":"2023-10-06T03:24:52.897893+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:15:18.163195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T03:24:51.898563+0000","last_change":"2023-10-06T03:24:51.891835+0000","last_active":"2023-10-06T03:24:51.898563+0000","last_peered":"2023-10-06T03:24:51.898563+0000","last_clean":"2023-10-06T03:24:51.898563+0000","last_became_active":"2023-10-06T03:24:51.891382+0000","last_became_peered":"2023-10-06T03:24:51.891382+0000","last_unstale":"2023-10-06T03:24:51.898563+0000","last_undegraded":"2023-10-06T03:24:51.898563+0000","last_fullsized":"2023-10-06T03:24:51.898563+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:23:44.701074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.887890+0000","last_change":"2023-10-06T03:24:52.887890+0000","last_active":"2023-10-06T03:24:52.887890+0000","last_peered":"2023-10-06T03:24:52.887890+0000","last_clean":"2023-10-06T03:24:52.887890+0000","last_became_active":"2023-10-06T03:24:52.887615+0000","last_became_peered":"2023-10-06T03:24:52.887615+0000","last_unstale":"2023-10-06T03:24:52.887890+0000","last_undegraded":"2023-10-06T03:24:52.887890+0000","last_fullsized":"2023-10-06T03:24:52.887890+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:13:34.088412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T03:24:51.896136+0000","last_change":"2023-10-06T03:24:51.892877+0000","last_active":"2023-10-06T03:24:51.896136+0000","last_peered":"2023-10-06T03:24:51.896136+0000","last_clean":"2023-10-06T03:24:51.896136+0000","last_became_active":"2023-10-06T03:24:51.892603+0000","last_became_peered":"2023-10-06T03:24:51.892603+0000","last_unstale":"2023-10-06T03:24:51.896136+0000","last_undegraded":"2023-10-06T03:24:51.896136+0000","last_fullsized":"2023-10-06T03:24:51.896136+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:19.285704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.903715+0000","last_change":"2023-10-06T03:24:52.903715+0000","last_active":"2023-10-06T03:24:52.903715+0000","last_peered":"2023-10-06T03:24:52.903715+0000","last_clean":"2023-10-06T03:24:52.903715+0000","last_became_active":"2023-10-06T03:24:52.903399+0000","last_became_peered":"2023-10-06T03:24:52.903399+0000","last_unstale":"2023-10-06T03:24:52.903715+0000","last_undegraded":"2023-10-06T03:24:52.903715+0000","last_fullsized":"2023-10-06T03:24:52.903715+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:47:01.894746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"37'3","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.911012+0000","last_change":"2023-10-06T03:24:51.897648+0000","last_active":"2023-10-06T03:24:52.911012+0000","last_peered":"2023-10-06T03:24:52.911012+0000","last_clean":"2023-10-06T03:24:52.911012+0000","last_became_active":"2023-10-06T03:24:51.897385+0000","last_became_peered":"2023-10-06T03:24:51.897385+0000","last_unstale":"2023-10-06T03:24:52.911012+0000","last_undegraded":"2023-10-06T03:24:52.911012+0000","last_fullsized":"2023-10-06T03:24:52.911012+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:19.285704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.897695+0000","last_change":"2023-10-06T03:24:52.897695+0000","last_active":"2023-10-06T03:24:52.897695+0000","last_peered":"2023-10-06T03:24:52.897695+0000","last_clean":"2023-10-06T03:24:52.897695+0000","last_became_active":"2023-10-06T03:24:52.897424+0000","last_became_peered":"2023-10-06T03:24:52.897424+0000","last_unstale":"2023-10-06T03:24:52.897695+0000","last_undegraded":"2023-10-06T03:24:52.897695+0000","last_fullsized":"2023-10-06T03:24:52.897695+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:13:48.810571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"37'6","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.910208+0000","last_change":"2023-10-06T03:24:51.890583+0000","last_active":"2023-10-06T03:24:52.910208+0000","last_peered":"2023-10-06T03:24:52.910208+0000","last_clean":"2023-10-06T03:24:52.910208+0000","last_became_active":"2023-10-06T03:24:51.890300+0000","last_became_peered":"2023-10-06T03:24:51.890300+0000","last_unstale":"2023-10-06T03:24:52.910208+0000","last_undegraded":"2023-10-06T03:24:52.910208+0000","last_fullsized":"2023-10-06T03:24:52.910208+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:36.134927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.902446+0000","last_change":"2023-10-06T03:24:52.902446+0000","last_active":"2023-10-06T03:24:52.902446+0000","last_peered":"2023-10-06T03:24:52.902446+0000","last_clean":"2023-10-06T03:24:52.902446+0000","last_became_active":"2023-10-06T03:24:52.902195+0000","last_became_peered":"2023-10-06T03:24:52.902195+0000","last_unstale":"2023-10-06T03:24:52.902446+0000","last_undegraded":"2023-10-06T03:24:52.902446+0000","last_fullsized":"2023-10-06T03:24:52.902446+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:15:35.754152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"37'2","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.910125+0000","last_change":"2023-10-06T03:24:51.899364+0000","last_active":"2023-10-06T03:24:52.910125+0000","last_peered":"2023-10-06T03:24:52.910125+0000","last_clean":"2023-10-06T03:24:52.910125+0000","last_became_active":"2023-10-06T03:24:51.899085+0000","last_became_peered":"2023-10-06T03:24:51.899085+0000","last_unstale":"2023-10-06T03:24:52.910125+0000","last_undegraded":"2023-10-06T03:24:52.910125+0000","last_fullsized":"2023-10-06T03:24:52.910125+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:19:37.225873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.889403+0000","last_change":"2023-10-06T03:24:52.889403+0000","last_active":"2023-10-06T03:24:52.889403+0000","last_peered":"2023-10-06T03:24:52.889403+0000","last_clean":"2023-10-06T03:24:52.889403+0000","last_became_active":"2023-10-06T03:24:52.889137+0000","last_became_peered":"2023-10-06T03:24:52.889137+0000","last_unstale":"2023-10-06T03:24:52.889403+0000","last_undegraded":"2023-10-06T03:24:52.889403+0000","last_fullsized":"2023-10-06T03:24:52.889403+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:37.052006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T03:24:51.887727+0000","last_change":"2023-10-06T03:24:51.884744+0000","last_active":"2023-10-06T03:24:51.887727+0000","last_peered":"2023-10-06T03:24:51.887727+0000","last_clean":"2023-10-06T03:24:51.887727+0000","last_became_active":"2023-10-06T03:24:51.884495+0000","last_became_peered":"2023-10-06T03:24:51.884495+0000","last_unstale":"2023-10-06T03:24:51.887727+0000","last_undegraded":"2023-10-06T03:24:51.887727+0000","last_fullsized":"2023-10-06T03:24:51.887727+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:46.469127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.901833+0000","last_change":"2023-10-06T03:24:52.901833+0000","last_active":"2023-10-06T03:24:52.901833+0000","last_peered":"2023-10-06T03:24:52.901833+0000","last_clean":"2023-10-06T03:24:52.901833+0000","last_became_active":"2023-10-06T03:24:52.901070+0000","last_became_peered":"2023-10-06T03:24:52.901070+0000","last_unstale":"2023-10-06T03:24:52.901833+0000","last_undegraded":"2023-10-06T03:24:52.901833+0000","last_fullsized":"2023-10-06T03:24:52.901833+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:57.998695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T03:24:51.905182+0000","last_change":"2023-10-06T03:24:51.899292+0000","last_active":"2023-10-06T03:24:51.905182+0000","last_peered":"2023-10-06T03:24:51.905182+0000","last_clean":"2023-10-06T03:24:51.905182+0000","last_became_active":"2023-10-06T03:24:51.899042+0000","last_became_peered":"2023-10-06T03:24:51.899042+0000","last_unstale":"2023-10-06T03:24:51.905182+0000","last_undegraded":"2023-10-06T03:24:51.905182+0000","last_fullsized":"2023-10-06T03:24:51.905182+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:37:20.617840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.899661+0000","last_change":"2023-10-06T03:24:52.899661+0000","last_active":"2023-10-06T03:24:52.899661+0000","last_peered":"2023-10-06T03:24:52.899661+0000","last_clean":"2023-10-06T03:24:52.899661+0000","last_became_active":"2023-10-06T03:24:52.899143+0000","last_became_peered":"2023-10-06T03:24:52.899143+0000","last_unstale":"2023-10-06T03:24:52.899661+0000","last_undegraded":"2023-10-06T03:24:52.899661+0000","last_fullsized":"2023-10-06T03:24:52.899661+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:29:39.027777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"37'8","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.915514+0000","last_change":"2023-10-06T03:24:51.896612+0000","last_active":"2023-10-06T03:24:52.915514+0000","last_peered":"2023-10-06T03:24:52.915514+0000","last_clean":"2023-10-06T03:24:52.915514+0000","last_became_active":"2023-10-06T03:24:51.896311+0000","last_became_peered":"2023-10-06T03:24:51.896311+0000","last_unstale":"2023-10-06T03:24:52.915514+0000","last_undegraded":"2023-10-06T03:24:52.915514+0000","last_fullsized":"2023-10-06T03:24:52.915514+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:15:34.745541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.893859+0000","last_change":"2023-10-06T03:24:52.893859+0000","last_active":"2023-10-06T03:24:52.893859+0000","last_peered":"2023-10-06T03:24:52.893859+0000","last_clean":"2023-10-06T03:24:52.893859+0000","last_became_active":"2023-10-06T03:24:52.893441+0000","last_became_peered":"2023-10-06T03:24:52.893441+0000","last_unstale":"2023-10-06T03:24:52.893859+0000","last_undegraded":"2023-10-06T03:24:52.893859+0000","last_fullsized":"2023-10-06T03:24:52.893859+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:33:46.236949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"37'1","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.876095+0000","last_change":"2023-10-06T03:24:51.887113+0000","last_active":"2023-10-06T03:24:52.876095+0000","last_peered":"2023-10-06T03:24:52.876095+0000","last_clean":"2023-10-06T03:24:52.876095+0000","last_became_active":"2023-10-06T03:24:51.886844+0000","last_became_peered":"2023-10-06T03:24:51.886844+0000","last_unstale":"2023-10-06T03:24:52.876095+0000","last_undegraded":"2023-10-06T03:24:52.876095+0000","last_fullsized":"2023-10-06T03:24:52.876095+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:54:13.068961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.907217+0000","last_change":"2023-10-06T03:24:52.907217+0000","last_active":"2023-10-06T03:24:52.907217+0000","last_peered":"2023-10-06T03:24:52.907217+0000","last_clean":"2023-10-06T03:24:52.907217+0000","last_became_active":"2023-10-06T03:24:52.906931+0000","last_became_peered":"2023-10-06T03:24:52.906931+0000","last_unstale":"2023-10-06T03:24:52.907217+0000","last_undegraded":"2023-10-06T03:24:52.907217+0000","last_fullsized":"2023-10-06T03:24:52.907217+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:37:21.626452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"37'2","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.910037+0000","last_change":"2023-10-06T03:24:51.892088+0000","last_active":"2023-10-06T03:24:52.910037+0000","last_peered":"2023-10-06T03:24:52.910037+0000","last_clean":"2023-10-06T03:24:52.910037+0000","last_became_active":"2023-10-06T03:24:51.891731+0000","last_became_peered":"2023-10-06T03:24:51.891731+0000","last_unstale":"2023-10-06T03:24:52.910037+0000","last_undegraded":"2023-10-06T03:24:52.910037+0000","last_fullsized":"2023-10-06T03:24:52.910037+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:34:53.266309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.904968+0000","last_change":"2023-10-06T03:24:52.904968+0000","last_active":"2023-10-06T03:24:52.904968+0000","last_peered":"2023-10-06T03:24:52.904968+0000","last_clean":"2023-10-06T03:24:52.904968+0000","last_became_active":"2023-10-06T03:24:52.904539+0000","last_became_peered":"2023-10-06T03:24:52.904539+0000","last_unstale":"2023-10-06T03:24:52.904968+0000","last_undegraded":"2023-10-06T03:24:52.904968+0000","last_fullsized":"2023-10-06T03:24:52.904968+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:34.464352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"37'1","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.877634+0000","last_change":"2023-10-06T03:24:51.894334+0000","last_active":"2023-10-06T03:24:52.877634+0000","last_peered":"2023-10-06T03:24:52.877634+0000","last_clean":"2023-10-06T03:24:52.877634+0000","last_became_active":"2023-10-06T03:24:51.893942+0000","last_became_peered":"2023-10-06T03:24:51.893942+0000","last_unstale":"2023-10-06T03:24:52.877634+0000","last_undegraded":"2023-10-06T03:24:52.877634+0000","last_fullsized":"2023-10-06T03:24:52.877634+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:44:58.096466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.908999+0000","last_change":"2023-10-06T03:24:52.908999+0000","last_active":"2023-10-06T03:24:52.908999+0000","last_peered":"2023-10-06T03:24:52.908999+0000","last_clean":"2023-10-06T03:24:52.908999+0000","last_became_active":"2023-10-06T03:24:52.906378+0000","last_became_peered":"2023-10-06T03:24:52.906378+0000","last_unstale":"2023-10-06T03:24:52.908999+0000","last_undegraded":"2023-10-06T03:24:52.908999+0000","last_fullsized":"2023-10-06T03:24:52.908999+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:31:32.821603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T03:24:51.897327+0000","last_change":"2023-10-06T03:24:51.892875+0000","last_active":"2023-10-06T03:24:51.897327+0000","last_peered":"2023-10-06T03:24:51.897327+0000","last_clean":"2023-10-06T03:24:51.897327+0000","last_became_active":"2023-10-06T03:24:51.892590+0000","last_became_peered":"2023-10-06T03:24:51.892590+0000","last_unstale":"2023-10-06T03:24:51.897327+0000","last_undegraded":"2023-10-06T03:24:51.897327+0000","last_fullsized":"2023-10-06T03:24:51.897327+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:13:47.801960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.903063+0000","last_change":"2023-10-06T03:24:52.903063+0000","last_active":"2023-10-06T03:24:52.903063+0000","last_peered":"2023-10-06T03:24:52.903063+0000","last_clean":"2023-10-06T03:24:52.903063+0000","last_became_active":"2023-10-06T03:24:52.902612+0000","last_became_peered":"2023-10-06T03:24:52.902612+0000","last_unstale":"2023-10-06T03:24:52.903063+0000","last_undegraded":"2023-10-06T03:24:52.903063+0000","last_fullsized":"2023-10-06T03:24:52.903063+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:55:10.923774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"37'2","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.909960+0000","last_change":"2023-10-06T03:24:51.893257+0000","last_active":"2023-10-06T03:24:52.909960+0000","last_peered":"2023-10-06T03:24:52.909960+0000","last_clean":"2023-10-06T03:24:52.909960+0000","last_became_active":"2023-10-06T03:24:51.892929+0000","last_became_peered":"2023-10-06T03:24:51.892929+0000","last_unstale":"2023-10-06T03:24:52.909960+0000","last_undegraded":"2023-10-06T03:24:52.909960+0000","last_fullsized":"2023-10-06T03:24:52.909960+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:29:38.019166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.903912+0000","last_change":"2023-10-06T03:24:52.903912+0000","last_active":"2023-10-06T03:24:52.903912+0000","last_peered":"2023-10-06T03:24:52.903912+0000","last_clean":"2023-10-06T03:24:52.903912+0000","last_became_active":"2023-10-06T03:24:52.903626+0000","last_became_peered":"2023-10-06T03:24:52.903626+0000","last_unstale":"2023-10-06T03:24:52.903912+0000","last_undegraded":"2023-10-06T03:24:52.903912+0000","last_fullsized":"2023-10-06T03:24:52.903912+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:15:35.754152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T03:24:51.899672+0000","last_change":"2023-10-06T03:24:51.894067+0000","last_active":"2023-10-06T03:24:51.899672+0000","last_peered":"2023-10-06T03:24:51.899672+0000","last_clean":"2023-10-06T03:24:51.899672+0000","last_became_active":"2023-10-06T03:24:51.893781+0000","last_became_peered":"2023-10-06T03:24:51.893781+0000","last_unstale":"2023-10-06T03:24:51.899672+0000","last_undegraded":"2023-10-06T03:24:51.899672+0000","last_fullsized":"2023-10-06T03:24:51.899672+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:15:34.745541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.893152+0000","last_change":"2023-10-06T03:24:52.893152+0000","last_active":"2023-10-06T03:24:52.893152+0000","last_peered":"2023-10-06T03:24:52.893152+0000","last_clean":"2023-10-06T03:24:52.893152+0000","last_became_active":"2023-10-06T03:24:52.892851+0000","last_became_peered":"2023-10-06T03:24:52.892851+0000","last_unstale":"2023-10-06T03:24:52.893152+0000","last_undegraded":"2023-10-06T03:24:52.893152+0000","last_fullsized":"2023-10-06T03:24:52.893152+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:28:59.340879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T03:24:51.898444+0000","last_change":"2023-10-06T03:24:51.896202+0000","last_active":"2023-10-06T03:24:51.898444+0000","last_peered":"2023-10-06T03:24:51.898444+0000","last_clean":"2023-10-06T03:24:51.898444+0000","last_became_active":"2023-10-06T03:24:51.895907+0000","last_became_peered":"2023-10-06T03:24:51.895907+0000","last_unstale":"2023-10-06T03:24:51.898444+0000","last_undegraded":"2023-10-06T03:24:51.898444+0000","last_fullsized":"2023-10-06T03:24:51.898444+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:20.147715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.904851+0000","last_change":"2023-10-06T03:24:52.904851+0000","last_active":"2023-10-06T03:24:52.904851+0000","last_peered":"2023-10-06T03:24:52.904851+0000","last_clean":"2023-10-06T03:24:52.904851+0000","last_became_active":"2023-10-06T03:24:52.904582+0000","last_became_peered":"2023-10-06T03:24:52.904582+0000","last_unstale":"2023-10-06T03:24:52.904851+0000","last_undegraded":"2023-10-06T03:24:52.904851+0000","last_fullsized":"2023-10-06T03:24:52.904851+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:34:54.274921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T03:24:51.889882+0000","last_change":"2023-10-06T03:24:51.885457+0000","last_active":"2023-10-06T03:24:51.889882+0000","last_peered":"2023-10-06T03:24:51.889882+0000","last_clean":"2023-10-06T03:24:51.889882+0000","last_became_active":"2023-10-06T03:24:51.885154+0000","last_became_peered":"2023-10-06T03:24:51.885154+0000","last_unstale":"2023-10-06T03:24:51.889882+0000","last_undegraded":"2023-10-06T03:24:51.889882+0000","last_fullsized":"2023-10-06T03:24:51.889882+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:14.560601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.901571+0000","last_change":"2023-10-06T03:24:52.901571+0000","last_active":"2023-10-06T03:24:52.901571+0000","last_peered":"2023-10-06T03:24:52.901571+0000","last_clean":"2023-10-06T03:24:52.901571+0000","last_became_active":"2023-10-06T03:24:52.901136+0000","last_became_peered":"2023-10-06T03:24:52.901136+0000","last_unstale":"2023-10-06T03:24:52.901571+0000","last_undegraded":"2023-10-06T03:24:52.901571+0000","last_fullsized":"2023-10-06T03:24:52.901571+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:29:27.289344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T03:24:51.899096+0000","last_change":"2023-10-06T03:24:51.896005+0000","last_active":"2023-10-06T03:24:51.899096+0000","last_peered":"2023-10-06T03:24:51.899096+0000","last_clean":"2023-10-06T03:24:51.899096+0000","last_became_active":"2023-10-06T03:24:51.895714+0000","last_became_peered":"2023-10-06T03:24:51.895714+0000","last_unstale":"2023-10-06T03:24:51.899096+0000","last_undegraded":"2023-10-06T03:24:51.899096+0000","last_fullsized":"2023-10-06T03:24:51.899096+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:19:37.225873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T03:24:51.886353+0000","last_change":"2023-10-06T03:23:35.397971+0000","last_active":"2023-10-06T03:24:51.886353+0000","last_peered":"2023-10-06T03:24:51.886353+0000","last_clean":"2023-10-06T03:24:51.886353+0000","last_became_active":"2023-10-06T03:23:35.397649+0000","last_became_peered":"2023-10-06T03:23:35.397649+0000","last_unstale":"2023-10-06T03:24:51.886353+0000","last_undegraded":"2023-10-06T03:24:51.886353+0000","last_fullsized":"2023-10-06T03:24:51.886353+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:11.974461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.908374+0000","last_change":"2023-10-06T03:24:52.908374+0000","last_active":"2023-10-06T03:24:52.908374+0000","last_peered":"2023-10-06T03:24:52.908374+0000","last_clean":"2023-10-06T03:24:52.908374+0000","last_became_active":"2023-10-06T03:24:52.908102+0000","last_became_peered":"2023-10-06T03:24:52.908102+0000","last_unstale":"2023-10-06T03:24:52.908374+0000","last_undegraded":"2023-10-06T03:24:52.908374+0000","last_fullsized":"2023-10-06T03:24:52.908374+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:09:31.423278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T03:24:51.892343+0000","last_change":"2023-10-06T03:24:51.889375+0000","last_active":"2023-10-06T03:24:51.892343+0000","last_peered":"2023-10-06T03:24:51.892343+0000","last_clean":"2023-10-06T03:24:51.892343+0000","last_became_active":"2023-10-06T03:24:51.889037+0000","last_became_peered":"2023-10-06T03:24:51.889037+0000","last_unstale":"2023-10-06T03:24:51.892343+0000","last_undegraded":"2023-10-06T03:24:51.892343+0000","last_fullsized":"2023-10-06T03:24:51.892343+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:15:34.745541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T03:24:51.881183+0000","last_change":"2023-10-06T03:23:34.866196+0000","last_active":"2023-10-06T03:24:51.881183+0000","last_peered":"2023-10-06T03:24:51.881183+0000","last_clean":"2023-10-06T03:24:51.881183+0000","last_became_active":"2023-10-06T03:23:34.865914+0000","last_became_peered":"2023-10-06T03:23:34.865914+0000","last_unstale":"2023-10-06T03:24:51.881183+0000","last_undegraded":"2023-10-06T03:24:51.881183+0000","last_fullsized":"2023-10-06T03:24:51.881183+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:11.974461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.894208+0000","last_change":"2023-10-06T03:24:52.894208+0000","last_active":"2023-10-06T03:24:52.894208+0000","last_peered":"2023-10-06T03:24:52.894208+0000","last_clean":"2023-10-06T03:24:52.894208+0000","last_became_active":"2023-10-06T03:24:52.893933+0000","last_became_peered":"2023-10-06T03:24:52.893933+0000","last_unstale":"2023-10-06T03:24:52.894208+0000","last_undegraded":"2023-10-06T03:24:52.894208+0000","last_fullsized":"2023-10-06T03:24:52.894208+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:50:04.406520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T03:24:51.896382+0000","last_change":"2023-10-06T03:24:51.895174+0000","last_active":"2023-10-06T03:24:51.896382+0000","last_peered":"2023-10-06T03:24:51.896382+0000","last_clean":"2023-10-06T03:24:51.896382+0000","last_became_active":"2023-10-06T03:24:51.894427+0000","last_became_peered":"2023-10-06T03:24:51.894427+0000","last_unstale":"2023-10-06T03:24:51.896382+0000","last_undegraded":"2023-10-06T03:24:51.896382+0000","last_fullsized":"2023-10-06T03:24:51.896382+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:31:31.812991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T03:24:51.877752+0000","last_change":"2023-10-06T03:23:34.874380+0000","last_active":"2023-10-06T03:24:51.877752+0000","last_peered":"2023-10-06T03:24:51.877752+0000","last_clean":"2023-10-06T03:24:51.877752+0000","last_became_active":"2023-10-06T03:23:34.873972+0000","last_became_peered":"2023-10-06T03:23:34.873972+0000","last_unstale":"2023-10-06T03:24:51.877752+0000","last_undegraded":"2023-10-06T03:24:51.877752+0000","last_fullsized":"2023-10-06T03:24:51.877752+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:30.204999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":177,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T03:24:51.873941+0000","last_change":"2023-10-06T03:23:34.864626+0000","last_active":"2023-10-06T03:24:51.873941+0000","last_peered":"2023-10-06T03:24:51.873941+0000","last_clean":"2023-10-06T03:24:51.873941+0000","last_became_active":"2023-10-06T03:23:34.863539+0000","last_became_peered":"2023-10-06T03:23:34.863539+0000","last_unstale":"2023-10-06T03:24:51.873941+0000","last_undegraded":"2023-10-06T03:24:51.873941+0000","last_fullsized":"2023-10-06T03:24:51.873941+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:11.750836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.894972+0000","last_change":"2023-10-06T03:24:52.894972+0000","last_active":"2023-10-06T03:24:52.894972+0000","last_peered":"2023-10-06T03:24:52.894972+0000","last_clean":"2023-10-06T03:24:52.894972+0000","last_became_active":"2023-10-06T03:24:52.894544+0000","last_became_peered":"2023-10-06T03:24:52.894544+0000","last_unstale":"2023-10-06T03:24:52.894972+0000","last_undegraded":"2023-10-06T03:24:52.894972+0000","last_fullsized":"2023-10-06T03:24:52.894972+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:25:53.153625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T03:24:51.900995+0000","last_change":"2023-10-06T03:24:51.898337+0000","last_active":"2023-10-06T03:24:51.900995+0000","last_peered":"2023-10-06T03:24:51.900995+0000","last_clean":"2023-10-06T03:24:51.900995+0000","last_became_active":"2023-10-06T03:24:51.898050+0000","last_became_peered":"2023-10-06T03:24:51.898050+0000","last_unstale":"2023-10-06T03:24:51.900995+0000","last_undegraded":"2023-10-06T03:24:51.900995+0000","last_fullsized":"2023-10-06T03:24:51.900995+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:22:49.453657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T03:24:51.873759+0000","last_change":"2023-10-06T03:23:34.864399+0000","last_active":"2023-10-06T03:24:51.873759+0000","last_peered":"2023-10-06T03:24:51.873759+0000","last_clean":"2023-10-06T03:24:51.873759+0000","last_became_active":"2023-10-06T03:23:34.863991+0000","last_became_peered":"2023-10-06T03:23:34.863991+0000","last_unstale":"2023-10-06T03:24:51.873759+0000","last_undegraded":"2023-10-06T03:24:51.873759+0000","last_fullsized":"2023-10-06T03:24:51.873759+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:56:32.358597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.896662+0000","last_change":"2023-10-06T03:24:52.896662+0000","last_active":"2023-10-06T03:24:52.896662+0000","last_peered":"2023-10-06T03:24:52.896662+0000","last_clean":"2023-10-06T03:24:52.896662+0000","last_became_active":"2023-10-06T03:24:52.896097+0000","last_became_peered":"2023-10-06T03:24:52.896097+0000","last_unstale":"2023-10-06T03:24:52.896662+0000","last_undegraded":"2023-10-06T03:24:52.896662+0000","last_fullsized":"2023-10-06T03:24:52.896662+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:20:09.762572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"37'2","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.912988+0000","last_change":"2023-10-06T03:24:51.893036+0000","last_active":"2023-10-06T03:24:52.912988+0000","last_peered":"2023-10-06T03:24:52.912988+0000","last_clean":"2023-10-06T03:24:52.912988+0000","last_became_active":"2023-10-06T03:24:51.892668+0000","last_became_peered":"2023-10-06T03:24:51.892668+0000","last_unstale":"2023-10-06T03:24:52.912988+0000","last_undegraded":"2023-10-06T03:24:52.912988+0000","last_fullsized":"2023-10-06T03:24:52.912988+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:20.147715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T03:24:51.873802+0000","last_change":"2023-10-06T03:23:34.865125+0000","last_active":"2023-10-06T03:24:51.873802+0000","last_peered":"2023-10-06T03:24:51.873802+0000","last_clean":"2023-10-06T03:24:51.873802+0000","last_became_active":"2023-10-06T03:23:34.864752+0000","last_became_peered":"2023-10-06T03:23:34.864752+0000","last_unstale":"2023-10-06T03:24:51.873802+0000","last_undegraded":"2023-10-06T03:24:51.873802+0000","last_fullsized":"2023-10-06T03:24:51.873802+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:00.374963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.901704+0000","last_change":"2023-10-06T03:24:52.901704+0000","last_active":"2023-10-06T03:24:52.901704+0000","last_peered":"2023-10-06T03:24:52.901704+0000","last_clean":"2023-10-06T03:24:52.901704+0000","last_became_active":"2023-10-06T03:24:52.901449+0000","last_became_peered":"2023-10-06T03:24:52.901449+0000","last_unstale":"2023-10-06T03:24:52.901704+0000","last_undegraded":"2023-10-06T03:24:52.901704+0000","last_fullsized":"2023-10-06T03:24:52.901704+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:48.777362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T03:24:51.898089+0000","last_change":"2023-10-06T03:24:51.896585+0000","last_active":"2023-10-06T03:24:51.898089+0000","last_peered":"2023-10-06T03:24:51.898089+0000","last_clean":"2023-10-06T03:24:51.898089+0000","last_became_active":"2023-10-06T03:24:51.896289+0000","last_became_peered":"2023-10-06T03:24:51.896289+0000","last_unstale":"2023-10-06T03:24:51.898089+0000","last_undegraded":"2023-10-06T03:24:51.898089+0000","last_fullsized":"2023-10-06T03:24:51.898089+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:25:52.145014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T03:24:51.885058+0000","last_change":"2023-10-06T03:23:34.864329+0000","last_active":"2023-10-06T03:24:51.885058+0000","last_peered":"2023-10-06T03:24:51.885058+0000","last_clean":"2023-10-06T03:24:51.885058+0000","last_became_active":"2023-10-06T03:23:34.863953+0000","last_became_peered":"2023-10-06T03:23:34.863953+0000","last_unstale":"2023-10-06T03:24:51.885058+0000","last_undegraded":"2023-10-06T03:24:51.885058+0000","last_fullsized":"2023-10-06T03:24:51.885058+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:30.204999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.894422+0000","last_change":"2023-10-06T03:24:52.894422+0000","last_active":"2023-10-06T03:24:52.894422+0000","last_peered":"2023-10-06T03:24:52.894422+0000","last_clean":"2023-10-06T03:24:52.894422+0000","last_became_active":"2023-10-06T03:24:52.892882+0000","last_became_peered":"2023-10-06T03:24:52.892882+0000","last_unstale":"2023-10-06T03:24:52.894422+0000","last_undegraded":"2023-10-06T03:24:52.894422+0000","last_fullsized":"2023-10-06T03:24:52.894422+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:21:41.768629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T03:24:51.901773+0000","last_change":"2023-10-06T03:24:51.898863+0000","last_active":"2023-10-06T03:24:51.901773+0000","last_peered":"2023-10-06T03:24:51.901773+0000","last_clean":"2023-10-06T03:24:51.901773+0000","last_became_active":"2023-10-06T03:24:51.898601+0000","last_became_peered":"2023-10-06T03:24:51.898601+0000","last_unstale":"2023-10-06T03:24:51.901773+0000","last_undegraded":"2023-10-06T03:24:51.901773+0000","last_fullsized":"2023-10-06T03:24:51.901773+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:07:33.659992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T03:24:51.898766+0000","last_change":"2023-10-06T03:23:34.873939+0000","last_active":"2023-10-06T03:24:51.898766+0000","last_peered":"2023-10-06T03:24:51.898766+0000","last_clean":"2023-10-06T03:24:51.898766+0000","last_became_active":"2023-10-06T03:23:34.873623+0000","last_became_peered":"2023-10-06T03:23:34.873623+0000","last_unstale":"2023-10-06T03:24:51.898766+0000","last_undegraded":"2023-10-06T03:24:51.898766+0000","last_fullsized":"2023-10-06T03:24:51.898766+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:30.204999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.909550+0000","last_change":"2023-10-06T03:24:52.909550+0000","last_active":"2023-10-06T03:24:52.909550+0000","last_peered":"2023-10-06T03:24:52.909550+0000","last_clean":"2023-10-06T03:24:52.909550+0000","last_became_active":"2023-10-06T03:24:52.909184+0000","last_became_peered":"2023-10-06T03:24:52.909184+0000","last_unstale":"2023-10-06T03:24:52.909550+0000","last_undegraded":"2023-10-06T03:24:52.909550+0000","last_fullsized":"2023-10-06T03:24:52.909550+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:42:07.439014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T03:24:51.898431+0000","last_change":"2023-10-06T03:24:51.895997+0000","last_active":"2023-10-06T03:24:51.898431+0000","last_peered":"2023-10-06T03:24:51.898431+0000","last_clean":"2023-10-06T03:24:51.898431+0000","last_became_active":"2023-10-06T03:24:51.895729+0000","last_became_peered":"2023-10-06T03:24:51.895729+0000","last_unstale":"2023-10-06T03:24:51.898431+0000","last_undegraded":"2023-10-06T03:24:51.898431+0000","last_fullsized":"2023-10-06T03:24:51.898431+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:22:49.453657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T03:24:51.897474+0000","last_change":"2023-10-06T03:23:34.872453+0000","last_active":"2023-10-06T03:24:51.897474+0000","last_peered":"2023-10-06T03:24:51.897474+0000","last_clean":"2023-10-06T03:24:51.897474+0000","last_became_active":"2023-10-06T03:23:34.872139+0000","last_became_peered":"2023-10-06T03:23:34.872139+0000","last_unstale":"2023-10-06T03:24:51.897474+0000","last_undegraded":"2023-10-06T03:24:51.897474+0000","last_fullsized":"2023-10-06T03:24:51.897474+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:25:46.214290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298288,"kb_used_data":1000,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073552,"statfs":{"total":96636764160,"available":96331317248,"internally_reserved":0,"allocated":1024000,"data_stored":780480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.55100000000000005}]},{"osd":1,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.501}]},{"osd":2,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.52700000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.624}]},{"osd":4,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.79300000000000004}]},{"osd":5,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.59999999999999998}]},{"osd":6,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.76300000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297708,"kb_used_data":420,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074132,"statfs":{"total":96636764160,"available":96331911168,"internally_reserved":0,"allocated":430080,"data_stored":189313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.54300000000000004}]},{"osd":1,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.72799999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.60699999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.65800000000000003}]},{"osd":4,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.78900000000000003}]},{"osd":5,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.76000000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.77600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298288,"kb_used_data":1000,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073552,"statfs":{"total":96636764160,"available":96331317248,"internally_reserved":0,"allocated":1024000,"data_stored":780460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:35 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.46600000000000003}]},{"osd":2,"last update":"Fri Oct 6 03:24:35 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.39900000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:24:35 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.434},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.49199999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:24:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.81999999999999995}]},{"osd":5,"last update":"Fri Oct 6 03:24:35 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.68899999999999995}]},{"osd":6,"last update":"Fri Oct 6 03:24:35 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.80200000000000005}]},{"osd":7,"last update":"Fri Oct 6 03:24:35 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.69499999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297708,"kb_used_data":420,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074132,"statfs":{"total":96636764160,"available":96331911168,"internally_reserved":0,"allocated":430080,"data_stored":190056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.42899999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.441},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.38700000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.47799999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.64100000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.68000000000000005}]},{"osd":6,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.76900000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.68999999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297692,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074148,"statfs":{"total":96636764160,"available":96331927552,"internally_reserved":0,"allocated":413696,"data_stored":182586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.53500000000000003}]},{"osd":1,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.499}]},{"osd":3,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":0.40500000000000003}]},{"osd":4,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.81599999999999995}]},{"osd":5,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.61899999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.66200000000000003}]},{"osd":7,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.70999999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297692,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074148,"statfs":{"total":96636764160,"available":96331927552,"internally_reserved":0,"allocated":413696,"data_stored":182586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.442}]},{"osd":1,"last update":"Fri Oct 6 03:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.371}]},{"osd":2,"last update":"Fri Oct 6 03:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.38800000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.76800000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.78100000000000003}]},{"osd":6,"last update":"Fri Oct 6 03:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.72799999999999998}]},{"osd":7,"last update":"Fri Oct 6 03:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.71599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297716,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074124,"statfs":{"total":96636764160,"available":96331902976,"internally_reserved":0,"allocated":438272,"data_stored":191558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":1.012}]},{"osd":1,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.90900000000000003}]},{"osd":2,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.82599999999999996}]},{"osd":3,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.92900000000000005}]},{"osd":5,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.59799999999999998}]},{"osd":6,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.61799999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.77800000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297708,"kb_used_data":420,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074132,"statfs":{"total":96636764160,"available":96331911168,"internally_reserved":0,"allocated":430080,"data_stored":190092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.59299999999999997}]},{"osd":1,"last update":"Fri Oct 6 03:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.54400000000000004}]},{"osd":2,"last update":"Fri Oct 6 03:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.82699999999999996}]},{"osd":3,"last update":"Fri Oct 6 03:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.89700000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.65100000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.87},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":0.77100000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.92000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:24:57.215 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:24:57.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.425+0000 7fa26ebff700 1 Processor -- start 2023-10-06T03:24:57.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.426+0000 7fa26ebff700 1 -- start start 2023-10-06T03:24:57.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.427+0000 7fa26ebff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa2680af930 0x7fa2680ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:57.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.427+0000 7fa26ebff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2680cd270 0x7fa2680b0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:57.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.427+0000 7fa26ebff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2680b0760 con 0x7fa2680af560 2023-10-06T03:24:57.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.427+0000 7fa26ebff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2680cbd20 con 0x7fa2680af930 2023-10-06T03:24:57.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.427+0000 7fa26ebff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2680cd6c0 con 0x7fa2680cd270 2023-10-06T03:24:57.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.427+0000 7fa267fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa2680af930 0x7fa2680ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:57.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.427+0000 7fa26c99b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa2680af560 0x7fa2680cf2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42002/0 (socket says 172.21.15.81:42002) 2023-10-06T03:24:57.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.427+0000 7fa26c99b700 1 -- 172.21.15.81:0/2487174615 learned_addr learned my addr 172.21.15.81:0/2487174615 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:24:57.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.427+0000 7fa26d19c700 1 --2- 172.21.15.81:0/2487174615 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2680cd270 0x7fa2680b0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:57.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.427+0000 7fa267fff700 1 -- 172.21.15.81:0/2487174615 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2680cd270 msgr2=0x7fa2680b0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:57.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.428+0000 7fa267fff700 1 --2- 172.21.15.81:0/2487174615 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2680cd270 0x7fa2680b0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:57.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.428+0000 7fa267fff700 1 -- 172.21.15.81:0/2487174615 >> v1:172.21.15.81:6789/0 conn(0x7fa2680af560 legacy=0x7fa2680cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:57.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.427+0000 7fa2677fe700 1 -- 172.21.15.81:0/2487174615 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1876429842 0 0) 0x7fa2680b0760 con 0x7fa2680af560 2023-10-06T03:24:57.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.428+0000 7fa267fff700 1 -- 172.21.15.81:0/2487174615 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2680cfd50 con 0x7fa2680af930 2023-10-06T03:24:57.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.428+0000 7fa26d19c700 1 --2- 172.21.15.81:0/2487174615 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2680cd270 0x7fa2680b0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:57.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.428+0000 7fa267fff700 1 --2- 172.21.15.81:0/2487174615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2680af930 0x7fa2680ccd30 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa2540098e0 tx=0x7fa2540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d26cc0c5fa187391 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:57.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.428+0000 7fa2677fe700 1 -- 172.21.15.81:0/2487174615 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa254009e80 con 0x7fa2680af930 2023-10-06T03:24:57.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.428+0000 7fa2677fe700 1 -- 172.21.15.81:0/2487174615 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa25400b860 con 0x7fa2680af930 2023-10-06T03:24:57.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.428+0000 7fa2677fe700 1 -- 172.21.15.81:0/2487174615 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25400bbe0 con 0x7fa2680af930 2023-10-06T03:24:57.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.429+0000 7fa26ebff700 1 -- 172.21.15.81:0/2487174615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2680af930 msgr2=0x7fa2680ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:57.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.429+0000 7fa26ebff700 1 --2- 172.21.15.81:0/2487174615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2680af930 0x7fa2680ccd30 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa2540098e0 tx=0x7fa2540091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:57.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.429+0000 7fa26ebff700 1 -- 172.21.15.81:0/2487174615 shutdown_connections 2023-10-06T03:24:57.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.429+0000 7fa26ebff700 1 --2- 172.21.15.81:0/2487174615 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2680cd270 0x7fa2680b0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:57.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.429+0000 7fa26ebff700 1 --2- 172.21.15.81:0/2487174615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2680af930 0x7fa2680ccd30 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:57.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.429+0000 7fa26ebff700 1 -- 172.21.15.81:0/2487174615 >> 172.21.15.81:0/2487174615 conn(0x7fa26806ed10 msgr2=0x7fa26806f110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:57.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.429+0000 7fa26ebff700 1 -- 172.21.15.81:0/2487174615 shutdown_connections 2023-10-06T03:24:57.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.429+0000 7fa26ebff700 1 -- 172.21.15.81:0/2487174615 wait complete. 2023-10-06T03:24:57.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.430+0000 7fa26ebff700 1 Processor -- start 2023-10-06T03:24:57.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.430+0000 7fa26ebff700 1 -- start start 2023-10-06T03:24:57.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.431+0000 7fa26ebff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2680af560 0x7fa2681480d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:57.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.431+0000 7fa26ebff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2680af930 0x7fa26815c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:57.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.431+0000 7fa26ebff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2680cd270 0x7fa26815a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:57.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.431+0000 7fa26ebff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa268156270 con 0x7fa2680af560 2023-10-06T03:24:57.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.431+0000 7fa26ebff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa268148610 con 0x7fa2680af930 2023-10-06T03:24:57.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.431+0000 7fa26ebff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa26816ab80 con 0x7fa2680cd270 2023-10-06T03:24:57.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.431+0000 7fa26c99b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2680af560 0x7fa2681480d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:57.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.431+0000 7fa26c99b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2680af560 0x7fa2681480d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42234/0 (socket says 172.21.15.81:42234) 2023-10-06T03:24:57.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.431+0000 7fa26c99b700 1 -- 172.21.15.81:0/71179352 learned_addr learned my addr 172.21.15.81:0/71179352 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:57.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.432+0000 7fa267fff700 1 --2- 172.21.15.81:0/71179352 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2680af930 0x7fa26815c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:57.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.432+0000 7fa26d19c700 1 --2- 172.21.15.81:0/71179352 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2680cd270 0x7fa26815a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:57.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.432+0000 7fa26c99b700 1 -- 172.21.15.81:0/71179352 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2680cd270 msgr2=0x7fa26815a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:57.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.432+0000 7fa26c99b700 1 --2- 172.21.15.81:0/71179352 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2680cd270 0x7fa26815a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:57.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.432+0000 7fa26c99b700 1 -- 172.21.15.81:0/71179352 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2680af930 msgr2=0x7fa26815c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:57.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.432+0000 7fa26c99b700 1 --2- 172.21.15.81:0/71179352 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2680af930 0x7fa26815c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:57.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.432+0000 7fa26c99b700 1 -- 172.21.15.81:0/71179352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa254009420 con 0x7fa2680af560 2023-10-06T03:24:57.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.432+0000 7fa26c99b700 1 --2- 172.21.15.81:0/71179352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2680af560 0x7fa2681480d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa25c00c5e0 tx=0x7fa25c001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:57.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.432+0000 7fa264ff9700 1 -- 172.21.15.81:0/71179352 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25c005b30 con 0x7fa2680af560 2023-10-06T03:24:57.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.432+0000 7fa264ff9700 1 -- 172.21.15.81:0/71179352 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa25c005c90 con 0x7fa2680af560 2023-10-06T03:24:57.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.432+0000 7fa264ff9700 1 -- 172.21.15.81:0/71179352 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25c007300 con 0x7fa2680af560 2023-10-06T03:24:57.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.432+0000 7fa26ebff700 1 -- 172.21.15.81:0/71179352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2680b3ea0 con 0x7fa2680af560 2023-10-06T03:24:57.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.432+0000 7fa26ebff700 1 -- 172.21.15.81:0/71179352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa26816a8a0 con 0x7fa2680af560 2023-10-06T03:24:57.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.433+0000 7fa26ebff700 1 -- 172.21.15.81:0/71179352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa26804c3c0 con 0x7fa2680af560 2023-10-06T03:24:57.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.434+0000 7fa264ff9700 1 -- 172.21.15.81:0/71179352 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa25c01b3b0 con 0x7fa2680af560 2023-10-06T03:24:57.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.436+0000 7fa264ff9700 1 --2- 172.21.15.81:0/71179352 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa24c066f30 0x7fa24c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:57.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.436+0000 7fa264ff9700 1 -- 172.21.15.81:0/71179352 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fa25c083ce0 con 0x7fa2680af560 2023-10-06T03:24:57.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.436+0000 7fa267fff700 1 --2- 172.21.15.81:0/71179352 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa24c066f30 0x7fa24c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:57.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.436+0000 7fa267fff700 1 --2- 172.21.15.81:0/71179352 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa24c066f30 0x7fa24c0693e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa2680afd00 tx=0x7fa254017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:57.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.440+0000 7fa264ff9700 1 -- 172.21.15.81:0/71179352 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa25c050cb0 con 0x7fa2680af560 2023-10-06T03:24:57.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.627+0000 7fa26ebff700 1 -- 172.21.15.81:0/71179352 --> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa2680d0030 con 0x7fa24c066f30 2023-10-06T03:24:57.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.637+0000 7fa264ff9700 1 -- 172.21.15.81:0/71179352 <== mgr.4100 v2:172.21.15.81:6832/85286 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311471 (secure 0 0 0) 0x7fa2680d0030 con 0x7fa24c066f30 2023-10-06T03:24:57.643 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:24:57.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.641+0000 7fa26ebff700 1 -- 172.21.15.81:0/71179352 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa24c066f30 msgr2=0x7fa24c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:57.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.641+0000 7fa26ebff700 1 --2- 172.21.15.81:0/71179352 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa24c066f30 0x7fa24c0693e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa2680afd00 tx=0x7fa254017000 comp rx=0 tx=0).stop 2023-10-06T03:24:57.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.641+0000 7fa26ebff700 1 -- 172.21.15.81:0/71179352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2680af560 msgr2=0x7fa2681480d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:57.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.641+0000 7fa26ebff700 1 --2- 172.21.15.81:0/71179352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2680af560 0x7fa2681480d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa25c00c5e0 tx=0x7fa25c001070 comp rx=0 tx=0).stop 2023-10-06T03:24:57.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.641+0000 7fa26ebff700 1 -- 172.21.15.81:0/71179352 shutdown_connections 2023-10-06T03:24:57.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.641+0000 7fa26ebff700 1 --2- 172.21.15.81:0/71179352 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa24c066f30 0x7fa24c0693e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:57.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.641+0000 7fa26ebff700 1 --2- 172.21.15.81:0/71179352 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2680cd270 0x7fa26815a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:57.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.641+0000 7fa26ebff700 1 --2- 172.21.15.81:0/71179352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2680af560 0x7fa2681480d0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:57.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.641+0000 7fa26ebff700 1 --2- 172.21.15.81:0/71179352 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2680af930 0x7fa26815c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:57.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.641+0000 7fa26ebff700 1 -- 172.21.15.81:0/71179352 >> 172.21.15.81:0/71179352 conn(0x7fa26806ed10 msgr2=0x7fa2680c6790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:57.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.641+0000 7fa26ebff700 1 -- 172.21.15.81:0/71179352 shutdown_connections 2023-10-06T03:24:57.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.641+0000 7fa26ebff700 1 -- 172.21.15.81:0/71179352 wait complete. 2023-10-06T03:24:57.646 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-06T03:24:57.661 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2023-10-06T03:24:57.569635+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":125,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382800,"kb_used_data":4496,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752591920,"statfs":{"total":773094113280,"available":770654126080,"internally_reserved":0,"allocated":4603904,"data_stored":2687131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001143"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.897461+0000","last_change":"2023-10-06T03:24:52.897461+0000","last_active":"2023-10-06T03:24:52.897461+0000","last_peered":"2023-10-06T03:24:52.897461+0000","last_clean":"2023-10-06T03:24:52.897461+0000","last_became_active":"2023-10-06T03:24:52.897152+0000","last_became_peered":"2023-10-06T03:24:52.897152+0000","last_unstale":"2023-10-06T03:24:52.897461+0000","last_undegraded":"2023-10-06T03:24:52.897461+0000","last_fullsized":"2023-10-06T03:24:52.897461+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:21:41.768629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.898209+0000","last_change":"2023-10-06T03:24:52.898209+0000","last_active":"2023-10-06T03:24:52.898209+0000","last_peered":"2023-10-06T03:24:52.898209+0000","last_clean":"2023-10-06T03:24:52.898209+0000","last_became_active":"2023-10-06T03:24:52.897942+0000","last_became_peered":"2023-10-06T03:24:52.897942+0000","last_unstale":"2023-10-06T03:24:52.898209+0000","last_undegraded":"2023-10-06T03:24:52.898209+0000","last_fullsized":"2023-10-06T03:24:52.898209+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:19:38.234484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.911044+0000","last_change":"2023-10-06T03:24:52.911044+0000","last_active":"2023-10-06T03:24:52.911044+0000","last_peered":"2023-10-06T03:24:52.911044+0000","last_clean":"2023-10-06T03:24:52.911044+0000","last_became_active":"2023-10-06T03:24:52.910768+0000","last_became_peered":"2023-10-06T03:24:52.910768+0000","last_unstale":"2023-10-06T03:24:52.911044+0000","last_undegraded":"2023-10-06T03:24:52.911044+0000","last_fullsized":"2023-10-06T03:24:52.911044+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:55:10.923774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.906642+0000","last_change":"2023-10-06T03:24:52.906642+0000","last_active":"2023-10-06T03:24:52.906642+0000","last_peered":"2023-10-06T03:24:52.906642+0000","last_clean":"2023-10-06T03:24:52.906642+0000","last_became_active":"2023-10-06T03:24:52.906258+0000","last_became_peered":"2023-10-06T03:24:52.906258+0000","last_unstale":"2023-10-06T03:24:52.906642+0000","last_undegraded":"2023-10-06T03:24:52.906642+0000","last_fullsized":"2023-10-06T03:24:52.906642+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:07:33.466087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.899906+0000","last_change":"2023-10-06T03:24:52.899906+0000","last_active":"2023-10-06T03:24:52.899906+0000","last_peered":"2023-10-06T03:24:52.899906+0000","last_clean":"2023-10-06T03:24:52.899906+0000","last_became_active":"2023-10-06T03:24:52.898552+0000","last_became_peered":"2023-10-06T03:24:52.898552+0000","last_unstale":"2023-10-06T03:24:52.899906+0000","last_undegraded":"2023-10-06T03:24:52.899906+0000","last_fullsized":"2023-10-06T03:24:52.899906+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:25:53.153625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.902889+0000","last_change":"2023-10-06T03:24:52.902889+0000","last_active":"2023-10-06T03:24:52.902889+0000","last_peered":"2023-10-06T03:24:52.902889+0000","last_clean":"2023-10-06T03:24:52.902889+0000","last_became_active":"2023-10-06T03:24:52.902326+0000","last_became_peered":"2023-10-06T03:24:52.902326+0000","last_unstale":"2023-10-06T03:24:52.902889+0000","last_undegraded":"2023-10-06T03:24:52.902889+0000","last_fullsized":"2023-10-06T03:24:52.902889+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:23:00.964971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.904345+0000","last_change":"2023-10-06T03:24:52.904345+0000","last_active":"2023-10-06T03:24:52.904345+0000","last_peered":"2023-10-06T03:24:52.904345+0000","last_clean":"2023-10-06T03:24:52.904345+0000","last_became_active":"2023-10-06T03:24:52.904090+0000","last_became_peered":"2023-10-06T03:24:52.904090+0000","last_unstale":"2023-10-06T03:24:52.904345+0000","last_undegraded":"2023-10-06T03:24:52.904345+0000","last_fullsized":"2023-10-06T03:24:52.904345+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:39:39.788711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.907518+0000","last_change":"2023-10-06T03:24:52.907518+0000","last_active":"2023-10-06T03:24:52.907518+0000","last_peered":"2023-10-06T03:24:52.907518+0000","last_clean":"2023-10-06T03:24:52.907518+0000","last_became_active":"2023-10-06T03:24:52.907099+0000","last_became_peered":"2023-10-06T03:24:52.907099+0000","last_unstale":"2023-10-06T03:24:52.907518+0000","last_undegraded":"2023-10-06T03:24:52.907518+0000","last_fullsized":"2023-10-06T03:24:52.907518+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:55:10.923774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.907375+0000","last_change":"2023-10-06T03:24:52.907375+0000","last_active":"2023-10-06T03:24:52.907375+0000","last_peered":"2023-10-06T03:24:52.907375+0000","last_clean":"2023-10-06T03:24:52.907375+0000","last_became_active":"2023-10-06T03:24:52.906566+0000","last_became_peered":"2023-10-06T03:24:52.906566+0000","last_unstale":"2023-10-06T03:24:52.907375+0000","last_undegraded":"2023-10-06T03:24:52.907375+0000","last_fullsized":"2023-10-06T03:24:52.907375+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:37.077847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.906894+0000","last_change":"2023-10-06T03:24:52.906894+0000","last_active":"2023-10-06T03:24:52.906894+0000","last_peered":"2023-10-06T03:24:52.906894+0000","last_clean":"2023-10-06T03:24:52.906894+0000","last_became_active":"2023-10-06T03:24:52.906619+0000","last_became_peered":"2023-10-06T03:24:52.906619+0000","last_unstale":"2023-10-06T03:24:52.906894+0000","last_undegraded":"2023-10-06T03:24:52.906894+0000","last_fullsized":"2023-10-06T03:24:52.906894+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:57.998695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.909562+0000","last_change":"2023-10-06T03:24:52.909562+0000","last_active":"2023-10-06T03:24:52.909562+0000","last_peered":"2023-10-06T03:24:52.909562+0000","last_clean":"2023-10-06T03:24:52.909562+0000","last_became_active":"2023-10-06T03:24:52.909289+0000","last_became_peered":"2023-10-06T03:24:52.909289+0000","last_unstale":"2023-10-06T03:24:52.909562+0000","last_undegraded":"2023-10-06T03:24:52.909562+0000","last_fullsized":"2023-10-06T03:24:52.909562+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:13:28.806646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.900489+0000","last_change":"2023-10-06T03:24:52.900489+0000","last_active":"2023-10-06T03:24:52.900489+0000","last_peered":"2023-10-06T03:24:52.900489+0000","last_clean":"2023-10-06T03:24:52.900489+0000","last_became_active":"2023-10-06T03:24:52.900121+0000","last_became_peered":"2023-10-06T03:24:52.900121+0000","last_unstale":"2023-10-06T03:24:52.900489+0000","last_undegraded":"2023-10-06T03:24:52.900489+0000","last_fullsized":"2023-10-06T03:24:52.900489+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:13:34.088412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.903126+0000","last_change":"2023-10-06T03:24:52.903126+0000","last_active":"2023-10-06T03:24:52.903126+0000","last_peered":"2023-10-06T03:24:52.903126+0000","last_clean":"2023-10-06T03:24:52.903126+0000","last_became_active":"2023-10-06T03:24:52.902882+0000","last_became_peered":"2023-10-06T03:24:52.902882+0000","last_unstale":"2023-10-06T03:24:52.903126+0000","last_undegraded":"2023-10-06T03:24:52.903126+0000","last_fullsized":"2023-10-06T03:24:52.903126+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:07:34.668603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.905927+0000","last_change":"2023-10-06T03:24:52.905927+0000","last_active":"2023-10-06T03:24:52.905927+0000","last_peered":"2023-10-06T03:24:52.905927+0000","last_clean":"2023-10-06T03:24:52.905927+0000","last_became_active":"2023-10-06T03:24:52.905675+0000","last_became_peered":"2023-10-06T03:24:52.905675+0000","last_unstale":"2023-10-06T03:24:52.905927+0000","last_undegraded":"2023-10-06T03:24:52.905927+0000","last_fullsized":"2023-10-06T03:24:52.905927+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:09:31.423278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.902002+0000","last_change":"2023-10-06T03:24:52.902002+0000","last_active":"2023-10-06T03:24:52.902002+0000","last_peered":"2023-10-06T03:24:52.902002+0000","last_clean":"2023-10-06T03:24:52.902002+0000","last_became_active":"2023-10-06T03:24:52.901518+0000","last_became_peered":"2023-10-06T03:24:52.901518+0000","last_unstale":"2023-10-06T03:24:52.902002+0000","last_undegraded":"2023-10-06T03:24:52.902002+0000","last_fullsized":"2023-10-06T03:24:52.902002+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:16:25.142515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.903138+0000","last_change":"2023-10-06T03:24:52.903138+0000","last_active":"2023-10-06T03:24:52.903138+0000","last_peered":"2023-10-06T03:24:52.903138+0000","last_clean":"2023-10-06T03:24:52.903138+0000","last_became_active":"2023-10-06T03:24:52.902865+0000","last_became_peered":"2023-10-06T03:24:52.902865+0000","last_unstale":"2023-10-06T03:24:52.903138+0000","last_undegraded":"2023-10-06T03:24:52.903138+0000","last_fullsized":"2023-10-06T03:24:52.903138+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:20.294316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.890961+0000","last_change":"2023-10-06T03:24:52.890961+0000","last_active":"2023-10-06T03:24:52.890961+0000","last_peered":"2023-10-06T03:24:52.890961+0000","last_clean":"2023-10-06T03:24:52.890961+0000","last_became_active":"2023-10-06T03:24:52.890503+0000","last_became_peered":"2023-10-06T03:24:52.890503+0000","last_unstale":"2023-10-06T03:24:52.890961+0000","last_undegraded":"2023-10-06T03:24:52.890961+0000","last_fullsized":"2023-10-06T03:24:52.890961+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:16:25.142515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.898060+0000","last_change":"2023-10-06T03:24:52.898060+0000","last_active":"2023-10-06T03:24:52.898060+0000","last_peered":"2023-10-06T03:24:52.898060+0000","last_clean":"2023-10-06T03:24:52.898060+0000","last_became_active":"2023-10-06T03:24:52.897632+0000","last_became_peered":"2023-10-06T03:24:52.897632+0000","last_unstale":"2023-10-06T03:24:52.898060+0000","last_undegraded":"2023-10-06T03:24:52.898060+0000","last_fullsized":"2023-10-06T03:24:52.898060+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:29:27.289344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.901825+0000","last_change":"2023-10-06T03:24:52.901825+0000","last_active":"2023-10-06T03:24:52.901825+0000","last_peered":"2023-10-06T03:24:52.901825+0000","last_clean":"2023-10-06T03:24:52.901825+0000","last_became_active":"2023-10-06T03:24:52.901542+0000","last_became_peered":"2023-10-06T03:24:52.901542+0000","last_unstale":"2023-10-06T03:24:52.901825+0000","last_undegraded":"2023-10-06T03:24:52.901825+0000","last_fullsized":"2023-10-06T03:24:52.901825+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:21.156326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.899212+0000","last_change":"2023-10-06T03:24:52.899212+0000","last_active":"2023-10-06T03:24:52.899212+0000","last_peered":"2023-10-06T03:24:52.899212+0000","last_clean":"2023-10-06T03:24:52.899212+0000","last_became_active":"2023-10-06T03:24:52.898943+0000","last_became_peered":"2023-10-06T03:24:52.898943+0000","last_unstale":"2023-10-06T03:24:52.899212+0000","last_undegraded":"2023-10-06T03:24:52.899212+0000","last_fullsized":"2023-10-06T03:24:52.899212+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:14.189954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.902183+0000","last_change":"2023-10-06T03:24:52.902183+0000","last_active":"2023-10-06T03:24:52.902183+0000","last_peered":"2023-10-06T03:24:52.902183+0000","last_clean":"2023-10-06T03:24:52.902183+0000","last_became_active":"2023-10-06T03:24:52.901811+0000","last_became_peered":"2023-10-06T03:24:52.901811+0000","last_unstale":"2023-10-06T03:24:52.902183+0000","last_undegraded":"2023-10-06T03:24:52.902183+0000","last_fullsized":"2023-10-06T03:24:52.902183+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:15:18.163195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.906447+0000","last_change":"2023-10-06T03:24:52.906447+0000","last_active":"2023-10-06T03:24:52.906447+0000","last_peered":"2023-10-06T03:24:52.906447+0000","last_clean":"2023-10-06T03:24:52.906447+0000","last_became_active":"2023-10-06T03:24:52.906165+0000","last_became_peered":"2023-10-06T03:24:52.906165+0000","last_unstale":"2023-10-06T03:24:52.906447+0000","last_undegraded":"2023-10-06T03:24:52.906447+0000","last_fullsized":"2023-10-06T03:24:52.906447+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:04:27.035319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.895400+0000","last_change":"2023-10-06T03:24:52.895400+0000","last_active":"2023-10-06T03:24:52.895400+0000","last_peered":"2023-10-06T03:24:52.895400+0000","last_clean":"2023-10-06T03:24:52.895400+0000","last_became_active":"2023-10-06T03:24:52.895092+0000","last_became_peered":"2023-10-06T03:24:52.895092+0000","last_unstale":"2023-10-06T03:24:52.895400+0000","last_undegraded":"2023-10-06T03:24:52.895400+0000","last_fullsized":"2023-10-06T03:24:52.895400+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:14.189954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.892004+0000","last_change":"2023-10-06T03:24:52.892004+0000","last_active":"2023-10-06T03:24:52.892004+0000","last_peered":"2023-10-06T03:24:52.892004+0000","last_clean":"2023-10-06T03:24:52.892004+0000","last_became_active":"2023-10-06T03:24:52.891503+0000","last_became_peered":"2023-10-06T03:24:52.891503+0000","last_unstale":"2023-10-06T03:24:52.892004+0000","last_undegraded":"2023-10-06T03:24:52.892004+0000","last_fullsized":"2023-10-06T03:24:52.892004+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:28:59.340879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.905563+0000","last_change":"2023-10-06T03:24:52.905563+0000","last_active":"2023-10-06T03:24:52.905563+0000","last_peered":"2023-10-06T03:24:52.905563+0000","last_clean":"2023-10-06T03:24:52.905563+0000","last_became_active":"2023-10-06T03:24:52.905295+0000","last_became_peered":"2023-10-06T03:24:52.905295+0000","last_unstale":"2023-10-06T03:24:52.905563+0000","last_undegraded":"2023-10-06T03:24:52.905563+0000","last_fullsized":"2023-10-06T03:24:52.905563+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:47.477738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.893673+0000","last_change":"2023-10-06T03:24:52.893673+0000","last_active":"2023-10-06T03:24:52.893673+0000","last_peered":"2023-10-06T03:24:52.893673+0000","last_clean":"2023-10-06T03:24:52.893673+0000","last_became_active":"2023-10-06T03:24:52.893145+0000","last_became_peered":"2023-10-06T03:24:52.893145+0000","last_unstale":"2023-10-06T03:24:52.893673+0000","last_undegraded":"2023-10-06T03:24:52.893673+0000","last_fullsized":"2023-10-06T03:24:52.893673+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:31:32.821603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.902609+0000","last_change":"2023-10-06T03:24:52.902609+0000","last_active":"2023-10-06T03:24:52.902609+0000","last_peered":"2023-10-06T03:24:52.902609+0000","last_clean":"2023-10-06T03:24:52.902609+0000","last_became_active":"2023-10-06T03:24:52.902417+0000","last_became_peered":"2023-10-06T03:24:52.902417+0000","last_unstale":"2023-10-06T03:24:52.902609+0000","last_undegraded":"2023-10-06T03:24:52.902609+0000","last_fullsized":"2023-10-06T03:24:52.902609+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:23:00.964971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.900662+0000","last_change":"2023-10-06T03:24:52.900662+0000","last_active":"2023-10-06T03:24:52.900662+0000","last_peered":"2023-10-06T03:24:52.900662+0000","last_clean":"2023-10-06T03:24:52.900662+0000","last_became_active":"2023-10-06T03:24:52.899346+0000","last_became_peered":"2023-10-06T03:24:52.899346+0000","last_unstale":"2023-10-06T03:24:52.900662+0000","last_undegraded":"2023-10-06T03:24:52.900662+0000","last_fullsized":"2023-10-06T03:24:52.900662+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:37:21.626452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.906006+0000","last_change":"2023-10-06T03:24:52.906006+0000","last_active":"2023-10-06T03:24:52.906006+0000","last_peered":"2023-10-06T03:24:52.906006+0000","last_clean":"2023-10-06T03:24:52.906006+0000","last_became_active":"2023-10-06T03:24:52.905646+0000","last_became_peered":"2023-10-06T03:24:52.905646+0000","last_unstale":"2023-10-06T03:24:52.906006+0000","last_undegraded":"2023-10-06T03:24:52.906006+0000","last_fullsized":"2023-10-06T03:24:52.906006+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:15.569212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.893426+0000","last_change":"2023-10-06T03:24:52.893426+0000","last_active":"2023-10-06T03:24:52.893426+0000","last_peered":"2023-10-06T03:24:52.893426+0000","last_clean":"2023-10-06T03:24:52.893426+0000","last_became_active":"2023-10-06T03:24:52.892685+0000","last_became_peered":"2023-10-06T03:24:52.892685+0000","last_unstale":"2023-10-06T03:24:52.893426+0000","last_undegraded":"2023-10-06T03:24:52.893426+0000","last_fullsized":"2023-10-06T03:24:52.893426+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:51:58.806411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.901813+0000","last_change":"2023-10-06T03:24:52.901813+0000","last_active":"2023-10-06T03:24:52.901813+0000","last_peered":"2023-10-06T03:24:52.901813+0000","last_clean":"2023-10-06T03:24:52.901813+0000","last_became_active":"2023-10-06T03:24:52.901237+0000","last_became_peered":"2023-10-06T03:24:52.901237+0000","last_unstale":"2023-10-06T03:24:52.901813+0000","last_undegraded":"2023-10-06T03:24:52.901813+0000","last_fullsized":"2023-10-06T03:24:52.901813+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:51:58.806411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.894898+0000","last_change":"2023-10-06T03:24:52.894898+0000","last_active":"2023-10-06T03:24:52.894898+0000","last_peered":"2023-10-06T03:24:52.894898+0000","last_clean":"2023-10-06T03:24:52.894898+0000","last_became_active":"2023-10-06T03:24:52.894641+0000","last_became_peered":"2023-10-06T03:24:52.894641+0000","last_unstale":"2023-10-06T03:24:52.894898+0000","last_undegraded":"2023-10-06T03:24:52.894898+0000","last_fullsized":"2023-10-06T03:24:52.894898+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:43.207997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.914664+0000","last_change":"2023-10-06T03:24:52.914664+0000","last_active":"2023-10-06T03:24:52.914664+0000","last_peered":"2023-10-06T03:24:52.914664+0000","last_clean":"2023-10-06T03:24:52.914664+0000","last_became_active":"2023-10-06T03:24:52.914377+0000","last_became_peered":"2023-10-06T03:24:52.914377+0000","last_unstale":"2023-10-06T03:24:52.914664+0000","last_undegraded":"2023-10-06T03:24:52.914664+0000","last_fullsized":"2023-10-06T03:24:52.914664+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:20.294316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"37'4","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.910011+0000","last_change":"2023-10-06T03:24:51.897948+0000","last_active":"2023-10-06T03:24:52.910011+0000","last_peered":"2023-10-06T03:24:52.910011+0000","last_clean":"2023-10-06T03:24:52.910011+0000","last_became_active":"2023-10-06T03:24:51.897756+0000","last_became_peered":"2023-10-06T03:24:51.897756+0000","last_unstale":"2023-10-06T03:24:52.910011+0000","last_undegraded":"2023-10-06T03:24:52.910011+0000","last_fullsized":"2023-10-06T03:24:52.910011+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:39:38.780100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.898059+0000","last_change":"2023-10-06T03:24:52.898059+0000","last_active":"2023-10-06T03:24:52.898059+0000","last_peered":"2023-10-06T03:24:52.898059+0000","last_clean":"2023-10-06T03:24:52.898059+0000","last_became_active":"2023-10-06T03:24:52.897720+0000","last_became_peered":"2023-10-06T03:24:52.897720+0000","last_unstale":"2023-10-06T03:24:52.898059+0000","last_undegraded":"2023-10-06T03:24:52.898059+0000","last_fullsized":"2023-10-06T03:24:52.898059+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:22:50.462269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"37'1","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.889060+0000","last_change":"2023-10-06T03:24:51.897018+0000","last_active":"2023-10-06T03:24:52.889060+0000","last_peered":"2023-10-06T03:24:52.889060+0000","last_clean":"2023-10-06T03:24:52.889060+0000","last_became_active":"2023-10-06T03:24:51.896761+0000","last_became_peered":"2023-10-06T03:24:51.896761+0000","last_unstale":"2023-10-06T03:24:52.889060+0000","last_undegraded":"2023-10-06T03:24:52.889060+0000","last_fullsized":"2023-10-06T03:24:52.889060+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:30:12.116091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.905335+0000","last_change":"2023-10-06T03:24:52.905335+0000","last_active":"2023-10-06T03:24:52.905335+0000","last_peered":"2023-10-06T03:24:52.905335+0000","last_clean":"2023-10-06T03:24:52.905335+0000","last_became_active":"2023-10-06T03:24:52.904837+0000","last_became_peered":"2023-10-06T03:24:52.904837+0000","last_unstale":"2023-10-06T03:24:52.905335+0000","last_undegraded":"2023-10-06T03:24:52.905335+0000","last_fullsized":"2023-10-06T03:24:52.905335+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:29:39.027777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"37'2","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.914509+0000","last_change":"2023-10-06T03:24:51.895311+0000","last_active":"2023-10-06T03:24:52.914509+0000","last_peered":"2023-10-06T03:24:52.914509+0000","last_clean":"2023-10-06T03:24:52.914509+0000","last_became_active":"2023-10-06T03:24:51.894793+0000","last_became_peered":"2023-10-06T03:24:51.894793+0000","last_unstale":"2023-10-06T03:24:52.914509+0000","last_undegraded":"2023-10-06T03:24:52.914509+0000","last_fullsized":"2023-10-06T03:24:52.914509+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:33:45.228338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.898600+0000","last_change":"2023-10-06T03:24:52.898600+0000","last_active":"2023-10-06T03:24:52.898600+0000","last_peered":"2023-10-06T03:24:52.898600+0000","last_clean":"2023-10-06T03:24:52.898600+0000","last_became_active":"2023-10-06T03:24:52.898146+0000","last_became_peered":"2023-10-06T03:24:52.898146+0000","last_unstale":"2023-10-06T03:24:52.898600+0000","last_undegraded":"2023-10-06T03:24:52.898600+0000","last_fullsized":"2023-10-06T03:24:52.898600+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:21.156326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"37'2","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.910881+0000","last_change":"2023-10-06T03:24:51.895167+0000","last_active":"2023-10-06T03:24:52.910881+0000","last_peered":"2023-10-06T03:24:52.910881+0000","last_clean":"2023-10-06T03:24:52.910881+0000","last_became_active":"2023-10-06T03:24:51.894885+0000","last_became_peered":"2023-10-06T03:24:51.894885+0000","last_unstale":"2023-10-06T03:24:52.910881+0000","last_undegraded":"2023-10-06T03:24:52.910881+0000","last_fullsized":"2023-10-06T03:24:52.910881+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:20.147715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.908109+0000","last_change":"2023-10-06T03:24:52.908109+0000","last_active":"2023-10-06T03:24:52.908109+0000","last_peered":"2023-10-06T03:24:52.908109+0000","last_clean":"2023-10-06T03:24:52.908109+0000","last_became_active":"2023-10-06T03:24:52.907857+0000","last_became_peered":"2023-10-06T03:24:52.907857+0000","last_unstale":"2023-10-06T03:24:52.908109+0000","last_undegraded":"2023-10-06T03:24:52.908109+0000","last_fullsized":"2023-10-06T03:24:52.908109+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:45.950298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"37'1","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.883967+0000","last_change":"2023-10-06T03:24:51.888611+0000","last_active":"2023-10-06T03:24:52.883967+0000","last_peered":"2023-10-06T03:24:52.883967+0000","last_clean":"2023-10-06T03:24:52.883967+0000","last_became_active":"2023-10-06T03:24:51.888339+0000","last_became_peered":"2023-10-06T03:24:51.888339+0000","last_unstale":"2023-10-06T03:24:52.883967+0000","last_undegraded":"2023-10-06T03:24:52.883967+0000","last_fullsized":"2023-10-06T03:24:52.883967+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:13:33.079801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.896461+0000","last_change":"2023-10-06T03:24:52.896461+0000","last_active":"2023-10-06T03:24:52.896461+0000","last_peered":"2023-10-06T03:24:52.896461+0000","last_clean":"2023-10-06T03:24:52.896461+0000","last_became_active":"2023-10-06T03:24:52.895898+0000","last_became_peered":"2023-10-06T03:24:52.895898+0000","last_unstale":"2023-10-06T03:24:52.896461+0000","last_undegraded":"2023-10-06T03:24:52.896461+0000","last_fullsized":"2023-10-06T03:24:52.896461+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:36:59.402104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"37'1","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.883974+0000","last_change":"2023-10-06T03:24:51.896182+0000","last_active":"2023-10-06T03:24:52.883974+0000","last_peered":"2023-10-06T03:24:52.883974+0000","last_clean":"2023-10-06T03:24:52.883974+0000","last_became_active":"2023-10-06T03:24:51.895884+0000","last_became_peered":"2023-10-06T03:24:51.895884+0000","last_unstale":"2023-10-06T03:24:52.883974+0000","last_undegraded":"2023-10-06T03:24:52.883974+0000","last_fullsized":"2023-10-06T03:24:52.883974+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:37:20.617840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.907351+0000","last_change":"2023-10-06T03:24:52.907351+0000","last_active":"2023-10-06T03:24:52.907351+0000","last_peered":"2023-10-06T03:24:52.907351+0000","last_clean":"2023-10-06T03:24:52.907351+0000","last_became_active":"2023-10-06T03:24:52.906756+0000","last_became_peered":"2023-10-06T03:24:52.906756+0000","last_unstale":"2023-10-06T03:24:52.907351+0000","last_undegraded":"2023-10-06T03:24:52.907351+0000","last_fullsized":"2023-10-06T03:24:52.907351+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:47:01.894746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T03:24:51.898802+0000","last_change":"2023-10-06T03:24:51.893866+0000","last_active":"2023-10-06T03:24:51.898802+0000","last_peered":"2023-10-06T03:24:51.898802+0000","last_clean":"2023-10-06T03:24:51.898802+0000","last_became_active":"2023-10-06T03:24:51.893462+0000","last_became_peered":"2023-10-06T03:24:51.893462+0000","last_unstale":"2023-10-06T03:24:51.898802+0000","last_undegraded":"2023-10-06T03:24:51.898802+0000","last_fullsized":"2023-10-06T03:24:51.898802+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:47.768751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.887852+0000","last_change":"2023-10-06T03:24:52.887852+0000","last_active":"2023-10-06T03:24:52.887852+0000","last_peered":"2023-10-06T03:24:52.887852+0000","last_clean":"2023-10-06T03:24:52.887852+0000","last_became_active":"2023-10-06T03:24:52.887530+0000","last_became_peered":"2023-10-06T03:24:52.887530+0000","last_unstale":"2023-10-06T03:24:52.887852+0000","last_undegraded":"2023-10-06T03:24:52.887852+0000","last_fullsized":"2023-10-06T03:24:52.887852+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:33:46.236949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T03:24:51.901296+0000","last_change":"2023-10-06T03:24:51.897111+0000","last_active":"2023-10-06T03:24:51.901296+0000","last_peered":"2023-10-06T03:24:51.901296+0000","last_clean":"2023-10-06T03:24:51.901296+0000","last_became_active":"2023-10-06T03:24:51.896826+0000","last_became_peered":"2023-10-06T03:24:51.896826+0000","last_unstale":"2023-10-06T03:24:51.901296+0000","last_undegraded":"2023-10-06T03:24:51.901296+0000","last_fullsized":"2023-10-06T03:24:51.901296+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:47.768751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.897893+0000","last_change":"2023-10-06T03:24:52.897893+0000","last_active":"2023-10-06T03:24:52.897893+0000","last_peered":"2023-10-06T03:24:52.897893+0000","last_clean":"2023-10-06T03:24:52.897893+0000","last_became_active":"2023-10-06T03:24:52.897300+0000","last_became_peered":"2023-10-06T03:24:52.897300+0000","last_unstale":"2023-10-06T03:24:52.897893+0000","last_undegraded":"2023-10-06T03:24:52.897893+0000","last_fullsized":"2023-10-06T03:24:52.897893+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:15:18.163195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T03:24:51.898563+0000","last_change":"2023-10-06T03:24:51.891835+0000","last_active":"2023-10-06T03:24:51.898563+0000","last_peered":"2023-10-06T03:24:51.898563+0000","last_clean":"2023-10-06T03:24:51.898563+0000","last_became_active":"2023-10-06T03:24:51.891382+0000","last_became_peered":"2023-10-06T03:24:51.891382+0000","last_unstale":"2023-10-06T03:24:51.898563+0000","last_undegraded":"2023-10-06T03:24:51.898563+0000","last_fullsized":"2023-10-06T03:24:51.898563+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:23:44.701074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.887890+0000","last_change":"2023-10-06T03:24:52.887890+0000","last_active":"2023-10-06T03:24:52.887890+0000","last_peered":"2023-10-06T03:24:52.887890+0000","last_clean":"2023-10-06T03:24:52.887890+0000","last_became_active":"2023-10-06T03:24:52.887615+0000","last_became_peered":"2023-10-06T03:24:52.887615+0000","last_unstale":"2023-10-06T03:24:52.887890+0000","last_undegraded":"2023-10-06T03:24:52.887890+0000","last_fullsized":"2023-10-06T03:24:52.887890+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:13:34.088412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T03:24:51.896136+0000","last_change":"2023-10-06T03:24:51.892877+0000","last_active":"2023-10-06T03:24:51.896136+0000","last_peered":"2023-10-06T03:24:51.896136+0000","last_clean":"2023-10-06T03:24:51.896136+0000","last_became_active":"2023-10-06T03:24:51.892603+0000","last_became_peered":"2023-10-06T03:24:51.892603+0000","last_unstale":"2023-10-06T03:24:51.896136+0000","last_undegraded":"2023-10-06T03:24:51.896136+0000","last_fullsized":"2023-10-06T03:24:51.896136+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:19.285704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.903715+0000","last_change":"2023-10-06T03:24:52.903715+0000","last_active":"2023-10-06T03:24:52.903715+0000","last_peered":"2023-10-06T03:24:52.903715+0000","last_clean":"2023-10-06T03:24:52.903715+0000","last_became_active":"2023-10-06T03:24:52.903399+0000","last_became_peered":"2023-10-06T03:24:52.903399+0000","last_unstale":"2023-10-06T03:24:52.903715+0000","last_undegraded":"2023-10-06T03:24:52.903715+0000","last_fullsized":"2023-10-06T03:24:52.903715+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:47:01.894746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"37'3","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.911012+0000","last_change":"2023-10-06T03:24:51.897648+0000","last_active":"2023-10-06T03:24:52.911012+0000","last_peered":"2023-10-06T03:24:52.911012+0000","last_clean":"2023-10-06T03:24:52.911012+0000","last_became_active":"2023-10-06T03:24:51.897385+0000","last_became_peered":"2023-10-06T03:24:51.897385+0000","last_unstale":"2023-10-06T03:24:52.911012+0000","last_undegraded":"2023-10-06T03:24:52.911012+0000","last_fullsized":"2023-10-06T03:24:52.911012+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:19.285704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.897695+0000","last_change":"2023-10-06T03:24:52.897695+0000","last_active":"2023-10-06T03:24:52.897695+0000","last_peered":"2023-10-06T03:24:52.897695+0000","last_clean":"2023-10-06T03:24:52.897695+0000","last_became_active":"2023-10-06T03:24:52.897424+0000","last_became_peered":"2023-10-06T03:24:52.897424+0000","last_unstale":"2023-10-06T03:24:52.897695+0000","last_undegraded":"2023-10-06T03:24:52.897695+0000","last_fullsized":"2023-10-06T03:24:52.897695+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:13:48.810571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"37'6","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.910208+0000","last_change":"2023-10-06T03:24:51.890583+0000","last_active":"2023-10-06T03:24:52.910208+0000","last_peered":"2023-10-06T03:24:52.910208+0000","last_clean":"2023-10-06T03:24:52.910208+0000","last_became_active":"2023-10-06T03:24:51.890300+0000","last_became_peered":"2023-10-06T03:24:51.890300+0000","last_unstale":"2023-10-06T03:24:52.910208+0000","last_undegraded":"2023-10-06T03:24:52.910208+0000","last_fullsized":"2023-10-06T03:24:52.910208+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:36.134927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.902446+0000","last_change":"2023-10-06T03:24:52.902446+0000","last_active":"2023-10-06T03:24:52.902446+0000","last_peered":"2023-10-06T03:24:52.902446+0000","last_clean":"2023-10-06T03:24:52.902446+0000","last_became_active":"2023-10-06T03:24:52.902195+0000","last_became_peered":"2023-10-06T03:24:52.902195+0000","last_unstale":"2023-10-06T03:24:52.902446+0000","last_undegraded":"2023-10-06T03:24:52.902446+0000","last_fullsized":"2023-10-06T03:24:52.902446+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:15:35.754152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"37'2","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.910125+0000","last_change":"2023-10-06T03:24:51.899364+0000","last_active":"2023-10-06T03:24:52.910125+0000","last_peered":"2023-10-06T03:24:52.910125+0000","last_clean":"2023-10-06T03:24:52.910125+0000","last_became_active":"2023-10-06T03:24:51.899085+0000","last_became_peered":"2023-10-06T03:24:51.899085+0000","last_unstale":"2023-10-06T03:24:52.910125+0000","last_undegraded":"2023-10-06T03:24:52.910125+0000","last_fullsized":"2023-10-06T03:24:52.910125+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:19:37.225873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.889403+0000","last_change":"2023-10-06T03:24:52.889403+0000","last_active":"2023-10-06T03:24:52.889403+0000","last_peered":"2023-10-06T03:24:52.889403+0000","last_clean":"2023-10-06T03:24:52.889403+0000","last_became_active":"2023-10-06T03:24:52.889137+0000","last_became_peered":"2023-10-06T03:24:52.889137+0000","last_unstale":"2023-10-06T03:24:52.889403+0000","last_undegraded":"2023-10-06T03:24:52.889403+0000","last_fullsized":"2023-10-06T03:24:52.889403+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:37.052006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T03:24:51.887727+0000","last_change":"2023-10-06T03:24:51.884744+0000","last_active":"2023-10-06T03:24:51.887727+0000","last_peered":"2023-10-06T03:24:51.887727+0000","last_clean":"2023-10-06T03:24:51.887727+0000","last_became_active":"2023-10-06T03:24:51.884495+0000","last_became_peered":"2023-10-06T03:24:51.884495+0000","last_unstale":"2023-10-06T03:24:51.887727+0000","last_undegraded":"2023-10-06T03:24:51.887727+0000","last_fullsized":"2023-10-06T03:24:51.887727+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:46.469127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.901833+0000","last_change":"2023-10-06T03:24:52.901833+0000","last_active":"2023-10-06T03:24:52.901833+0000","last_peered":"2023-10-06T03:24:52.901833+0000","last_clean":"2023-10-06T03:24:52.901833+0000","last_became_active":"2023-10-06T03:24:52.901070+0000","last_became_peered":"2023-10-06T03:24:52.901070+0000","last_unstale":"2023-10-06T03:24:52.901833+0000","last_undegraded":"2023-10-06T03:24:52.901833+0000","last_fullsized":"2023-10-06T03:24:52.901833+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:57.998695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T03:24:51.905182+0000","last_change":"2023-10-06T03:24:51.899292+0000","last_active":"2023-10-06T03:24:51.905182+0000","last_peered":"2023-10-06T03:24:51.905182+0000","last_clean":"2023-10-06T03:24:51.905182+0000","last_became_active":"2023-10-06T03:24:51.899042+0000","last_became_peered":"2023-10-06T03:24:51.899042+0000","last_unstale":"2023-10-06T03:24:51.905182+0000","last_undegraded":"2023-10-06T03:24:51.905182+0000","last_fullsized":"2023-10-06T03:24:51.905182+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:37:20.617840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.899661+0000","last_change":"2023-10-06T03:24:52.899661+0000","last_active":"2023-10-06T03:24:52.899661+0000","last_peered":"2023-10-06T03:24:52.899661+0000","last_clean":"2023-10-06T03:24:52.899661+0000","last_became_active":"2023-10-06T03:24:52.899143+0000","last_became_peered":"2023-10-06T03:24:52.899143+0000","last_unstale":"2023-10-06T03:24:52.899661+0000","last_undegraded":"2023-10-06T03:24:52.899661+0000","last_fullsized":"2023-10-06T03:24:52.899661+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:29:39.027777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"37'8","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.915514+0000","last_change":"2023-10-06T03:24:51.896612+0000","last_active":"2023-10-06T03:24:52.915514+0000","last_peered":"2023-10-06T03:24:52.915514+0000","last_clean":"2023-10-06T03:24:52.915514+0000","last_became_active":"2023-10-06T03:24:51.896311+0000","last_became_peered":"2023-10-06T03:24:51.896311+0000","last_unstale":"2023-10-06T03:24:52.915514+0000","last_undegraded":"2023-10-06T03:24:52.915514+0000","last_fullsized":"2023-10-06T03:24:52.915514+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:15:34.745541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.893859+0000","last_change":"2023-10-06T03:24:52.893859+0000","last_active":"2023-10-06T03:24:52.893859+0000","last_peered":"2023-10-06T03:24:52.893859+0000","last_clean":"2023-10-06T03:24:52.893859+0000","last_became_active":"2023-10-06T03:24:52.893441+0000","last_became_peered":"2023-10-06T03:24:52.893441+0000","last_unstale":"2023-10-06T03:24:52.893859+0000","last_undegraded":"2023-10-06T03:24:52.893859+0000","last_fullsized":"2023-10-06T03:24:52.893859+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:33:46.236949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"37'1","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.876095+0000","last_change":"2023-10-06T03:24:51.887113+0000","last_active":"2023-10-06T03:24:52.876095+0000","last_peered":"2023-10-06T03:24:52.876095+0000","last_clean":"2023-10-06T03:24:52.876095+0000","last_became_active":"2023-10-06T03:24:51.886844+0000","last_became_peered":"2023-10-06T03:24:51.886844+0000","last_unstale":"2023-10-06T03:24:52.876095+0000","last_undegraded":"2023-10-06T03:24:52.876095+0000","last_fullsized":"2023-10-06T03:24:52.876095+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:54:13.068961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.907217+0000","last_change":"2023-10-06T03:24:52.907217+0000","last_active":"2023-10-06T03:24:52.907217+0000","last_peered":"2023-10-06T03:24:52.907217+0000","last_clean":"2023-10-06T03:24:52.907217+0000","last_became_active":"2023-10-06T03:24:52.906931+0000","last_became_peered":"2023-10-06T03:24:52.906931+0000","last_unstale":"2023-10-06T03:24:52.907217+0000","last_undegraded":"2023-10-06T03:24:52.907217+0000","last_fullsized":"2023-10-06T03:24:52.907217+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:37:21.626452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"37'2","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.910037+0000","last_change":"2023-10-06T03:24:51.892088+0000","last_active":"2023-10-06T03:24:52.910037+0000","last_peered":"2023-10-06T03:24:52.910037+0000","last_clean":"2023-10-06T03:24:52.910037+0000","last_became_active":"2023-10-06T03:24:51.891731+0000","last_became_peered":"2023-10-06T03:24:51.891731+0000","last_unstale":"2023-10-06T03:24:52.910037+0000","last_undegraded":"2023-10-06T03:24:52.910037+0000","last_fullsized":"2023-10-06T03:24:52.910037+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:34:53.266309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.904968+0000","last_change":"2023-10-06T03:24:52.904968+0000","last_active":"2023-10-06T03:24:52.904968+0000","last_peered":"2023-10-06T03:24:52.904968+0000","last_clean":"2023-10-06T03:24:52.904968+0000","last_became_active":"2023-10-06T03:24:52.904539+0000","last_became_peered":"2023-10-06T03:24:52.904539+0000","last_unstale":"2023-10-06T03:24:52.904968+0000","last_undegraded":"2023-10-06T03:24:52.904968+0000","last_fullsized":"2023-10-06T03:24:52.904968+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:34.464352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"37'1","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.877634+0000","last_change":"2023-10-06T03:24:51.894334+0000","last_active":"2023-10-06T03:24:52.877634+0000","last_peered":"2023-10-06T03:24:52.877634+0000","last_clean":"2023-10-06T03:24:52.877634+0000","last_became_active":"2023-10-06T03:24:51.893942+0000","last_became_peered":"2023-10-06T03:24:51.893942+0000","last_unstale":"2023-10-06T03:24:52.877634+0000","last_undegraded":"2023-10-06T03:24:52.877634+0000","last_fullsized":"2023-10-06T03:24:52.877634+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:44:58.096466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.908999+0000","last_change":"2023-10-06T03:24:52.908999+0000","last_active":"2023-10-06T03:24:52.908999+0000","last_peered":"2023-10-06T03:24:52.908999+0000","last_clean":"2023-10-06T03:24:52.908999+0000","last_became_active":"2023-10-06T03:24:52.906378+0000","last_became_peered":"2023-10-06T03:24:52.906378+0000","last_unstale":"2023-10-06T03:24:52.908999+0000","last_undegraded":"2023-10-06T03:24:52.908999+0000","last_fullsized":"2023-10-06T03:24:52.908999+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:31:32.821603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T03:24:51.897327+0000","last_change":"2023-10-06T03:24:51.892875+0000","last_active":"2023-10-06T03:24:51.897327+0000","last_peered":"2023-10-06T03:24:51.897327+0000","last_clean":"2023-10-06T03:24:51.897327+0000","last_became_active":"2023-10-06T03:24:51.892590+0000","last_became_peered":"2023-10-06T03:24:51.892590+0000","last_unstale":"2023-10-06T03:24:51.897327+0000","last_undegraded":"2023-10-06T03:24:51.897327+0000","last_fullsized":"2023-10-06T03:24:51.897327+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:13:47.801960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.903063+0000","last_change":"2023-10-06T03:24:52.903063+0000","last_active":"2023-10-06T03:24:52.903063+0000","last_peered":"2023-10-06T03:24:52.903063+0000","last_clean":"2023-10-06T03:24:52.903063+0000","last_became_active":"2023-10-06T03:24:52.902612+0000","last_became_peered":"2023-10-06T03:24:52.902612+0000","last_unstale":"2023-10-06T03:24:52.903063+0000","last_undegraded":"2023-10-06T03:24:52.903063+0000","last_fullsized":"2023-10-06T03:24:52.903063+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:55:10.923774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"37'2","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.909960+0000","last_change":"2023-10-06T03:24:51.893257+0000","last_active":"2023-10-06T03:24:52.909960+0000","last_peered":"2023-10-06T03:24:52.909960+0000","last_clean":"2023-10-06T03:24:52.909960+0000","last_became_active":"2023-10-06T03:24:51.892929+0000","last_became_peered":"2023-10-06T03:24:51.892929+0000","last_unstale":"2023-10-06T03:24:52.909960+0000","last_undegraded":"2023-10-06T03:24:52.909960+0000","last_fullsized":"2023-10-06T03:24:52.909960+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:29:38.019166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.903912+0000","last_change":"2023-10-06T03:24:52.903912+0000","last_active":"2023-10-06T03:24:52.903912+0000","last_peered":"2023-10-06T03:24:52.903912+0000","last_clean":"2023-10-06T03:24:52.903912+0000","last_became_active":"2023-10-06T03:24:52.903626+0000","last_became_peered":"2023-10-06T03:24:52.903626+0000","last_unstale":"2023-10-06T03:24:52.903912+0000","last_undegraded":"2023-10-06T03:24:52.903912+0000","last_fullsized":"2023-10-06T03:24:52.903912+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:15:35.754152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T03:24:51.899672+0000","last_change":"2023-10-06T03:24:51.894067+0000","last_active":"2023-10-06T03:24:51.899672+0000","last_peered":"2023-10-06T03:24:51.899672+0000","last_clean":"2023-10-06T03:24:51.899672+0000","last_became_active":"2023-10-06T03:24:51.893781+0000","last_became_peered":"2023-10-06T03:24:51.893781+0000","last_unstale":"2023-10-06T03:24:51.899672+0000","last_undegraded":"2023-10-06T03:24:51.899672+0000","last_fullsized":"2023-10-06T03:24:51.899672+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:15:34.745541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.893152+0000","last_change":"2023-10-06T03:24:52.893152+0000","last_active":"2023-10-06T03:24:52.893152+0000","last_peered":"2023-10-06T03:24:52.893152+0000","last_clean":"2023-10-06T03:24:52.893152+0000","last_became_active":"2023-10-06T03:24:52.892851+0000","last_became_peered":"2023-10-06T03:24:52.892851+0000","last_unstale":"2023-10-06T03:24:52.893152+0000","last_undegraded":"2023-10-06T03:24:52.893152+0000","last_fullsized":"2023-10-06T03:24:52.893152+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:28:59.340879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T03:24:51.898444+0000","last_change":"2023-10-06T03:24:51.896202+0000","last_active":"2023-10-06T03:24:51.898444+0000","last_peered":"2023-10-06T03:24:51.898444+0000","last_clean":"2023-10-06T03:24:51.898444+0000","last_became_active":"2023-10-06T03:24:51.895907+0000","last_became_peered":"2023-10-06T03:24:51.895907+0000","last_unstale":"2023-10-06T03:24:51.898444+0000","last_undegraded":"2023-10-06T03:24:51.898444+0000","last_fullsized":"2023-10-06T03:24:51.898444+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:20.147715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.904851+0000","last_change":"2023-10-06T03:24:52.904851+0000","last_active":"2023-10-06T03:24:52.904851+0000","last_peered":"2023-10-06T03:24:52.904851+0000","last_clean":"2023-10-06T03:24:52.904851+0000","last_became_active":"2023-10-06T03:24:52.904582+0000","last_became_peered":"2023-10-06T03:24:52.904582+0000","last_unstale":"2023-10-06T03:24:52.904851+0000","last_undegraded":"2023-10-06T03:24:52.904851+0000","last_fullsized":"2023-10-06T03:24:52.904851+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:34:54.274921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T03:24:51.889882+0000","last_change":"2023-10-06T03:24:51.885457+0000","last_active":"2023-10-06T03:24:51.889882+0000","last_peered":"2023-10-06T03:24:51.889882+0000","last_clean":"2023-10-06T03:24:51.889882+0000","last_became_active":"2023-10-06T03:24:51.885154+0000","last_became_peered":"2023-10-06T03:24:51.885154+0000","last_unstale":"2023-10-06T03:24:51.889882+0000","last_undegraded":"2023-10-06T03:24:51.889882+0000","last_fullsized":"2023-10-06T03:24:51.889882+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:14.560601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.901571+0000","last_change":"2023-10-06T03:24:52.901571+0000","last_active":"2023-10-06T03:24:52.901571+0000","last_peered":"2023-10-06T03:24:52.901571+0000","last_clean":"2023-10-06T03:24:52.901571+0000","last_became_active":"2023-10-06T03:24:52.901136+0000","last_became_peered":"2023-10-06T03:24:52.901136+0000","last_unstale":"2023-10-06T03:24:52.901571+0000","last_undegraded":"2023-10-06T03:24:52.901571+0000","last_fullsized":"2023-10-06T03:24:52.901571+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:29:27.289344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T03:24:51.899096+0000","last_change":"2023-10-06T03:24:51.896005+0000","last_active":"2023-10-06T03:24:51.899096+0000","last_peered":"2023-10-06T03:24:51.899096+0000","last_clean":"2023-10-06T03:24:51.899096+0000","last_became_active":"2023-10-06T03:24:51.895714+0000","last_became_peered":"2023-10-06T03:24:51.895714+0000","last_unstale":"2023-10-06T03:24:51.899096+0000","last_undegraded":"2023-10-06T03:24:51.899096+0000","last_fullsized":"2023-10-06T03:24:51.899096+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:19:37.225873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T03:24:51.886353+0000","last_change":"2023-10-06T03:23:35.397971+0000","last_active":"2023-10-06T03:24:51.886353+0000","last_peered":"2023-10-06T03:24:51.886353+0000","last_clean":"2023-10-06T03:24:51.886353+0000","last_became_active":"2023-10-06T03:23:35.397649+0000","last_became_peered":"2023-10-06T03:23:35.397649+0000","last_unstale":"2023-10-06T03:24:51.886353+0000","last_undegraded":"2023-10-06T03:24:51.886353+0000","last_fullsized":"2023-10-06T03:24:51.886353+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:11.974461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.908374+0000","last_change":"2023-10-06T03:24:52.908374+0000","last_active":"2023-10-06T03:24:52.908374+0000","last_peered":"2023-10-06T03:24:52.908374+0000","last_clean":"2023-10-06T03:24:52.908374+0000","last_became_active":"2023-10-06T03:24:52.908102+0000","last_became_peered":"2023-10-06T03:24:52.908102+0000","last_unstale":"2023-10-06T03:24:52.908374+0000","last_undegraded":"2023-10-06T03:24:52.908374+0000","last_fullsized":"2023-10-06T03:24:52.908374+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:09:31.423278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T03:24:51.892343+0000","last_change":"2023-10-06T03:24:51.889375+0000","last_active":"2023-10-06T03:24:51.892343+0000","last_peered":"2023-10-06T03:24:51.892343+0000","last_clean":"2023-10-06T03:24:51.892343+0000","last_became_active":"2023-10-06T03:24:51.889037+0000","last_became_peered":"2023-10-06T03:24:51.889037+0000","last_unstale":"2023-10-06T03:24:51.892343+0000","last_undegraded":"2023-10-06T03:24:51.892343+0000","last_fullsized":"2023-10-06T03:24:51.892343+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:15:34.745541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T03:24:51.881183+0000","last_change":"2023-10-06T03:23:34.866196+0000","last_active":"2023-10-06T03:24:51.881183+0000","last_peered":"2023-10-06T03:24:51.881183+0000","last_clean":"2023-10-06T03:24:51.881183+0000","last_became_active":"2023-10-06T03:23:34.865914+0000","last_became_peered":"2023-10-06T03:23:34.865914+0000","last_unstale":"2023-10-06T03:24:51.881183+0000","last_undegraded":"2023-10-06T03:24:51.881183+0000","last_fullsized":"2023-10-06T03:24:51.881183+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:11.974461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.894208+0000","last_change":"2023-10-06T03:24:52.894208+0000","last_active":"2023-10-06T03:24:52.894208+0000","last_peered":"2023-10-06T03:24:52.894208+0000","last_clean":"2023-10-06T03:24:52.894208+0000","last_became_active":"2023-10-06T03:24:52.893933+0000","last_became_peered":"2023-10-06T03:24:52.893933+0000","last_unstale":"2023-10-06T03:24:52.894208+0000","last_undegraded":"2023-10-06T03:24:52.894208+0000","last_fullsized":"2023-10-06T03:24:52.894208+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:50:04.406520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T03:24:51.896382+0000","last_change":"2023-10-06T03:24:51.895174+0000","last_active":"2023-10-06T03:24:51.896382+0000","last_peered":"2023-10-06T03:24:51.896382+0000","last_clean":"2023-10-06T03:24:51.896382+0000","last_became_active":"2023-10-06T03:24:51.894427+0000","last_became_peered":"2023-10-06T03:24:51.894427+0000","last_unstale":"2023-10-06T03:24:51.896382+0000","last_undegraded":"2023-10-06T03:24:51.896382+0000","last_fullsized":"2023-10-06T03:24:51.896382+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:31:31.812991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T03:24:51.877752+0000","last_change":"2023-10-06T03:23:34.874380+0000","last_active":"2023-10-06T03:24:51.877752+0000","last_peered":"2023-10-06T03:24:51.877752+0000","last_clean":"2023-10-06T03:24:51.877752+0000","last_became_active":"2023-10-06T03:23:34.873972+0000","last_became_peered":"2023-10-06T03:23:34.873972+0000","last_unstale":"2023-10-06T03:24:51.877752+0000","last_undegraded":"2023-10-06T03:24:51.877752+0000","last_fullsized":"2023-10-06T03:24:51.877752+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:30.204999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":177,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T03:24:51.873941+0000","last_change":"2023-10-06T03:23:34.864626+0000","last_active":"2023-10-06T03:24:51.873941+0000","last_peered":"2023-10-06T03:24:51.873941+0000","last_clean":"2023-10-06T03:24:51.873941+0000","last_became_active":"2023-10-06T03:23:34.863539+0000","last_became_peered":"2023-10-06T03:23:34.863539+0000","last_unstale":"2023-10-06T03:24:51.873941+0000","last_undegraded":"2023-10-06T03:24:51.873941+0000","last_fullsized":"2023-10-06T03:24:51.873941+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:11.750836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.894972+0000","last_change":"2023-10-06T03:24:52.894972+0000","last_active":"2023-10-06T03:24:52.894972+0000","last_peered":"2023-10-06T03:24:52.894972+0000","last_clean":"2023-10-06T03:24:52.894972+0000","last_became_active":"2023-10-06T03:24:52.894544+0000","last_became_peered":"2023-10-06T03:24:52.894544+0000","last_unstale":"2023-10-06T03:24:52.894972+0000","last_undegraded":"2023-10-06T03:24:52.894972+0000","last_fullsized":"2023-10-06T03:24:52.894972+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:25:53.153625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T03:24:51.900995+0000","last_change":"2023-10-06T03:24:51.898337+0000","last_active":"2023-10-06T03:24:51.900995+0000","last_peered":"2023-10-06T03:24:51.900995+0000","last_clean":"2023-10-06T03:24:51.900995+0000","last_became_active":"2023-10-06T03:24:51.898050+0000","last_became_peered":"2023-10-06T03:24:51.898050+0000","last_unstale":"2023-10-06T03:24:51.900995+0000","last_undegraded":"2023-10-06T03:24:51.900995+0000","last_fullsized":"2023-10-06T03:24:51.900995+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:22:49.453657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T03:24:51.873759+0000","last_change":"2023-10-06T03:23:34.864399+0000","last_active":"2023-10-06T03:24:51.873759+0000","last_peered":"2023-10-06T03:24:51.873759+0000","last_clean":"2023-10-06T03:24:51.873759+0000","last_became_active":"2023-10-06T03:23:34.863991+0000","last_became_peered":"2023-10-06T03:23:34.863991+0000","last_unstale":"2023-10-06T03:24:51.873759+0000","last_undegraded":"2023-10-06T03:24:51.873759+0000","last_fullsized":"2023-10-06T03:24:51.873759+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:56:32.358597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.896662+0000","last_change":"2023-10-06T03:24:52.896662+0000","last_active":"2023-10-06T03:24:52.896662+0000","last_peered":"2023-10-06T03:24:52.896662+0000","last_clean":"2023-10-06T03:24:52.896662+0000","last_became_active":"2023-10-06T03:24:52.896097+0000","last_became_peered":"2023-10-06T03:24:52.896097+0000","last_unstale":"2023-10-06T03:24:52.896662+0000","last_undegraded":"2023-10-06T03:24:52.896662+0000","last_fullsized":"2023-10-06T03:24:52.896662+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:20:09.762572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"37'2","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.912988+0000","last_change":"2023-10-06T03:24:51.893036+0000","last_active":"2023-10-06T03:24:52.912988+0000","last_peered":"2023-10-06T03:24:52.912988+0000","last_clean":"2023-10-06T03:24:52.912988+0000","last_became_active":"2023-10-06T03:24:51.892668+0000","last_became_peered":"2023-10-06T03:24:51.892668+0000","last_unstale":"2023-10-06T03:24:52.912988+0000","last_undegraded":"2023-10-06T03:24:52.912988+0000","last_fullsized":"2023-10-06T03:24:52.912988+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:20.147715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T03:24:51.873802+0000","last_change":"2023-10-06T03:23:34.865125+0000","last_active":"2023-10-06T03:24:51.873802+0000","last_peered":"2023-10-06T03:24:51.873802+0000","last_clean":"2023-10-06T03:24:51.873802+0000","last_became_active":"2023-10-06T03:23:34.864752+0000","last_became_peered":"2023-10-06T03:23:34.864752+0000","last_unstale":"2023-10-06T03:24:51.873802+0000","last_undegraded":"2023-10-06T03:24:51.873802+0000","last_fullsized":"2023-10-06T03:24:51.873802+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:00.374963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.901704+0000","last_change":"2023-10-06T03:24:52.901704+0000","last_active":"2023-10-06T03:24:52.901704+0000","last_peered":"2023-10-06T03:24:52.901704+0000","last_clean":"2023-10-06T03:24:52.901704+0000","last_became_active":"2023-10-06T03:24:52.901449+0000","last_became_peered":"2023-10-06T03:24:52.901449+0000","last_unstale":"2023-10-06T03:24:52.901704+0000","last_undegraded":"2023-10-06T03:24:52.901704+0000","last_fullsized":"2023-10-06T03:24:52.901704+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:48.777362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T03:24:51.898089+0000","last_change":"2023-10-06T03:24:51.896585+0000","last_active":"2023-10-06T03:24:51.898089+0000","last_peered":"2023-10-06T03:24:51.898089+0000","last_clean":"2023-10-06T03:24:51.898089+0000","last_became_active":"2023-10-06T03:24:51.896289+0000","last_became_peered":"2023-10-06T03:24:51.896289+0000","last_unstale":"2023-10-06T03:24:51.898089+0000","last_undegraded":"2023-10-06T03:24:51.898089+0000","last_fullsized":"2023-10-06T03:24:51.898089+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:25:52.145014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T03:24:51.885058+0000","last_change":"2023-10-06T03:23:34.864329+0000","last_active":"2023-10-06T03:24:51.885058+0000","last_peered":"2023-10-06T03:24:51.885058+0000","last_clean":"2023-10-06T03:24:51.885058+0000","last_became_active":"2023-10-06T03:23:34.863953+0000","last_became_peered":"2023-10-06T03:23:34.863953+0000","last_unstale":"2023-10-06T03:24:51.885058+0000","last_undegraded":"2023-10-06T03:24:51.885058+0000","last_fullsized":"2023-10-06T03:24:51.885058+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:30.204999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.894422+0000","last_change":"2023-10-06T03:24:52.894422+0000","last_active":"2023-10-06T03:24:52.894422+0000","last_peered":"2023-10-06T03:24:52.894422+0000","last_clean":"2023-10-06T03:24:52.894422+0000","last_became_active":"2023-10-06T03:24:52.892882+0000","last_became_peered":"2023-10-06T03:24:52.892882+0000","last_unstale":"2023-10-06T03:24:52.894422+0000","last_undegraded":"2023-10-06T03:24:52.894422+0000","last_fullsized":"2023-10-06T03:24:52.894422+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:21:41.768629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T03:24:51.901773+0000","last_change":"2023-10-06T03:24:51.898863+0000","last_active":"2023-10-06T03:24:51.901773+0000","last_peered":"2023-10-06T03:24:51.901773+0000","last_clean":"2023-10-06T03:24:51.901773+0000","last_became_active":"2023-10-06T03:24:51.898601+0000","last_became_peered":"2023-10-06T03:24:51.898601+0000","last_unstale":"2023-10-06T03:24:51.901773+0000","last_undegraded":"2023-10-06T03:24:51.901773+0000","last_fullsized":"2023-10-06T03:24:51.901773+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:07:33.659992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T03:24:51.898766+0000","last_change":"2023-10-06T03:23:34.873939+0000","last_active":"2023-10-06T03:24:51.898766+0000","last_peered":"2023-10-06T03:24:51.898766+0000","last_clean":"2023-10-06T03:24:51.898766+0000","last_became_active":"2023-10-06T03:23:34.873623+0000","last_became_peered":"2023-10-06T03:23:34.873623+0000","last_unstale":"2023-10-06T03:24:51.898766+0000","last_undegraded":"2023-10-06T03:24:51.898766+0000","last_fullsized":"2023-10-06T03:24:51.898766+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:30.204999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T03:24:52.909550+0000","last_change":"2023-10-06T03:24:52.909550+0000","last_active":"2023-10-06T03:24:52.909550+0000","last_peered":"2023-10-06T03:24:52.909550+0000","last_clean":"2023-10-06T03:24:52.909550+0000","last_became_active":"2023-10-06T03:24:52.909184+0000","last_became_peered":"2023-10-06T03:24:52.909184+0000","last_unstale":"2023-10-06T03:24:52.909550+0000","last_undegraded":"2023-10-06T03:24:52.909550+0000","last_fullsized":"2023-10-06T03:24:52.909550+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:51.865677+0000","last_clean_scrub_stamp":"2023-10-06T03:24:51.865677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:42:07.439014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T03:24:51.898431+0000","last_change":"2023-10-06T03:24:51.895997+0000","last_active":"2023-10-06T03:24:51.898431+0000","last_peered":"2023-10-06T03:24:51.898431+0000","last_clean":"2023-10-06T03:24:51.898431+0000","last_became_active":"2023-10-06T03:24:51.895729+0000","last_became_peered":"2023-10-06T03:24:51.895729+0000","last_unstale":"2023-10-06T03:24:51.898431+0000","last_undegraded":"2023-10-06T03:24:51.898431+0000","last_fullsized":"2023-10-06T03:24:51.898431+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:24:50.857066+0000","last_clean_scrub_stamp":"2023-10-06T03:24:50.857066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:22:49.453657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T03:24:51.897474+0000","last_change":"2023-10-06T03:23:34.872453+0000","last_active":"2023-10-06T03:24:51.897474+0000","last_peered":"2023-10-06T03:24:51.897474+0000","last_clean":"2023-10-06T03:24:51.897474+0000","last_became_active":"2023-10-06T03:23:34.872139+0000","last_became_peered":"2023-10-06T03:23:34.872139+0000","last_unstale":"2023-10-06T03:24:51.897474+0000","last_undegraded":"2023-10-06T03:24:51.897474+0000","last_fullsized":"2023-10-06T03:24:51.897474+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:25:46.214290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298288,"kb_used_data":1000,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073552,"statfs":{"total":96636764160,"available":96331317248,"internally_reserved":0,"allocated":1024000,"data_stored":780480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.55100000000000005}]},{"osd":1,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.501}]},{"osd":2,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.52700000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.624}]},{"osd":4,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.79300000000000004}]},{"osd":5,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.59999999999999998}]},{"osd":6,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.76300000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297708,"kb_used_data":420,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074132,"statfs":{"total":96636764160,"available":96331911168,"internally_reserved":0,"allocated":430080,"data_stored":189313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.54300000000000004}]},{"osd":1,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.72799999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.60699999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.65800000000000003}]},{"osd":4,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.78900000000000003}]},{"osd":5,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.76000000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.77600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298288,"kb_used_data":1000,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073552,"statfs":{"total":96636764160,"available":96331317248,"internally_reserved":0,"allocated":1024000,"data_stored":780460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:35 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.46600000000000003}]},{"osd":2,"last update":"Fri Oct 6 03:24:35 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.39900000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:24:35 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.434},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.49199999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:24:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.81999999999999995}]},{"osd":5,"last update":"Fri Oct 6 03:24:35 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.68899999999999995}]},{"osd":6,"last update":"Fri Oct 6 03:24:35 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.80200000000000005}]},{"osd":7,"last update":"Fri Oct 6 03:24:35 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.69499999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297708,"kb_used_data":420,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074132,"statfs":{"total":96636764160,"available":96331911168,"internally_reserved":0,"allocated":430080,"data_stored":190056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.42899999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.441},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.38700000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.47799999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.64100000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.68000000000000005}]},{"osd":6,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.76900000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.68999999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297692,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074148,"statfs":{"total":96636764160,"available":96331927552,"internally_reserved":0,"allocated":413696,"data_stored":182586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.53500000000000003}]},{"osd":1,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.499}]},{"osd":3,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":0.40500000000000003}]},{"osd":4,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.81599999999999995}]},{"osd":5,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.61899999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.66200000000000003}]},{"osd":7,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.70999999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297692,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074148,"statfs":{"total":96636764160,"available":96331927552,"internally_reserved":0,"allocated":413696,"data_stored":182586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.442}]},{"osd":1,"last update":"Fri Oct 6 03:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.371}]},{"osd":2,"last update":"Fri Oct 6 03:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.38800000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.76800000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.78100000000000003}]},{"osd":6,"last update":"Fri Oct 6 03:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.72799999999999998}]},{"osd":7,"last update":"Fri Oct 6 03:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.71599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297716,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074124,"statfs":{"total":96636764160,"available":96331902976,"internally_reserved":0,"allocated":438272,"data_stored":191558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":1.012}]},{"osd":1,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.90900000000000003}]},{"osd":2,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.82599999999999996}]},{"osd":3,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.92900000000000005}]},{"osd":5,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.59799999999999998}]},{"osd":6,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.61799999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.77800000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297708,"kb_used_data":420,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074132,"statfs":{"total":96636764160,"available":96331911168,"internally_reserved":0,"allocated":430080,"data_stored":190092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.59299999999999997}]},{"osd":1,"last update":"Fri Oct 6 03:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.54400000000000004}]},{"osd":2,"last update":"Fri Oct 6 03:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.82699999999999996}]},{"osd":3,"last update":"Fri Oct 6 03:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.89700000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.65100000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.87},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":0.77100000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.92000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:24:57.668 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T03:24:57.668 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T03:24:57.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.886+0000 7f636d99d700 1 Processor -- start 2023-10-06T03:24:57.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.887+0000 7f636d99d700 1 -- start start 2023-10-06T03:24:57.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.888+0000 7f636d99d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6368159750 0x7f63680aba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:57.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.888+0000 7f636d99d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f63680ae560 0x7f63680c7420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:57.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.888+0000 7f636d99d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63680c7cc0 con 0x7f6368159b20 2023-10-06T03:24:57.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.888+0000 7f636d99d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63680abfa0 con 0x7f63680ae560 2023-10-06T03:24:57.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.888+0000 7f636d99d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63680c7fa0 con 0x7f6368159750 2023-10-06T03:24:57.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.888+0000 7f636d19c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6368159b20 0x7f6368155430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42008/0 (socket says 172.21.15.81:42008) 2023-10-06T03:24:57.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.888+0000 7f636d19c700 1 -- 172.21.15.81:0/1521740361 learned_addr learned my addr 172.21.15.81:0/1521740361 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:24:57.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.888+0000 7f636c99b700 1 --2- 172.21.15.81:0/1521740361 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6368159750 0x7f63680aba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:57.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.888+0000 7f6367fff700 1 --2- 172.21.15.81:0/1521740361 >> v2:172.21.15.83:3300/0 conn(0x7f63680ae560 0x7f63680c7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:57.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.888+0000 7f63677fe700 1 -- 172.21.15.81:0/1521740361 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 21879919 0 0) 0x7f63680c7cc0 con 0x7f6368159b20 2023-10-06T03:24:57.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.888+0000 7f63677fe700 1 -- 172.21.15.81:0/1521740361 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6358003570 con 0x7f6368159b20 2023-10-06T03:24:57.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.889+0000 7f63677fe700 1 -- 172.21.15.81:0/1521740361 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1755238118 0 0) 0x7f6358003570 con 0x7f6368159b20 2023-10-06T03:24:57.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.889+0000 7f636c99b700 1 -- 172.21.15.81:0/1521740361 >> v2:172.21.15.83:3300/0 conn(0x7f63680ae560 msgr2=0x7f63680c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:57.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.889+0000 7f636c99b700 1 --2- 172.21.15.81:0/1521740361 >> v2:172.21.15.83:3300/0 conn(0x7f63680ae560 0x7f63680c7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:57.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.889+0000 7f636c99b700 1 -- 172.21.15.81:0/1521740361 >> v1:172.21.15.81:6789/0 conn(0x7f6368159b20 legacy=0x7f6368155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:57.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.889+0000 7f636c99b700 1 -- 172.21.15.81:0/1521740361 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6368069350 con 0x7f6368159750 2023-10-06T03:24:57.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.889+0000 7f636c99b700 1 --2- 172.21.15.81:0/1521740361 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6368159750 0x7f63680aba60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f635c0098e0 tx=0x7f635c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=515fda29125964eb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:57.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.889+0000 7f63677fe700 1 -- 172.21.15.81:0/1521740361 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63600017f0 con 0x7f6368159750 2023-10-06T03:24:57.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.889+0000 7f63677fe700 1 -- 172.21.15.81:0/1521740361 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f635c011420 con 0x7f6368159750 2023-10-06T03:24:57.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.889+0000 7f63677fe700 1 -- 172.21.15.81:0/1521740361 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635c0117c0 con 0x7f6368159750 2023-10-06T03:24:57.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.890+0000 7f636d99d700 1 -- 172.21.15.81:0/1521740361 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6368159750 msgr2=0x7f63680aba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:57.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.890+0000 7f636d99d700 1 --2- 172.21.15.81:0/1521740361 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6368159750 0x7f63680aba60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f635c0098e0 tx=0x7f635c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:57.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.890+0000 7f636d99d700 1 -- 172.21.15.81:0/1521740361 shutdown_connections 2023-10-06T03:24:57.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.890+0000 7f636d99d700 1 --2- 172.21.15.81:0/1521740361 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6368159750 0x7f63680aba60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:57.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.890+0000 7f636d99d700 1 --2- 172.21.15.81:0/1521740361 >> v2:172.21.15.83:3300/0 conn(0x7f63680ae560 0x7f63680c7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:57.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.890+0000 7f636d99d700 1 -- 172.21.15.81:0/1521740361 >> 172.21.15.81:0/1521740361 conn(0x7f63680680b0 msgr2=0x7f63680cbeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:57.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.890+0000 7f636d99d700 1 -- 172.21.15.81:0/1521740361 shutdown_connections 2023-10-06T03:24:57.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.890+0000 7f636d99d700 1 -- 172.21.15.81:0/1521740361 wait complete. 2023-10-06T03:24:57.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.891+0000 7f636d99d700 1 Processor -- start 2023-10-06T03:24:57.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.892+0000 7f636d99d700 1 -- start start 2023-10-06T03:24:57.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.892+0000 7f636d99d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f63680ae560 0x7f636816a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:57.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.892+0000 7f636d99d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6368159750 0x7f63680b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:57.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.892+0000 7f636d99d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6368159b20 0x7f63680b11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:57.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.892+0000 7f636d99d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63680b07e0 con 0x7f6368159b20 2023-10-06T03:24:57.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.892+0000 7f636d99d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63680bf600 con 0x7f6368159750 2023-10-06T03:24:57.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.892+0000 7f636d99d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63680adef0 con 0x7f63680ae560 2023-10-06T03:24:57.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.893+0000 7f636d19c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6368159b20 0x7f63680b11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:57.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.893+0000 7f636d19c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6368159b20 0x7f63680b11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42240/0 (socket says 172.21.15.81:42240) 2023-10-06T03:24:57.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.893+0000 7f636d19c700 1 -- 172.21.15.81:0/3996240997 learned_addr learned my addr 172.21.15.81:0/3996240997 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:57.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.893+0000 7f636c99b700 1 --2- 172.21.15.81:0/3996240997 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f63680ae560 0x7f636816a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:57.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.893+0000 7f6367fff700 1 --2- 172.21.15.81:0/3996240997 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6368159750 0x7f63680b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:57.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.893+0000 7f636d19c700 1 -- 172.21.15.81:0/3996240997 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f63680ae560 msgr2=0x7f636816a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:57.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.893+0000 7f636d19c700 1 --2- 172.21.15.81:0/3996240997 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f63680ae560 0x7f636816a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:57.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.893+0000 7f636d19c700 1 -- 172.21.15.81:0/3996240997 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6368159750 msgr2=0x7f63680b0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:57.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.893+0000 7f636d19c700 1 --2- 172.21.15.81:0/3996240997 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6368159750 0x7f63680b0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:57.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.893+0000 7f636d19c700 1 -- 172.21.15.81:0/3996240997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f635c009420 con 0x7f6368159b20 2023-10-06T03:24:57.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.893+0000 7f636d19c700 1 --2- 172.21.15.81:0/3996240997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6368159b20 0x7f63680b11b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f636000cae0 tx=0x7f6360007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:57.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.894+0000 7f6364ff9700 1 -- 172.21.15.81:0/3996240997 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6360004dc0 con 0x7f6368159b20 2023-10-06T03:24:57.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.894+0000 7f6364ff9700 1 -- 172.21.15.81:0/3996240997 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f636000a6a0 con 0x7f6368159b20 2023-10-06T03:24:57.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.894+0000 7f636d99d700 1 -- 172.21.15.81:0/3996240997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63680ae1d0 con 0x7f6368159b20 2023-10-06T03:24:57.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.894+0000 7f6364ff9700 1 -- 172.21.15.81:0/3996240997 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636000aa60 con 0x7f6368159b20 2023-10-06T03:24:57.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.894+0000 7f636d99d700 1 -- 172.21.15.81:0/3996240997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63680b0180 con 0x7f6368159b20 2023-10-06T03:24:57.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.895+0000 7f636d99d700 1 -- 172.21.15.81:0/3996240997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63680b0990 con 0x7f6368159b20 2023-10-06T03:24:57.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.896+0000 7f6364ff9700 1 -- 172.21.15.81:0/3996240997 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6360007150 con 0x7f6368159b20 2023-10-06T03:24:57.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.897+0000 7f6364ff9700 1 --2- 172.21.15.81:0/3996240997 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f634c066f30 0x7f634c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:57.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.897+0000 7f6364ff9700 1 -- 172.21.15.81:0/3996240997 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6360084380 con 0x7f6368159b20 2023-10-06T03:24:57.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.897+0000 7f636c99b700 1 --2- 172.21.15.81:0/3996240997 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f634c066f30 0x7f634c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:57.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.898+0000 7f636c99b700 1 --2- 172.21.15.81:0/3996240997 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f634c066f30 0x7f634c0693e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f635c0030c0 tx=0x7f635c016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:57.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:57.901+0000 7f6364ff9700 1 -- 172.21.15.81:0/3996240997 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6360051330 con 0x7f6368159b20 2023-10-06T03:24:58.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.166+0000 7f636d99d700 1 -- 172.21.15.81:0/3996240997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f636804c3c0 con 0x7f6368159b20 2023-10-06T03:24:58.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.170+0000 7f6364ff9700 1 -- 172.21.15.81:0/3996240997 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7f6360054950 con 0x7f6368159b20 2023-10-06T03:24:58.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.173+0000 7f636d99d700 1 -- 172.21.15.81:0/3996240997 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f634c066f30 msgr2=0x7f634c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:58.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.173+0000 7f636d99d700 1 --2- 172.21.15.81:0/3996240997 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f634c066f30 0x7f634c0693e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f635c0030c0 tx=0x7f635c016000 comp rx=0 tx=0).stop 2023-10-06T03:24:58.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.173+0000 7f636d99d700 1 -- 172.21.15.81:0/3996240997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6368159b20 msgr2=0x7f63680b11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:58.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.173+0000 7f636d99d700 1 --2- 172.21.15.81:0/3996240997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6368159b20 0x7f63680b11b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f636000cae0 tx=0x7f6360007ca0 comp rx=0 tx=0).stop 2023-10-06T03:24:58.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.173+0000 7f636d99d700 1 -- 172.21.15.81:0/3996240997 shutdown_connections 2023-10-06T03:24:58.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.173+0000 7f636d99d700 1 --2- 172.21.15.81:0/3996240997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6368159b20 0x7f63680b11b0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:58.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.173+0000 7f636d99d700 1 --2- 172.21.15.81:0/3996240997 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f634c066f30 0x7f634c0693e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:58.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.173+0000 7f636d99d700 1 --2- 172.21.15.81:0/3996240997 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f63680ae560 0x7f636816a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:58.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.173+0000 7f636d99d700 1 --2- 172.21.15.81:0/3996240997 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6368159750 0x7f63680b0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:58.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.173+0000 7f636d99d700 1 -- 172.21.15.81:0/3996240997 >> 172.21.15.81:0/3996240997 conn(0x7f63680680b0 msgr2=0x7f636806a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:58.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.173+0000 7f636d99d700 1 -- 172.21.15.81:0/3996240997 shutdown_connections 2023-10-06T03:24:58.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.173+0000 7f636d99d700 1 -- 172.21.15.81:0/3996240997 wait complete. 2023-10-06T03:24:58.177 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2023-10-06T03:24:58.192 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:24:58.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.370+0000 7ff31359e700 1 Processor -- start 2023-10-06T03:24:58.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.370+0000 7ff31359e700 1 -- start start 2023-10-06T03:24:58.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.371+0000 7ff31359e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff3140ab7b0 0x7ff314156910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:58.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.371+0000 7ff31359e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff3140ace00 0x7ff3140abb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:58.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.371+0000 7ff31359e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3140ac5f0 con 0x7ff3141594c0 2023-10-06T03:24:58.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.371+0000 7ff31359e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3140ae330 con 0x7ff3140ab7b0 2023-10-06T03:24:58.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.371+0000 7ff31359e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff314156e50 con 0x7ff3140ace00 2023-10-06T03:24:58.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.372+0000 7ff31259c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff3140ab7b0 0x7ff314156910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:58.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.372+0000 7ff30bfff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff3140ace00 0x7ff3140abb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:58.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.372+0000 7ff30bfff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff3140ace00 0x7ff3140abb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:40322/0 (socket says 172.21.15.81:40322) 2023-10-06T03:24:58.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.372+0000 7ff30bfff700 1 -- 172.21.15.81:0/4131587650 learned_addr learned my addr 172.21.15.81:0/4131587650 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:58.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.372+0000 7ff31259c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff3140ab7b0 0x7ff314156910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:36964/0 (socket says 172.21.15.81:36964) 2023-10-06T03:24:58.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.372+0000 7ff312d9d700 1 --1- 172.21.15.81:0/4131587650 >> v1:172.21.15.83:6789/0 conn(0x7ff3141594c0 0x7ff3141598e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:52878/0 (socket says 172.21.15.81:52878) 2023-10-06T03:24:58.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.372+0000 7ff30bfff700 1 -- 172.21.15.81:0/4131587650 >> v2:172.21.15.83:3300/0 conn(0x7ff3140ab7b0 msgr2=0x7ff314156910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:58.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.372+0000 7ff30bfff700 1 --2- 172.21.15.81:0/4131587650 >> v2:172.21.15.83:3300/0 conn(0x7ff3140ab7b0 0x7ff314156910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:58.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.372+0000 7ff30bfff700 1 -- 172.21.15.81:0/4131587650 >> v1:172.21.15.83:6789/0 conn(0x7ff3141594c0 legacy=0x7ff3141598e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:58.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.372+0000 7ff30bfff700 1 -- 172.21.15.81:0/4131587650 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3140ac0c0 con 0x7ff3140ace00 2023-10-06T03:24:58.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.373+0000 7ff30bfff700 1 --2- 172.21.15.81:0/4131587650 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff3140ace00 0x7ff3140abb80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc0099b0 tx=0x7ff2fc009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62b0612948b5be53 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:58.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.373+0000 7ff311d9b700 1 -- 172.21.15.81:0/4131587650 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc009ea0 con 0x7ff3140ace00 2023-10-06T03:24:58.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.373+0000 7ff311d9b700 1 -- 172.21.15.81:0/4131587650 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2fc00b860 con 0x7ff3140ace00 2023-10-06T03:24:58.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.373+0000 7ff311d9b700 1 -- 172.21.15.81:0/4131587650 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc00bc00 con 0x7ff3140ace00 2023-10-06T03:24:58.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.373+0000 7ff31359e700 1 -- 172.21.15.81:0/4131587650 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff3140ace00 msgr2=0x7ff3140abb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:58.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.373+0000 7ff31359e700 1 --2- 172.21.15.81:0/4131587650 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff3140ace00 0x7ff3140abb80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc0099b0 tx=0x7ff2fc009250 comp rx=0 tx=0).stop 2023-10-06T03:24:58.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.373+0000 7ff31359e700 1 -- 172.21.15.81:0/4131587650 shutdown_connections 2023-10-06T03:24:58.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.373+0000 7ff31359e700 1 --2- 172.21.15.81:0/4131587650 >> v2:172.21.15.83:3300/0 conn(0x7ff3140ab7b0 0x7ff314156910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:58.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.373+0000 7ff31359e700 1 --2- 172.21.15.81:0/4131587650 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff3140ace00 0x7ff3140abb80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:58.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.373+0000 7ff31359e700 1 -- 172.21.15.81:0/4131587650 >> 172.21.15.81:0/4131587650 conn(0x7ff3140cbef0 msgr2=0x7ff3140cc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:58.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.374+0000 7ff31359e700 1 -- 172.21.15.81:0/4131587650 shutdown_connections 2023-10-06T03:24:58.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.374+0000 7ff31359e700 1 -- 172.21.15.81:0/4131587650 wait complete. 2023-10-06T03:24:58.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.375+0000 7ff31359e700 1 Processor -- start 2023-10-06T03:24:58.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.375+0000 7ff31359e700 1 -- start start 2023-10-06T03:24:58.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.376+0000 7ff31359e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff3140ab7b0 0x7ff3140a5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:58.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.376+0000 7ff31359e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3140ace00 0x7ff31415c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:58.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.376+0000 7ff31359e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3141594c0 0x7ff3141423d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:58.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.376+0000 7ff31359e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff314152880 con 0x7ff3141594c0 2023-10-06T03:24:58.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.376+0000 7ff31359e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff31415a5b0 con 0x7ff3140ace00 2023-10-06T03:24:58.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.376+0000 7ff31359e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3140a5a10 con 0x7ff3140ab7b0 2023-10-06T03:24:58.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.376+0000 7ff312d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3141594c0 0x7ff3141423d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:58.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.376+0000 7ff312d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3141594c0 0x7ff3141423d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42252/0 (socket says 172.21.15.81:42252) 2023-10-06T03:24:58.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.376+0000 7ff312d9d700 1 -- 172.21.15.81:0/3060653299 learned_addr learned my addr 172.21.15.81:0/3060653299 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:58.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.376+0000 7ff31259c700 1 --2- 172.21.15.81:0/3060653299 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff3140ab7b0 0x7ff3140a5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:58.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.376+0000 7ff30bfff700 1 --2- 172.21.15.81:0/3060653299 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3140ace00 0x7ff31415c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:58.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.377+0000 7ff312d9d700 1 -- 172.21.15.81:0/3060653299 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff3140ab7b0 msgr2=0x7ff3140a5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:58.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.377+0000 7ff312d9d700 1 --2- 172.21.15.81:0/3060653299 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff3140ab7b0 0x7ff3140a5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:58.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.377+0000 7ff312d9d700 1 -- 172.21.15.81:0/3060653299 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3140ace00 msgr2=0x7ff31415c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:58.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.377+0000 7ff312d9d700 1 --2- 172.21.15.81:0/3060653299 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3140ace00 0x7ff31415c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:58.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.377+0000 7ff312d9d700 1 -- 172.21.15.81:0/3060653299 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2fc0094f0 con 0x7ff3141594c0 2023-10-06T03:24:58.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.377+0000 7ff312d9d700 1 --2- 172.21.15.81:0/3060653299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3141594c0 0x7ff3141423d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff30c00cc70 tx=0x7ff30c001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:58.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.377+0000 7ff30a7fc700 1 -- 172.21.15.81:0/3060653299 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30c005df0 con 0x7ff3141594c0 2023-10-06T03:24:58.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.377+0000 7ff30a7fc700 1 -- 172.21.15.81:0/3060653299 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff30c00a5b0 con 0x7ff3141594c0 2023-10-06T03:24:58.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.377+0000 7ff31359e700 1 -- 172.21.15.81:0/3060653299 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff31415a850 con 0x7ff3141594c0 2023-10-06T03:24:58.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.377+0000 7ff30a7fc700 1 -- 172.21.15.81:0/3060653299 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30c00a930 con 0x7ff3141594c0 2023-10-06T03:24:58.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.377+0000 7ff31359e700 1 -- 172.21.15.81:0/3060653299 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff31415ae10 con 0x7ff3141594c0 2023-10-06T03:24:58.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.378+0000 7ff31359e700 1 -- 172.21.15.81:0/3060653299 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3140ad290 con 0x7ff3141594c0 2023-10-06T03:24:58.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.379+0000 7ff30a7fc700 1 -- 172.21.15.81:0/3060653299 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff30c00ace0 con 0x7ff3141594c0 2023-10-06T03:24:58.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.380+0000 7ff30a7fc700 1 --2- 172.21.15.81:0/3060653299 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff2f4066f30 0x7ff2f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:58.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.380+0000 7ff30a7fc700 1 -- 172.21.15.81:0/3060653299 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff30c084800 con 0x7ff3141594c0 2023-10-06T03:24:58.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.380+0000 7ff31259c700 1 --2- 172.21.15.81:0/3060653299 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff2f4066f30 0x7ff2f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:58.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.381+0000 7ff31259c700 1 --2- 172.21.15.81:0/3060653299 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff2f4066f30 0x7ff2f40693e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff304015490 tx=0x7ff30400f040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:58.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.384+0000 7ff30a7fc700 1 -- 172.21.15.81:0/3060653299 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff30c0517b0 con 0x7ff3141594c0 2023-10-06T03:24:58.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.615+0000 7ff31359e700 1 -- 172.21.15.81:0/3060653299 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff31404bb80 con 0x7ff3141594c0 2023-10-06T03:24:58.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.616+0000 7ff30a7fc700 1 -- 172.21.15.81:0/3060653299 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4594 (secure 0 0 0) 0x7ff30c054dd0 con 0x7ff3141594c0 2023-10-06T03:24:58.618 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:24:58.618 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5065,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6834/822949628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":822949628},{"type":"v1","addr":"172.21.15.83:6834","nonce":822949628}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5068,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3024690603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6833","nonce":3024690603},{"type":"v1","addr":"172.21.15.83:6835","nonce":3024690603}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5074,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2638072815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2638072815},{"type":"v1","addr":"172.21.15.81:6837","nonce":2638072815}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:24:52.345868+0000","modified":"2023-10-06T03:24:55.900366+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5121},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5121":{"gid":5121,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6835/2789471208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2789471208},{"type":"v1","addr":"172.21.15.81:6835","nonce":2789471208}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T03:24:58.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.618+0000 7ff31359e700 1 -- 172.21.15.81:0/3060653299 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff2f4066f30 msgr2=0x7ff2f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:58.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.618+0000 7ff31359e700 1 --2- 172.21.15.81:0/3060653299 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff2f4066f30 0x7ff2f40693e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff304015490 tx=0x7ff30400f040 comp rx=0 tx=0).stop 2023-10-06T03:24:58.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.618+0000 7ff31359e700 1 -- 172.21.15.81:0/3060653299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3141594c0 msgr2=0x7ff3141423d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:58.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.618+0000 7ff31359e700 1 --2- 172.21.15.81:0/3060653299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3141594c0 0x7ff3141423d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff30c00cc70 tx=0x7ff30c001a70 comp rx=0 tx=0).stop 2023-10-06T03:24:58.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.619+0000 7ff31359e700 1 -- 172.21.15.81:0/3060653299 shutdown_connections 2023-10-06T03:24:58.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.619+0000 7ff31359e700 1 --2- 172.21.15.81:0/3060653299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3141594c0 0x7ff3141423d0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:58.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.619+0000 7ff31359e700 1 --2- 172.21.15.81:0/3060653299 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff2f4066f30 0x7ff2f40693e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:58.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.619+0000 7ff31359e700 1 --2- 172.21.15.81:0/3060653299 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff3140ab7b0 0x7ff3140a5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:58.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.619+0000 7ff31359e700 1 --2- 172.21.15.81:0/3060653299 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3140ace00 0x7ff31415c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:58.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.619+0000 7ff31359e700 1 -- 172.21.15.81:0/3060653299 >> 172.21.15.81:0/3060653299 conn(0x7ff3140cbef0 msgr2=0x7ff3140b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:58.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.619+0000 7ff31359e700 1 -- 172.21.15.81:0/3060653299 shutdown_connections 2023-10-06T03:24:58.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:58.619+0000 7ff31359e700 1 -- 172.21.15.81:0/3060653299 wait complete. 2023-10-06T03:24:58.622 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 18 2023-10-06T03:24:59.041 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T03:24:52.345868+0000', 'modified': '2023-10-06T03:24:55.900366+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5121}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5121': {'gid': 5121, 'name': 'a', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.81:6835/2789471208', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6834', 'nonce': 2789471208}, {'type': 'v1', 'addr': '172.21.15.81:6835', 'nonce': 2789471208}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T03:24:59.041 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T03:24:59.042 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T03:24:59.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.223+0000 7f116fbff700 1 Processor -- start 2023-10-06T03:24:59.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.223+0000 7f116fbff700 1 -- start start 2023-10-06T03:24:59.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.224+0000 7f116fbff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1168155bc0 0x7f1168156c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:59.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.224+0000 7f116fbff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1168069ee0 0x7f116806a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:59.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.224+0000 7f116fbff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11680c9c60 con 0x7f11681557f0 2023-10-06T03:24:59.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.224+0000 7f116fbff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f116806df20 con 0x7f1168069ee0 2023-10-06T03:24:59.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.224+0000 7f116fbff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f116806a880 con 0x7f1168155bc0 2023-10-06T03:24:59.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.224+0000 7f116e19c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1168069ee0 0x7f116806a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:59.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.225+0000 7f116e19c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1168069ee0 0x7f116806a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42254/0 (socket says 172.21.15.81:42254) 2023-10-06T03:24:59.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.225+0000 7f116e19c700 1 -- 172.21.15.81:0/4152217273 learned_addr learned my addr 172.21.15.81:0/4152217273 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:59.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.225+0000 7f116d19a700 1 --2- 172.21.15.81:0/4152217273 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1168155bc0 0x7f1168156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:59.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.225+0000 7f116e19c700 1 -- 172.21.15.81:0/4152217273 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1168155bc0 msgr2=0x7f1168156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:59.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.225+0000 7f116e19c700 1 --2- 172.21.15.81:0/4152217273 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1168155bc0 0x7f1168156c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.225+0000 7f116e19c700 1 -- 172.21.15.81:0/4152217273 >> v1:172.21.15.83:6789/0 conn(0x7f11681557f0 legacy=0x7f11680c6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:59.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.225+0000 7f116e19c700 1 -- 172.21.15.81:0/4152217273 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f116806dc60 con 0x7f1168069ee0 2023-10-06T03:24:59.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.225+0000 7f116e19c700 1 --2- 172.21.15.81:0/4152217273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1168069ee0 0x7f116806a340 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f11600099b0 tx=0x7f1160009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbda5c03aa37838 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:59.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.225+0000 7f116c999700 1 -- 172.21.15.81:0/4152217273 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116000b820 con 0x7f1168069ee0 2023-10-06T03:24:59.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.226+0000 7f116c999700 1 -- 172.21.15.81:0/4152217273 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116000b980 con 0x7f1168069ee0 2023-10-06T03:24:59.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.226+0000 7f116c999700 1 -- 172.21.15.81:0/4152217273 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116000bd20 con 0x7f1168069ee0 2023-10-06T03:24:59.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.226+0000 7f116fbff700 1 -- 172.21.15.81:0/4152217273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1168069ee0 msgr2=0x7f116806a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:59.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.226+0000 7f116fbff700 1 --2- 172.21.15.81:0/4152217273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1168069ee0 0x7f116806a340 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f11600099b0 tx=0x7f1160009250 comp rx=0 tx=0).stop 2023-10-06T03:24:59.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.226+0000 7f116fbff700 1 -- 172.21.15.81:0/4152217273 shutdown_connections 2023-10-06T03:24:59.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.226+0000 7f116fbff700 1 --2- 172.21.15.81:0/4152217273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1168069ee0 0x7f116806a340 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.226+0000 7f116fbff700 1 --2- 172.21.15.81:0/4152217273 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1168155bc0 0x7f1168156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.226+0000 7f116fbff700 1 -- 172.21.15.81:0/4152217273 >> 172.21.15.81:0/4152217273 conn(0x7f11680cc090 msgr2=0x7f11680cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:59.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.226+0000 7f116fbff700 1 -- 172.21.15.81:0/4152217273 shutdown_connections 2023-10-06T03:24:59.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.226+0000 7f116fbff700 1 -- 172.21.15.81:0/4152217273 wait complete. 2023-10-06T03:24:59.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.228+0000 7f116fbff700 1 Processor -- start 2023-10-06T03:24:59.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.228+0000 7f116fbff700 1 -- start start 2023-10-06T03:24:59.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.229+0000 7f116fbff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1168069ee0 0x7f1168143ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:59.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.229+0000 7f116fbff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11681557f0 0x7f11680c3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:59.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.229+0000 7f116fbff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1168155bc0 0x7f11680b0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:59.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.229+0000 7f116fbff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11680c3a40 con 0x7f11681557f0 2023-10-06T03:24:59.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.229+0000 7f116fbff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11680c3d20 con 0x7f1168155bc0 2023-10-06T03:24:59.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.229+0000 7f116fbff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11680c4000 con 0x7f1168069ee0 2023-10-06T03:24:59.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.229+0000 7f116e19c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1168155bc0 0x7f11680b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:59.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.229+0000 7f116e19c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1168155bc0 0x7f11680b0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:36976/0 (socket says 172.21.15.81:36976) 2023-10-06T03:24:59.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.229+0000 7f116e19c700 1 -- 172.21.15.81:0/2361609220 learned_addr learned my addr 172.21.15.81:0/2361609220 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:59.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.229+0000 7f116d19a700 1 --2- 172.21.15.81:0/2361609220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11681557f0 0x7f11680c3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:59.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.229+0000 7f116d99b700 1 --2- 172.21.15.81:0/2361609220 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1168069ee0 0x7f1168143ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:59.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.230+0000 7f116e19c700 1 -- 172.21.15.81:0/2361609220 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1168069ee0 msgr2=0x7f1168143ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:59.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.230+0000 7f116e19c700 1 --2- 172.21.15.81:0/2361609220 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1168069ee0 0x7f1168143ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.230+0000 7f116e19c700 1 -- 172.21.15.81:0/2361609220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11681557f0 msgr2=0x7f11680c3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:59.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.230+0000 7f116e19c700 1 --2- 172.21.15.81:0/2361609220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11681557f0 0x7f11680c3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.230+0000 7f116e19c700 1 -- 172.21.15.81:0/2361609220 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11600094f0 con 0x7f1168155bc0 2023-10-06T03:24:59.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.230+0000 7f116d99b700 1 --2- 172.21.15.81:0/2361609220 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1168069ee0 0x7f1168143ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:24:59.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.230+0000 7f116e19c700 1 --2- 172.21.15.81:0/2361609220 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1168155bc0 0x7f11680b0350 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f11600030c0 tx=0x7f1160016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:59.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.230+0000 7f115dffb700 1 -- 172.21.15.81:0/2361609220 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116001b450 con 0x7f1168155bc0 2023-10-06T03:24:59.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.230+0000 7f115dffb700 1 -- 172.21.15.81:0/2361609220 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1160020070 con 0x7f1168155bc0 2023-10-06T03:24:59.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.230+0000 7f115dffb700 1 -- 172.21.15.81:0/2361609220 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116001b800 con 0x7f1168155bc0 2023-10-06T03:24:59.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.230+0000 7f116fbff700 1 -- 172.21.15.81:0/2361609220 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11680c4520 con 0x7f1168155bc0 2023-10-06T03:24:59.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.230+0000 7f116fbff700 1 -- 172.21.15.81:0/2361609220 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11681440e0 con 0x7f1168155bc0 2023-10-06T03:24:59.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.232+0000 7f115dffb700 1 -- 172.21.15.81:0/2361609220 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1160022030 con 0x7f1168155bc0 2023-10-06T03:24:59.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.233+0000 7f115dffb700 1 --2- 172.21.15.81:0/2361609220 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f114c066f30 0x7f114c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:59.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.233+0000 7f115dffb700 1 -- 172.21.15.81:0/2361609220 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f11600869b0 con 0x7f1168155bc0 2023-10-06T03:24:59.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.233+0000 7f116d99b700 1 --2- 172.21.15.81:0/2361609220 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f114c066f30 0x7f114c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:59.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.234+0000 7f116d99b700 1 --2- 172.21.15.81:0/2361609220 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f114c066f30 0x7f114c0693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1164007fd0 tx=0x7f1164009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:59.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.235+0000 7f117e2e8b80 1 Processor -- start 2023-10-06T03:24:59.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.235+0000 7f117e2e8b80 1 -- start start 2023-10-06T03:24:59.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.236+0000 7f117e2e8b80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x555812d84840 0x555812d84c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:59.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.236+0000 7f117e2e8b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555812d85cc0 0x555812dd46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:59.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.236+0000 7f117e2e8b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555812dd4c00 0x555812dd5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:59.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.236+0000 7f117e2e8b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x555812cdba70 con 0x555812dd4c00 2023-10-06T03:24:59.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.236+0000 7f117e2e8b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x555812cd9270 con 0x555812d85cc0 2023-10-06T03:24:59.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.236+0000 7f117e2e8b80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x555812cd5060 con 0x555812d84840 2023-10-06T03:24:59.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.236+0000 7f116e19c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555812dd4c00 0x555812dd5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:59.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.236+0000 7f116e19c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555812dd4c00 0x555812dd5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42276/0 (socket says 172.21.15.81:42276) 2023-10-06T03:24:59.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.236+0000 7f116e19c700 1 -- 172.21.15.81:0/2767910178 learned_addr learned my addr 172.21.15.81:0/2767910178 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:59.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.236+0000 7f116d19a700 1 --2- 172.21.15.81:0/2767910178 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555812d85cc0 0x555812dd46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:59.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.236+0000 7f116d99b700 1 --2- 172.21.15.81:0/2767910178 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x555812d84840 0x555812d84c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:59.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.236+0000 7f116e19c700 1 -- 172.21.15.81:0/2767910178 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x555812d84840 msgr2=0x555812d84c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:59.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.236+0000 7f116e19c700 1 --2- 172.21.15.81:0/2767910178 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x555812d84840 0x555812d84c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.236+0000 7f116e19c700 1 -- 172.21.15.81:0/2767910178 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555812d85cc0 msgr2=0x555812dd46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:59.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.236+0000 7f116e19c700 1 --2- 172.21.15.81:0/2767910178 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555812d85cc0 0x555812dd46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.236+0000 7f116e19c700 1 -- 172.21.15.81:0/2767910178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555812b6f270 con 0x555812dd4c00 2023-10-06T03:24:59.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.237+0000 7f116e19c700 1 --2- 172.21.15.81:0/2767910178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555812dd4c00 0x555812dd5050 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f1160057530 tx=0x7f1160084af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3071d8fa42f19ce7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:59.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.237+0000 7f114affd700 1 -- 172.21.15.81:0/2767910178 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1160057d20 con 0x555812dd4c00 2023-10-06T03:24:59.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.237+0000 7f114affd700 1 -- 172.21.15.81:0/2767910178 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11600575a0 con 0x555812dd4c00 2023-10-06T03:24:59.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.237+0000 7f114affd700 1 -- 172.21.15.81:0/2767910178 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116005a7f0 con 0x555812dd4c00 2023-10-06T03:24:59.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.237+0000 7f117e2e8b80 1 -- 172.21.15.81:0/2767910178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555812dd4c00 msgr2=0x555812dd5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:59.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.237+0000 7f117e2e8b80 1 --2- 172.21.15.81:0/2767910178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555812dd4c00 0x555812dd5050 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f1160057530 tx=0x7f1160084af0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.237+0000 7f117e2e8b80 1 -- 172.21.15.81:0/2767910178 shutdown_connections 2023-10-06T03:24:59.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.237+0000 7f117e2e8b80 1 --2- 172.21.15.81:0/2767910178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555812dd4c00 0x555812dd5050 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.237+0000 7f117e2e8b80 1 --2- 172.21.15.81:0/2767910178 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x555812d84840 0x555812d84c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.237+0000 7f117e2e8b80 1 --2- 172.21.15.81:0/2767910178 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555812d85cc0 0x555812dd46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.237+0000 7f117e2e8b80 1 -- 172.21.15.81:0/2767910178 >> 172.21.15.81:0/2767910178 conn(0x555812d86160 msgr2=0x555812d86530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:59.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.238+0000 7f117e2e8b80 1 -- 172.21.15.81:0/2767910178 shutdown_connections 2023-10-06T03:24:59.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.238+0000 7f117e2e8b80 1 -- 172.21.15.81:0/2767910178 wait complete. 2023-10-06T03:24:59.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.238+0000 7f117e2e8b80 1 -- start start 2023-10-06T03:24:59.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.238+0000 7f117e2e8b80 1 Processor -- start 2023-10-06T03:24:59.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.239+0000 7f117e2e8b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555812d84840 0x555812dc2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:59.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.239+0000 7f117e2e8b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555812d85cc0 0x555812da7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:59.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.239+0000 7f117e2e8b80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x555812dd4c00 0x555812dde2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:59.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.239+0000 7f117e2e8b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x555812c80890 con 0x555812d84840 2023-10-06T03:24:59.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.239+0000 7f117e2e8b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x555812c9bea0 con 0x555812d85cc0 2023-10-06T03:24:59.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.239+0000 7f117e2e8b80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x555812b57e30 con 0x555812dd4c00 2023-10-06T03:24:59.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.239+0000 7f117e2e8b80 10 client.0 _ll_register_callbacks cb 0x555812d47e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:24:59.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.240+0000 7f116d99b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555812d84840 0x555812dc2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:59.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.240+0000 7f116d99b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555812d84840 0x555812dc2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42286/0 (socket says 172.21.15.81:42286) 2023-10-06T03:24:59.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.240+0000 7f116d99b700 1 -- 172.21.15.81:0/641128127 learned_addr learned my addr 172.21.15.81:0/641128127 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:59.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.240+0000 7f116e19c700 1 --2- 172.21.15.81:0/641128127 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x555812dd4c00 0x555812dde2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:59.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.240+0000 7f116d99b700 1 -- 172.21.15.81:0/641128127 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x555812dd4c00 msgr2=0x555812dde2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:59.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.240+0000 7f116d19a700 1 --2- 172.21.15.81:0/641128127 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555812d85cc0 0x555812da7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:59.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.240+0000 7f116d99b700 1 --2- 172.21.15.81:0/641128127 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x555812dd4c00 0x555812dde2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.240+0000 7f116d99b700 1 -- 172.21.15.81:0/641128127 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555812d85cc0 msgr2=0x555812da7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:59.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.240+0000 7f116d99b700 1 --2- 172.21.15.81:0/641128127 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555812d85cc0 0x555812da7ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.240+0000 7f116d99b700 1 -- 172.21.15.81:0/641128127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11681440e0 con 0x555812d84840 2023-10-06T03:24:59.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.240+0000 7f116e19c700 1 --2- 172.21.15.81:0/641128127 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x555812dd4c00 0x555812dde2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:24:59.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.240+0000 7f116d99b700 1 --2- 172.21.15.81:0/641128127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555812d84840 0x555812dc2a10 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f1164015860 tx=0x7f1164017040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b74d80cf255433b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:59.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.240+0000 7f1143fff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-06T03:24:59.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.240+0000 7f1143fff700 1 -- 172.21.15.81:0/641128127 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1164013770 con 0x555812d84840 2023-10-06T03:24:59.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.241+0000 7f117e2e8b80 1 -- 172.21.15.81:0/641128127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555812d79940 con 0x555812d84840 2023-10-06T03:24:59.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.241+0000 7f1143fff700 1 -- 172.21.15.81:0/641128127 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f11640138d0 con 0x555812d84840 2023-10-06T03:24:59.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.241+0000 7f1143fff700 1 -- 172.21.15.81:0/641128127 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1164013ca0 con 0x555812d84840 2023-10-06T03:24:59.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.241+0000 7f117e2e8b80 10 client.5292 fetch_fsmap learned FSMap version 18 2023-10-06T03:24:59.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.241+0000 7f117e2e8b80 1 -- 172.21.15.81:0/641128127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x555812b11fe0 con 0x555812d84840 2023-10-06T03:24:59.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.241+0000 7f1143fff700 1 -- 172.21.15.81:0/641128127 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555812d79940 con 0x555812d84840 2023-10-06T03:24:59.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.241+0000 7f1143fff700 1 -- 172.21.15.81:0/641128127 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 18) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f1164021420 con 0x555812d84840 2023-10-06T03:24:59.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.241+0000 7f117e2e8b80 10 client.5292 fetch_fsmap finished waiting for FSMap version 18 2023-10-06T03:24:59.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.241+0000 7f117e2e8b80 10 client.5292 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T03:24:59.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.241+0000 7f117e2e8b80 20 client.5292 populate_metadata read hostname 'smithi081' 2023-10-06T03:24:59.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.241+0000 7f117e2e8b80 1 --2- 172.21.15.81:0/641128127 >> [v2:172.21.15.81:6834/2789471208,v1:172.21.15.81:6835/2789471208] conn(0x555812dcd4e0 0x555812dcd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:59.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.241+0000 7f117e2e8b80 4 client.5292 mds_command: new command op to 5121 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:24:59.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.241+0000 7f117e2e8b80 1 -- 172.21.15.81:0/641128127 --> [v2:172.21.15.81:6834/2789471208,v1:172.21.15.81:6835/2789471208] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555812d56870 con 0x555812dcd4e0 2023-10-06T03:24:59.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.241+0000 7f116d19a700 1 --2- 172.21.15.81:0/641128127 >> [v2:172.21.15.81:6834/2789471208,v1:172.21.15.81:6835/2789471208] conn(0x555812dcd4e0 0x555812dcd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:59.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.242+0000 7f116d19a700 1 --2- 172.21.15.81:0/641128127 >> [v2:172.21.15.81:6834/2789471208,v1:172.21.15.81:6835/2789471208] conn(0x555812dcd4e0 0x555812dcd8b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=895a8d9e8aa763c0 server_cookie=4fc2e730caa63f94 in_seq=0 out_seq=0 2023-10-06T03:24:59.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.242+0000 7f1143fff700 10 client.5292 ms_handle_connect on v2:172.21.15.81:6834/2789471208 2023-10-06T03:24:59.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.243+0000 7f1143fff700 1 -- 172.21.15.81:0/641128127 <== mds.0 v2:172.21.15.81:6834/2789471208 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x555812d56870 con 0x555812dcd4e0 2023-10-06T03:24:59.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.243+0000 7f1143fff700 10 client.5292 handle_command_reply: tid=0 2023-10-06T03:24:59.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.243+0000 7f117e2e8b80 1 client.5292 shutdown 2023-10-06T03:24:59.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.243+0000 7f117e2e8b80 1 -- 172.21.15.81:0/641128127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555812d84840 msgr2=0x555812dc2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:59.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.243+0000 7f117e2e8b80 1 --2- 172.21.15.81:0/641128127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555812d84840 0x555812dc2a10 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f1164015860 tx=0x7f1164017040 comp rx=0 tx=0).stop 2023-10-06T03:24:59.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.243+0000 7f117e2e8b80 1 -- 172.21.15.81:0/641128127 shutdown_connections 2023-10-06T03:24:59.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.243+0000 7f117e2e8b80 1 --2- 172.21.15.81:0/641128127 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x555812dd4c00 0x555812dde2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.243+0000 7f117e2e8b80 1 --2- 172.21.15.81:0/641128127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555812d84840 0x555812dc2a10 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.243+0000 7f117e2e8b80 1 --2- 172.21.15.81:0/641128127 >> [v2:172.21.15.81:6834/2789471208,v1:172.21.15.81:6835/2789471208] conn(0x555812dcd4e0 0x555812dcd8b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.243+0000 7f117e2e8b80 1 --2- 172.21.15.81:0/641128127 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555812d85cc0 0x555812da7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.243+0000 7f1143fff700 0 client.5292 ms_handle_reset on v2:172.21.15.81:6834/2789471208 2023-10-06T03:24:59.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.243+0000 7f117e2e8b80 1 -- 172.21.15.81:0/641128127 >> 172.21.15.81:0/641128127 conn(0x555812d86160 msgr2=0x555812d81a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:59.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.243+0000 7f117e2e8b80 1 -- 172.21.15.81:0/641128127 shutdown_connections 2023-10-06T03:24:59.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.243+0000 7f117e2e8b80 1 -- 172.21.15.81:0/641128127 wait complete. 2023-10-06T03:24:59.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.243+0000 7f117e2e8b80 20 client.5292 trim_cache size 0 max 16384 2023-10-06T03:24:59.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.260+0000 7f117e2e8b80 1 Processor -- start 2023-10-06T03:24:59.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.260+0000 7f117e2e8b80 1 -- start start 2023-10-06T03:24:59.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.261+0000 7f117e2e8b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555812d86160 0x555812d86530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:59.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.261+0000 7f117e2e8b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555812d84840 0x555812d86a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:59.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.261+0000 7f117e2e8b80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x555812d85cc0 0x555812dc78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:59.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.261+0000 7f117e2e8b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x555812d83dc0 con 0x555812d84840 2023-10-06T03:24:59.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.261+0000 7f117e2e8b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x555812dde130 con 0x555812d86160 2023-10-06T03:24:59.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.261+0000 7f117e2e8b80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x555812dc3470 con 0x555812d85cc0 2023-10-06T03:24:59.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.261+0000 7f116d19a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555812d84840 0x555812d86a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:59.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.261+0000 7f116d19a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555812d84840 0x555812d86a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42296/0 (socket says 172.21.15.81:42296) 2023-10-06T03:24:59.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.261+0000 7f116d19a700 1 -- 172.21.15.81:0/460695080 learned_addr learned my addr 172.21.15.81:0/460695080 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:59.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.262+0000 7f116d19a700 1 -- 172.21.15.81:0/460695080 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x555812d85cc0 msgr2=0x555812dc78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:59.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.262+0000 7f116d19a700 1 --2- 172.21.15.81:0/460695080 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x555812d85cc0 0x555812dc78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.262+0000 7f116d99b700 1 --2- 172.21.15.81:0/460695080 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555812d86160 0x555812d86530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:59.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.262+0000 7f116d19a700 1 -- 172.21.15.81:0/460695080 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555812d86160 msgr2=0x555812d86530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:59.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.262+0000 7f116d19a700 1 --2- 172.21.15.81:0/460695080 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555812d86160 0x555812d86530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.262+0000 7f116d19a700 1 -- 172.21.15.81:0/460695080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555812ca3780 con 0x555812d84840 2023-10-06T03:24:59.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.262+0000 7f116d19a700 1 --2- 172.21.15.81:0/460695080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555812d84840 0x555812d86a70 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f1158006fd0 tx=0x7f1158008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d339c4889e48121c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:59.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.262+0000 7f114b7fe700 1 -- 172.21.15.81:0/460695080 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1158016970 con 0x555812d84840 2023-10-06T03:24:59.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.262+0000 7f114b7fe700 1 -- 172.21.15.81:0/460695080 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f115800c040 con 0x555812d84840 2023-10-06T03:24:59.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.262+0000 7f114b7fe700 1 -- 172.21.15.81:0/460695080 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1158016d20 con 0x555812d84840 2023-10-06T03:24:59.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.263+0000 7f117e2e8b80 1 -- 172.21.15.81:0/460695080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555812d84840 msgr2=0x555812d86a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:59.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.263+0000 7f117e2e8b80 1 --2- 172.21.15.81:0/460695080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555812d84840 0x555812d86a70 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f1158006fd0 tx=0x7f1158008040 comp rx=0 tx=0).stop 2023-10-06T03:24:59.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.263+0000 7f117e2e8b80 1 -- 172.21.15.81:0/460695080 shutdown_connections 2023-10-06T03:24:59.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.263+0000 7f117e2e8b80 1 --2- 172.21.15.81:0/460695080 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x555812d85cc0 0x555812dc78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.263+0000 7f117e2e8b80 1 --2- 172.21.15.81:0/460695080 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555812d86160 0x555812d86530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.263+0000 7f117e2e8b80 1 --2- 172.21.15.81:0/460695080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555812d84840 0x555812d86a70 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.263+0000 7f117e2e8b80 1 -- 172.21.15.81:0/460695080 >> 172.21.15.81:0/460695080 conn(0x555812dc4230 msgr2=0x555812d7d280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:59.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.263+0000 7f117e2e8b80 1 -- 172.21.15.81:0/460695080 shutdown_connections 2023-10-06T03:24:59.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.263+0000 7f117e2e8b80 1 -- 172.21.15.81:0/460695080 wait complete. 2023-10-06T03:24:59.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.263+0000 7f117e2e8b80 1 -- start start 2023-10-06T03:24:59.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.264+0000 7f117e2e8b80 1 Processor -- start 2023-10-06T03:24:59.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.265+0000 7f117e2e8b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555812d84840 0x555812e2af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:59.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.265+0000 7f117e2e8b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555812d85cc0 0x555812dc1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:59.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.265+0000 7f117e2e8b80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x555812d86160 0x555812e30fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:59.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.265+0000 7f117e2e8b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x555812da6780 con 0x555812d84840 2023-10-06T03:24:59.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.265+0000 7f117e2e8b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x555812e2b440 con 0x555812d85cc0 2023-10-06T03:24:59.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.265+0000 7f117e2e8b80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x555812da6410 con 0x555812d86160 2023-10-06T03:24:59.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.265+0000 7f117e2e8b80 10 client.0 _ll_register_callbacks cb 0x555812d47e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:24:59.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.265+0000 7f116d99b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555812d84840 0x555812e2af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:59.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.265+0000 7f116d99b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555812d84840 0x555812e2af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42300/0 (socket says 172.21.15.81:42300) 2023-10-06T03:24:59.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.265+0000 7f116d99b700 1 -- 172.21.15.81:0/1720163162 learned_addr learned my addr 172.21.15.81:0/1720163162 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:59.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.265+0000 7f116d19a700 1 --2- 172.21.15.81:0/1720163162 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555812d85cc0 0x555812dc1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:59.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.265+0000 7f116e19c700 1 --2- 172.21.15.81:0/1720163162 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x555812d86160 0x555812e30fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:59.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.265+0000 7f116d99b700 1 -- 172.21.15.81:0/1720163162 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x555812d86160 msgr2=0x555812e30fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:59.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.265+0000 7f116d99b700 1 --2- 172.21.15.81:0/1720163162 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x555812d86160 0x555812e30fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.265+0000 7f116d99b700 1 -- 172.21.15.81:0/1720163162 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555812d85cc0 msgr2=0x555812dc1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:59.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.265+0000 7f116d99b700 1 --2- 172.21.15.81:0/1720163162 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555812d85cc0 0x555812dc1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.265+0000 7f116d99b700 1 -- 172.21.15.81:0/1720163162 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f115800aa50 con 0x555812d84840 2023-10-06T03:24:59.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.265+0000 7f116d99b700 1 --2- 172.21.15.81:0/1720163162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555812d84840 0x555812e2af00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f1164024040 tx=0x7f116401a030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df0ed2d890317305 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:59.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.265+0000 7f1143fff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-06T03:24:59.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.266+0000 7f1143fff700 1 -- 172.21.15.81:0/1720163162 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1164021930 con 0x555812d84840 2023-10-06T03:24:59.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.266+0000 7f117e2e8b80 1 -- 172.21.15.81:0/1720163162 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555812dc9470 con 0x555812d84840 2023-10-06T03:24:59.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.266+0000 7f1143fff700 1 -- 172.21.15.81:0/1720163162 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f1164021420 con 0x555812d84840 2023-10-06T03:24:59.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.266+0000 7f1143fff700 1 -- 172.21.15.81:0/1720163162 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1164013ca0 con 0x555812d84840 2023-10-06T03:24:59.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.266+0000 7f117e2e8b80 10 client.5298 fetch_fsmap learned FSMap version 18 2023-10-06T03:24:59.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.266+0000 7f117e2e8b80 1 -- 172.21.15.81:0/1720163162 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x555812c8a470 con 0x555812d84840 2023-10-06T03:24:59.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.266+0000 7f1143fff700 1 -- 172.21.15.81:0/1720163162 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555812dc9470 con 0x555812d84840 2023-10-06T03:24:59.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.266+0000 7f1143fff700 1 -- 172.21.15.81:0/1720163162 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 18) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f1164021b40 con 0x555812d84840 2023-10-06T03:24:59.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.266+0000 7f117e2e8b80 10 client.5298 fetch_fsmap finished waiting for FSMap version 18 2023-10-06T03:24:59.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.266+0000 7f117e2e8b80 10 client.5298 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T03:24:59.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.266+0000 7f117e2e8b80 20 client.5298 populate_metadata read hostname 'smithi081' 2023-10-06T03:24:59.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.266+0000 7f117e2e8b80 1 --2- 172.21.15.81:0/1720163162 >> [v2:172.21.15.81:6834/2789471208,v1:172.21.15.81:6835/2789471208] conn(0x555812dd4c00 0x555812da6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:59.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.266+0000 7f117e2e8b80 4 client.5298 mds_command: new command op to 5121 tid=0[{"prefix": "status"}] 2023-10-06T03:24:59.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.266+0000 7f117e2e8b80 1 -- 172.21.15.81:0/1720163162 --> [v2:172.21.15.81:6834/2789471208,v1:172.21.15.81:6835/2789471208] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f11600575a0 con 0x555812dd4c00 2023-10-06T03:24:59.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.267+0000 7f116d19a700 1 --2- 172.21.15.81:0/1720163162 >> [v2:172.21.15.81:6834/2789471208,v1:172.21.15.81:6835/2789471208] conn(0x555812dd4c00 0x555812da6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:59.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.267+0000 7f1143fff700 10 client.5298 ms_handle_connect on v2:172.21.15.81:6834/2789471208 2023-10-06T03:24:59.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.267+0000 7f116d19a700 1 --2- 172.21.15.81:0/1720163162 >> [v2:172.21.15.81:6834/2789471208,v1:172.21.15.81:6835/2789471208] conn(0x555812dd4c00 0x555812da6cd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6606b265eb3b7462 server_cookie=8b8062ab059c6111 in_seq=0 out_seq=0 2023-10-06T03:24:59.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.267+0000 7f1143fff700 1 -- 172.21.15.81:0/1720163162 <== mds.0 v2:172.21.15.81:6834/2789471208 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x7f11600575a0 con 0x555812dd4c00 2023-10-06T03:24:59.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.267+0000 7f1143fff700 10 client.5298 handle_command_reply: tid=0 2023-10-06T03:24:59.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.267+0000 7f117e2e8b80 1 client.5298 shutdown 2023-10-06T03:24:59.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.267+0000 7f117e2e8b80 1 -- 172.21.15.81:0/1720163162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555812d84840 msgr2=0x555812e2af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:59.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.267+0000 7f117e2e8b80 1 --2- 172.21.15.81:0/1720163162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555812d84840 0x555812e2af00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f1164024040 tx=0x7f116401a030 comp rx=0 tx=0).stop 2023-10-06T03:24:59.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.267+0000 7f117e2e8b80 1 -- 172.21.15.81:0/1720163162 shutdown_connections 2023-10-06T03:24:59.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.267+0000 7f117e2e8b80 1 --2- 172.21.15.81:0/1720163162 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x555812d86160 0x555812e30fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.267+0000 7f117e2e8b80 1 --2- 172.21.15.81:0/1720163162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555812d84840 0x555812e2af00 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.267+0000 7f117e2e8b80 1 --2- 172.21.15.81:0/1720163162 >> [v2:172.21.15.81:6834/2789471208,v1:172.21.15.81:6835/2789471208] conn(0x555812dd4c00 0x555812da6cd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.267+0000 7f117e2e8b80 1 --2- 172.21.15.81:0/1720163162 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555812d85cc0 0x555812dc1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.267+0000 7f117e2e8b80 1 -- 172.21.15.81:0/1720163162 >> 172.21.15.81:0/1720163162 conn(0x555812dc4230 msgr2=0x555812dac290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:59.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.267+0000 7f1143fff700 0 client.5298 ms_handle_reset on v2:172.21.15.81:6834/2789471208 2023-10-06T03:24:59.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.268+0000 7f117e2e8b80 1 -- 172.21.15.81:0/1720163162 shutdown_connections 2023-10-06T03:24:59.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.268+0000 7f117e2e8b80 1 -- 172.21.15.81:0/1720163162 wait complete. 2023-10-06T03:24:59.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.268+0000 7f117e2e8b80 20 client.5298 trim_cache size 0 max 16384 2023-10-06T03:24:59.275 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T03:24:59.275 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "1807b5d7-9be8-43ad-aaf8-99a4273430b3", 2023-10-06T03:24:59.275 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2023-10-06T03:24:59.275 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 5121, 2023-10-06T03:24:59.276 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2023-10-06T03:24:59.276 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2023-10-06T03:24:59.276 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2023-10-06T03:24:59.276 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 6.3952128950000002, 2023-10-06T03:24:59.276 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 18, 2023-10-06T03:24:59.276 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 38, 2023-10-06T03:24:59.276 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 38, 2023-10-06T03:24:59.276 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 15.19296716 2023-10-06T03:24:59.276 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T03:24:59.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.268+0000 7f116fbff700 1 -- 172.21.15.81:0/2361609220 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f114c066f30 msgr2=0x7f114c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:59.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.268+0000 7f116fbff700 1 --2- 172.21.15.81:0/2361609220 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f114c066f30 0x7f114c0693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1164007fd0 tx=0x7f1164009040 comp rx=0 tx=0).stop 2023-10-06T03:24:59.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.268+0000 7f116fbff700 1 -- 172.21.15.81:0/2361609220 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1168155bc0 msgr2=0x7f11680b0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:59.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.268+0000 7f116fbff700 1 --2- 172.21.15.81:0/2361609220 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1168155bc0 0x7f11680b0350 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f11600030c0 tx=0x7f1160016000 comp rx=0 tx=0).stop 2023-10-06T03:24:59.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.268+0000 7f116fbff700 1 -- 172.21.15.81:0/2361609220 shutdown_connections 2023-10-06T03:24:59.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.268+0000 7f116fbff700 1 --2- 172.21.15.81:0/2361609220 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1168155bc0 0x7f11680b0350 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.268+0000 7f116fbff700 1 --2- 172.21.15.81:0/2361609220 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f114c066f30 0x7f114c0693e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.268+0000 7f116fbff700 1 --2- 172.21.15.81:0/2361609220 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1168069ee0 0x7f1168143ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.268+0000 7f116fbff700 1 --2- 172.21.15.81:0/2361609220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11681557f0 0x7f11680c3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.268+0000 7f116fbff700 1 -- 172.21.15.81:0/2361609220 >> 172.21.15.81:0/2361609220 conn(0x7f11680cc090 msgr2=0x7f1168063500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:59.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.268+0000 7f116fbff700 1 -- 172.21.15.81:0/2361609220 shutdown_connections 2023-10-06T03:24:59.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.269+0000 7f116fbff700 1 -- 172.21.15.81:0/2361609220 wait complete. 2023-10-06T03:24:59.287 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:24:59.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.464+0000 7fdfc2bff700 1 Processor -- start 2023-10-06T03:24:59.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.464+0000 7fdfc2bff700 1 -- start start 2023-10-06T03:24:59.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.466+0000 7fdfc2bff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fdfbc13f9c0 0x7fdfbc0ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:59.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.466+0000 7fdfc2bff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdfbc0cab60 0x7fdfbc159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:59.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.466+0000 7fdfc2bff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfbc0cafe0 con 0x7fdfbc13fd90 2023-10-06T03:24:59.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.466+0000 7fdfc2bff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfbc0cb2c0 con 0x7fdfbc0cab60 2023-10-06T03:24:59.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.466+0000 7fdfc2bff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfbc0cb5a0 con 0x7fdfbc13f9c0 2023-10-06T03:24:59.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.466+0000 7fdfbbfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdfbc0cab60 0x7fdfbc159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:59.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.466+0000 7fdfbbfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdfbc0cab60 0x7fdfbc159eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42304/0 (socket says 172.21.15.81:42304) 2023-10-06T03:24:59.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.466+0000 7fdfbbfff700 1 -- 172.21.15.81:0/1978638212 learned_addr learned my addr 172.21.15.81:0/1978638212 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:59.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.466+0000 7fdfc099b700 1 --2- 172.21.15.81:0/1978638212 >> v2:172.21.15.83:3300/0 conn(0x7fdfbc13f9c0 0x7fdfbc0ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:59.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.466+0000 7fdfbbfff700 1 -- 172.21.15.81:0/1978638212 >> v2:172.21.15.83:3300/0 conn(0x7fdfbc13f9c0 msgr2=0x7fdfbc0ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:24:59.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.466+0000 7fdfbbfff700 1 --2- 172.21.15.81:0/1978638212 >> v2:172.21.15.83:3300/0 conn(0x7fdfbc13f9c0 0x7fdfbc0ca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.466+0000 7fdfbbfff700 1 -- 172.21.15.81:0/1978638212 >> v1:172.21.15.83:6789/0 conn(0x7fdfbc13fd90 legacy=0x7fdfbc06e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:59.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.466+0000 7fdfbbfff700 1 -- 172.21.15.81:0/1978638212 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfbc0cb880 con 0x7fdfbc0cab60 2023-10-06T03:24:59.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.467+0000 7fdfbbfff700 1 --2- 172.21.15.81:0/1978638212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfbc0cab60 0x7fdfbc159eb0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc069010 tx=0x7fdfa8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcba48a06105eeac server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:59.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.467+0000 7fdfbb7fe700 1 -- 172.21.15.81:0/1978638212 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa8009e70 con 0x7fdfbc0cab60 2023-10-06T03:24:59.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.467+0000 7fdfbb7fe700 1 -- 172.21.15.81:0/1978638212 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa800b860 con 0x7fdfbc0cab60 2023-10-06T03:24:59.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.467+0000 7fdfbb7fe700 1 -- 172.21.15.81:0/1978638212 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa800bc00 con 0x7fdfbc0cab60 2023-10-06T03:24:59.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.467+0000 7fdfc2bff700 1 -- 172.21.15.81:0/1978638212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfbc0cab60 msgr2=0x7fdfbc159eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:59.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.467+0000 7fdfc2bff700 1 --2- 172.21.15.81:0/1978638212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfbc0cab60 0x7fdfbc159eb0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc069010 tx=0x7fdfa8009250 comp rx=0 tx=0).stop 2023-10-06T03:24:59.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.467+0000 7fdfc2bff700 1 -- 172.21.15.81:0/1978638212 shutdown_connections 2023-10-06T03:24:59.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.467+0000 7fdfc2bff700 1 --2- 172.21.15.81:0/1978638212 >> v2:172.21.15.83:3300/0 conn(0x7fdfbc13f9c0 0x7fdfbc0ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.467+0000 7fdfc2bff700 1 --2- 172.21.15.81:0/1978638212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfbc0cab60 0x7fdfbc159eb0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.467+0000 7fdfc2bff700 1 -- 172.21.15.81:0/1978638212 >> 172.21.15.81:0/1978638212 conn(0x7fdfbc0cc090 msgr2=0x7fdfbc0cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:59.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.468+0000 7fdfc2bff700 1 -- 172.21.15.81:0/1978638212 shutdown_connections 2023-10-06T03:24:59.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.468+0000 7fdfc2bff700 1 -- 172.21.15.81:0/1978638212 wait complete. 2023-10-06T03:24:59.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.469+0000 7fdfc2bff700 1 Processor -- start 2023-10-06T03:24:59.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.469+0000 7fdfc2bff700 1 -- start start 2023-10-06T03:24:59.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.470+0000 7fdfc2bff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdfbc13f9c0 0x7fdfbc158d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:59.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.470+0000 7fdfc2bff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfbc13fd90 0x7fdfbc0af7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:59.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.470+0000 7fdfc2bff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfbc0afd30 0x7fdfbc06e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:59.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.470+0000 7fdfc2bff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfbc1592c0 con 0x7fdfbc13fd90 2023-10-06T03:24:59.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.470+0000 7fdfc2bff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfbc0addd0 con 0x7fdfbc0afd30 2023-10-06T03:24:59.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.470+0000 7fdfc2bff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfbc0b17f0 con 0x7fdfbc13f9c0 2023-10-06T03:24:59.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.470+0000 7fdfbbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfbc13fd90 0x7fdfbc0af7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:59.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.470+0000 7fdfbbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfbc13fd90 0x7fdfbc0af7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42308/0 (socket says 172.21.15.81:42308) 2023-10-06T03:24:59.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.470+0000 7fdfbbfff700 1 -- 172.21.15.81:0/899470292 learned_addr learned my addr 172.21.15.81:0/899470292 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:24:59.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.470+0000 7fdfc099b700 1 --2- 172.21.15.81:0/899470292 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdfbc13f9c0 0x7fdfbc158d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:59.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.470+0000 7fdfc119c700 1 --2- 172.21.15.81:0/899470292 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfbc0afd30 0x7fdfbc06e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:59.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.471+0000 7fdfbbfff700 1 -- 172.21.15.81:0/899470292 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdfbc13f9c0 msgr2=0x7fdfbc158d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:59.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.471+0000 7fdfbbfff700 1 --2- 172.21.15.81:0/899470292 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdfbc13f9c0 0x7fdfbc158d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.471+0000 7fdfbbfff700 1 -- 172.21.15.81:0/899470292 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfbc0afd30 msgr2=0x7fdfbc06e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:59.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.471+0000 7fdfbbfff700 1 --2- 172.21.15.81:0/899470292 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfbc0afd30 0x7fdfbc06e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.471+0000 7fdfbbfff700 1 -- 172.21.15.81:0/899470292 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa80094f0 con 0x7fdfbc13fd90 2023-10-06T03:24:59.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.471+0000 7fdfbbfff700 1 --2- 172.21.15.81:0/899470292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfbc13fd90 0x7fdfbc0af7f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc0c8ad0 tx=0x7fdfa8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:59.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.471+0000 7fdfb8ff9700 1 -- 172.21.15.81:0/899470292 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa800bbe0 con 0x7fdfbc13fd90 2023-10-06T03:24:59.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.471+0000 7fdfb8ff9700 1 -- 172.21.15.81:0/899470292 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa8011420 con 0x7fdfbc13fd90 2023-10-06T03:24:59.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.471+0000 7fdfb8ff9700 1 -- 172.21.15.81:0/899470292 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa80117e0 con 0x7fdfbc13fd90 2023-10-06T03:24:59.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.471+0000 7fdfc2bff700 1 -- 172.21.15.81:0/899470292 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfbc0ad1c0 con 0x7fdfbc13fd90 2023-10-06T03:24:59.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.471+0000 7fdfc2bff700 1 -- 172.21.15.81:0/899470292 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfbc0ad780 con 0x7fdfbc13fd90 2023-10-06T03:24:59.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.472+0000 7fdfc2bff700 1 -- 172.21.15.81:0/899470292 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfbc06b1c0 con 0x7fdfbc13fd90 2023-10-06T03:24:59.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.473+0000 7fdfb8ff9700 1 -- 172.21.15.81:0/899470292 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdfa8011c10 con 0x7fdfbc13fd90 2023-10-06T03:24:59.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.474+0000 7fdfb8ff9700 1 --2- 172.21.15.81:0/899470292 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fdfa0066f30 0x7fdfa00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:24:59.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.474+0000 7fdfb8ff9700 1 -- 172.21.15.81:0/899470292 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fdfa8086080 con 0x7fdfbc13fd90 2023-10-06T03:24:59.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.474+0000 7fdfc099b700 1 --2- 172.21.15.81:0/899470292 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fdfa0066f30 0x7fdfa00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:24:59.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.475+0000 7fdfc099b700 1 --2- 172.21.15.81:0/899470292 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fdfa0066f30 0x7fdfa00693e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fdfb0009db0 tx=0x7fdfb00091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:24:59.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.478+0000 7fdfb8ff9700 1 -- 172.21.15.81:0/899470292 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdfa80b75a0 con 0x7fdfbc13fd90 2023-10-06T03:24:59.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.712+0000 7fdfc2bff700 1 -- 172.21.15.81:0/899470292 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdfbc0adf40 con 0x7fdfbc13fd90 2023-10-06T03:24:59.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.713+0000 7fdfb8ff9700 1 -- 172.21.15.81:0/899470292 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+73 (secure 0 0 0) 0x7fdfa8015070 con 0x7fdfbc13fd90 2023-10-06T03:24:59.715 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T03:24:59.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.715+0000 7fdfc2bff700 1 -- 172.21.15.81:0/899470292 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fdfa0066f30 msgr2=0x7fdfa00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:59.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.715+0000 7fdfc2bff700 1 --2- 172.21.15.81:0/899470292 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fdfa0066f30 0x7fdfa00693e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fdfb0009db0 tx=0x7fdfb00091a0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.715+0000 7fdfc2bff700 1 -- 172.21.15.81:0/899470292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfbc13fd90 msgr2=0x7fdfbc0af7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:24:59.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.715+0000 7fdfc2bff700 1 --2- 172.21.15.81:0/899470292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfbc13fd90 0x7fdfbc0af7f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc0c8ad0 tx=0x7fdfa8017000 comp rx=0 tx=0).stop 2023-10-06T03:24:59.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.715+0000 7fdfc2bff700 1 -- 172.21.15.81:0/899470292 shutdown_connections 2023-10-06T03:24:59.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.715+0000 7fdfc2bff700 1 --2- 172.21.15.81:0/899470292 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfbc0afd30 0x7fdfbc06e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.715+0000 7fdfc2bff700 1 --2- 172.21.15.81:0/899470292 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fdfa0066f30 0x7fdfa00693e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.715+0000 7fdfc2bff700 1 --2- 172.21.15.81:0/899470292 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdfbc13f9c0 0x7fdfbc158d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.715+0000 7fdfc2bff700 1 --2- 172.21.15.81:0/899470292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfbc13fd90 0x7fdfbc0af7f0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:24:59.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.715+0000 7fdfc2bff700 1 -- 172.21.15.81:0/899470292 >> 172.21.15.81:0/899470292 conn(0x7fdfbc0cc090 msgr2=0x7fdfbc159570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:24:59.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.715+0000 7fdfc2bff700 1 -- 172.21.15.81:0/899470292 shutdown_connections 2023-10-06T03:24:59.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:24:59.715+0000 7fdfc2bff700 1 -- 172.21.15.81:0/899470292 wait complete. 2023-10-06T03:24:59.735 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T03:24:59.735 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:24:59.735 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2023-10-06T03:24:59.735 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T03:24:59.735 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T03:24:59.735 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T03:24:59.735 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T03:24:59.735 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:24:59.735 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:24:59.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:59.736 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2023-10-06T03:24:59.773 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:24:59.773 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:24:59.773 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:24:59.774 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:59.774 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-10-06T03:24:59.774 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:59.774 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:24:59.774 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:24:59.775 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2023-10-06T03:24:59.775 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:24:59.775 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:24:59.775 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2023-10-06T03:24:59.775 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:24:59.775 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:24:59.776 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:24:59.776 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:24:59.776 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T03:24:59.776 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42199sec preferred_lft 42199sec 2023-10-06T03:24:59.776 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2023-10-06T03:24:59.777 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:59.777 INFO:teuthology.orchestra.run.smithi081.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:24:59.777 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 66:05:4b:05:47:f7 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:24:59.777 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T03:24:59.777 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:59.777 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::e80b:69ff:fe9b:cd37/64 scope link 2023-10-06T03:24:59.778 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:59.778 INFO:teuthology.orchestra.run.smithi081.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:24:59.778 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 66:05:4b:05:47:f7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T03:24:59.778 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::6405:4bff:fe05:47f7/64 scope link 2023-10-06T03:24:59.778 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:59.778 INFO:teuthology.orchestra.run.smithi081.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:24:59.779 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether e2:cb:97:b2:62:56 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T03:24:59.779 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::e0cb:97ff:feb2:6256/64 scope link 2023-10-06T03:24:59.779 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:24:59.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:59.780 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:24:59.872 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-10-06T03:24:59.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:59.875 DEBUG:teuthology.orchestra.run.smithi081:> route 2023-10-06T03:24:59.915 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2023-10-06T03:24:59.915 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:24:59.915 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:24:59.915 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T03:24:59.915 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:24:59.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:24:59.916 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-06T03:24:59.916 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-06T03:24:59.916 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:24:59.916 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:24:59.916 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:24:59.916 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-06T03:25:00.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:00.111 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-10-06T03:25:00.146 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T03:25:00.146 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T03:25:00.147 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:25:00.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:00.147 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2023-10-06T03:25:00.247 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:25:00.247 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T03:25:00.283 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:25:00.283 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:25:00.283 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:25:00.361 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-06T03:25:00.361 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:25:00.362 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:25:00.490 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:25:00.490 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:25:00.519 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T03:25:00.519 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T03:25:00.519 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T03:25:00.519 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with new device syntax: 0@1807b5d7-9be8-43ad-aaf8-99a4273430b3.cephfs=/ 2023-10-06T03:25:00.519 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.81:3300/172.21.15.83:3300/172.21.15.83:3301" will pass to kernel 2023-10-06T03:25:00.523 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T03:25:00.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:00.524 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:25:00.585 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T03:25:00.585 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-10-06T03:25:00.585 DEBUG:teuthology.orchestra.run.smithi081:> import uuid 2023-10-06T03:25:00.585 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-06T03:25:00.585 DEBUG:teuthology.orchestra.run.smithi081:> n = 1 2023-10-06T03:25:00.585 DEBUG:teuthology.orchestra.run.smithi081:> create_hard_links = False 2023-10-06T03:25:00.588 DEBUG:teuthology.orchestra.run.smithi081:> if 0 > 0: 2023-10-06T03:25:00.588 DEBUG:teuthology.orchestra.run.smithi081:> create_hard_links = True 2023-10-06T03:25:00.588 DEBUG:teuthology.orchestra.run.smithi081:> path = "/home/ubuntu/cephtest/mnt.0/file_on_fs" 2023-10-06T03:25:00.588 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-06T03:25:00.588 DEBUG:teuthology.orchestra.run.smithi081:> dpath = os.path.dirname(path) 2023-10-06T03:25:00.588 DEBUG:teuthology.orchestra.run.smithi081:> fnameprefix = os.path.basename(path) 2023-10-06T03:25:00.588 DEBUG:teuthology.orchestra.run.smithi081:> os.makedirs(dpath, exist_ok=True) 2023-10-06T03:25:00.588 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-06T03:25:00.588 DEBUG:teuthology.orchestra.run.smithi081:> try: 2023-10-06T03:25:00.589 DEBUG:teuthology.orchestra.run.smithi081:> dirfd = os.open(dpath, os.O_DIRECTORY) 2023-10-06T03:25:00.589 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-06T03:25:00.589 DEBUG:teuthology.orchestra.run.smithi081:> for i in range(n): 2023-10-06T03:25:00.589 DEBUG:teuthology.orchestra.run.smithi081:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2023-10-06T03:25:00.589 DEBUG:teuthology.orchestra.run.smithi081:> with open(fpath, '"'"'w'"'"') as f: 2023-10-06T03:25:00.589 DEBUG:teuthology.orchestra.run.smithi081:> f.write(f"{i}") 2023-10-06T03:25:00.589 DEBUG:teuthology.orchestra.run.smithi081:> if True: 2023-10-06T03:25:00.589 DEBUG:teuthology.orchestra.run.smithi081:> f.flush() 2023-10-06T03:25:00.589 DEBUG:teuthology.orchestra.run.smithi081:> os.fsync(f.fileno()) 2023-10-06T03:25:00.589 DEBUG:teuthology.orchestra.run.smithi081:> if False: 2023-10-06T03:25:00.589 DEBUG:teuthology.orchestra.run.smithi081:> os.unlink(fpath) 2023-10-06T03:25:00.589 DEBUG:teuthology.orchestra.run.smithi081:> if False: 2023-10-06T03:25:00.589 DEBUG:teuthology.orchestra.run.smithi081:> os.fsync(dirfd) 2023-10-06T03:25:00.590 DEBUG:teuthology.orchestra.run.smithi081:> if create_hard_links: 2023-10-06T03:25:00.590 DEBUG:teuthology.orchestra.run.smithi081:> for j in range(0): 2023-10-06T03:25:00.590 DEBUG:teuthology.orchestra.run.smithi081:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2023-10-06T03:25:00.590 DEBUG:teuthology.orchestra.run.smithi081:> if False: 2023-10-06T03:25:00.590 DEBUG:teuthology.orchestra.run.smithi081:> os.fsync(dirfd) 2023-10-06T03:25:00.590 DEBUG:teuthology.orchestra.run.smithi081:> finally: 2023-10-06T03:25:00.590 DEBUG:teuthology.orchestra.run.smithi081:> os.close(dirfd) 2023-10-06T03:25:00.590 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-10-06T03:25:00.879 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T03:25:01.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.098+0000 7f377d19d700 1 Processor -- start 2023-10-06T03:25:01.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.099+0000 7f377d19d700 1 -- start start 2023-10-06T03:25:01.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.100+0000 7f377d19d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f377806e2e0 0x7f3778160860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:01.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.100+0000 7f377d19d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37780ac5f0 con 0x7f37780ab7b0 2023-10-06T03:25:01.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.100+0000 7f377d19d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37780ad290 con 0x7f37780ace00 2023-10-06T03:25:01.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.100+0000 7f377d19d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37780ae330 con 0x7f377806e2e0 2023-10-06T03:25:01.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.100+0000 7f377c99c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f377806e2e0 0x7f3778160860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:01.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.100+0000 7f3777fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f37780ab7b0 0x7f3778156910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53382/0 (socket says 172.21.15.81:53382) 2023-10-06T03:25:01.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.100+0000 7f3777fff700 1 -- 172.21.15.81:0/1684154013 learned_addr learned my addr 172.21.15.81:0/1684154013 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:25:01.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.101+0000 7f377c99c700 1 -- 172.21.15.81:0/1684154013 >> v1:172.21.15.83:6789/0 conn(0x7f37780ace00 legacy=0x7f37780abb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:01.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.101+0000 7f377c99c700 1 -- 172.21.15.81:0/1684154013 >> v1:172.21.15.81:6789/0 conn(0x7f37780ab7b0 legacy=0x7f3778156910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:01.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.101+0000 7f377c99c700 1 -- 172.21.15.81:0/1684154013 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37780ad570 con 0x7f377806e2e0 2023-10-06T03:25:01.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.101+0000 7f3776ffd700 1 -- 172.21.15.81:0/1684154013 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 479764094 0 0) 0x7f37780ac5f0 con 0x7f37780ab7b0 2023-10-06T03:25:01.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.101+0000 7f377c99c700 1 --2- 172.21.15.81:0/1684154013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f377806e2e0 0x7f3778160860 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f3778155f20 tx=0x7f3770009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfe4e544b97fb909 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:01.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.101+0000 7f3776ffd700 1 -- 172.21.15.81:0/1684154013 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3770016070 con 0x7f377806e2e0 2023-10-06T03:25:01.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.101+0000 7f3776ffd700 1 -- 172.21.15.81:0/1684154013 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377000bc30 con 0x7f377806e2e0 2023-10-06T03:25:01.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.101+0000 7f3776ffd700 1 -- 172.21.15.81:0/1684154013 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377000e070 con 0x7f377806e2e0 2023-10-06T03:25:01.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.102+0000 7f377d19d700 1 -- 172.21.15.81:0/1684154013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f377806e2e0 msgr2=0x7f3778160860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:01.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.102+0000 7f377d19d700 1 --2- 172.21.15.81:0/1684154013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f377806e2e0 0x7f3778160860 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f3778155f20 tx=0x7f3770009780 comp rx=0 tx=0).stop 2023-10-06T03:25:01.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.102+0000 7f377d19d700 1 -- 172.21.15.81:0/1684154013 shutdown_connections 2023-10-06T03:25:01.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.102+0000 7f377d19d700 1 --2- 172.21.15.81:0/1684154013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f377806e2e0 0x7f3778160860 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:01.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.102+0000 7f377d19d700 1 -- 172.21.15.81:0/1684154013 >> 172.21.15.81:0/1684154013 conn(0x7f37780cbef0 msgr2=0x7f37780cc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:01.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.102+0000 7f377d19d700 1 -- 172.21.15.81:0/1684154013 shutdown_connections 2023-10-06T03:25:01.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.102+0000 7f377d19d700 1 -- 172.21.15.81:0/1684154013 wait complete. 2023-10-06T03:25:01.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.103+0000 7f377d19d700 1 Processor -- start 2023-10-06T03:25:01.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.103+0000 7f377d19d700 1 -- start start 2023-10-06T03:25:01.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.104+0000 7f377d19d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37780ab7b0 0x7f3778157550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:01.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.104+0000 7f377d19d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f37780ace00 0x7f3778150930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:01.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.104+0000 7f377d19d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f37780a9840 0x7f3778140c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:01.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.104+0000 7f377d19d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37780aad10 con 0x7f37780ab7b0 2023-10-06T03:25:01.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.104+0000 7f377d19d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37780aa100 con 0x7f37780a9840 2023-10-06T03:25:01.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.104+0000 7f377d19d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37780aa3e0 con 0x7f37780ace00 2023-10-06T03:25:01.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.105+0000 7f3777fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37780ab7b0 0x7f3778157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:01.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.105+0000 7f3777fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37780ab7b0 0x7f3778157550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34738/0 (socket says 172.21.15.81:34738) 2023-10-06T03:25:01.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.105+0000 7f3777fff700 1 -- 172.21.15.81:0/3339242928 learned_addr learned my addr 172.21.15.81:0/3339242928 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:01.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.105+0000 7f3777fff700 1 -- 172.21.15.81:0/3339242928 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f37780ace00 msgr2=0x7f3778150930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:01.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.105+0000 7f3777fff700 1 --2- 172.21.15.81:0/3339242928 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f37780ace00 0x7f3778150930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:01.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.105+0000 7f3777fff700 1 -- 172.21.15.81:0/3339242928 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f37780a9840 msgr2=0x7f3778140c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:01.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.105+0000 7f3777fff700 1 --2- 172.21.15.81:0/3339242928 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f37780a9840 0x7f3778140c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:01.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.105+0000 7f3777fff700 1 -- 172.21.15.81:0/3339242928 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3770009a20 con 0x7f37780ab7b0 2023-10-06T03:25:01.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.105+0000 7f3777fff700 1 --2- 172.21.15.81:0/3339242928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37780ab7b0 0x7f3778157550 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f376800c7e0 tx=0x7f3768007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:01.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.105+0000 7f375ffff700 1 -- 172.21.15.81:0/3339242928 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3768005b30 con 0x7f37780ab7b0 2023-10-06T03:25:01.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.105+0000 7f375ffff700 1 -- 172.21.15.81:0/3339242928 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3768005c90 con 0x7f37780ab7b0 2023-10-06T03:25:01.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.105+0000 7f375ffff700 1 -- 172.21.15.81:0/3339242928 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3768007300 con 0x7f37780ab7b0 2023-10-06T03:25:01.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.105+0000 7f377d19d700 1 -- 172.21.15.81:0/3339242928 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37780aa6c0 con 0x7f37780ab7b0 2023-10-06T03:25:01.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.106+0000 7f377d19d700 1 -- 172.21.15.81:0/3339242928 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3778150e70 con 0x7f37780ab7b0 2023-10-06T03:25:01.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.107+0000 7f377d19d700 1 -- 172.21.15.81:0/3339242928 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37780ad850 con 0x7f37780ab7b0 2023-10-06T03:25:01.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.107+0000 7f375ffff700 1 -- 172.21.15.81:0/3339242928 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f376801b400 con 0x7f37780ab7b0 2023-10-06T03:25:01.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.108+0000 7f375ffff700 1 --2- 172.21.15.81:0/3339242928 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f3764066f30 0x7f37640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:01.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.108+0000 7f375ffff700 1 -- 172.21.15.81:0/3339242928 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f3768084390 con 0x7f37780ab7b0 2023-10-06T03:25:01.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.108+0000 7f37777fe700 1 --2- 172.21.15.81:0/3339242928 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f3764066f30 0x7f37640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:01.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.109+0000 7f37777fe700 1 --2- 172.21.15.81:0/3339242928 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f3764066f30 0x7f37640693e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f37780a8de0 tx=0x7f376c007b40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:01.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.112+0000 7f375ffff700 1 -- 172.21.15.81:0/3339242928 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3768051340 con 0x7f37780ab7b0 2023-10-06T03:25:01.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.345+0000 7f377d19d700 1 -- 172.21.15.81:0/3339242928 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f377804bb80 con 0x7f37780ab7b0 2023-10-06T03:25:01.347 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-10-06T03:25:01.345+0000 7f96a11f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T03:25:01.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.350+0000 7f375ffff700 1 -- 172.21.15.81:0/3339242928 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) v1 ==== 161+0+0 (secure 0 0 0) 0x7f3768054960 con 0x7f37780ab7b0 2023-10-06T03:25:01.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.352+0000 7f377d19d700 1 -- 172.21.15.81:0/3339242928 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f3764066f30 msgr2=0x7f37640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:01.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.352+0000 7f377d19d700 1 --2- 172.21.15.81:0/3339242928 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f3764066f30 0x7f37640693e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f37780a8de0 tx=0x7f376c007b40 comp rx=0 tx=0).stop 2023-10-06T03:25:01.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.352+0000 7f377d19d700 1 -- 172.21.15.81:0/3339242928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37780ab7b0 msgr2=0x7f3778157550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:01.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.352+0000 7f377d19d700 1 --2- 172.21.15.81:0/3339242928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37780ab7b0 0x7f3778157550 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f376800c7e0 tx=0x7f3768007df0 comp rx=0 tx=0).stop 2023-10-06T03:25:01.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.352+0000 7f377d19d700 1 -- 172.21.15.81:0/3339242928 shutdown_connections 2023-10-06T03:25:01.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.352+0000 7f377d19d700 1 --2- 172.21.15.81:0/3339242928 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f37780a9840 0x7f3778140c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:01.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.352+0000 7f377d19d700 1 --2- 172.21.15.81:0/3339242928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37780ab7b0 0x7f3778157550 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:01.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.352+0000 7f377d19d700 1 --2- 172.21.15.81:0/3339242928 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f3764066f30 0x7f37640693e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:01.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.352+0000 7f377d19d700 1 --2- 172.21.15.81:0/3339242928 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f37780ace00 0x7f3778150930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:01.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.353+0000 7f377d19d700 1 -- 172.21.15.81:0/3339242928 >> 172.21.15.81:0/3339242928 conn(0x7f37780cbef0 msgr2=0x7f37780cb550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:01.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.353+0000 7f377d19d700 1 -- 172.21.15.81:0/3339242928 shutdown_connections 2023-10-06T03:25:01.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.353+0000 7f377d19d700 1 -- 172.21.15.81:0/3339242928 wait complete. 2023-10-06T03:25:01.356 INFO:tasks.ceph.mds.a.smithi081.stderr: -861> 2023-10-06T03:24:55.860+0000 7f0a317f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T03:25:01.356 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T03:25:01.373 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T03:25:01.395 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2023-10-06T03:25:01.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.555+0000 7f15b8dff700 1 Processor -- start 2023-10-06T03:25:01.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.555+0000 7f15b8dff700 1 -- start start 2023-10-06T03:25:01.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.556+0000 7f15b8dff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f15b40b29d0 0x7f15b40c6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:01.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.556+0000 7f15b8dff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f15b40c5210 0x7f15b40cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:01.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.556+0000 7f15b8dff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15b40cf7d0 con 0x7f15b40cefb0 2023-10-06T03:25:01.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.556+0000 7f15b8dff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15b40c70d0 con 0x7f15b40c5210 2023-10-06T03:25:01.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.556+0000 7f15b8dff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15b40cf430 con 0x7f15b40b29d0 2023-10-06T03:25:01.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.557+0000 7f15b1d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f15b40c5210 0x7f15b40cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:01.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.557+0000 7f15b1d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f15b40c5210 0x7f15b40cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34760/0 (socket says 172.21.15.81:34760) 2023-10-06T03:25:01.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.557+0000 7f15b1d9b700 1 -- 172.21.15.81:0/3370181116 learned_addr learned my addr 172.21.15.81:0/3370181116 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:01.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.557+0000 7f15b259c700 1 --2- 172.21.15.81:0/3370181116 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f15b40b29d0 0x7f15b40c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:01.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.557+0000 7f15b1d9b700 1 -- 172.21.15.81:0/3370181116 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f15b40b29d0 msgr2=0x7f15b40c6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:01.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.557+0000 7f15b1d9b700 1 --2- 172.21.15.81:0/3370181116 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f15b40b29d0 0x7f15b40c6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:01.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.557+0000 7f15b1d9b700 1 -- 172.21.15.81:0/3370181116 >> v1:172.21.15.83:6789/0 conn(0x7f15b40cefb0 legacy=0x7f15b40ad580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:01.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.557+0000 7f15b1d9b700 1 -- 172.21.15.81:0/3370181116 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b4159b10 con 0x7f15b40c5210 2023-10-06T03:25:01.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.557+0000 7f15b1d9b700 1 --2- 172.21.15.81:0/3370181116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15b40c5210 0x7f15b40cea70 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f15a80099e0 tx=0x7f15a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a8a05938cc0d67b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:01.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.558+0000 7f15b159a700 1 -- 172.21.15.81:0/3370181116 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a800b820 con 0x7f15b40c5210 2023-10-06T03:25:01.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.558+0000 7f15b159a700 1 -- 172.21.15.81:0/3370181116 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a800b980 con 0x7f15b40c5210 2023-10-06T03:25:01.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.558+0000 7f15b159a700 1 -- 172.21.15.81:0/3370181116 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a800bd20 con 0x7f15b40c5210 2023-10-06T03:25:01.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.558+0000 7f15b8dff700 1 -- 172.21.15.81:0/3370181116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15b40c5210 msgr2=0x7f15b40cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:01.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.558+0000 7f15b8dff700 1 --2- 172.21.15.81:0/3370181116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15b40c5210 0x7f15b40cea70 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f15a80099e0 tx=0x7f15a8009250 comp rx=0 tx=0).stop 2023-10-06T03:25:01.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.558+0000 7f15b8dff700 1 -- 172.21.15.81:0/3370181116 shutdown_connections 2023-10-06T03:25:01.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.558+0000 7f15b8dff700 1 --2- 172.21.15.81:0/3370181116 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f15b40b29d0 0x7f15b40c6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:01.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.558+0000 7f15b8dff700 1 --2- 172.21.15.81:0/3370181116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15b40c5210 0x7f15b40cea70 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:01.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.558+0000 7f15b8dff700 1 -- 172.21.15.81:0/3370181116 >> 172.21.15.81:0/3370181116 conn(0x7f15b40997d0 msgr2=0x7f15b406f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:01.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.558+0000 7f15b8dff700 1 -- 172.21.15.81:0/3370181116 shutdown_connections 2023-10-06T03:25:01.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.558+0000 7f15b8dff700 1 -- 172.21.15.81:0/3370181116 wait complete. 2023-10-06T03:25:01.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.560+0000 7f15b8dff700 1 Processor -- start 2023-10-06T03:25:01.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.560+0000 7f15b8dff700 1 -- start start 2023-10-06T03:25:01.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.561+0000 7f15b8dff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f15b40b29d0 0x7f15b415c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:01.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.561+0000 7f15b8dff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f15b40c5210 0x7f15b4158c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:01.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.561+0000 7f15b8dff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15b40cefb0 0x7f15b4159160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:01.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.561+0000 7f15b8dff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b409bfb0 con 0x7f15b40cefb0 2023-10-06T03:25:01.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.561+0000 7f15b8dff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b409b3a0 con 0x7f15b40c5210 2023-10-06T03:25:01.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.561+0000 7f15b8dff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15b409b680 con 0x7f15b40b29d0 2023-10-06T03:25:01.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.561+0000 7f15b2d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15b40cefb0 0x7f15b4159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:01.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.561+0000 7f15b2d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15b40cefb0 0x7f15b4159160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34770/0 (socket says 172.21.15.81:34770) 2023-10-06T03:25:01.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.561+0000 7f15b2d9d700 1 -- 172.21.15.81:0/2191744919 learned_addr learned my addr 172.21.15.81:0/2191744919 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:01.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.561+0000 7f15b259c700 1 --2- 172.21.15.81:0/2191744919 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f15b40b29d0 0x7f15b415c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:01.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.561+0000 7f15b1d9b700 1 --2- 172.21.15.81:0/2191744919 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f15b40c5210 0x7f15b4158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:01.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.561+0000 7f15b2d9d700 1 -- 172.21.15.81:0/2191744919 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f15b40b29d0 msgr2=0x7f15b415c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:01.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.561+0000 7f15b2d9d700 1 --2- 172.21.15.81:0/2191744919 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f15b40b29d0 0x7f15b415c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:01.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.561+0000 7f15b2d9d700 1 -- 172.21.15.81:0/2191744919 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f15b40c5210 msgr2=0x7f15b4158c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:01.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.561+0000 7f15b2d9d700 1 --2- 172.21.15.81:0/2191744919 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f15b40c5210 0x7f15b4158c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:01.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.561+0000 7f15b2d9d700 1 -- 172.21.15.81:0/2191744919 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a80094f0 con 0x7f15b40cefb0 2023-10-06T03:25:01.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.562+0000 7f15b2d9d700 1 --2- 172.21.15.81:0/2191744919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15b40cefb0 0x7f15b4159160 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f15ac00c840 tx=0x7f15ac001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:01.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.562+0000 7f15a27fc700 1 -- 172.21.15.81:0/2191744919 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ac012630 con 0x7f15b40cefb0 2023-10-06T03:25:01.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.562+0000 7f15a27fc700 1 -- 172.21.15.81:0/2191744919 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15ac0127b0 con 0x7f15b40cefb0 2023-10-06T03:25:01.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.562+0000 7f15b8dff700 1 -- 172.21.15.81:0/2191744919 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15b409b960 con 0x7f15b40cefb0 2023-10-06T03:25:01.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.562+0000 7f15a27fc700 1 -- 172.21.15.81:0/2191744919 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ac012b70 con 0x7f15b40cefb0 2023-10-06T03:25:01.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.562+0000 7f15b8dff700 1 -- 172.21.15.81:0/2191744919 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15b409df00 con 0x7f15b40cefb0 2023-10-06T03:25:01.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.563+0000 7f15b8dff700 1 -- 172.21.15.81:0/2191744919 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15b409c120 con 0x7f15b40cefb0 2023-10-06T03:25:01.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.564+0000 7f15a27fc700 1 -- 172.21.15.81:0/2191744919 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f15ac01a3a0 con 0x7f15b40cefb0 2023-10-06T03:25:01.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.565+0000 7f15a27fc700 1 --2- 172.21.15.81:0/2191744919 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f1594066f30 0x7f15940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:01.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.565+0000 7f15a27fc700 1 -- 172.21.15.81:0/2191744919 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f15ac0849d0 con 0x7f15b40cefb0 2023-10-06T03:25:01.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.566+0000 7f15b259c700 1 --2- 172.21.15.81:0/2191744919 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f1594066f30 0x7f15940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:01.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.566+0000 7f15b259c700 1 --2- 172.21.15.81:0/2191744919 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f1594066f30 0x7f15940693e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f15a4009da0 tx=0x7f15a4009120 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:01.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.570+0000 7f15a27fc700 1 -- 172.21.15.81:0/2191744919 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f15ac0518d0 con 0x7f15b40cefb0 2023-10-06T03:25:01.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:01.805+0000 7f15b8dff700 1 -- 172.21.15.81:0/2191744919 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f15b404c3c0 con 0x7f15b40cefb0 2023-10-06T03:25:02.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.354+0000 7f15a27fc700 1 -- 172.21.15.81:0/2191744919 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) v1 ==== 104+0+0 (secure 0 0 0) 0x7f15ac054ef0 con 0x7f15b40cefb0 2023-10-06T03:25:02.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.358+0000 7f15b8dff700 1 -- 172.21.15.81:0/2191744919 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f1594066f30 msgr2=0x7f15940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:02.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.358+0000 7f15b8dff700 1 --2- 172.21.15.81:0/2191744919 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f1594066f30 0x7f15940693e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f15a4009da0 tx=0x7f15a4009120 comp rx=0 tx=0).stop 2023-10-06T03:25:02.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.358+0000 7f15b8dff700 1 -- 172.21.15.81:0/2191744919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15b40cefb0 msgr2=0x7f15b4159160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:02.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.358+0000 7f15b8dff700 1 --2- 172.21.15.81:0/2191744919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15b40cefb0 0x7f15b4159160 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f15ac00c840 tx=0x7f15ac001670 comp rx=0 tx=0).stop 2023-10-06T03:25:02.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.358+0000 7f15b8dff700 1 -- 172.21.15.81:0/2191744919 shutdown_connections 2023-10-06T03:25:02.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.358+0000 7f15b8dff700 1 --2- 172.21.15.81:0/2191744919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15b40cefb0 0x7f15b4159160 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:02.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.358+0000 7f15b8dff700 1 --2- 172.21.15.81:0/2191744919 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f1594066f30 0x7f15940693e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:02.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.358+0000 7f15b8dff700 1 --2- 172.21.15.81:0/2191744919 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f15b40b29d0 0x7f15b415c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:02.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.358+0000 7f15b8dff700 1 --2- 172.21.15.81:0/2191744919 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f15b40c5210 0x7f15b4158c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:02.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.358+0000 7f15b8dff700 1 -- 172.21.15.81:0/2191744919 >> 172.21.15.81:0/2191744919 conn(0x7f15b40997d0 msgr2=0x7f15b40c9530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:02.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.358+0000 7f15b8dff700 1 -- 172.21.15.81:0/2191744919 shutdown_connections 2023-10-06T03:25:02.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.358+0000 7f15b8dff700 1 -- 172.21.15.81:0/2191744919 wait complete. 2023-10-06T03:25:02.380 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --recover --force --fscid 2 2023-10-06T03:25:02.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.610+0000 7fc1ce59d700 1 Processor -- start 2023-10-06T03:25:02.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.610+0000 7fc1ce59d700 1 -- start start 2023-10-06T03:25:02.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.611+0000 7fc1ce59d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc1c815ac00 0x7fc1c815a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:02.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.611+0000 7fc1ce59d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc1c8157670 0x7fc1c80b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:02.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.611+0000 7fc1ce59d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1c815bef0 con 0x7fc1c81535a0 2023-10-06T03:25:02.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.611+0000 7fc1ce59d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1c815aaa0 con 0x7fc1c8157670 2023-10-06T03:25:02.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.611+0000 7fc1ce59d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c80d1160 con 0x7fc1c815ac00 2023-10-06T03:25:02.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.612+0000 7fc1cdd9c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc1c8157670 0x7fc1c80b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:02.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.612+0000 7fc1cdd9c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc1c8157670 0x7fc1c80b1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34784/0 (socket says 172.21.15.81:34784) 2023-10-06T03:25:02.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.612+0000 7fc1cdd9c700 1 -- 172.21.15.81:0/150217811 learned_addr learned my addr 172.21.15.81:0/150217811 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:02.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.612+0000 7fc1ccd9a700 1 --2- 172.21.15.81:0/150217811 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc1c815ac00 0x7fc1c815a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:02.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.612+0000 7fc1cdd9c700 1 -- 172.21.15.81:0/150217811 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc1c815ac00 msgr2=0x7fc1c815a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:02.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.612+0000 7fc1cdd9c700 1 --2- 172.21.15.81:0/150217811 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc1c815ac00 0x7fc1c815a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:02.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.612+0000 7fc1cdd9c700 1 -- 172.21.15.81:0/150217811 >> v1:172.21.15.83:6789/0 conn(0x7fc1c81535a0 legacy=0x7fc1c8153970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:02.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.612+0000 7fc1cdd9c700 1 -- 172.21.15.81:0/150217811 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c815b050 con 0x7fc1c8157670 2023-10-06T03:25:02.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.613+0000 7fc1cdd9c700 1 --2- 172.21.15.81:0/150217811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1c8157670 0x7fc1c80b1cf0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0009f20 tx=0x7fc1c0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a8f72e51542c217 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:02.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.613+0000 7fc1bffff700 1 -- 172.21.15.81:0/150217811 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c000e070 con 0x7fc1c8157670 2023-10-06T03:25:02.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.613+0000 7fc1bffff700 1 -- 172.21.15.81:0/150217811 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c000b9d0 con 0x7fc1c8157670 2023-10-06T03:25:02.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.613+0000 7fc1bffff700 1 -- 172.21.15.81:0/150217811 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c00092e0 con 0x7fc1c8157670 2023-10-06T03:25:02.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.613+0000 7fc1ce59d700 1 -- 172.21.15.81:0/150217811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1c8157670 msgr2=0x7fc1c80b1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:02.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.613+0000 7fc1ce59d700 1 --2- 172.21.15.81:0/150217811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1c8157670 0x7fc1c80b1cf0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0009f20 tx=0x7fc1c0009840 comp rx=0 tx=0).stop 2023-10-06T03:25:02.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.613+0000 7fc1ce59d700 1 -- 172.21.15.81:0/150217811 shutdown_connections 2023-10-06T03:25:02.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.613+0000 7fc1ce59d700 1 --2- 172.21.15.81:0/150217811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1c8157670 0x7fc1c80b1cf0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:02.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.613+0000 7fc1ce59d700 1 --2- 172.21.15.81:0/150217811 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc1c815ac00 0x7fc1c815a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:02.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.613+0000 7fc1ce59d700 1 -- 172.21.15.81:0/150217811 >> 172.21.15.81:0/150217811 conn(0x7fc1c8068230 msgr2=0x7fc1c8068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:02.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.613+0000 7fc1ce59d700 1 -- 172.21.15.81:0/150217811 shutdown_connections 2023-10-06T03:25:02.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.614+0000 7fc1ce59d700 1 -- 172.21.15.81:0/150217811 wait complete. 2023-10-06T03:25:02.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.615+0000 7fc1ce59d700 1 Processor -- start 2023-10-06T03:25:02.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.615+0000 7fc1ce59d700 1 -- start start 2023-10-06T03:25:02.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.616+0000 7fc1ce59d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc1c81535a0 0x7fc1c8169e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:02.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.616+0000 7fc1ce59d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc1c8157670 0x7fc1c8155a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:02.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.616+0000 7fc1ce59d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1c815ac00 0x7fc1c815f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:02.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.616+0000 7fc1ce59d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c816a350 con 0x7fc1c815ac00 2023-10-06T03:25:02.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.616+0000 7fc1ce59d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c815e410 con 0x7fc1c81535a0 2023-10-06T03:25:02.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.616+0000 7fc1ce59d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c81568d0 con 0x7fc1c8157670 2023-10-06T03:25:02.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.616+0000 7fc1cdd9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1c815ac00 0x7fc1c815f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:02.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.616+0000 7fc1cdd9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1c815ac00 0x7fc1c815f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34798/0 (socket says 172.21.15.81:34798) 2023-10-06T03:25:02.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.616+0000 7fc1cdd9c700 1 -- 172.21.15.81:0/4179981731 learned_addr learned my addr 172.21.15.81:0/4179981731 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:02.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.616+0000 7fc1cd59b700 1 --2- 172.21.15.81:0/4179981731 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc1c81535a0 0x7fc1c8169e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:02.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.616+0000 7fc1ccd9a700 1 --2- 172.21.15.81:0/4179981731 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc1c8157670 0x7fc1c8155a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:02.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.616+0000 7fc1cdd9c700 1 -- 172.21.15.81:0/4179981731 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc1c8157670 msgr2=0x7fc1c8155a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:02.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.616+0000 7fc1cdd9c700 1 --2- 172.21.15.81:0/4179981731 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc1c8157670 0x7fc1c8155a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:02.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.616+0000 7fc1cdd9c700 1 -- 172.21.15.81:0/4179981731 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc1c81535a0 msgr2=0x7fc1c8169e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:02.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.616+0000 7fc1cdd9c700 1 --2- 172.21.15.81:0/4179981731 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc1c81535a0 0x7fc1c8169e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:02.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.616+0000 7fc1cdd9c700 1 -- 172.21.15.81:0/4179981731 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c0009ae0 con 0x7fc1c815ac00 2023-10-06T03:25:02.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.616+0000 7fc1cd59b700 1 --2- 172.21.15.81:0/4179981731 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc1c81535a0 0x7fc1c8169e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:02.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.617+0000 7fc1cdd9c700 1 --2- 172.21.15.81:0/4179981731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1c815ac00 0x7fc1c815f080 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc1c000b610 tx=0x7fc1c0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:02.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.617+0000 7fc1bd7fa700 1 -- 172.21.15.81:0/4179981731 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c0008b80 con 0x7fc1c815ac00 2023-10-06T03:25:02.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.617+0000 7fc1bd7fa700 1 -- 172.21.15.81:0/4179981731 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c0008ce0 con 0x7fc1c815ac00 2023-10-06T03:25:02.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.617+0000 7fc1ce59d700 1 -- 172.21.15.81:0/4179981731 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1c815d800 con 0x7fc1c815ac00 2023-10-06T03:25:02.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.617+0000 7fc1bd7fa700 1 -- 172.21.15.81:0/4179981731 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c0026690 con 0x7fc1c815ac00 2023-10-06T03:25:02.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.617+0000 7fc1ce59d700 1 -- 172.21.15.81:0/4179981731 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1c815ddc0 con 0x7fc1c815ac00 2023-10-06T03:25:02.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.618+0000 7fc1ce59d700 1 -- 172.21.15.81:0/4179981731 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1c804c3c0 con 0x7fc1c815ac00 2023-10-06T03:25:02.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.619+0000 7fc1bd7fa700 1 -- 172.21.15.81:0/4179981731 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc1c0003040 con 0x7fc1c815ac00 2023-10-06T03:25:02.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.620+0000 7fc1bd7fa700 1 --2- 172.21.15.81:0/4179981731 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc1ac066f30 0x7fc1ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:02.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.620+0000 7fc1bd7fa700 1 -- 172.21.15.81:0/4179981731 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fc1c0086800 con 0x7fc1c815ac00 2023-10-06T03:25:02.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.620+0000 7fc1cd59b700 1 --2- 172.21.15.81:0/4179981731 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc1ac066f30 0x7fc1ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:02.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.620+0000 7fc1cd59b700 1 --2- 172.21.15.81:0/4179981731 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc1ac066f30 0x7fc1ac0693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc1c4007fd0 tx=0x7fc1c4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:02.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.624+0000 7fc1bd7fa700 1 -- 172.21.15.81:0/4179981731 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc1c0053700 con 0x7fc1c815ac00 2023-10-06T03:25:02.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:02.861+0000 7fc1ce59d700 1 -- 172.21.15.81:0/4179981731 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "recover": true, "force": true, "fscid": 2} v 0) v1 -- 0x7fc1c815b2e0 con 0x7fc1c815ac00 2023-10-06T03:25:03.664 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-10-06T03:25:03.662+0000 7f96a39f6700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T03:25:03.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.675+0000 7fc1bd7fa700 1 -- 172.21.15.81:0/4179981731 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "recover": true, "force": true, "fscid": 2}]=0 new fs with metadata pool 6 and data pool 7 v21) v1 ==== 216+0+0 (secure 0 0 0) 0x7fc1c0056d20 con 0x7fc1c815ac00 2023-10-06T03:25:03.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.678+0000 7fc1ce59d700 1 -- 172.21.15.81:0/4179981731 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc1ac066f30 msgr2=0x7fc1ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:03.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.678+0000 7fc1ce59d700 1 --2- 172.21.15.81:0/4179981731 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc1ac066f30 0x7fc1ac0693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc1c4007fd0 tx=0x7fc1c4009040 comp rx=0 tx=0).stop 2023-10-06T03:25:03.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.678+0000 7fc1ce59d700 1 -- 172.21.15.81:0/4179981731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1c815ac00 msgr2=0x7fc1c815f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:03.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.678+0000 7fc1ce59d700 1 --2- 172.21.15.81:0/4179981731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1c815ac00 0x7fc1c815f080 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc1c000b610 tx=0x7fc1c0018000 comp rx=0 tx=0).stop 2023-10-06T03:25:03.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.678+0000 7fc1ce59d700 1 -- 172.21.15.81:0/4179981731 shutdown_connections 2023-10-06T03:25:03.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.678+0000 7fc1ce59d700 1 --2- 172.21.15.81:0/4179981731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1c815ac00 0x7fc1c815f080 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:03.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.678+0000 7fc1ce59d700 1 --2- 172.21.15.81:0/4179981731 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc1c81535a0 0x7fc1c8169e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:03.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.678+0000 7fc1ce59d700 1 --2- 172.21.15.81:0/4179981731 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc1ac066f30 0x7fc1ac0693e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:03.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.678+0000 7fc1ce59d700 1 --2- 172.21.15.81:0/4179981731 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc1c8157670 0x7fc1c8155a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:03.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.678+0000 7fc1ce59d700 1 -- 172.21.15.81:0/4179981731 >> 172.21.15.81:0/4179981731 conn(0x7fc1c8068230 msgr2=0x7fc1c80ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:03.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.678+0000 7fc1ce59d700 1 -- 172.21.15.81:0/4179981731 shutdown_connections 2023-10-06T03:25:03.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.678+0000 7fc1ce59d700 1 -- 172.21.15.81:0/4179981731 wait complete. 2023-10-06T03:25:03.681 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 6 and data pool 7 2023-10-06T03:25:03.700 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-10-06T03:25:03.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.885+0000 7f7b523ff700 1 Processor -- start 2023-10-06T03:25:03.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.885+0000 7f7b523ff700 1 -- start start 2023-10-06T03:25:03.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.887+0000 7f7b523ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b4c0c7ac0 0x7f7b4c162570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:03.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.887+0000 7f7b523ff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b4c06a630 con 0x7f7b4c0ae130 2023-10-06T03:25:03.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.887+0000 7f7b523ff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b4c06a910 con 0x7f7b4c06a180 2023-10-06T03:25:03.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.887+0000 7f7b523ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c06abf0 con 0x7f7b4c0c7ac0 2023-10-06T03:25:03.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.887+0000 7f7b4bfff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7b4c0ae130 0x7f7b4c06d870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53402/0 (socket says 172.21.15.81:53402) 2023-10-06T03:25:03.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.887+0000 7f7b4bfff700 1 -- 172.21.15.81:0/2023168012 learned_addr learned my addr 172.21.15.81:0/2023168012 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:25:03.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.887+0000 7f7b5099c700 1 --2- 172.21.15.81:0/2023168012 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b4c0c7ac0 0x7f7b4c162570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:03.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.887+0000 7f7b4b7fe700 1 -- 172.21.15.81:0/2023168012 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3360087061 0 0) 0x7f7b4c06a630 con 0x7f7b4c0ae130 2023-10-06T03:25:03.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.888+0000 7f7b4b7fe700 1 -- 172.21.15.81:0/2023168012 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b38003570 con 0x7f7b4c0ae130 2023-10-06T03:25:03.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.888+0000 7f7b4b7fe700 1 -- 172.21.15.81:0/2023168012 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2262455914 0 0) 0x7f7b38003570 con 0x7f7b4c0ae130 2023-10-06T03:25:03.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.888+0000 7f7b4b7fe700 1 -- 172.21.15.81:0/2023168012 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b4c0c7ac0 msgr2=0x7f7b4c162570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:03.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.888+0000 7f7b4b7fe700 1 --2- 172.21.15.81:0/2023168012 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b4c0c7ac0 0x7f7b4c162570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:03.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.888+0000 7f7b4b7fe700 1 -- 172.21.15.81:0/2023168012 >> v1:172.21.15.83:6789/0 conn(0x7f7b4c06a180 legacy=0x7f7b4c1570f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:03.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.888+0000 7f7b4b7fe700 1 -- 172.21.15.81:0/2023168012 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b4c06aed0 con 0x7f7b4c0ae130 2023-10-06T03:25:03.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.888+0000 7f7b4b7fe700 1 -- 172.21.15.81:0/2023168012 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2513016936 0 0) 0x7f7b3c0015f0 con 0x7f7b4c0ae130 2023-10-06T03:25:03.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.888+0000 7f7b4b7fe700 1 -- 172.21.15.81:0/2023168012 >> v1:172.21.15.81:6789/0 conn(0x7f7b4c0ae130 legacy=0x7f7b4c06d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:03.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.888+0000 7f7b4b7fe700 1 --2- 172.21.15.81:0/2023168012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b38003a90 0x7f7b38003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:03.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.888+0000 7f7b4b7fe700 1 --2- 172.21.15.81:0/2023168012 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b4c0c7ac0 0x7f7b38004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:03.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.888+0000 7f7b4b7fe700 1 --2- 172.21.15.81:0/2023168012 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b38004d50 0x7f7b380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:03.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.888+0000 7f7b4b7fe700 1 -- 172.21.15.81:0/2023168012 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c06abf0 con 0x7f7b38003a90 2023-10-06T03:25:03.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.888+0000 7f7b4b7fe700 1 -- 172.21.15.81:0/2023168012 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3800bbf0 con 0x7f7b38004d50 2023-10-06T03:25:03.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.888+0000 7f7b4b7fe700 1 -- 172.21.15.81:0/2023168012 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3800bd80 con 0x7f7b4c0c7ac0 2023-10-06T03:25:03.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.888+0000 7f7b4bfff700 1 --2- 172.21.15.81:0/2023168012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b38003a90 0x7f7b38003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:03.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.888+0000 7f7b43fff700 1 --2- 172.21.15.81:0/2023168012 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b4c0c7ac0 0x7f7b38004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:03.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.888+0000 7f7b5099c700 1 --2- 172.21.15.81:0/2023168012 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b38004d50 0x7f7b380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:03.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.889+0000 7f7b4bfff700 1 -- 172.21.15.81:0/2023168012 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b4c0c7ac0 msgr2=0x7f7b38004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:03.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.889+0000 7f7b4bfff700 1 --2- 172.21.15.81:0/2023168012 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b4c0c7ac0 0x7f7b38004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:03.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.889+0000 7f7b4bfff700 1 -- 172.21.15.81:0/2023168012 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b38004d50 msgr2=0x7f7b380051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:03.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.889+0000 7f7b4bfff700 1 --2- 172.21.15.81:0/2023168012 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b38004d50 0x7f7b380051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:03.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.889+0000 7f7b4bfff700 1 -- 172.21.15.81:0/2023168012 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b38003570 con 0x7f7b38003a90 2023-10-06T03:25:03.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.889+0000 7f7b4bfff700 1 --2- 172.21.15.81:0/2023168012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b38003a90 0x7f7b38003ea0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c00c210 tx=0x7f7b3c007810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a208cd47d799a090 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:03.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.889+0000 7f7b4b7fe700 1 -- 172.21.15.81:0/2023168012 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c00cb40 con 0x7f7b38003a90 2023-10-06T03:25:03.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.889+0000 7f7b4b7fe700 1 -- 172.21.15.81:0/2023168012 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b3c00ccc0 con 0x7f7b38003a90 2023-10-06T03:25:03.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.889+0000 7f7b4b7fe700 1 -- 172.21.15.81:0/2023168012 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c007320 con 0x7f7b38003a90 2023-10-06T03:25:03.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.890+0000 7f7b523ff700 1 -- 172.21.15.81:0/2023168012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b38003a90 msgr2=0x7f7b38003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:03.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.890+0000 7f7b523ff700 1 --2- 172.21.15.81:0/2023168012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b38003a90 0x7f7b38003ea0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c00c210 tx=0x7f7b3c007810 comp rx=0 tx=0).stop 2023-10-06T03:25:03.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.890+0000 7f7b5099c700 1 -- 172.21.15.81:0/2023168012 reap_dead start 2023-10-06T03:25:03.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.890+0000 7f7b523ff700 1 -- 172.21.15.81:0/2023168012 shutdown_connections 2023-10-06T03:25:03.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.890+0000 7f7b523ff700 1 -- 172.21.15.81:0/2023168012 >> 172.21.15.81:0/2023168012 conn(0x7f7b4c0cc090 msgr2=0x7f7b4c0cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:03.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.890+0000 7f7b523ff700 1 -- 172.21.15.81:0/2023168012 shutdown_connections 2023-10-06T03:25:03.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.890+0000 7f7b523ff700 1 -- 172.21.15.81:0/2023168012 wait complete. 2023-10-06T03:25:03.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.891+0000 7f7b523ff700 1 Processor -- start 2023-10-06T03:25:03.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.891+0000 7f7b523ff700 1 -- start start 2023-10-06T03:25:03.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.892+0000 7f7b523ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b38003a90 0x7f7b4c14fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:03.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.892+0000 7f7b523ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b4c0c5dc0 0x7f7b4c155640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:03.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.892+0000 7f7b523ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b4c155b80 0x7f7b4c169b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:03.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.892+0000 7f7b523ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c156670 con 0x7f7b4c0c5dc0 2023-10-06T03:25:03.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.892+0000 7f7b523ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c0ca430 con 0x7f7b38003a90 2023-10-06T03:25:03.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.892+0000 7f7b523ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c150220 con 0x7f7b4c155b80 2023-10-06T03:25:03.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.893+0000 7f7b43fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b4c0c5dc0 0x7f7b4c155640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:03.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.893+0000 7f7b43fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b4c0c5dc0 0x7f7b4c155640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34804/0 (socket says 172.21.15.81:34804) 2023-10-06T03:25:03.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.893+0000 7f7b43fff700 1 -- 172.21.15.81:0/4259470135 learned_addr learned my addr 172.21.15.81:0/4259470135 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:03.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.893+0000 7f7b43fff700 1 -- 172.21.15.81:0/4259470135 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b4c155b80 msgr2=0x7f7b4c169b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:03.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.893+0000 7f7b43fff700 1 --2- 172.21.15.81:0/4259470135 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b4c155b80 0x7f7b4c169b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:03.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.893+0000 7f7b43fff700 1 -- 172.21.15.81:0/4259470135 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b38003a90 msgr2=0x7f7b4c14fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:03.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.893+0000 7f7b43fff700 1 --2- 172.21.15.81:0/4259470135 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b38003a90 0x7f7b4c14fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:03.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.893+0000 7f7b43fff700 1 -- 172.21.15.81:0/4259470135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b4c1560b0 con 0x7f7b4c0c5dc0 2023-10-06T03:25:03.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.893+0000 7f7b43fff700 1 --2- 172.21.15.81:0/4259470135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b4c0c5dc0 0x7f7b4c155640 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7b3400e840 tx=0x7f7b34009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:03.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.893+0000 7f7b48ff9700 1 -- 172.21.15.81:0/4259470135 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b34013630 con 0x7f7b4c0c5dc0 2023-10-06T03:25:03.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.893+0000 7f7b48ff9700 1 -- 172.21.15.81:0/4259470135 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b34013790 con 0x7f7b4c0c5dc0 2023-10-06T03:25:03.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.893+0000 7f7b523ff700 1 -- 172.21.15.81:0/4259470135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b4c156390 con 0x7f7b4c0c5dc0 2023-10-06T03:25:03.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.893+0000 7f7b48ff9700 1 -- 172.21.15.81:0/4259470135 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b34013b30 con 0x7f7b4c0c5dc0 2023-10-06T03:25:03.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.894+0000 7f7b523ff700 1 -- 172.21.15.81:0/4259470135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b4c16a050 con 0x7f7b4c0c5dc0 2023-10-06T03:25:03.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.895+0000 7f7b523ff700 1 -- 172.21.15.81:0/4259470135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b4c0c64c0 con 0x7f7b4c0c5dc0 2023-10-06T03:25:03.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.895+0000 7f7b48ff9700 1 -- 172.21.15.81:0/4259470135 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7b3401c400 con 0x7f7b4c0c5dc0 2023-10-06T03:25:03.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.896+0000 7f7b48ff9700 1 --2- 172.21.15.81:0/4259470135 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7b2c066f30 0x7f7b2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:03.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.897+0000 7f7b48ff9700 1 -- 172.21.15.81:0/4259470135 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f7b34084c70 con 0x7f7b4c0c5dc0 2023-10-06T03:25:03.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.897+0000 7f7b4bfff700 1 --2- 172.21.15.81:0/4259470135 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7b2c066f30 0x7f7b2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:03.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.897+0000 7f7b4bfff700 1 --2- 172.21.15.81:0/4259470135 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7b2c066f30 0x7f7b2c0693e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c001150 tx=0x7f7b3c015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:03.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:03.900+0000 7f7b48ff9700 1 -- 172.21.15.81:0/4259470135 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7b34051bf0 con 0x7f7b4c0c5dc0 2023-10-06T03:25:04.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.134+0000 7f7b523ff700 1 -- 172.21.15.81:0/4259470135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f7b4c0ca5a0 con 0x7f7b4c0c5dc0 2023-10-06T03:25:04.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.678+0000 7f7b48ff9700 1 -- 172.21.15.81:0/4259470135 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v22) v1 ==== 162+0+0 (secure 0 0 0) 0x7f7b34055210 con 0x7f7b4c0c5dc0 2023-10-06T03:25:04.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.681+0000 7f7b523ff700 1 -- 172.21.15.81:0/4259470135 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7b2c066f30 msgr2=0x7f7b2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:04.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.681+0000 7f7b523ff700 1 --2- 172.21.15.81:0/4259470135 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7b2c066f30 0x7f7b2c0693e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c001150 tx=0x7f7b3c015000 comp rx=0 tx=0).stop 2023-10-06T03:25:04.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.681+0000 7f7b523ff700 1 -- 172.21.15.81:0/4259470135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b4c0c5dc0 msgr2=0x7f7b4c155640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:04.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.681+0000 7f7b523ff700 1 --2- 172.21.15.81:0/4259470135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b4c0c5dc0 0x7f7b4c155640 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7b3400e840 tx=0x7f7b34009040 comp rx=0 tx=0).stop 2023-10-06T03:25:04.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.681+0000 7f7b523ff700 1 -- 172.21.15.81:0/4259470135 shutdown_connections 2023-10-06T03:25:04.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.681+0000 7f7b523ff700 1 --2- 172.21.15.81:0/4259470135 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7b2c066f30 0x7f7b2c0693e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:04.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.681+0000 7f7b523ff700 1 --2- 172.21.15.81:0/4259470135 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b4c155b80 0x7f7b4c169b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:04.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.681+0000 7f7b523ff700 1 --2- 172.21.15.81:0/4259470135 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b38003a90 0x7f7b4c14fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:04.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.681+0000 7f7b523ff700 1 --2- 172.21.15.81:0/4259470135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b4c0c5dc0 0x7f7b4c155640 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:04.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.681+0000 7f7b523ff700 1 -- 172.21.15.81:0/4259470135 >> 172.21.15.81:0/4259470135 conn(0x7f7b4c0cc090 msgr2=0x7f7b4c0c0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:04.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.681+0000 7f7b523ff700 1 -- 172.21.15.81:0/4259470135 shutdown_connections 2023-10-06T03:25:04.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.681+0000 7f7b523ff700 1 -- 172.21.15.81:0/4259470135 wait complete. 2023-10-06T03:25:04.685 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked joinable; MDS may join as newly active. 2023-10-06T03:25:04.704 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:25:04.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.882+0000 7ff23c1ff700 1 Processor -- start 2023-10-06T03:25:04.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.882+0000 7ff23c1ff700 1 -- start start 2023-10-06T03:25:04.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.883+0000 7ff23c1ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff2341557f0 0x7ff234156c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:04.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.883+0000 7ff23c1ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff234069ee0 0x7ff23406a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:04.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.883+0000 7ff23c1ff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2340c9c60 con 0x7ff234155bc0 2023-10-06T03:25:04.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.883+0000 7ff23c1ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff23406df20 con 0x7ff2341557f0 2023-10-06T03:25:04.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.883+0000 7ff23c1ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff23406a8a0 con 0x7ff234069ee0 2023-10-06T03:25:04.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.883+0000 7ff239f9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff2341557f0 0x7ff234156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:04.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.883+0000 7ff23979a700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff234155bc0 0x7ff2340c6cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53410/0 (socket says 172.21.15.81:53410) 2023-10-06T03:25:04.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.884+0000 7ff23979a700 1 -- 172.21.15.81:0/26506706 learned_addr learned my addr 172.21.15.81:0/26506706 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:25:04.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.884+0000 7ff23a79c700 1 --2- 172.21.15.81:0/26506706 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff234069ee0 0x7ff23406a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:04.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.884+0000 7ff239f9b700 1 -- 172.21.15.81:0/26506706 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff234069ee0 msgr2=0x7ff23406a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:04.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.884+0000 7ff239f9b700 1 --2- 172.21.15.81:0/26506706 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff234069ee0 0x7ff23406a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:04.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.884+0000 7ff239f9b700 1 -- 172.21.15.81:0/26506706 >> v1:172.21.15.81:6789/0 conn(0x7ff234155bc0 legacy=0x7ff2340c6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:04.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.884+0000 7ff239f9b700 1 -- 172.21.15.81:0/26506706 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff23406dc60 con 0x7ff2341557f0 2023-10-06T03:25:04.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.884+0000 7ff23a79c700 1 --2- 172.21.15.81:0/26506706 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff234069ee0 0x7ff23406a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:04.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.884+0000 7ff238f99700 1 -- 172.21.15.81:0/26506706 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 412179925 0 0) 0x7ff2340c9c60 con 0x7ff234155bc0 2023-10-06T03:25:04.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.884+0000 7ff239f9b700 1 --2- 172.21.15.81:0/26506706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2341557f0 0x7ff234156c90 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff2300098e0 tx=0x7ff2300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59107db3af18d3fd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:04.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.884+0000 7ff238f99700 1 -- 172.21.15.81:0/26506706 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff230009e80 con 0x7ff2341557f0 2023-10-06T03:25:04.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.884+0000 7ff238f99700 1 -- 172.21.15.81:0/26506706 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff23000b860 con 0x7ff2341557f0 2023-10-06T03:25:04.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.884+0000 7ff238f99700 1 -- 172.21.15.81:0/26506706 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23000bbe0 con 0x7ff2341557f0 2023-10-06T03:25:04.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.885+0000 7ff23c1ff700 1 -- 172.21.15.81:0/26506706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2341557f0 msgr2=0x7ff234156c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:04.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.885+0000 7ff23c1ff700 1 --2- 172.21.15.81:0/26506706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2341557f0 0x7ff234156c90 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff2300098e0 tx=0x7ff2300091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:04.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.885+0000 7ff23c1ff700 1 -- 172.21.15.81:0/26506706 shutdown_connections 2023-10-06T03:25:04.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.885+0000 7ff23c1ff700 1 --2- 172.21.15.81:0/26506706 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff234069ee0 0x7ff23406a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:04.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.885+0000 7ff23c1ff700 1 --2- 172.21.15.81:0/26506706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2341557f0 0x7ff234156c90 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:04.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.885+0000 7ff23c1ff700 1 -- 172.21.15.81:0/26506706 >> 172.21.15.81:0/26506706 conn(0x7ff2340cc090 msgr2=0x7ff2340cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:04.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.885+0000 7ff23c1ff700 1 -- 172.21.15.81:0/26506706 shutdown_connections 2023-10-06T03:25:04.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.885+0000 7ff23c1ff700 1 -- 172.21.15.81:0/26506706 wait complete. 2023-10-06T03:25:04.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.887+0000 7ff23c1ff700 1 Processor -- start 2023-10-06T03:25:04.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.887+0000 7ff23c1ff700 1 -- start start 2023-10-06T03:25:04.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.888+0000 7ff23c1ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff234069ee0 0x7ff234146b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:04.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.888+0000 7ff23c1ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2341557f0 0x7ff2340ac050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:04.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.888+0000 7ff23c1ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff234155bc0 0x7ff2340b14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:04.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.888+0000 7ff23c1ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2340c5170 con 0x7ff2341557f0 2023-10-06T03:25:04.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.888+0000 7ff23c1ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2340c4560 con 0x7ff234155bc0 2023-10-06T03:25:04.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.888+0000 7ff23c1ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2340c4840 con 0x7ff234069ee0 2023-10-06T03:25:04.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.888+0000 7ff23979a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2341557f0 0x7ff2340ac050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:04.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.888+0000 7ff23979a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2341557f0 0x7ff2340ac050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34830/0 (socket says 172.21.15.81:34830) 2023-10-06T03:25:04.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.888+0000 7ff23979a700 1 -- 172.21.15.81:0/3470866960 learned_addr learned my addr 172.21.15.81:0/3470866960 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:04.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.888+0000 7ff239f9b700 1 --2- 172.21.15.81:0/3470866960 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff234069ee0 0x7ff234146b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:04.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.888+0000 7ff23a79c700 1 --2- 172.21.15.81:0/3470866960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff234155bc0 0x7ff2340b14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:04.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.888+0000 7ff23979a700 1 -- 172.21.15.81:0/3470866960 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff234069ee0 msgr2=0x7ff234146b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:04.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.888+0000 7ff23979a700 1 --2- 172.21.15.81:0/3470866960 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff234069ee0 0x7ff234146b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:04.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.888+0000 7ff23979a700 1 -- 172.21.15.81:0/3470866960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff234155bc0 msgr2=0x7ff2340b14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:04.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.888+0000 7ff23979a700 1 --2- 172.21.15.81:0/3470866960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff234155bc0 0x7ff2340b14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:04.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.888+0000 7ff23979a700 1 -- 172.21.15.81:0/3470866960 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff230009420 con 0x7ff2341557f0 2023-10-06T03:25:04.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.888+0000 7ff23979a700 1 --2- 172.21.15.81:0/3470866960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2341557f0 0x7ff2340ac050 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff22400c7e0 tx=0x7ff224007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:04.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.889+0000 7ff229ffb700 1 -- 172.21.15.81:0/3470866960 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff224005b30 con 0x7ff2341557f0 2023-10-06T03:25:04.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.889+0000 7ff229ffb700 1 -- 172.21.15.81:0/3470866960 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff224005c90 con 0x7ff2341557f0 2023-10-06T03:25:04.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.889+0000 7ff23c1ff700 1 -- 172.21.15.81:0/3470866960 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2340c4b20 con 0x7ff2341557f0 2023-10-06T03:25:04.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.889+0000 7ff229ffb700 1 -- 172.21.15.81:0/3470866960 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff224007300 con 0x7ff2341557f0 2023-10-06T03:25:04.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.889+0000 7ff23c1ff700 1 -- 172.21.15.81:0/3470866960 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff234147040 con 0x7ff2341557f0 2023-10-06T03:25:04.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.890+0000 7ff23c1ff700 1 -- 172.21.15.81:0/3470866960 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff23404c3c0 con 0x7ff2341557f0 2023-10-06T03:25:04.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.891+0000 7ff229ffb700 1 -- 172.21.15.81:0/3470866960 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff22401b400 con 0x7ff2341557f0 2023-10-06T03:25:04.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.891+0000 7ff229ffb700 1 --2- 172.21.15.81:0/3470866960 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff218066f30 0x7ff2180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:04.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.891+0000 7ff229ffb700 1 -- 172.21.15.81:0/3470866960 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6464+0+0 (secure 0 0 0) 0x7ff224084420 con 0x7ff2341557f0 2023-10-06T03:25:04.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.892+0000 7ff239f9b700 1 --2- 172.21.15.81:0/3470866960 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff218066f30 0x7ff2180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:04.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.892+0000 7ff239f9b700 1 --2- 172.21.15.81:0/3470866960 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff218066f30 0x7ff2180693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff2300091e0 tx=0x7ff230017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:04.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:04.895+0000 7ff229ffb700 1 -- 172.21.15.81:0/3470866960 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff2240513a0 con 0x7ff2341557f0 2023-10-06T03:25:05.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:05.128+0000 7ff23c1ff700 1 -- 172.21.15.81:0/3470866960 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff2340c52b0 con 0x7ff2341557f0 2023-10-06T03:25:05.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:05.129+0000 7ff229ffb700 1 -- 172.21.15.81:0/3470866960 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4594 (secure 0 0 0) 0x7ff2240549c0 con 0x7ff2341557f0 2023-10-06T03:25:05.132 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:25:05.132 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":23,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5065,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6834/822949628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":822949628},{"type":"v1","addr":"172.21.15.83:6834","nonce":822949628}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5068,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3024690603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6833","nonce":3024690603},{"type":"v1","addr":"172.21.15.83:6835","nonce":3024690603}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5074,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2638072815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2638072815},{"type":"v1","addr":"172.21.15.81:6837","nonce":2638072815}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:25:02.863416+0000","modified":"2023-10-06T03:25:04.680124+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5322":{"gid":5322,"name":"a","rank":0,"incarnation":23,"state":"up:replay","state_seq":1,"addr":"172.21.15.81:6835/2219056136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2219056136},{"type":"v1","addr":"172.21.15.81:6835","nonce":2219056136}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T03:25:05.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:05.131+0000 7ff23c1ff700 1 -- 172.21.15.81:0/3470866960 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff218066f30 msgr2=0x7ff2180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:05.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:05.131+0000 7ff23c1ff700 1 --2- 172.21.15.81:0/3470866960 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff218066f30 0x7ff2180693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff2300091e0 tx=0x7ff230017000 comp rx=0 tx=0).stop 2023-10-06T03:25:05.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:05.131+0000 7ff23c1ff700 1 -- 172.21.15.81:0/3470866960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2341557f0 msgr2=0x7ff2340ac050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:05.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:05.131+0000 7ff23c1ff700 1 --2- 172.21.15.81:0/3470866960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2341557f0 0x7ff2340ac050 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff22400c7e0 tx=0x7ff224007df0 comp rx=0 tx=0).stop 2023-10-06T03:25:05.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:05.131+0000 7ff23c1ff700 1 -- 172.21.15.81:0/3470866960 shutdown_connections 2023-10-06T03:25:05.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:05.131+0000 7ff23c1ff700 1 --2- 172.21.15.81:0/3470866960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff234155bc0 0x7ff2340b14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:05.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:05.131+0000 7ff23c1ff700 1 --2- 172.21.15.81:0/3470866960 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff218066f30 0x7ff2180693e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:05.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:05.132+0000 7ff23c1ff700 1 --2- 172.21.15.81:0/3470866960 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff234069ee0 0x7ff234146b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:05.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:05.132+0000 7ff23c1ff700 1 --2- 172.21.15.81:0/3470866960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2341557f0 0x7ff2340ac050 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:05.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:05.132+0000 7ff23c1ff700 1 -- 172.21.15.81:0/3470866960 >> 172.21.15.81:0/3470866960 conn(0x7ff2340cc090 msgr2=0x7ff23406f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:05.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:05.132+0000 7ff23c1ff700 1 -- 172.21.15.81:0/3470866960 shutdown_connections 2023-10-06T03:25:05.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:05.132+0000 7ff23c1ff700 1 -- 172.21.15.81:0/3470866960 wait complete. 2023-10-06T03:25:05.136 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 23 2023-10-06T03:25:05.554 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T03:25:02.863416+0000', 'modified': '2023-10-06T03:25:04.680124+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5322}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5322': {'gid': 5322, 'name': 'a', 'rank': 0, 'incarnation': 23, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.81:6835/2219056136', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6834', 'nonce': 2219056136}, {'type': 'v1', 'addr': '172.21.15.81:6835', 'nonce': 2219056136}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T03:25:05.555 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5322:up:replay 2023-10-06T03:25:06.556 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:25:06.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.746+0000 7fe3b9bff700 1 Processor -- start 2023-10-06T03:25:06.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.746+0000 7fe3b9bff700 1 -- start start 2023-10-06T03:25:06.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.747+0000 7fe3b9bff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe3b41557f0 0x7fe3b4156c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:06.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.747+0000 7fe3b9bff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3b4069ee0 0x7fe3b406a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:06.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.747+0000 7fe3b9bff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3b40c9c60 con 0x7fe3b4155bc0 2023-10-06T03:25:06.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.747+0000 7fe3b9bff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3b406df20 con 0x7fe3b41557f0 2023-10-06T03:25:06.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.747+0000 7fe3b9bff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b406a8a0 con 0x7fe3b4069ee0 2023-10-06T03:25:06.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.748+0000 7fe3b37fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe3b41557f0 0x7fe3b4156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:06.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.748+0000 7fe3b3fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3b4069ee0 0x7fe3b406a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:06.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.748+0000 7fe3b37fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe3b41557f0 0x7fe3b4156c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:60196/0 (socket says 172.21.15.81:60196) 2023-10-06T03:25:06.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.748+0000 7fe3b37fe700 1 -- 172.21.15.81:0/3397797782 learned_addr learned my addr 172.21.15.81:0/3397797782 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:06.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.748+0000 7fe3b3fff700 1 -- 172.21.15.81:0/3397797782 >> v2:172.21.15.83:3300/0 conn(0x7fe3b41557f0 msgr2=0x7fe3b4156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:06.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.748+0000 7fe3b3fff700 1 --2- 172.21.15.81:0/3397797782 >> v2:172.21.15.83:3300/0 conn(0x7fe3b41557f0 0x7fe3b4156c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:06.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.748+0000 7fe3b3fff700 1 -- 172.21.15.81:0/3397797782 >> v1:172.21.15.83:6789/0 conn(0x7fe3b4155bc0 legacy=0x7fe3b40c6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:06.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.748+0000 7fe3b3fff700 1 -- 172.21.15.81:0/3397797782 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b406dc60 con 0x7fe3b4069ee0 2023-10-06T03:25:06.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.748+0000 7fe3b37fe700 1 --2- 172.21.15.81:0/3397797782 >> v2:172.21.15.83:3300/0 conn(0x7fe3b41557f0 0x7fe3b4156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:25:06.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.749+0000 7fe3b3fff700 1 --2- 172.21.15.81:0/3397797782 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3b4069ee0 0x7fe3b406a360 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac00d0d0 tx=0x7fe3ac00b990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37cc3f69257e0d88 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:06.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.749+0000 7fe3b27fc700 1 -- 172.21.15.81:0/3397797782 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac010070 con 0x7fe3b4069ee0 2023-10-06T03:25:06.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.749+0000 7fe3b27fc700 1 -- 172.21.15.81:0/3397797782 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3ac00b2e0 con 0x7fe3b4069ee0 2023-10-06T03:25:06.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.749+0000 7fe3b27fc700 1 -- 172.21.15.81:0/3397797782 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac00dd80 con 0x7fe3b4069ee0 2023-10-06T03:25:06.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.749+0000 7fe3b9bff700 1 -- 172.21.15.81:0/3397797782 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3b4069ee0 msgr2=0x7fe3b406a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:06.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.749+0000 7fe3b9bff700 1 --2- 172.21.15.81:0/3397797782 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3b4069ee0 0x7fe3b406a360 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac00d0d0 tx=0x7fe3ac00b990 comp rx=0 tx=0).stop 2023-10-06T03:25:06.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.749+0000 7fe3b9bff700 1 -- 172.21.15.81:0/3397797782 shutdown_connections 2023-10-06T03:25:06.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.749+0000 7fe3b9bff700 1 --2- 172.21.15.81:0/3397797782 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3b4069ee0 0x7fe3b406a360 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:06.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.749+0000 7fe3b9bff700 1 --2- 172.21.15.81:0/3397797782 >> v2:172.21.15.83:3300/0 conn(0x7fe3b41557f0 0x7fe3b4156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:06.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.749+0000 7fe3b9bff700 1 -- 172.21.15.81:0/3397797782 >> 172.21.15.81:0/3397797782 conn(0x7fe3b40cc090 msgr2=0x7fe3b40cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:06.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.749+0000 7fe3b9bff700 1 -- 172.21.15.81:0/3397797782 shutdown_connections 2023-10-06T03:25:06.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.750+0000 7fe3b9bff700 1 -- 172.21.15.81:0/3397797782 wait complete. 2023-10-06T03:25:06.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.751+0000 7fe3b9bff700 1 Processor -- start 2023-10-06T03:25:06.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.751+0000 7fe3b9bff700 1 -- start start 2023-10-06T03:25:06.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.752+0000 7fe3b9bff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3b4069ee0 0x7fe3b4150660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:06.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.752+0000 7fe3b9bff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3b41557f0 0x7fe3b40c3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:06.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.752+0000 7fe3b9bff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3b4155bc0 0x7fe3b40c3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:06.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.752+0000 7fe3b9bff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b41589c0 con 0x7fe3b4155bc0 2023-10-06T03:25:06.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.752+0000 7fe3b9bff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b40af8c0 con 0x7fe3b4069ee0 2023-10-06T03:25:06.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.752+0000 7fe3b9bff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b4150ba0 con 0x7fe3b41557f0 2023-10-06T03:25:06.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.752+0000 7fe3b3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3b4155bc0 0x7fe3b40c3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:06.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.752+0000 7fe3b37fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3b4069ee0 0x7fe3b4150660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:06.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.752+0000 7fe3b3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3b4155bc0 0x7fe3b40c3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34834/0 (socket says 172.21.15.81:34834) 2023-10-06T03:25:06.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.752+0000 7fe3b3fff700 1 -- 172.21.15.81:0/1191559886 learned_addr learned my addr 172.21.15.81:0/1191559886 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:06.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.752+0000 7fe3b2ffd700 1 --2- 172.21.15.81:0/1191559886 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3b41557f0 0x7fe3b40c3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:06.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.753+0000 7fe3b3fff700 1 -- 172.21.15.81:0/1191559886 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3b41557f0 msgr2=0x7fe3b40c3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:06.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.753+0000 7fe3b3fff700 1 --2- 172.21.15.81:0/1191559886 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3b41557f0 0x7fe3b40c3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:06.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.753+0000 7fe3b3fff700 1 -- 172.21.15.81:0/1191559886 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3b4069ee0 msgr2=0x7fe3b4150660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:06.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.753+0000 7fe3b3fff700 1 --2- 172.21.15.81:0/1191559886 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3b4069ee0 0x7fe3b4150660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:06.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.753+0000 7fe3b3fff700 1 -- 172.21.15.81:0/1191559886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a400a590 con 0x7fe3b4155bc0 2023-10-06T03:25:06.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.753+0000 7fe3b37fe700 1 --2- 172.21.15.81:0/1191559886 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3b4069ee0 0x7fe3b4150660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:25:06.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.753+0000 7fe3b3fff700 1 --2- 172.21.15.81:0/1191559886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3b4155bc0 0x7fe3b40c3680 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac00d770 tx=0x7fe3ac01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:06.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.753+0000 7fe39b7fe700 1 -- 172.21.15.81:0/1191559886 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac00ab50 con 0x7fe3b4155bc0 2023-10-06T03:25:06.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.753+0000 7fe39b7fe700 1 -- 172.21.15.81:0/1191559886 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3ac00acb0 con 0x7fe3b4155bc0 2023-10-06T03:25:06.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.753+0000 7fe3b9bff700 1 -- 172.21.15.81:0/1191559886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3ac00bc30 con 0x7fe3b4155bc0 2023-10-06T03:25:06.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.753+0000 7fe39b7fe700 1 -- 172.21.15.81:0/1191559886 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac01d680 con 0x7fe3b4155bc0 2023-10-06T03:25:06.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.753+0000 7fe3b9bff700 1 -- 172.21.15.81:0/1191559886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3b4158400 con 0x7fe3b4155bc0 2023-10-06T03:25:06.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.754+0000 7fe3b9bff700 1 -- 172.21.15.81:0/1191559886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3b40afa70 con 0x7fe3b4155bc0 2023-10-06T03:25:06.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.755+0000 7fe39b7fe700 1 -- 172.21.15.81:0/1191559886 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe3ac003040 con 0x7fe3b4155bc0 2023-10-06T03:25:06.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.756+0000 7fe39b7fe700 1 --2- 172.21.15.81:0/1191559886 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fe3a0066f30 0x7fe3a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:06.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.756+0000 7fe39b7fe700 1 -- 172.21.15.81:0/1191559886 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fe3ac085e70 con 0x7fe3b4155bc0 2023-10-06T03:25:06.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.757+0000 7fe3b37fe700 1 --2- 172.21.15.81:0/1191559886 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fe3a0066f30 0x7fe3a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:06.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.757+0000 7fe3b37fe700 1 --2- 172.21.15.81:0/1191559886 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fe3a0066f30 0x7fe3a00693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe3a400afd0 tx=0x7fe3a400a330 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:06.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.761+0000 7fe39b7fe700 1 -- 172.21.15.81:0/1191559886 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe3b40afa70 con 0x7fe3b4155bc0 2023-10-06T03:25:06.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.993+0000 7fe3b9bff700 1 -- 172.21.15.81:0/1191559886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe3b40afa30 con 0x7fe3b4155bc0 2023-10-06T03:25:06.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.993+0000 7fe39b7fe700 1 -- 172.21.15.81:0/1191559886 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4594 (secure 0 0 0) 0x7fe3ac021090 con 0x7fe3b4155bc0 2023-10-06T03:25:06.995 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:25:06.995 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":25,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5065,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6834/822949628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":822949628},{"type":"v1","addr":"172.21.15.83:6834","nonce":822949628}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5068,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3024690603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6833","nonce":3024690603},{"type":"v1","addr":"172.21.15.83:6835","nonce":3024690603}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5074,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2638072815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2638072815},{"type":"v1","addr":"172.21.15.81:6837","nonce":2638072815}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:25:02.863416+0000","modified":"2023-10-06T03:25:06.688307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5322":{"gid":5322,"name":"a","rank":0,"incarnation":23,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.81:6835/2219056136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2219056136},{"type":"v1","addr":"172.21.15.81:6835","nonce":2219056136}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T03:25:06.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.996+0000 7fe3b9bff700 1 -- 172.21.15.81:0/1191559886 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fe3a0066f30 msgr2=0x7fe3a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:06.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.996+0000 7fe3b9bff700 1 --2- 172.21.15.81:0/1191559886 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fe3a0066f30 0x7fe3a00693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe3a400afd0 tx=0x7fe3a400a330 comp rx=0 tx=0).stop 2023-10-06T03:25:06.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.996+0000 7fe3b9bff700 1 -- 172.21.15.81:0/1191559886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3b4155bc0 msgr2=0x7fe3b40c3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:06.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.996+0000 7fe3b9bff700 1 --2- 172.21.15.81:0/1191559886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3b4155bc0 0x7fe3b40c3680 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac00d770 tx=0x7fe3ac01a000 comp rx=0 tx=0).stop 2023-10-06T03:25:06.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.996+0000 7fe3b9bff700 1 -- 172.21.15.81:0/1191559886 shutdown_connections 2023-10-06T03:25:06.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.996+0000 7fe3b9bff700 1 --2- 172.21.15.81:0/1191559886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3b4155bc0 0x7fe3b40c3680 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:06.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.996+0000 7fe3b9bff700 1 --2- 172.21.15.81:0/1191559886 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3b4069ee0 0x7fe3b4150660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:06.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.996+0000 7fe3b9bff700 1 --2- 172.21.15.81:0/1191559886 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fe3a0066f30 0x7fe3a00693e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:06.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.996+0000 7fe3b9bff700 1 --2- 172.21.15.81:0/1191559886 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3b41557f0 0x7fe3b40c3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:06.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.996+0000 7fe3b9bff700 1 -- 172.21.15.81:0/1191559886 >> 172.21.15.81:0/1191559886 conn(0x7fe3b40cc090 msgr2=0x7fe3b4153940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:06.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.996+0000 7fe3b9bff700 1 -- 172.21.15.81:0/1191559886 shutdown_connections 2023-10-06T03:25:06.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:06.996+0000 7fe3b9bff700 1 -- 172.21.15.81:0/1191559886 wait complete. 2023-10-06T03:25:07.000 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 25 2023-10-06T03:25:07.418 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T03:25:02.863416+0000', 'modified': '2023-10-06T03:25:06.688307+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5322}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5322': {'gid': 5322, 'name': 'a', 'rank': 0, 'incarnation': 23, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.81:6835/2219056136', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6834', 'nonce': 2219056136}, {'type': 'v1', 'addr': '172.21.15.81:6835', 'nonce': 2219056136}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T03:25:07.418 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5322:up:rejoin 2023-10-06T03:25:08.420 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:25:08.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.608+0000 7f237679d700 1 Processor -- start 2023-10-06T03:25:08.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.608+0000 7f237679d700 1 -- start start 2023-10-06T03:25:08.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.609+0000 7f237679d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f237006e2e0 0x7f2370160860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:08.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.609+0000 7f237679d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23700ac5f0 con 0x7f23700ab7b0 2023-10-06T03:25:08.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.610+0000 7f237679d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23700ad290 con 0x7f23700ace00 2023-10-06T03:25:08.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.610+0000 7f237679d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23700ae330 con 0x7f237006e2e0 2023-10-06T03:25:08.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.610+0000 7f2375f9c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f237006e2e0 0x7f2370160860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:08.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.610+0000 7f237579b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f23700ab7b0 0x7f2370156910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53416/0 (socket says 172.21.15.81:53416) 2023-10-06T03:25:08.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.610+0000 7f237579b700 1 -- 172.21.15.81:0/3573080108 learned_addr learned my addr 172.21.15.81:0/3573080108 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:25:08.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.610+0000 7f2367fff700 1 -- 172.21.15.81:0/3573080108 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 210665309 0 0) 0x7f23700ac5f0 con 0x7f23700ab7b0 2023-10-06T03:25:08.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.610+0000 7f2367fff700 1 -- 172.21.15.81:0/3573080108 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f235c003570 con 0x7f23700ab7b0 2023-10-06T03:25:08.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.610+0000 7f2375f9c700 1 -- 172.21.15.81:0/3573080108 >> v1:172.21.15.83:6789/0 conn(0x7f23700ace00 legacy=0x7f23700abb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:08.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.610+0000 7f2375f9c700 1 -- 172.21.15.81:0/3573080108 >> v1:172.21.15.81:6789/0 conn(0x7f23700ab7b0 legacy=0x7f2370156910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:08.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.610+0000 7f2375f9c700 1 -- 172.21.15.81:0/3573080108 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23700ad570 con 0x7f237006e2e0 2023-10-06T03:25:08.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.611+0000 7f2375f9c700 1 --2- 172.21.15.81:0/3573080108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f237006e2e0 0x7f2370160860 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2370155f20 tx=0x7f236800a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4e0a93dbf91c22 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:08.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.611+0000 7f2367fff700 1 -- 172.21.15.81:0/3573080108 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236800f070 con 0x7f237006e2e0 2023-10-06T03:25:08.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.611+0000 7f2367fff700 1 -- 172.21.15.81:0/3573080108 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f236800a2e0 con 0x7f237006e2e0 2023-10-06T03:25:08.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.611+0000 7f2367fff700 1 -- 172.21.15.81:0/3573080108 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236800cc50 con 0x7f237006e2e0 2023-10-06T03:25:08.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.611+0000 7f237679d700 1 -- 172.21.15.81:0/3573080108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f237006e2e0 msgr2=0x7f2370160860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:08.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.611+0000 7f237679d700 1 --2- 172.21.15.81:0/3573080108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f237006e2e0 0x7f2370160860 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2370155f20 tx=0x7f236800a890 comp rx=0 tx=0).stop 2023-10-06T03:25:08.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.611+0000 7f237679d700 1 -- 172.21.15.81:0/3573080108 shutdown_connections 2023-10-06T03:25:08.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.611+0000 7f237679d700 1 --2- 172.21.15.81:0/3573080108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f237006e2e0 0x7f2370160860 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:08.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.611+0000 7f237679d700 1 -- 172.21.15.81:0/3573080108 >> 172.21.15.81:0/3573080108 conn(0x7f23700cbef0 msgr2=0x7f23700cc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:08.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.611+0000 7f237679d700 1 -- 172.21.15.81:0/3573080108 shutdown_connections 2023-10-06T03:25:08.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.612+0000 7f237679d700 1 -- 172.21.15.81:0/3573080108 wait complete. 2023-10-06T03:25:08.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.613+0000 7f237679d700 1 Processor -- start 2023-10-06T03:25:08.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.613+0000 7f237679d700 1 -- start start 2023-10-06T03:25:08.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.614+0000 7f237679d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f23700ab7b0 0x7f237013b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:08.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.614+0000 7f237679d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23700ace00 0x7f23700ca800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:08.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.614+0000 7f237679d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23700cad40 0x7f23700c88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:08.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.614+0000 7f237679d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23700afd10 con 0x7f23700ace00 2023-10-06T03:25:08.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.614+0000 7f237679d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23700cb380 con 0x7f23700cad40 2023-10-06T03:25:08.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.614+0000 7f237679d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23700cb660 con 0x7f23700ab7b0 2023-10-06T03:25:08.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.614+0000 7f2374f9a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23700ace00 0x7f23700ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:08.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.614+0000 7f2374f9a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23700ace00 0x7f23700ca800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34850/0 (socket says 172.21.15.81:34850) 2023-10-06T03:25:08.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.614+0000 7f2374f9a700 1 -- 172.21.15.81:0/4128205704 learned_addr learned my addr 172.21.15.81:0/4128205704 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:08.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.614+0000 7f2375f9c700 1 --2- 172.21.15.81:0/4128205704 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23700cad40 0x7f23700c88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:08.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.614+0000 7f237579b700 1 --2- 172.21.15.81:0/4128205704 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f23700ab7b0 0x7f237013b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:08.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.615+0000 7f2374f9a700 1 -- 172.21.15.81:0/4128205704 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f23700ab7b0 msgr2=0x7f237013b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:08.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.615+0000 7f2374f9a700 1 --2- 172.21.15.81:0/4128205704 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f23700ab7b0 0x7f237013b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:08.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.615+0000 7f2374f9a700 1 -- 172.21.15.81:0/4128205704 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23700cad40 msgr2=0x7f23700c88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:08.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.615+0000 7f2374f9a700 1 --2- 172.21.15.81:0/4128205704 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23700cad40 0x7f23700c88f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:08.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.615+0000 7f2374f9a700 1 -- 172.21.15.81:0/4128205704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f236800ab30 con 0x7f23700ace00 2023-10-06T03:25:08.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.615+0000 7f2374f9a700 1 --2- 172.21.15.81:0/4128205704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23700ace00 0x7f23700ca800 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f236000c590 tx=0x7f2360007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:08.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.615+0000 7f23657fa700 1 -- 172.21.15.81:0/4128205704 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2360011590 con 0x7f23700ace00 2023-10-06T03:25:08.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.615+0000 7f23657fa700 1 -- 172.21.15.81:0/4128205704 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2360011730 con 0x7f23700ace00 2023-10-06T03:25:08.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.615+0000 7f23657fa700 1 -- 172.21.15.81:0/4128205704 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2360011af0 con 0x7f23700ace00 2023-10-06T03:25:08.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.615+0000 7f237679d700 1 -- 172.21.15.81:0/4128205704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23700cb940 con 0x7f23700ace00 2023-10-06T03:25:08.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.615+0000 7f237679d700 1 -- 172.21.15.81:0/4128205704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f237014cff0 con 0x7f23700ace00 2023-10-06T03:25:08.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.616+0000 7f237679d700 1 -- 172.21.15.81:0/4128205704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23700cb140 con 0x7f23700ace00 2023-10-06T03:25:08.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.617+0000 7f23657fa700 1 -- 172.21.15.81:0/4128205704 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2360012420 con 0x7f23700ace00 2023-10-06T03:25:08.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.618+0000 7f23657fa700 1 --2- 172.21.15.81:0/4128205704 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2354066f30 0x7f23540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:08.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.618+0000 7f23657fa700 1 -- 172.21.15.81:0/4128205704 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f23600839f0 con 0x7f23700ace00 2023-10-06T03:25:08.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.618+0000 7f237579b700 1 --2- 172.21.15.81:0/4128205704 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2354066f30 0x7f23540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:08.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.619+0000 7f237579b700 1 --2- 172.21.15.81:0/4128205704 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2354066f30 0x7f23540693e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f236c007fd0 tx=0x7f236c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:08.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.622+0000 7f23657fa700 1 -- 172.21.15.81:0/4128205704 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f236004b5a0 con 0x7f23700ace00 2023-10-06T03:25:08.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.858+0000 7f237679d700 1 -- 172.21.15.81:0/4128205704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f23700ad850 con 0x7f23700ace00 2023-10-06T03:25:08.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.859+0000 7f23657fa700 1 -- 172.21.15.81:0/4128205704 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4594 (secure 0 0 0) 0x7f2360017070 con 0x7f23700ace00 2023-10-06T03:25:08.861 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:25:08.861 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":27,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5065,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6834/822949628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":822949628},{"type":"v1","addr":"172.21.15.83:6834","nonce":822949628}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5068,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3024690603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6833","nonce":3024690603},{"type":"v1","addr":"172.21.15.83:6835","nonce":3024690603}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5074,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2638072815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2638072815},{"type":"v1","addr":"172.21.15.81:6837","nonce":2638072815}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:25:02.863416+0000","modified":"2023-10-06T03:25:07.689931+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5322":{"gid":5322,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6835/2219056136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2219056136},{"type":"v1","addr":"172.21.15.81:6835","nonce":2219056136}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":2}]} 2023-10-06T03:25:08.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.861+0000 7f237679d700 1 -- 172.21.15.81:0/4128205704 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2354066f30 msgr2=0x7f23540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:08.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.861+0000 7f237679d700 1 --2- 172.21.15.81:0/4128205704 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2354066f30 0x7f23540693e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f236c007fd0 tx=0x7f236c009040 comp rx=0 tx=0).stop 2023-10-06T03:25:08.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.861+0000 7f237679d700 1 -- 172.21.15.81:0/4128205704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23700ace00 msgr2=0x7f23700ca800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:08.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.861+0000 7f237679d700 1 --2- 172.21.15.81:0/4128205704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23700ace00 0x7f23700ca800 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f236000c590 tx=0x7f2360007f30 comp rx=0 tx=0).stop 2023-10-06T03:25:08.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.861+0000 7f237679d700 1 -- 172.21.15.81:0/4128205704 shutdown_connections 2023-10-06T03:25:08.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.861+0000 7f237679d700 1 --2- 172.21.15.81:0/4128205704 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23700cad40 0x7f23700c88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:08.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.861+0000 7f237679d700 1 --2- 172.21.15.81:0/4128205704 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2354066f30 0x7f23540693e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:08.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.861+0000 7f237679d700 1 --2- 172.21.15.81:0/4128205704 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f23700ab7b0 0x7f237013b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:08.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.861+0000 7f237679d700 1 --2- 172.21.15.81:0/4128205704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23700ace00 0x7f23700ca800 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:08.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.861+0000 7f237679d700 1 -- 172.21.15.81:0/4128205704 >> 172.21.15.81:0/4128205704 conn(0x7f23700cbef0 msgr2=0x7f2370154ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:08.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.861+0000 7f237679d700 1 -- 172.21.15.81:0/4128205704 shutdown_connections 2023-10-06T03:25:08.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:08.861+0000 7f237679d700 1 -- 172.21.15.81:0/4128205704 wait complete. 2023-10-06T03:25:08.864 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 27 2023-10-06T03:25:09.283 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T03:25:02.863416+0000', 'modified': '2023-10-06T03:25:07.689931+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5322}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5322': {'gid': 5322, 'name': 'a', 'rank': 0, 'incarnation': 23, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.81:6835/2219056136', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6834', 'nonce': 2219056136}, {'type': 'v1', 'addr': '172.21.15.81:6835', 'nonce': 2219056136}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 1} 2023-10-06T03:25:09.283 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T03:25:09.283 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T03:25:09.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.463+0000 7f0ffad9d700 1 Processor -- start 2023-10-06T03:25:09.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.463+0000 7f0ffad9d700 1 -- start start 2023-10-06T03:25:09.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.465+0000 7f0ffad9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0ff4156220 0x7f0ff40ab7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:09.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.465+0000 7f0ffad9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ff406eaf0 0x7f0ff41565f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:09.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.465+0000 7f0ffad9d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ff40b0910 con 0x7f0ff40a6730 2023-10-06T03:25:09.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.465+0000 7f0ffad9d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ff40b0390 con 0x7f0ff4156220 2023-10-06T03:25:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.465+0000 7f0ffad9d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff4157800 con 0x7f0ff406eaf0 2023-10-06T03:25:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.465+0000 7f0ff9d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0ff4156220 0x7f0ff40ab7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.465+0000 7f0ff9d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0ff4156220 0x7f0ff40ab7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34866/0 (socket says 172.21.15.81:34866) 2023-10-06T03:25:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.465+0000 7f0ff9d9b700 1 -- 172.21.15.81:0/3732458807 learned_addr learned my addr 172.21.15.81:0/3732458807 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.465+0000 7f0ffa59c700 1 --2- 172.21.15.81:0/3732458807 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ff406eaf0 0x7f0ff41565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.465+0000 7f0ff9d9b700 1 -- 172.21.15.81:0/3732458807 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ff406eaf0 msgr2=0x7f0ff41565f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.465+0000 7f0ff9d9b700 1 --2- 172.21.15.81:0/3732458807 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ff406eaf0 0x7f0ff41565f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.465+0000 7f0ff9d9b700 1 -- 172.21.15.81:0/3732458807 >> v1:172.21.15.83:6789/0 conn(0x7f0ff40a6730 legacy=0x7f0ff406e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.465+0000 7f0ff9d9b700 1 -- 172.21.15.81:0/3732458807 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff4157240 con 0x7f0ff4156220 2023-10-06T03:25:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.465+0000 7f0ffa59c700 1 --2- 172.21.15.81:0/3732458807 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ff406eaf0 0x7f0ff41565f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.466+0000 7f0ff9d9b700 1 --2- 172.21.15.81:0/3732458807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ff4156220 0x7f0ff40ab7b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0ff000bc50 tx=0x7f0ff000b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c88209d0809fe5ee server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:09.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.466+0000 7f0ff8d99700 1 -- 172.21.15.81:0/3732458807 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff000be60 con 0x7f0ff4156220 2023-10-06T03:25:09.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.466+0000 7f0ff8d99700 1 -- 172.21.15.81:0/3732458807 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff000de00 con 0x7f0ff4156220 2023-10-06T03:25:09.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.466+0000 7f0ff8d99700 1 -- 172.21.15.81:0/3732458807 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff00196b0 con 0x7f0ff4156220 2023-10-06T03:25:09.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.466+0000 7f0ffad9d700 1 -- 172.21.15.81:0/3732458807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ff4156220 msgr2=0x7f0ff40ab7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:09.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.466+0000 7f0ffad9d700 1 --2- 172.21.15.81:0/3732458807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ff4156220 0x7f0ff40ab7b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0ff000bc50 tx=0x7f0ff000b4f0 comp rx=0 tx=0).stop 2023-10-06T03:25:09.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.466+0000 7f0ffad9d700 1 -- 172.21.15.81:0/3732458807 shutdown_connections 2023-10-06T03:25:09.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.466+0000 7f0ffad9d700 1 --2- 172.21.15.81:0/3732458807 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ff406eaf0 0x7f0ff41565f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:09.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.466+0000 7f0ffad9d700 1 --2- 172.21.15.81:0/3732458807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ff4156220 0x7f0ff40ab7b0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:09.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.466+0000 7f0ffad9d700 1 -- 172.21.15.81:0/3732458807 >> 172.21.15.81:0/3732458807 conn(0x7f0ff40cbef0 msgr2=0x7f0ff40cc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:09.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.467+0000 7f0ffad9d700 1 -- 172.21.15.81:0/3732458807 shutdown_connections 2023-10-06T03:25:09.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.467+0000 7f0ffad9d700 1 -- 172.21.15.81:0/3732458807 wait complete. 2023-10-06T03:25:09.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.468+0000 7f0ffad9d700 1 Processor -- start 2023-10-06T03:25:09.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.468+0000 7f0ffad9d700 1 -- start start 2023-10-06T03:25:09.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.469+0000 7f0ffad9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ff406eaf0 0x7f0ff4169560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:09.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.469+0000 7f0ffad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ff40a6730 0x7f0ff406a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:09.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.469+0000 7f0ffad9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ff4156220 0x7f0ff406a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:09.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.469+0000 7f0ffad9d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff41670b0 con 0x7f0ff40a6730 2023-10-06T03:25:09.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.469+0000 7f0ffad9d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff4169aa0 con 0x7f0ff406eaf0 2023-10-06T03:25:09.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.469+0000 7f0ffad9d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff40a70f0 con 0x7f0ff4156220 2023-10-06T03:25:09.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.469+0000 7f0ff959a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ff40a6730 0x7f0ff406a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:09.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.469+0000 7f0ff959a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ff40a6730 0x7f0ff406a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34874/0 (socket says 172.21.15.81:34874) 2023-10-06T03:25:09.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.469+0000 7f0ff959a700 1 -- 172.21.15.81:0/233741810 learned_addr learned my addr 172.21.15.81:0/233741810 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:09.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.469+0000 7f0ff9d9b700 1 --2- 172.21.15.81:0/233741810 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ff406eaf0 0x7f0ff4169560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:09.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.469+0000 7f0ffa59c700 1 --2- 172.21.15.81:0/233741810 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ff4156220 0x7f0ff406a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:09.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.470+0000 7f0ff959a700 1 -- 172.21.15.81:0/233741810 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ff4156220 msgr2=0x7f0ff406a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:09.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.470+0000 7f0ff959a700 1 --2- 172.21.15.81:0/233741810 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ff4156220 0x7f0ff406a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:09.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.470+0000 7f0ff959a700 1 -- 172.21.15.81:0/233741810 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ff406eaf0 msgr2=0x7f0ff4169560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:09.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.470+0000 7f0ff959a700 1 --2- 172.21.15.81:0/233741810 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ff406eaf0 0x7f0ff4169560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:09.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.470+0000 7f0ff959a700 1 -- 172.21.15.81:0/233741810 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff000b790 con 0x7f0ff40a6730 2023-10-06T03:25:09.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.470+0000 7f0ffa59c700 1 --2- 172.21.15.81:0/233741810 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ff4156220 0x7f0ff406a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:09.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.470+0000 7f0ff959a700 1 --2- 172.21.15.81:0/233741810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ff40a6730 0x7f0ff406a490 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0fe400c7f0 tx=0x7f0fe4007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:09.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.470+0000 7f0fe9ffb700 1 -- 172.21.15.81:0/233741810 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe4011590 con 0x7f0ff40a6730 2023-10-06T03:25:09.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.470+0000 7f0fe9ffb700 1 -- 172.21.15.81:0/233741810 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe4011710 con 0x7f0ff40a6730 2023-10-06T03:25:09.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.470+0000 7f0ffad9d700 1 -- 172.21.15.81:0/233741810 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ff4155820 con 0x7f0ff40a6730 2023-10-06T03:25:09.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.470+0000 7f0fe9ffb700 1 -- 172.21.15.81:0/233741810 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe4011ad0 con 0x7f0ff40a6730 2023-10-06T03:25:09.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.470+0000 7f0ffad9d700 1 -- 172.21.15.81:0/233741810 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff4166a60 con 0x7f0ff40a6730 2023-10-06T03:25:09.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.472+0000 7f0fe9ffb700 1 -- 172.21.15.81:0/233741810 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0fe401b3b0 con 0x7f0ff40a6730 2023-10-06T03:25:09.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.473+0000 7f0fe9ffb700 1 --2- 172.21.15.81:0/233741810 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0fd8066fb0 0x7f0fd8069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:09.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.473+0000 7f0fe9ffb700 1 -- 172.21.15.81:0/233741810 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f0fe4083d10 con 0x7f0ff40a6730 2023-10-06T03:25:09.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.473+0000 7f0ff9d9b700 1 --2- 172.21.15.81:0/233741810 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0fd8066fb0 0x7f0fd8069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:09.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.474+0000 7f0ff9d9b700 1 --2- 172.21.15.81:0/233741810 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0fd8066fb0 0x7f0fd8069460 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0ff000bc50 tx=0x7f0ff001b000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:09.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.475+0000 7f100a80bb80 1 Processor -- start 2023-10-06T03:25:09.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.475+0000 7f100a80bb80 1 -- start start 2023-10-06T03:25:09.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.476+0000 7f100a80bb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56446882ce90 0x56446885fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:09.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.476+0000 7f100a80bb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564468832250 0x56446882d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:09.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.476+0000 7f100a80bb80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x564468860350 0x56446887c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:09.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.476+0000 7f100a80bb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564468787a70 con 0x564468832250 2023-10-06T03:25:09.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.476+0000 7f100a80bb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x564468785270 con 0x56446882ce90 2023-10-06T03:25:09.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.476+0000 7f100a80bb80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x564468781060 con 0x564468860350 2023-10-06T03:25:09.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.476+0000 7f0ff959a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564468832250 0x56446882d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:09.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.476+0000 7f0ff9d9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56446882ce90 0x56446885fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:09.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.476+0000 7f0ff959a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564468832250 0x56446882d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34890/0 (socket says 172.21.15.81:34890) 2023-10-06T03:25:09.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.476+0000 7f0ff959a700 1 -- 172.21.15.81:0/507332297 learned_addr learned my addr 172.21.15.81:0/507332297 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:09.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.476+0000 7f0ffa59c700 1 --2- 172.21.15.81:0/507332297 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x564468860350 0x56446887c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:09.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.476+0000 7f0ff959a700 1 -- 172.21.15.81:0/507332297 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x564468860350 msgr2=0x56446887c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:09.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.476+0000 7f0ff959a700 1 --2- 172.21.15.81:0/507332297 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x564468860350 0x56446887c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:09.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.476+0000 7f0ff959a700 1 -- 172.21.15.81:0/507332297 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56446882ce90 msgr2=0x56446885fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:09.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.476+0000 7f0ff959a700 1 --2- 172.21.15.81:0/507332297 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56446882ce90 0x56446885fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:09.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.476+0000 7f0ff959a700 1 -- 172.21.15.81:0/507332297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56446861b270 con 0x564468832250 2023-10-06T03:25:09.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.477+0000 7f0ff959a700 1 --2- 172.21.15.81:0/507332297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564468832250 0x56446882d260 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0fe400a040 tx=0x7f0fe4081e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8eb50dafe68cee3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:09.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.477+0000 7f0fdeffd700 1 -- 172.21.15.81:0/507332297 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe40548d0 con 0x564468832250 2023-10-06T03:25:09.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.477+0000 7f0fdeffd700 1 -- 172.21.15.81:0/507332297 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe4057b20 con 0x564468832250 2023-10-06T03:25:09.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.477+0000 7f0fdeffd700 1 -- 172.21.15.81:0/507332297 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe405b870 con 0x564468832250 2023-10-06T03:25:09.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.477+0000 7f100a80bb80 1 -- 172.21.15.81:0/507332297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564468832250 msgr2=0x56446882d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:09.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.477+0000 7f100a80bb80 1 --2- 172.21.15.81:0/507332297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564468832250 0x56446882d260 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0fe400a040 tx=0x7f0fe4081e20 comp rx=0 tx=0).stop 2023-10-06T03:25:09.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.478+0000 7f100a80bb80 1 -- 172.21.15.81:0/507332297 shutdown_connections 2023-10-06T03:25:09.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.478+0000 7f100a80bb80 1 --2- 172.21.15.81:0/507332297 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x564468860350 0x56446887c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:09.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.478+0000 7f100a80bb80 1 --2- 172.21.15.81:0/507332297 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56446882ce90 0x56446885fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:09.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.478+0000 7f100a80bb80 1 --2- 172.21.15.81:0/507332297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564468832250 0x56446882d260 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:09.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.478+0000 7f100a80bb80 1 -- 172.21.15.81:0/507332297 >> 172.21.15.81:0/507332297 conn(0x564468831e80 msgr2=0x5644688326b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:09.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.478+0000 7f100a80bb80 1 -- 172.21.15.81:0/507332297 shutdown_connections 2023-10-06T03:25:09.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.478+0000 7f100a80bb80 1 -- 172.21.15.81:0/507332297 wait complete. 2023-10-06T03:25:09.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.478+0000 7f100a80bb80 1 -- start start 2023-10-06T03:25:09.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.479+0000 7f100a80bb80 1 Processor -- start 2023-10-06T03:25:09.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.479+0000 7f100a80bb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56446882ce90 0x564468852f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:09.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.479+0000 7f100a80bb80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x564468832250 0x56446885b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:09.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.480+0000 7f100a80bb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564468860350 0x564468832690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:09.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.480+0000 7f100a80bb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56446872c890 con 0x564468860350 2023-10-06T03:25:09.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.480+0000 7f100a80bb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x564468747ea0 con 0x56446882ce90 2023-10-06T03:25:09.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.480+0000 7f100a80bb80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x564468603e30 con 0x564468832250 2023-10-06T03:25:09.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.480+0000 7f100a80bb80 10 client.0 _ll_register_callbacks cb 0x5644687f4020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:25:09.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.480+0000 7f0ffa59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564468860350 0x564468832690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:09.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.480+0000 7f0ffa59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564468860350 0x564468832690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34904/0 (socket says 172.21.15.81:34904) 2023-10-06T03:25:09.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.480+0000 7f0ffa59c700 1 -- 172.21.15.81:0/4284203621 learned_addr learned my addr 172.21.15.81:0/4284203621 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:09.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.480+0000 7f0ff9d9b700 1 --2- 172.21.15.81:0/4284203621 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56446882ce90 0x564468852f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:09.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.480+0000 7f0ff959a700 1 --2- 172.21.15.81:0/4284203621 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x564468832250 0x56446885b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:09.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.480+0000 7f0ffa59c700 1 -- 172.21.15.81:0/4284203621 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x564468832250 msgr2=0x56446885b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:09.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.480+0000 7f0ffa59c700 1 --2- 172.21.15.81:0/4284203621 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x564468832250 0x56446885b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:09.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.480+0000 7f0ffa59c700 1 -- 172.21.15.81:0/4284203621 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56446882ce90 msgr2=0x564468852f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:09.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.480+0000 7f0ffa59c700 1 --2- 172.21.15.81:0/4284203621 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56446882ce90 0x564468852f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:09.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.480+0000 7f0ffa59c700 1 -- 172.21.15.81:0/4284203621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff4166a60 con 0x564468860350 2023-10-06T03:25:09.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.481+0000 7f0ffa59c700 1 --2- 172.21.15.81:0/4284203621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564468860350 0x564468832690 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0fec002e80 tx=0x7f0fec009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe0ccccdfc847446 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:09.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.481+0000 7f0fd3fff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-06T03:25:09.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.481+0000 7f0fd3fff700 1 -- 172.21.15.81:0/4284203621 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec012ba0 con 0x564468860350 2023-10-06T03:25:09.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.481+0000 7f0fd3fff700 1 -- 172.21.15.81:0/4284203621 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f0fec012d00 con 0x564468860350 2023-10-06T03:25:09.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.481+0000 7f100a80bb80 1 -- 172.21.15.81:0/4284203621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564468825940 con 0x564468860350 2023-10-06T03:25:09.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.481+0000 7f0fd3fff700 1 -- 172.21.15.81:0/4284203621 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0fec012ec0 con 0x564468860350 2023-10-06T03:25:09.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.481+0000 7f100a80bb80 10 client.5373 fetch_fsmap learned FSMap version 27 2023-10-06T03:25:09.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.481+0000 7f100a80bb80 1 -- 172.21.15.81:0/4284203621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0x5644685bdfe0 con 0x564468860350 2023-10-06T03:25:09.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.481+0000 7f0fd3fff700 1 -- 172.21.15.81:0/4284203621 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564468825940 con 0x564468860350 2023-10-06T03:25:09.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.481+0000 7f0fd3fff700 1 -- 172.21.15.81:0/4284203621 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0fec014040 con 0x564468860350 2023-10-06T03:25:09.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.481+0000 7f100a80bb80 10 client.5373 fetch_fsmap finished waiting for FSMap version 27 2023-10-06T03:25:09.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.481+0000 7f100a80bb80 10 client.5373 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T03:25:09.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.481+0000 7f100a80bb80 20 client.5373 populate_metadata read hostname 'smithi081' 2023-10-06T03:25:09.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.481+0000 7f100a80bb80 1 --2- 172.21.15.81:0/4284203621 >> [v2:172.21.15.81:6834/2219056136,v1:172.21.15.81:6835/2219056136] conn(0x56446885c980 0x56446888bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:09.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.481+0000 7f100a80bb80 4 client.5373 mds_command: new command op to 5322 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:25:09.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.481+0000 7f100a80bb80 1 -- 172.21.15.81:0/4284203621 --> [v2:172.21.15.81:6834/2219056136,v1:172.21.15.81:6835/2219056136] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564468802870 con 0x56446885c980 2023-10-06T03:25:09.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.482+0000 7f0ff9d9b700 1 --2- 172.21.15.81:0/4284203621 >> [v2:172.21.15.81:6834/2219056136,v1:172.21.15.81:6835/2219056136] conn(0x56446885c980 0x56446888bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:09.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.482+0000 7f0fd3fff700 10 client.5373 ms_handle_connect on v2:172.21.15.81:6834/2219056136 2023-10-06T03:25:09.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.482+0000 7f0ff9d9b700 1 --2- 172.21.15.81:0/4284203621 >> [v2:172.21.15.81:6834/2219056136,v1:172.21.15.81:6835/2219056136] conn(0x56446885c980 0x56446888bbf0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40af771c7cae11b server_cookie=716430170b96bdb in_seq=0 out_seq=0 2023-10-06T03:25:09.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.483+0000 7f0fd3fff700 1 -- 172.21.15.81:0/4284203621 <== mds.0 v2:172.21.15.81:6834/2219056136 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x564468802870 con 0x56446885c980 2023-10-06T03:25:09.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.483+0000 7f0fd3fff700 10 client.5373 handle_command_reply: tid=0 2023-10-06T03:25:09.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.483+0000 7f100a80bb80 1 client.5373 shutdown 2023-10-06T03:25:09.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.483+0000 7f100a80bb80 1 -- 172.21.15.81:0/4284203621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564468860350 msgr2=0x564468832690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:09.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.483+0000 7f100a80bb80 1 --2- 172.21.15.81:0/4284203621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564468860350 0x564468832690 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0fec002e80 tx=0x7f0fec009c20 comp rx=0 tx=0).stop 2023-10-06T03:25:09.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.483+0000 7f100a80bb80 1 -- 172.21.15.81:0/4284203621 shutdown_connections 2023-10-06T03:25:09.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.483+0000 7f100a80bb80 1 --2- 172.21.15.81:0/4284203621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564468860350 0x564468832690 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:09.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.483+0000 7f100a80bb80 1 --2- 172.21.15.81:0/4284203621 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56446882ce90 0x564468852f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:09.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.483+0000 7f100a80bb80 1 --2- 172.21.15.81:0/4284203621 >> [v2:172.21.15.81:6834/2219056136,v1:172.21.15.81:6835/2219056136] conn(0x56446885c980 0x56446888bbf0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:09.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.483+0000 7f100a80bb80 1 --2- 172.21.15.81:0/4284203621 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x564468832250 0x56446885b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:09.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.484+0000 7f0fd3fff700 0 client.5373 ms_handle_reset on v2:172.21.15.81:6834/2219056136 2023-10-06T03:25:09.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.484+0000 7f100a80bb80 1 -- 172.21.15.81:0/4284203621 >> 172.21.15.81:0/4284203621 conn(0x564468831e80 msgr2=0x564468858630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:09.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.484+0000 7f100a80bb80 1 -- 172.21.15.81:0/4284203621 shutdown_connections 2023-10-06T03:25:09.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.484+0000 7f100a80bb80 1 -- 172.21.15.81:0/4284203621 wait complete. 2023-10-06T03:25:09.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.484+0000 7f100a80bb80 20 client.5373 trim_cache size 0 max 16384 2023-10-06T03:25:09.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.501+0000 7f100a80bb80 1 Processor -- start 2023-10-06T03:25:09.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.501+0000 7f100a80bb80 1 -- start start 2023-10-06T03:25:09.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.502+0000 7f100a80bb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56446882ce90 0x56446888a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:09.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.502+0000 7f100a80bb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564468832250 0x56446887b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:09.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.502+0000 7f100a80bb80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x564468860350 0x56446887b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:09.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.502+0000 7f100a80bb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564468854da0 con 0x56446882ce90 2023-10-06T03:25:09.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.502+0000 7f100a80bb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x564468854b90 con 0x564468832250 2023-10-06T03:25:09.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.502+0000 7f100a80bb80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x56446882e5d0 con 0x564468860350 2023-10-06T03:25:09.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.502+0000 7f0ff9d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56446882ce90 0x56446888a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:09.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.502+0000 7f0ff9d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56446882ce90 0x56446888a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34918/0 (socket says 172.21.15.81:34918) 2023-10-06T03:25:09.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.502+0000 7f0ff9d9b700 1 -- 172.21.15.81:0/799748114 learned_addr learned my addr 172.21.15.81:0/799748114 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:09.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.503+0000 7f0ff9d9b700 1 -- 172.21.15.81:0/799748114 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x564468860350 msgr2=0x56446887b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:09.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.503+0000 7f0ff9d9b700 1 --2- 172.21.15.81:0/799748114 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x564468860350 0x56446887b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:09.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.503+0000 7f0ff9d9b700 1 -- 172.21.15.81:0/799748114 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564468832250 msgr2=0x56446887b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:09.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.503+0000 7f0ff9d9b700 1 --2- 172.21.15.81:0/799748114 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564468832250 0x56446887b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:09.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.503+0000 7f0ff9d9b700 1 -- 172.21.15.81:0/799748114 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56446874f780 con 0x56446882ce90 2023-10-06T03:25:09.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.503+0000 7f0ff9d9b700 1 --2- 172.21.15.81:0/799748114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56446882ce90 0x56446888a370 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0006fd0 tx=0x7f0ff0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d7029d6c7d5eff server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:09.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.503+0000 7f0fdf7fe700 1 -- 172.21.15.81:0/799748114 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff002c040 con 0x56446882ce90 2023-10-06T03:25:09.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.503+0000 7f0fdf7fe700 1 -- 172.21.15.81:0/799748114 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff002d040 con 0x56446882ce90 2023-10-06T03:25:09.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.503+0000 7f0fdf7fe700 1 -- 172.21.15.81:0/799748114 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff0019db0 con 0x56446882ce90 2023-10-06T03:25:09.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.504+0000 7f100a80bb80 1 -- 172.21.15.81:0/799748114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56446882ce90 msgr2=0x56446888a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:09.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.504+0000 7f100a80bb80 1 --2- 172.21.15.81:0/799748114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56446882ce90 0x56446888a370 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0006fd0 tx=0x7f0ff0019000 comp rx=0 tx=0).stop 2023-10-06T03:25:09.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.504+0000 7f100a80bb80 1 -- 172.21.15.81:0/799748114 shutdown_connections 2023-10-06T03:25:09.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.504+0000 7f100a80bb80 1 --2- 172.21.15.81:0/799748114 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x564468860350 0x56446887b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:09.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.504+0000 7f100a80bb80 1 --2- 172.21.15.81:0/799748114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56446882ce90 0x56446888a370 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:09.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.504+0000 7f100a80bb80 1 --2- 172.21.15.81:0/799748114 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564468832250 0x56446887b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:09.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.504+0000 7f100a80bb80 1 -- 172.21.15.81:0/799748114 >> 172.21.15.81:0/799748114 conn(0x564468831e80 msgr2=0x564468854190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:09.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.504+0000 7f100a80bb80 1 -- 172.21.15.81:0/799748114 shutdown_connections 2023-10-06T03:25:09.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.504+0000 7f100a80bb80 1 -- 172.21.15.81:0/799748114 wait complete. 2023-10-06T03:25:09.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.504+0000 7f100a80bb80 1 -- start start 2023-10-06T03:25:09.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.505+0000 7f100a80bb80 1 Processor -- start 2023-10-06T03:25:09.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.505+0000 7f100a80bb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56446882ce90 0x5644688ca0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:09.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.506+0000 7f100a80bb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564468832250 0x56446888c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:09.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.506+0000 7f100a80bb80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x564468860350 0x56446887a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:09.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.506+0000 7f100a80bb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644688e1890 con 0x56446882ce90 2023-10-06T03:25:09.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.506+0000 7f100a80bb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x56446887af00 con 0x564468832250 2023-10-06T03:25:09.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.506+0000 7f100a80bb80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x56446888c0e0 con 0x564468860350 2023-10-06T03:25:09.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.506+0000 7f100a80bb80 10 client.0 _ll_register_callbacks cb 0x5644687f4020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:25:09.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.506+0000 7f0ff9d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56446882ce90 0x5644688ca0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:09.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.506+0000 7f0ff9d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56446882ce90 0x5644688ca0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34920/0 (socket says 172.21.15.81:34920) 2023-10-06T03:25:09.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.506+0000 7f0ff9d9b700 1 -- 172.21.15.81:0/2238067995 learned_addr learned my addr 172.21.15.81:0/2238067995 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:09.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.506+0000 7f0ff9d9b700 1 -- 172.21.15.81:0/2238067995 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x564468860350 msgr2=0x56446887a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:09.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.506+0000 7f0ff9d9b700 1 --2- 172.21.15.81:0/2238067995 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x564468860350 0x56446887a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:09.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.506+0000 7f0ff959a700 1 --2- 172.21.15.81:0/2238067995 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564468832250 0x56446888c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:09.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.506+0000 7f0ff9d9b700 1 -- 172.21.15.81:0/2238067995 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564468832250 msgr2=0x56446888c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:09.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.506+0000 7f0ff9d9b700 1 --2- 172.21.15.81:0/2238067995 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564468832250 0x56446888c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:09.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.506+0000 7f0ff9d9b700 1 -- 172.21.15.81:0/2238067995 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff001f040 con 0x56446882ce90 2023-10-06T03:25:09.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.506+0000 7f0ff9d9b700 1 --2- 172.21.15.81:0/2238067995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56446882ce90 0x5644688ca0a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f0ff000d960 tx=0x7f0ff0036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2af474f70284e3c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:09.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.506+0000 7f0fd3fff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-06T03:25:09.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.507+0000 7f0fd3fff700 1 -- 172.21.15.81:0/2238067995 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff002c070 con 0x56446882ce90 2023-10-06T03:25:09.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.507+0000 7f0fd3fff700 1 -- 172.21.15.81:0/2238067995 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f0ff0014070 con 0x56446882ce90 2023-10-06T03:25:09.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.507+0000 7f100a80bb80 1 -- 172.21.15.81:0/2238067995 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0fe4057b20 con 0x56446882ce90 2023-10-06T03:25:09.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.507+0000 7f0fd3fff700 1 -- 172.21.15.81:0/2238067995 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ff0010b70 con 0x56446882ce90 2023-10-06T03:25:09.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.507+0000 7f100a80bb80 10 client.5379 fetch_fsmap learned FSMap version 27 2023-10-06T03:25:09.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.507+0000 7f100a80bb80 1 -- 172.21.15.81:0/2238067995 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0x564468736470 con 0x56446882ce90 2023-10-06T03:25:09.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.507+0000 7f0fd3fff700 1 -- 172.21.15.81:0/2238067995 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe4057b20 con 0x56446882ce90 2023-10-06T03:25:09.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.507+0000 7f0fd3fff700 1 -- 172.21.15.81:0/2238067995 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0ff003e030 con 0x56446882ce90 2023-10-06T03:25:09.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.507+0000 7f100a80bb80 10 client.5379 fetch_fsmap finished waiting for FSMap version 27 2023-10-06T03:25:09.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.507+0000 7f100a80bb80 10 client.5379 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T03:25:09.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.507+0000 7f100a80bb80 20 client.5379 populate_metadata read hostname 'smithi081' 2023-10-06T03:25:09.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.507+0000 7f100a80bb80 1 --2- 172.21.15.81:0/2238067995 >> [v2:172.21.15.81:6834/2219056136,v1:172.21.15.81:6835/2219056136] conn(0x56446888d1c0 0x56446888d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:09.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.507+0000 7f100a80bb80 4 client.5379 mds_command: new command op to 5322 tid=0[{"prefix": "status"}] 2023-10-06T03:25:09.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.507+0000 7f100a80bb80 1 -- 172.21.15.81:0/2238067995 --> [v2:172.21.15.81:6834/2219056136,v1:172.21.15.81:6835/2219056136] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564468723e00 con 0x56446888d1c0 2023-10-06T03:25:09.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.507+0000 7f0ff959a700 1 --2- 172.21.15.81:0/2238067995 >> [v2:172.21.15.81:6834/2219056136,v1:172.21.15.81:6835/2219056136] conn(0x56446888d1c0 0x56446888d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:09.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.508+0000 7f0ff959a700 1 --2- 172.21.15.81:0/2238067995 >> [v2:172.21.15.81:6834/2219056136,v1:172.21.15.81:6835/2219056136] conn(0x56446888d1c0 0x56446888d590 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abf42b1ea6a7cfe3 server_cookie=a2ad02540e365c56 in_seq=0 out_seq=0 2023-10-06T03:25:09.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.508+0000 7f0fd3fff700 10 client.5379 ms_handle_connect on v2:172.21.15.81:6834/2219056136 2023-10-06T03:25:09.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.508+0000 7f0fd3fff700 1 -- 172.21.15.81:0/2238067995 <== mds.0 v2:172.21.15.81:6834/2219056136 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x564468723e00 con 0x56446888d1c0 2023-10-06T03:25:09.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.508+0000 7f0fd3fff700 10 client.5379 handle_command_reply: tid=0 2023-10-06T03:25:09.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.508+0000 7f100a80bb80 1 client.5379 shutdown 2023-10-06T03:25:09.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.508+0000 7f100a80bb80 1 -- 172.21.15.81:0/2238067995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56446882ce90 msgr2=0x5644688ca0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:09.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.508+0000 7f100a80bb80 1 --2- 172.21.15.81:0/2238067995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56446882ce90 0x5644688ca0a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f0ff000d960 tx=0x7f0ff0036000 comp rx=0 tx=0).stop 2023-10-06T03:25:09.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.508+0000 7f100a80bb80 1 -- 172.21.15.81:0/2238067995 shutdown_connections 2023-10-06T03:25:09.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.508+0000 7f100a80bb80 1 --2- 172.21.15.81:0/2238067995 >> [v2:172.21.15.81:6834/2219056136,v1:172.21.15.81:6835/2219056136] conn(0x56446888d1c0 0x56446888d590 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:09.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.508+0000 7f100a80bb80 1 --2- 172.21.15.81:0/2238067995 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x564468860350 0x56446887a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:09.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.508+0000 7f100a80bb80 1 --2- 172.21.15.81:0/2238067995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56446882ce90 0x5644688ca0a0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:09.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.508+0000 7f100a80bb80 1 --2- 172.21.15.81:0/2238067995 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564468832250 0x56446888c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:09.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.508+0000 7f0fd3fff700 0 client.5379 ms_handle_reset on v2:172.21.15.81:6834/2219056136 2023-10-06T03:25:09.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.508+0000 7f100a80bb80 1 -- 172.21.15.81:0/2238067995 >> 172.21.15.81:0/2238067995 conn(0x564468831e80 msgr2=0x564468854190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:09.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.508+0000 7f100a80bb80 1 -- 172.21.15.81:0/2238067995 shutdown_connections 2023-10-06T03:25:09.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.508+0000 7f100a80bb80 1 -- 172.21.15.81:0/2238067995 wait complete. 2023-10-06T03:25:09.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.509+0000 7f100a80bb80 20 client.5379 trim_cache size 0 max 16384 2023-10-06T03:25:09.517 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T03:25:09.517 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "1807b5d7-9be8-43ad-aaf8-99a4273430b3", 2023-10-06T03:25:09.517 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2023-10-06T03:25:09.517 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 5322, 2023-10-06T03:25:09.517 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2023-10-06T03:25:09.517 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2023-10-06T03:25:09.517 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2023-10-06T03:25:09.517 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 4.8262489310000003, 2023-10-06T03:25:09.517 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 26, 2023-10-06T03:25:09.518 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 40, 2023-10-06T03:25:09.518 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 40, 2023-10-06T03:25:09.518 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 8.1109321879999996 2023-10-06T03:25:09.518 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T03:25:09.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.509+0000 7f0ffad9d700 1 -- 172.21.15.81:0/233741810 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0fd8066fb0 msgr2=0x7f0fd8069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:09.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.509+0000 7f0ffad9d700 1 --2- 172.21.15.81:0/233741810 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0fd8066fb0 0x7f0fd8069460 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0ff000bc50 tx=0x7f0ff001b000 comp rx=0 tx=0).stop 2023-10-06T03:25:09.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.509+0000 7f0ffad9d700 1 -- 172.21.15.81:0/233741810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ff40a6730 msgr2=0x7f0ff406a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:09.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.509+0000 7f0ffad9d700 1 --2- 172.21.15.81:0/233741810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ff40a6730 0x7f0ff406a490 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0fe400c7f0 tx=0x7f0fe4007f50 comp rx=0 tx=0).stop 2023-10-06T03:25:09.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.509+0000 7f0ffad9d700 1 -- 172.21.15.81:0/233741810 shutdown_connections 2023-10-06T03:25:09.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.509+0000 7f0ffad9d700 1 --2- 172.21.15.81:0/233741810 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0fd8066fb0 0x7f0fd8069460 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:09.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.509+0000 7f0ffad9d700 1 --2- 172.21.15.81:0/233741810 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ff4156220 0x7f0ff406a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:09.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.509+0000 7f0ffad9d700 1 --2- 172.21.15.81:0/233741810 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ff406eaf0 0x7f0ff4169560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:09.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.509+0000 7f0ffad9d700 1 --2- 172.21.15.81:0/233741810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ff40a6730 0x7f0ff406a490 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:09.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.509+0000 7f0ffad9d700 1 -- 172.21.15.81:0/233741810 >> 172.21.15.81:0/233741810 conn(0x7f0ff40cbef0 msgr2=0x7f0ff414f510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:09.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.509+0000 7f0ffad9d700 1 -- 172.21.15.81:0/233741810 shutdown_connections 2023-10-06T03:25:09.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:09.509+0000 7f0ffad9d700 1 -- 172.21.15.81:0/233741810 wait complete. 2023-10-06T03:25:09.528 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:25:09.528 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec cat /home/ubuntu/cephtest/mnt.0/file_on_fs_0) 2023-10-06T03:25:09.569 INFO:teuthology.orchestra.run.smithi081.stdout:0 2023-10-06T03:25:09.570 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T03:25:09.570 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:25:09.687 DEBUG:teuthology.orchestra.run.smithi083:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:25:09.775 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T03:25:09.775 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T03:25:09.775 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:25:09.775 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-06T03:25:09.856 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-10-06T03:25:09.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:09.857 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T03:25:09.893 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:25:10.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.112+0000 7fb0a15ff700 1 Processor -- start 2023-10-06T03:25:10.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.112+0000 7fb0a15ff700 1 -- start start 2023-10-06T03:25:10.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.113+0000 7fb0a15ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb09c13f9c0 0x7fb09c0ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:10.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.113+0000 7fb0a15ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb09c15a5c0 0x7fb09c0c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:10.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.114+0000 7fb0a15ff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb09c0cafe0 con 0x7fb09c0cab60 2023-10-06T03:25:10.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.114+0000 7fb0a15ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb09c0cb2c0 con 0x7fb09c15a5c0 2023-10-06T03:25:10.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.114+0000 7fb0a15ff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb09c0cb5a0 con 0x7fb09c13f9c0 2023-10-06T03:25:10.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.114+0000 7fb09a7fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb09c0cab60 0x7fb09c159eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53132/0 (socket says 172.21.15.81:53132) 2023-10-06T03:25:10.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.114+0000 7fb09a7fc700 1 -- 172.21.15.81:0/509572170 learned_addr learned my addr 172.21.15.81:0/509572170 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:25:10.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.114+0000 7fb09b7fe700 1 --2- 172.21.15.81:0/509572170 >> v2:172.21.15.81:3300/0 conn(0x7fb09c15a5c0 0x7fb09c0c6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:10.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.114+0000 7fb09affd700 1 --2- 172.21.15.81:0/509572170 >> v2:172.21.15.83:3300/0 conn(0x7fb09c13f9c0 0x7fb09c0ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:10.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.114+0000 7fb099ffb700 1 -- 172.21.15.81:0/509572170 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3598996680 0 0) 0x7fb09c0cafe0 con 0x7fb09c0cab60 2023-10-06T03:25:10.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.114+0000 7fb099ffb700 1 -- 172.21.15.81:0/509572170 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb084003570 con 0x7fb09c0cab60 2023-10-06T03:25:10.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.114+0000 7fb09b7fe700 1 -- 172.21.15.81:0/509572170 >> v2:172.21.15.83:3300/0 conn(0x7fb09c13f9c0 msgr2=0x7fb09c0ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:10.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.114+0000 7fb09b7fe700 1 --2- 172.21.15.81:0/509572170 >> v2:172.21.15.83:3300/0 conn(0x7fb09c13f9c0 0x7fb09c0ca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:10.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.114+0000 7fb09b7fe700 1 -- 172.21.15.81:0/509572170 >> v1:172.21.15.81:6789/0 conn(0x7fb09c0cab60 legacy=0x7fb09c159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:10.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.114+0000 7fb09b7fe700 1 -- 172.21.15.81:0/509572170 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb09c0cb880 con 0x7fb09c15a5c0 2023-10-06T03:25:10.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.115+0000 7fb09b7fe700 1 --2- 172.21.15.81:0/509572170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb09c15a5c0 0x7fb09c0c6ab0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb09c069010 tx=0x7fb094009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d7d8a7e042944cb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:10.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.115+0000 7fb099ffb700 1 -- 172.21.15.81:0/509572170 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09400e070 con 0x7fb09c15a5c0 2023-10-06T03:25:10.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.115+0000 7fb099ffb700 1 -- 172.21.15.81:0/509572170 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09400bab0 con 0x7fb09c15a5c0 2023-10-06T03:25:10.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.115+0000 7fb099ffb700 1 -- 172.21.15.81:0/509572170 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09400be70 con 0x7fb09c15a5c0 2023-10-06T03:25:10.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.115+0000 7fb0a15ff700 1 -- 172.21.15.81:0/509572170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb09c15a5c0 msgr2=0x7fb09c0c6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:10.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.115+0000 7fb0a15ff700 1 --2- 172.21.15.81:0/509572170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb09c15a5c0 0x7fb09c0c6ab0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb09c069010 tx=0x7fb094009780 comp rx=0 tx=0).stop 2023-10-06T03:25:10.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.115+0000 7fb0a15ff700 1 -- 172.21.15.81:0/509572170 shutdown_connections 2023-10-06T03:25:10.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.115+0000 7fb0a15ff700 1 --2- 172.21.15.81:0/509572170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb09c15a5c0 0x7fb09c0c6ab0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:10.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.115+0000 7fb0a15ff700 1 --2- 172.21.15.81:0/509572170 >> v2:172.21.15.83:3300/0 conn(0x7fb09c13f9c0 0x7fb09c0ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:10.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.116+0000 7fb0a15ff700 1 -- 172.21.15.81:0/509572170 >> 172.21.15.81:0/509572170 conn(0x7fb09c0cc090 msgr2=0x7fb09c0cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:10.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.116+0000 7fb0a15ff700 1 -- 172.21.15.81:0/509572170 shutdown_connections 2023-10-06T03:25:10.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.116+0000 7fb0a15ff700 1 -- 172.21.15.81:0/509572170 wait complete. 2023-10-06T03:25:10.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.117+0000 7fb0a15ff700 1 Processor -- start 2023-10-06T03:25:10.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.117+0000 7fb0a15ff700 1 -- start start 2023-10-06T03:25:10.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.118+0000 7fb0a15ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb09c13f9c0 0x7fb09c156140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:10.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.118+0000 7fb0a15ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb09c15a5c0 0x7fb09c0c1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:10.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.118+0000 7fb0a15ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb09c0c24f0 0x7fb09c0af060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:10.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.118+0000 7fb0a15ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb09c158600 con 0x7fb09c15a5c0 2023-10-06T03:25:10.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.118+0000 7fb0a15ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb09c0c2990 con 0x7fb09c13f9c0 2023-10-06T03:25:10.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.118+0000 7fb0a15ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb09c16c900 con 0x7fb09c0c24f0 2023-10-06T03:25:10.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.118+0000 7fb09a7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb09c15a5c0 0x7fb09c0c1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:10.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.118+0000 7fb09a7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb09c15a5c0 0x7fb09c0c1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36180/0 (socket says 172.21.15.81:36180) 2023-10-06T03:25:10.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.118+0000 7fb09a7fc700 1 -- 172.21.15.81:0/4067386310 learned_addr learned my addr 172.21.15.81:0/4067386310 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:10.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.118+0000 7fb09a7fc700 1 -- 172.21.15.81:0/4067386310 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb09c0c24f0 msgr2=0x7fb09c0af060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:10.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.118+0000 7fb09a7fc700 1 --2- 172.21.15.81:0/4067386310 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb09c0c24f0 0x7fb09c0af060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:10.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.118+0000 7fb09a7fc700 1 -- 172.21.15.81:0/4067386310 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb09c13f9c0 msgr2=0x7fb09c156140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:10.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.118+0000 7fb09a7fc700 1 --2- 172.21.15.81:0/4067386310 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb09c13f9c0 0x7fb09c156140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:10.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.118+0000 7fb09a7fc700 1 -- 172.21.15.81:0/4067386310 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb094009a20 con 0x7fb09c15a5c0 2023-10-06T03:25:10.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.119+0000 7fb09a7fc700 1 --2- 172.21.15.81:0/4067386310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb09c15a5c0 0x7fb09c0c1fb0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb09000c7c0 tx=0x7fb090007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:10.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.119+0000 7fb082ffd700 1 -- 172.21.15.81:0/4067386310 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb090005b30 con 0x7fb09c15a5c0 2023-10-06T03:25:10.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.119+0000 7fb082ffd700 1 -- 172.21.15.81:0/4067386310 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb090005c90 con 0x7fb09c15a5c0 2023-10-06T03:25:10.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.119+0000 7fb082ffd700 1 -- 172.21.15.81:0/4067386310 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb090007320 con 0x7fb09c15a5c0 2023-10-06T03:25:10.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.119+0000 7fb0a15ff700 1 -- 172.21.15.81:0/4067386310 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb09c16d480 con 0x7fb09c15a5c0 2023-10-06T03:25:10.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.119+0000 7fb0a15ff700 1 -- 172.21.15.81:0/4067386310 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb09c16ce30 con 0x7fb09c15a5c0 2023-10-06T03:25:10.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.120+0000 7fb0a15ff700 1 -- 172.21.15.81:0/4067386310 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb09c04c3c0 con 0x7fb09c15a5c0 2023-10-06T03:25:10.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.121+0000 7fb082ffd700 1 -- 172.21.15.81:0/4067386310 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb09001b400 con 0x7fb09c15a5c0 2023-10-06T03:25:10.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.124+0000 7fb082ffd700 1 --2- 172.21.15.81:0/4067386310 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb088066f30 0x7fb0880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:10.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.124+0000 7fb082ffd700 1 -- 172.21.15.81:0/4067386310 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fb0900842e0 con 0x7fb09c15a5c0 2023-10-06T03:25:10.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.124+0000 7fb09affd700 1 --2- 172.21.15.81:0/4067386310 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb088066f30 0x7fb0880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:10.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.124+0000 7fb09affd700 1 --2- 172.21.15.81:0/4067386310 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb088066f30 0x7fb0880693e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb09c166ef0 tx=0x7fb08c0091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:10.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.127+0000 7fb082ffd700 1 -- 172.21.15.81:0/4067386310 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb090051260 con 0x7fb09c15a5c0 2023-10-06T03:25:10.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.363+0000 7fb0a15ff700 1 -- 172.21.15.81:0/4067386310 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb09c16d610 con 0x7fb09c15a5c0 2023-10-06T03:25:10.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.364+0000 7fb082ffd700 1 -- 172.21.15.81:0/4067386310 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4594 (secure 0 0 0) 0x7fb090054880 con 0x7fb09c15a5c0 2023-10-06T03:25:10.366 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:25:10.366 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":27,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5065,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6834/822949628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":822949628},{"type":"v1","addr":"172.21.15.83:6834","nonce":822949628}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5068,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3024690603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6833","nonce":3024690603},{"type":"v1","addr":"172.21.15.83:6835","nonce":3024690603}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5074,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2638072815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2638072815},{"type":"v1","addr":"172.21.15.81:6837","nonce":2638072815}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:25:02.863416+0000","modified":"2023-10-06T03:25:07.689931+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5322":{"gid":5322,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6835/2219056136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2219056136},{"type":"v1","addr":"172.21.15.81:6835","nonce":2219056136}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":2}]} 2023-10-06T03:25:10.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.366+0000 7fb0a15ff700 1 -- 172.21.15.81:0/4067386310 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb088066f30 msgr2=0x7fb0880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:10.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.366+0000 7fb0a15ff700 1 --2- 172.21.15.81:0/4067386310 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb088066f30 0x7fb0880693e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb09c166ef0 tx=0x7fb08c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:10.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.366+0000 7fb0a15ff700 1 -- 172.21.15.81:0/4067386310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb09c15a5c0 msgr2=0x7fb09c0c1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:10.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.366+0000 7fb0a15ff700 1 --2- 172.21.15.81:0/4067386310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb09c15a5c0 0x7fb09c0c1fb0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb09000c7c0 tx=0x7fb090007e00 comp rx=0 tx=0).stop 2023-10-06T03:25:10.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.366+0000 7fb0a15ff700 1 -- 172.21.15.81:0/4067386310 shutdown_connections 2023-10-06T03:25:10.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.366+0000 7fb0a15ff700 1 --2- 172.21.15.81:0/4067386310 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb088066f30 0x7fb0880693e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:10.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.366+0000 7fb0a15ff700 1 --2- 172.21.15.81:0/4067386310 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb09c0c24f0 0x7fb09c0af060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:10.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.366+0000 7fb0a15ff700 1 --2- 172.21.15.81:0/4067386310 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb09c13f9c0 0x7fb09c156140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:10.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.366+0000 7fb0a15ff700 1 --2- 172.21.15.81:0/4067386310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb09c15a5c0 0x7fb09c0c1fb0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:10.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.366+0000 7fb0a15ff700 1 -- 172.21.15.81:0/4067386310 >> 172.21.15.81:0/4067386310 conn(0x7fb09c0cc090 msgr2=0x7fb09c0cc460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:10.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.366+0000 7fb0a15ff700 1 -- 172.21.15.81:0/4067386310 shutdown_connections 2023-10-06T03:25:10.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.366+0000 7fb0a15ff700 1 -- 172.21.15.81:0/4067386310 wait complete. 2023-10-06T03:25:10.370 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 27 2023-10-06T03:25:10.386 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:25:10.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.568+0000 7f6a5d19d700 1 Processor -- start 2023-10-06T03:25:10.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.568+0000 7f6a5d19d700 1 -- start start 2023-10-06T03:25:10.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.568+0000 7f6a5d19d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6a580ab7b0 0x7f6a58156910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:10.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.568+0000 7f6a5d19d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6a580ace00 0x7f6a580abb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:10.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.568+0000 7f6a5d19d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a580ac5f0 con 0x7f6a581594c0 2023-10-06T03:25:10.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.568+0000 7f6a5d19d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a580ae330 con 0x7f6a580ab7b0 2023-10-06T03:25:10.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.568+0000 7f6a5d19d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a58156e50 con 0x7f6a580ace00 2023-10-06T03:25:10.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.569+0000 7f6a57fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6a580ab7b0 0x7f6a58156910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:10.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.569+0000 7f6a5c99c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6a581594c0 0x7f6a581598d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53142/0 (socket says 172.21.15.81:53142) 2023-10-06T03:25:10.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.569+0000 7f6a5c99c700 1 -- 172.21.15.81:0/3501404082 learned_addr learned my addr 172.21.15.81:0/3501404082 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:25:10.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.569+0000 7f6a4ffff700 1 --2- 172.21.15.81:0/3501404082 >> v2:172.21.15.83:3300/0 conn(0x7f6a580ace00 0x7f6a580abb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:10.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.569+0000 7f6a577fe700 1 -- 172.21.15.81:0/3501404082 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2836948716 0 0) 0x7f6a580ac5f0 con 0x7f6a581594c0 2023-10-06T03:25:10.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.569+0000 7f6a57fff700 1 -- 172.21.15.81:0/3501404082 >> v2:172.21.15.83:3300/0 conn(0x7f6a580ace00 msgr2=0x7f6a580abb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:10.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.569+0000 7f6a57fff700 1 --2- 172.21.15.81:0/3501404082 >> v2:172.21.15.83:3300/0 conn(0x7f6a580ace00 0x7f6a580abb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:10.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.569+0000 7f6a57fff700 1 -- 172.21.15.81:0/3501404082 >> v1:172.21.15.81:6789/0 conn(0x7f6a581594c0 legacy=0x7f6a581598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:10.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.569+0000 7f6a57fff700 1 -- 172.21.15.81:0/3501404082 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a580ac0c0 con 0x7f6a580ab7b0 2023-10-06T03:25:10.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.569+0000 7f6a57fff700 1 --2- 172.21.15.81:0/3501404082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a580ab7b0 0x7f6a58156910 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f6a580cd000 tx=0x7f6a480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=572b7db4740cc7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:10.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.570+0000 7f6a577fe700 1 -- 172.21.15.81:0/3501404082 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4800b6b0 con 0x7f6a580ab7b0 2023-10-06T03:25:10.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.570+0000 7f6a577fe700 1 -- 172.21.15.81:0/3501404082 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a4800b810 con 0x7f6a580ab7b0 2023-10-06T03:25:10.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.570+0000 7f6a577fe700 1 -- 172.21.15.81:0/3501404082 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4800bbb0 con 0x7f6a580ab7b0 2023-10-06T03:25:10.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.570+0000 7f6a5d19d700 1 -- 172.21.15.81:0/3501404082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a580ab7b0 msgr2=0x7f6a58156910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:10.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.570+0000 7f6a5d19d700 1 --2- 172.21.15.81:0/3501404082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a580ab7b0 0x7f6a58156910 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f6a580cd000 tx=0x7f6a480091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:10.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.570+0000 7f6a5d19d700 1 -- 172.21.15.81:0/3501404082 shutdown_connections 2023-10-06T03:25:10.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.570+0000 7f6a5d19d700 1 --2- 172.21.15.81:0/3501404082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a580ab7b0 0x7f6a58156910 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:10.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.570+0000 7f6a5d19d700 1 --2- 172.21.15.81:0/3501404082 >> v2:172.21.15.83:3300/0 conn(0x7f6a580ace00 0x7f6a580abb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:10.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.570+0000 7f6a5d19d700 1 -- 172.21.15.81:0/3501404082 >> 172.21.15.81:0/3501404082 conn(0x7f6a580cbef0 msgr2=0x7f6a580cc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:10.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.570+0000 7f6a5d19d700 1 -- 172.21.15.81:0/3501404082 shutdown_connections 2023-10-06T03:25:10.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.570+0000 7f6a5d19d700 1 -- 172.21.15.81:0/3501404082 wait complete. 2023-10-06T03:25:10.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.572+0000 7f6a5d19d700 1 Processor -- start 2023-10-06T03:25:10.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.572+0000 7f6a5d19d700 1 -- start start 2023-10-06T03:25:10.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.573+0000 7f6a5d19d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6a580ab7b0 0x7f6a580ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:10.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.573+0000 7f6a5d19d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a580ace00 0x7f6a580a8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:10.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.573+0000 7f6a5d19d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a581594c0 0x7f6a58167bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:10.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.573+0000 7f6a5d19d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a580ca520 con 0x7f6a581594c0 2023-10-06T03:25:10.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.573+0000 7f6a5d19d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a580a8db0 con 0x7f6a580ace00 2023-10-06T03:25:10.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.573+0000 7f6a5d19d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a580c9910 con 0x7f6a580ab7b0 2023-10-06T03:25:10.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.573+0000 7f6a5c99c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a581594c0 0x7f6a58167bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:10.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.573+0000 7f6a5c99c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a581594c0 0x7f6a58167bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36196/0 (socket says 172.21.15.81:36196) 2023-10-06T03:25:10.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.573+0000 7f6a5c99c700 1 -- 172.21.15.81:0/3156311274 learned_addr learned my addr 172.21.15.81:0/3156311274 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:10.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.573+0000 7f6a4ffff700 1 --2- 172.21.15.81:0/3156311274 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a580ace00 0x7f6a580a8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:10.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.573+0000 7f6a57fff700 1 --2- 172.21.15.81:0/3156311274 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6a580ab7b0 0x7f6a580ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:10.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.573+0000 7f6a5c99c700 1 -- 172.21.15.81:0/3156311274 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6a580ab7b0 msgr2=0x7f6a580ca9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:10.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.573+0000 7f6a5c99c700 1 --2- 172.21.15.81:0/3156311274 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6a580ab7b0 0x7f6a580ca9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:10.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.573+0000 7f6a5c99c700 1 -- 172.21.15.81:0/3156311274 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a580ace00 msgr2=0x7f6a580a8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:10.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.573+0000 7f6a5c99c700 1 --2- 172.21.15.81:0/3156311274 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a580ace00 0x7f6a580a8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:10.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.573+0000 7f6a5c99c700 1 -- 172.21.15.81:0/3156311274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a48009420 con 0x7f6a581594c0 2023-10-06T03:25:10.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.574+0000 7f6a5c99c700 1 --2- 172.21.15.81:0/3156311274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a581594c0 0x7f6a58167bb0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f6a5000cc10 tx=0x7f6a50001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:10.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.574+0000 7f6a54ff9700 1 -- 172.21.15.81:0/3156311274 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5000a850 con 0x7f6a581594c0 2023-10-06T03:25:10.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.574+0000 7f6a54ff9700 1 -- 172.21.15.81:0/3156311274 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a5000a9d0 con 0x7f6a581594c0 2023-10-06T03:25:10.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.574+0000 7f6a5d19d700 1 -- 172.21.15.81:0/3156311274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a580c9bf0 con 0x7f6a581594c0 2023-10-06T03:25:10.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.574+0000 7f6a54ff9700 1 -- 172.21.15.81:0/3156311274 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5000ad90 con 0x7f6a581594c0 2023-10-06T03:25:10.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.574+0000 7f6a5d19d700 1 -- 172.21.15.81:0/3156311274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a580ca1b0 con 0x7f6a581594c0 2023-10-06T03:25:10.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.575+0000 7f6a5d19d700 1 -- 172.21.15.81:0/3156311274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a580ad290 con 0x7f6a581594c0 2023-10-06T03:25:10.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.576+0000 7f6a54ff9700 1 -- 172.21.15.81:0/3156311274 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6a50007300 con 0x7f6a581594c0 2023-10-06T03:25:10.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.577+0000 7f6a54ff9700 1 --2- 172.21.15.81:0/3156311274 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f6a38066f30 0x7f6a380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:10.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.577+0000 7f6a54ff9700 1 -- 172.21.15.81:0/3156311274 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f6a50084b50 con 0x7f6a581594c0 2023-10-06T03:25:10.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.577+0000 7f6a57fff700 1 --2- 172.21.15.81:0/3156311274 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f6a38066f30 0x7f6a380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:10.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.578+0000 7f6a57fff700 1 --2- 172.21.15.81:0/3156311274 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f6a38066f30 0x7f6a380693e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6a480093f0 tx=0x7f6a48017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:10.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.581+0000 7f6a54ff9700 1 -- 172.21.15.81:0/3156311274 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a50051a40 con 0x7f6a581594c0 2023-10-06T03:25:10.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.774+0000 7f6a5d19d700 1 -- 172.21.15.81:0/3156311274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a5804bb80 con 0x7f6a581594c0 2023-10-06T03:25:10.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.775+0000 7f6a54ff9700 1 -- 172.21.15.81:0/3156311274 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+17152 (secure 0 0 0) 0x7f6a50055060 con 0x7f6a581594c0 2023-10-06T03:25:10.777 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:25:10.778 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":40,"fsid":"1807b5d7-9be8-43ad-aaf8-99a4273430b3","created":"2023-10-06T03:23:20.805306+0000","modified":"2023-10-06T03:25:02.863295+0000","last_up_change":"2023-10-06T03:23:32.735796+0000","last_in_change":"2023-10-06T03:23:24.109024+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:33.198850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:33.606744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:24:50.339463+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T03:24:51.333980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"14fb667d-a677-4978-a477-80027f889d36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":85563},{"type":"v1","addr":"172.21.15.81:6818","nonce":85563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":85563},{"type":"v1","addr":"172.21.15.81:6822","nonce":85563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":85563},{"type":"v1","addr":"172.21.15.81:6830","nonce":85563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":85563},{"type":"v1","addr":"172.21.15.81:6826","nonce":85563}]},"public_addr":"172.21.15.81:6818/85563","cluster_addr":"172.21.15.81:6822/85563","heartbeat_back_addr":"172.21.15.81:6830/85563","heartbeat_front_addr":"172.21.15.81:6826/85563","state":["exists","up"]},{"osd":1,"uuid":"974d8a86-1829-4176-89ce-18e6038857f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":85561},{"type":"v1","addr":"172.21.15.81:6801","nonce":85561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":85561},{"type":"v1","addr":"172.21.15.81:6803","nonce":85561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":85561},{"type":"v1","addr":"172.21.15.81:6807","nonce":85561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":85561},{"type":"v1","addr":"172.21.15.81:6805","nonce":85561}]},"public_addr":"172.21.15.81:6801/85561","cluster_addr":"172.21.15.81:6803/85561","heartbeat_back_addr":"172.21.15.81:6807/85561","heartbeat_front_addr":"172.21.15.81:6805/85561","state":["exists","up"]},{"osd":2,"uuid":"ffbfe056-46bc-46e0-bf49-4d8f8650e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":85564},{"type":"v1","addr":"172.21.15.81:6809","nonce":85564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":85564},{"type":"v1","addr":"172.21.15.81:6811","nonce":85564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":85564},{"type":"v1","addr":"172.21.15.81:6815","nonce":85564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":85564},{"type":"v1","addr":"172.21.15.81:6813","nonce":85564}]},"public_addr":"172.21.15.81:6809/85564","cluster_addr":"172.21.15.81:6811/85564","heartbeat_back_addr":"172.21.15.81:6815/85564","heartbeat_front_addr":"172.21.15.81:6813/85564","state":["exists","up"]},{"osd":3,"uuid":"ef9a8314-3d37-4ea1-858a-e704d5695002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":85562},{"type":"v1","addr":"172.21.15.81:6819","nonce":85562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":85562},{"type":"v1","addr":"172.21.15.81:6823","nonce":85562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":85562},{"type":"v1","addr":"172.21.15.81:6831","nonce":85562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":85562},{"type":"v1","addr":"172.21.15.81:6827","nonce":85562}]},"public_addr":"172.21.15.81:6819/85562","cluster_addr":"172.21.15.81:6823/85562","heartbeat_back_addr":"172.21.15.81:6831/85562","heartbeat_front_addr":"172.21.15.81:6827/85562","state":["exists","up"]},{"osd":4,"uuid":"d83506a0-2c96-4bcb-a9fa-05e43dc329df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":85785},{"type":"v1","addr":"172.21.15.83:6801","nonce":85785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":85785},{"type":"v1","addr":"172.21.15.83:6803","nonce":85785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":85785},{"type":"v1","addr":"172.21.15.83:6807","nonce":85785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":85785},{"type":"v1","addr":"172.21.15.83:6805","nonce":85785}]},"public_addr":"172.21.15.83:6801/85785","cluster_addr":"172.21.15.83:6803/85785","heartbeat_back_addr":"172.21.15.83:6807/85785","heartbeat_front_addr":"172.21.15.83:6805/85785","state":["exists","up"]},{"osd":5,"uuid":"10687c63-a3d5-472f-acc0-4f61847b6e0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":85818},{"type":"v1","addr":"172.21.15.83:6825","nonce":85818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":85818},{"type":"v1","addr":"172.21.15.83:6827","nonce":85818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":85818},{"type":"v1","addr":"172.21.15.83:6831","nonce":85818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":85818},{"type":"v1","addr":"172.21.15.83:6829","nonce":85818}]},"public_addr":"172.21.15.83:6825/85818","cluster_addr":"172.21.15.83:6827/85818","heartbeat_back_addr":"172.21.15.83:6831/85818","heartbeat_front_addr":"172.21.15.83:6829/85818","state":["exists","up"]},{"osd":6,"uuid":"2e9daf76-5607-4a29-9a58-6e270700d223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":85787},{"type":"v1","addr":"172.21.15.83:6811","nonce":85787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":85787},{"type":"v1","addr":"172.21.15.83:6815","nonce":85787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":85787},{"type":"v1","addr":"172.21.15.83:6823","nonce":85787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6817","nonce":85787},{"type":"v1","addr":"172.21.15.83:6819","nonce":85787}]},"public_addr":"172.21.15.83:6811/85787","cluster_addr":"172.21.15.83:6815/85787","heartbeat_back_addr":"172.21.15.83:6823/85787","heartbeat_front_addr":"172.21.15.83:6819/85787","state":["exists","up"]},{"osd":7,"uuid":"5019e1ff-233a-4a5a-91ca-8afccb7ab6e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":85786},{"type":"v1","addr":"172.21.15.83:6810","nonce":85786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":85786},{"type":"v1","addr":"172.21.15.83:6814","nonce":85786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":85786},{"type":"v1","addr":"172.21.15.83:6822","nonce":85786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":85786},{"type":"v1","addr":"172.21.15.83:6818","nonce":85786}]},"public_addr":"172.21.15.83:6810/85786","cluster_addr":"172.21.15.83:6814/85786","heartbeat_back_addr":"172.21.15.83:6822/85786","heartbeat_front_addr":"172.21.15.83:6818/85786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.393431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.360031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.407428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.391613+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.403211+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.438142+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.496181+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.472323+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6835/2789471208":"2023-10-07T03:25:01.347009+0000","172.21.15.81:6834/2789471208":"2023-10-07T03:25:01.347009+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:25:10.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.777+0000 7f6a5d19d700 1 -- 172.21.15.81:0/3156311274 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f6a38066f30 msgr2=0x7f6a380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:10.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.777+0000 7f6a5d19d700 1 --2- 172.21.15.81:0/3156311274 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f6a38066f30 0x7f6a380693e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6a480093f0 tx=0x7f6a48017000 comp rx=0 tx=0).stop 2023-10-06T03:25:10.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.778+0000 7f6a5d19d700 1 -- 172.21.15.81:0/3156311274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a581594c0 msgr2=0x7f6a58167bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:10.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.778+0000 7f6a5d19d700 1 --2- 172.21.15.81:0/3156311274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a581594c0 0x7f6a58167bb0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f6a5000cc10 tx=0x7f6a50001970 comp rx=0 tx=0).stop 2023-10-06T03:25:10.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.778+0000 7f6a5d19d700 1 -- 172.21.15.81:0/3156311274 shutdown_connections 2023-10-06T03:25:10.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.778+0000 7f6a5d19d700 1 --2- 172.21.15.81:0/3156311274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a581594c0 0x7f6a58167bb0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:10.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.778+0000 7f6a5d19d700 1 --2- 172.21.15.81:0/3156311274 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f6a38066f30 0x7f6a380693e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:10.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.778+0000 7f6a5d19d700 1 --2- 172.21.15.81:0/3156311274 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6a580ab7b0 0x7f6a580ca9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:10.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.778+0000 7f6a5d19d700 1 --2- 172.21.15.81:0/3156311274 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a580ace00 0x7f6a580a8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:10.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.778+0000 7f6a5d19d700 1 -- 172.21.15.81:0/3156311274 >> 172.21.15.81:0/3156311274 conn(0x7f6a580cbef0 msgr2=0x7f6a58155770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:10.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.778+0000 7f6a5d19d700 1 -- 172.21.15.81:0/3156311274 shutdown_connections 2023-10-06T03:25:10.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.778+0000 7f6a5d19d700 1 -- 172.21.15.81:0/3156311274 wait complete. 2023-10-06T03:25:10.798 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:23:33.198850+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:23:33.606744+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:24:50.339463+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:24:51.333980+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:25:10.798 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:25:10.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.981+0000 7fb72359e700 1 Processor -- start 2023-10-06T03:25:10.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.981+0000 7fb72359e700 1 -- start start 2023-10-06T03:25:10.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.982+0000 7fb72359e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb72415ded0 0x7fb72406b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:10.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.982+0000 7fb72359e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb72406acb0 con 0x7fb7241594a0 2023-10-06T03:25:10.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.982+0000 7fb72359e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7240ca0e0 con 0x7fb724159870 2023-10-06T03:25:10.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.982+0000 7fb72359e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb72406b680 con 0x7fb72415ded0 2023-10-06T03:25:10.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.982+0000 7fb71bfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb72415ded0 0x7fb72406b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:10.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.982+0000 7fb72259c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb7241594a0 0x7fb7240c99d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53158/0 (socket says 172.21.15.81:53158) 2023-10-06T03:25:10.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.982+0000 7fb72259c700 1 -- 172.21.15.81:0/702424668 learned_addr learned my addr 172.21.15.81:0/702424668 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:25:10.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.983+0000 7fb721d9b700 1 -- 172.21.15.81:0/702424668 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 975477692 0 0) 0x7fb72406acb0 con 0x7fb7241594a0 2023-10-06T03:25:10.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.983+0000 7fb721d9b700 1 -- 172.21.15.81:0/702424668 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb710003570 con 0x7fb7241594a0 2023-10-06T03:25:10.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.983+0000 7fb71bfff700 1 -- 172.21.15.81:0/702424668 >> v1:172.21.15.83:6789/0 conn(0x7fb724159870 legacy=0x7fb7240c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:10.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.983+0000 7fb71bfff700 1 -- 172.21.15.81:0/702424668 >> v1:172.21.15.81:6789/0 conn(0x7fb7241594a0 legacy=0x7fb7240c99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:10.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.983+0000 7fb71bfff700 1 -- 172.21.15.81:0/702424668 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb72406a3c0 con 0x7fb72415ded0 2023-10-06T03:25:10.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.983+0000 7fb71bfff700 1 --2- 172.21.15.81:0/702424668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb72415ded0 0x7fb72406b140 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb70c0098e0 tx=0x7fb70c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd7370caf619dee9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:10.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.983+0000 7fb721d9b700 1 -- 172.21.15.81:0/702424668 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70c00b640 con 0x7fb72415ded0 2023-10-06T03:25:10.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.983+0000 7fb721d9b700 1 -- 172.21.15.81:0/702424668 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70c00b7a0 con 0x7fb72415ded0 2023-10-06T03:25:10.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.983+0000 7fb721d9b700 1 -- 172.21.15.81:0/702424668 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70c00bb40 con 0x7fb72415ded0 2023-10-06T03:25:10.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.984+0000 7fb72359e700 1 -- 172.21.15.81:0/702424668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb72415ded0 msgr2=0x7fb72406b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:10.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.984+0000 7fb72359e700 1 --2- 172.21.15.81:0/702424668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb72415ded0 0x7fb72406b140 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb70c0098e0 tx=0x7fb70c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:10.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.984+0000 7fb72359e700 1 -- 172.21.15.81:0/702424668 shutdown_connections 2023-10-06T03:25:10.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.984+0000 7fb72359e700 1 --2- 172.21.15.81:0/702424668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb72415ded0 0x7fb72406b140 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:10.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.984+0000 7fb72359e700 1 -- 172.21.15.81:0/702424668 >> 172.21.15.81:0/702424668 conn(0x7fb7240686f0 msgr2=0x7fb724068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:10.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.984+0000 7fb72359e700 1 -- 172.21.15.81:0/702424668 shutdown_connections 2023-10-06T03:25:10.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.984+0000 7fb72359e700 1 -- 172.21.15.81:0/702424668 wait complete. 2023-10-06T03:25:10.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.985+0000 7fb72359e700 1 Processor -- start 2023-10-06T03:25:10.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.986+0000 7fb72359e700 1 -- start start 2023-10-06T03:25:10.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.986+0000 7fb72359e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb7241594a0 0x7fb724169f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:10.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.986+0000 7fb72359e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb724159870 0x7fb7240cb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:10.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.986+0000 7fb72359e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb72415ded0 0x7fb7240b1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:10.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.986+0000 7fb72359e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7240c4a70 con 0x7fb72415ded0 2023-10-06T03:25:10.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.986+0000 7fb72359e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7240c4160 con 0x7fb724159870 2023-10-06T03:25:10.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.986+0000 7fb72359e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7240c4420 con 0x7fb7241594a0 2023-10-06T03:25:10.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.987+0000 7fb722d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb72415ded0 0x7fb7240b1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:10.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.987+0000 7fb722d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb72415ded0 0x7fb7240b1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36208/0 (socket says 172.21.15.81:36208) 2023-10-06T03:25:10.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.987+0000 7fb722d9d700 1 -- 172.21.15.81:0/3777445344 learned_addr learned my addr 172.21.15.81:0/3777445344 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:10.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.987+0000 7fb722d9d700 1 -- 172.21.15.81:0/3777445344 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb7241594a0 msgr2=0x7fb724169f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:10.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.987+0000 7fb722d9d700 1 --2- 172.21.15.81:0/3777445344 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb7241594a0 0x7fb724169f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:10.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.987+0000 7fb722d9d700 1 -- 172.21.15.81:0/3777445344 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb724159870 msgr2=0x7fb7240cb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:10.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.987+0000 7fb722d9d700 1 --2- 172.21.15.81:0/3777445344 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb724159870 0x7fb7240cb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:10.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.987+0000 7fb722d9d700 1 -- 172.21.15.81:0/3777445344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb70c009420 con 0x7fb72415ded0 2023-10-06T03:25:10.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.987+0000 7fb722d9d700 1 --2- 172.21.15.81:0/3777445344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb72415ded0 0x7fb7240b1e50 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fb71c00c8e0 tx=0x7fb71c001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:10.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.987+0000 7fb71a7fc700 1 -- 172.21.15.81:0/3777445344 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71c00ce80 con 0x7fb72415ded0 2023-10-06T03:25:10.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.988+0000 7fb71a7fc700 1 -- 172.21.15.81:0/3777445344 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb71c00a7e0 con 0x7fb72415ded0 2023-10-06T03:25:10.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.988+0000 7fb71a7fc700 1 -- 172.21.15.81:0/3777445344 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71c00ab80 con 0x7fb72415ded0 2023-10-06T03:25:10.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.988+0000 7fb72359e700 1 -- 172.21.15.81:0/3777445344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7240c4700 con 0x7fb72415ded0 2023-10-06T03:25:10.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.988+0000 7fb72359e700 1 -- 172.21.15.81:0/3777445344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb72416a520 con 0x7fb72415ded0 2023-10-06T03:25:10.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.988+0000 7fb72359e700 1 -- 172.21.15.81:0/3777445344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb72404c3c0 con 0x7fb72415ded0 2023-10-06T03:25:10.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.989+0000 7fb71a7fc700 1 -- 172.21.15.81:0/3777445344 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb71c012420 con 0x7fb72415ded0 2023-10-06T03:25:10.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.990+0000 7fb71a7fc700 1 --2- 172.21.15.81:0/3777445344 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb704066f30 0x7fb7040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:10.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.990+0000 7fb71a7fc700 1 -- 172.21.15.81:0/3777445344 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fb71c084b90 con 0x7fb72415ded0 2023-10-06T03:25:10.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.990+0000 7fb72259c700 1 --2- 172.21.15.81:0/3777445344 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb704066f30 0x7fb7040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:10.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.991+0000 7fb72259c700 1 --2- 172.21.15.81:0/3777445344 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb704066f30 0x7fb7040693e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb7140058d0 tx=0x7fb7140079d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:10.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:10.996+0000 7fb71a7fc700 1 -- 172.21.15.81:0/3777445344 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb71c051a90 con 0x7fb72415ded0 2023-10-06T03:25:11.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.186+0000 7fb72359e700 1 -- 172.21.15.81:0/3777445344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb7240c4bb0 con 0x7fb72415ded0 2023-10-06T03:25:11.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.186+0000 7fb71a7fc700 1 -- 172.21.15.81:0/3777445344 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v40) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb71c0550b0 con 0x7fb72415ded0 2023-10-06T03:25:11.189 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-10-06T03:25:11.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.189+0000 7fb72359e700 1 -- 172.21.15.81:0/3777445344 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb704066f30 msgr2=0x7fb7040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:11.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.189+0000 7fb72359e700 1 --2- 172.21.15.81:0/3777445344 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb704066f30 0x7fb7040693e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb7140058d0 tx=0x7fb7140079d0 comp rx=0 tx=0).stop 2023-10-06T03:25:11.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.189+0000 7fb72359e700 1 -- 172.21.15.81:0/3777445344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb72415ded0 msgr2=0x7fb7240b1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:11.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.189+0000 7fb72359e700 1 --2- 172.21.15.81:0/3777445344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb72415ded0 0x7fb7240b1e50 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fb71c00c8e0 tx=0x7fb71c001710 comp rx=0 tx=0).stop 2023-10-06T03:25:11.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.189+0000 7fb72359e700 1 -- 172.21.15.81:0/3777445344 shutdown_connections 2023-10-06T03:25:11.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.189+0000 7fb72359e700 1 --2- 172.21.15.81:0/3777445344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb72415ded0 0x7fb7240b1e50 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:11.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.189+0000 7fb72359e700 1 --2- 172.21.15.81:0/3777445344 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb704066f30 0x7fb7040693e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:11.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.189+0000 7fb72359e700 1 --2- 172.21.15.81:0/3777445344 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb7241594a0 0x7fb724169f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:11.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.189+0000 7fb72359e700 1 --2- 172.21.15.81:0/3777445344 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb724159870 0x7fb7240cb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:11.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.189+0000 7fb72359e700 1 -- 172.21.15.81:0/3777445344 >> 172.21.15.81:0/3777445344 conn(0x7fb7240686f0 msgr2=0x7fb72415c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:11.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.189+0000 7fb72359e700 1 -- 172.21.15.81:0/3777445344 shutdown_connections 2023-10-06T03:25:11.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.189+0000 7fb72359e700 1 -- 172.21.15.81:0/3777445344 wait complete. 2023-10-06T03:25:11.209 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:25:11.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.391+0000 7fbd84fff700 1 Processor -- start 2023-10-06T03:25:11.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.391+0000 7fbd84fff700 1 -- start start 2023-10-06T03:25:11.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.393+0000 7fbd84fff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fbd80159a60 0x7fbd8006af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:11.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.393+0000 7fbd84fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbd8006b4d0 0x7fbd800ca520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:11.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.393+0000 7fbd84fff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd8006ab00 con 0x7fbd80159e30 2023-10-06T03:25:11.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.393+0000 7fbd84fff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd80069ef0 con 0x7fbd8006b4d0 2023-10-06T03:25:11.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.393+0000 7fbd84fff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd8006a1d0 con 0x7fbd80159a60 2023-10-06T03:25:11.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.393+0000 7fbd77fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbd8006b4d0 0x7fbd800ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:11.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.393+0000 7fbd77fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbd8006b4d0 0x7fbd800ca520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36218/0 (socket says 172.21.15.81:36218) 2023-10-06T03:25:11.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.393+0000 7fbd77fff700 1 -- 172.21.15.81:0/617615325 learned_addr learned my addr 172.21.15.81:0/617615325 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:11.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.393+0000 7fbd7e59c700 1 --2- 172.21.15.81:0/617615325 >> v2:172.21.15.83:3300/0 conn(0x7fbd80159a60 0x7fbd8006af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:11.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.393+0000 7fbd77fff700 1 -- 172.21.15.81:0/617615325 >> v2:172.21.15.83:3300/0 conn(0x7fbd80159a60 msgr2=0x7fbd8006af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:11.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.393+0000 7fbd77fff700 1 --2- 172.21.15.81:0/617615325 >> v2:172.21.15.83:3300/0 conn(0x7fbd80159a60 0x7fbd8006af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:11.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.393+0000 7fbd77fff700 1 -- 172.21.15.81:0/617615325 >> v1:172.21.15.83:6789/0 conn(0x7fbd80159e30 legacy=0x7fbd80155650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:11.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.393+0000 7fbd77fff700 1 -- 172.21.15.81:0/617615325 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd8006a4b0 con 0x7fbd8006b4d0 2023-10-06T03:25:11.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.394+0000 7fbd77fff700 1 --2- 172.21.15.81:0/617615325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd8006b4d0 0x7fbd800ca520 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fbd80065090 tx=0x7fbd68009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=474e0cb38d10d620 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:11.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.394+0000 7fbd7dd9b700 1 -- 172.21.15.81:0/617615325 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6800b7e0 con 0x7fbd8006b4d0 2023-10-06T03:25:11.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.394+0000 7fbd7dd9b700 1 -- 172.21.15.81:0/617615325 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd6800b940 con 0x7fbd8006b4d0 2023-10-06T03:25:11.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.394+0000 7fbd7dd9b700 1 -- 172.21.15.81:0/617615325 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6800bce0 con 0x7fbd8006b4d0 2023-10-06T03:25:11.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.394+0000 7fbd84fff700 1 -- 172.21.15.81:0/617615325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd8006b4d0 msgr2=0x7fbd800ca520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:11.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.394+0000 7fbd84fff700 1 --2- 172.21.15.81:0/617615325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd8006b4d0 0x7fbd800ca520 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fbd80065090 tx=0x7fbd68009250 comp rx=0 tx=0).stop 2023-10-06T03:25:11.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.394+0000 7fbd84fff700 1 -- 172.21.15.81:0/617615325 shutdown_connections 2023-10-06T03:25:11.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.394+0000 7fbd84fff700 1 --2- 172.21.15.81:0/617615325 >> v2:172.21.15.83:3300/0 conn(0x7fbd80159a60 0x7fbd8006af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:11.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.394+0000 7fbd84fff700 1 --2- 172.21.15.81:0/617615325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd8006b4d0 0x7fbd800ca520 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:11.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.394+0000 7fbd84fff700 1 -- 172.21.15.81:0/617615325 >> 172.21.15.81:0/617615325 conn(0x7fbd800cc090 msgr2=0x7fbd800cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:11.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.395+0000 7fbd84fff700 1 -- 172.21.15.81:0/617615325 shutdown_connections 2023-10-06T03:25:11.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.395+0000 7fbd84fff700 1 -- 172.21.15.81:0/617615325 wait complete. 2023-10-06T03:25:11.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.396+0000 7fbd84fff700 1 Processor -- start 2023-10-06T03:25:11.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.396+0000 7fbd84fff700 1 -- start start 2023-10-06T03:25:11.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.397+0000 7fbd84fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd8006b4d0 0x7fbd800c1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:11.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.397+0000 7fbd84fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd80159a60 0x7fbd80169030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:11.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.397+0000 7fbd84fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd80159e30 0x7fbd800ac920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:11.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.397+0000 7fbd84fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd801688c0 con 0x7fbd80159a60 2023-10-06T03:25:11.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.397+0000 7fbd84fff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd80165b50 con 0x7fbd8006b4d0 2023-10-06T03:25:11.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.397+0000 7fbd84fff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd80165e30 con 0x7fbd80159e30 2023-10-06T03:25:11.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.397+0000 7fbd77fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd80159a60 0x7fbd80169030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:11.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.397+0000 7fbd77fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd80159a60 0x7fbd80169030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36222/0 (socket says 172.21.15.81:36222) 2023-10-06T03:25:11.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.397+0000 7fbd77fff700 1 -- 172.21.15.81:0/3345124474 learned_addr learned my addr 172.21.15.81:0/3345124474 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:11.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.397+0000 7fbd77fff700 1 -- 172.21.15.81:0/3345124474 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd80159e30 msgr2=0x7fbd800ac920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:11.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.397+0000 7fbd77fff700 1 --2- 172.21.15.81:0/3345124474 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd80159e30 0x7fbd800ac920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:11.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.398+0000 7fbd77fff700 1 -- 172.21.15.81:0/3345124474 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd8006b4d0 msgr2=0x7fbd800c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:11.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.398+0000 7fbd77fff700 1 --2- 172.21.15.81:0/3345124474 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd8006b4d0 0x7fbd800c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:11.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.398+0000 7fbd77fff700 1 -- 172.21.15.81:0/3345124474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd680094f0 con 0x7fbd80159a60 2023-10-06T03:25:11.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.398+0000 7fbd77fff700 1 --2- 172.21.15.81:0/3345124474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd80159a60 0x7fbd80169030 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fbd680030c0 tx=0x7fbd68016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:11.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.398+0000 7fbd767fc700 1 -- 172.21.15.81:0/3345124474 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd68006bc0 con 0x7fbd80159a60 2023-10-06T03:25:11.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.398+0000 7fbd767fc700 1 -- 172.21.15.81:0/3345124474 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd68020070 con 0x7fbd80159a60 2023-10-06T03:25:11.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.398+0000 7fbd84fff700 1 -- 172.21.15.81:0/3345124474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd80166110 con 0x7fbd80159a60 2023-10-06T03:25:11.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.398+0000 7fbd767fc700 1 -- 172.21.15.81:0/3345124474 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6801b450 con 0x7fbd80159a60 2023-10-06T03:25:11.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.398+0000 7fbd84fff700 1 -- 172.21.15.81:0/3345124474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd800c1d90 con 0x7fbd80159a60 2023-10-06T03:25:11.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.399+0000 7fbd84fff700 1 -- 172.21.15.81:0/3345124474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd801662a0 con 0x7fbd80159a60 2023-10-06T03:25:11.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.400+0000 7fbd767fc700 1 -- 172.21.15.81:0/3345124474 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbd68022030 con 0x7fbd80159a60 2023-10-06T03:25:11.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.401+0000 7fbd767fc700 1 --2- 172.21.15.81:0/3345124474 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fbd60066f30 0x7fbd600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:11.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.401+0000 7fbd767fc700 1 -- 172.21.15.81:0/3345124474 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fbd68086680 con 0x7fbd80159a60 2023-10-06T03:25:11.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.401+0000 7fbd7e59c700 1 --2- 172.21.15.81:0/3345124474 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fbd60066f30 0x7fbd600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:11.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.402+0000 7fbd7e59c700 1 --2- 172.21.15.81:0/3345124474 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fbd60066f30 0x7fbd600693e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbd70009a40 tx=0x7fbd70008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:11.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.405+0000 7fbd767fc700 1 -- 172.21.15.81:0/3345124474 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbd68053600 con 0x7fbd80159a60 2023-10-06T03:25:11.571 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:25:11.576 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:25:11.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.598+0000 7fbd84fff700 1 -- 172.21.15.81:0/3345124474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbd801662a0 con 0x7fbd80159a60 2023-10-06T03:25:11.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.598+0000 7fbd767fc700 1 -- 172.21.15.81:0/3345124474 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbd68056c20 con 0x7fbd80159a60 2023-10-06T03:25:11.599 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-06T03:25:11.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.600+0000 7fbd84fff700 1 -- 172.21.15.81:0/3345124474 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fbd60066f30 msgr2=0x7fbd600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:11.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.600+0000 7fbd84fff700 1 --2- 172.21.15.81:0/3345124474 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fbd60066f30 0x7fbd600693e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbd70009a40 tx=0x7fbd70008040 comp rx=0 tx=0).stop 2023-10-06T03:25:11.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.600+0000 7fbd84fff700 1 -- 172.21.15.81:0/3345124474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd80159a60 msgr2=0x7fbd80169030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:11.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.600+0000 7fbd84fff700 1 --2- 172.21.15.81:0/3345124474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd80159a60 0x7fbd80169030 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fbd680030c0 tx=0x7fbd68016000 comp rx=0 tx=0).stop 2023-10-06T03:25:11.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.601+0000 7fbd84fff700 1 -- 172.21.15.81:0/3345124474 shutdown_connections 2023-10-06T03:25:11.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.601+0000 7fbd84fff700 1 --2- 172.21.15.81:0/3345124474 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fbd60066f30 0x7fbd600693e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:11.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.601+0000 7fbd84fff700 1 --2- 172.21.15.81:0/3345124474 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd80159e30 0x7fbd800ac920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:11.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.601+0000 7fbd84fff700 1 --2- 172.21.15.81:0/3345124474 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd8006b4d0 0x7fbd800c1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:11.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.601+0000 7fbd84fff700 1 --2- 172.21.15.81:0/3345124474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd80159a60 0x7fbd80169030 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:11.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.601+0000 7fbd84fff700 1 -- 172.21.15.81:0/3345124474 >> 172.21.15.81:0/3345124474 conn(0x7fbd800cc090 msgr2=0x7fbd800c0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:11.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.601+0000 7fbd84fff700 1 -- 172.21.15.81:0/3345124474 shutdown_connections 2023-10-06T03:25:11.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.601+0000 7fbd84fff700 1 -- 172.21.15.81:0/3345124474 wait complete. 2023-10-06T03:25:11.621 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:25:11.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.845+0000 7fbd911ff700 1 Processor -- start 2023-10-06T03:25:12.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.845+0000 7fbd911ff700 1 -- start start 2023-10-06T03:25:12.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.846+0000 7fbd911ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fbd8c0695c0 0x7fbd8c159a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:12.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.847+0000 7fbd911ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd8c0ca520 0x7fbd8c0ca9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:12.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.847+0000 7fbd911ff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd8c06ab00 con 0x7fbd8c069990 2023-10-06T03:25:12.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.847+0000 7fbd911ff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd8c069ef0 con 0x7fbd8c0695c0 2023-10-06T03:25:12.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.847+0000 7fbd911ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8c06a1d0 con 0x7fbd8c0ca520 2023-10-06T03:25:12.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.847+0000 7fbd8ad9d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fbd8c0695c0 0x7fbd8c159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:12.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.847+0000 7fbd8b59e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd8c0ca520 0x7fbd8c0ca9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:12.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.847+0000 7fbd8ad9d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fbd8c0695c0 0x7fbd8c159a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:41466/0 (socket says 172.21.15.81:41466) 2023-10-06T03:25:12.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.847+0000 7fbd8ad9d700 1 -- 172.21.15.81:0/2974085719 learned_addr learned my addr 172.21.15.81:0/2974085719 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:12.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.848+0000 7fbd8ad9d700 1 -- 172.21.15.81:0/2974085719 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd8c0ca520 msgr2=0x7fbd8c0ca9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:12.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.848+0000 7fbd8ad9d700 1 --2- 172.21.15.81:0/2974085719 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd8c0ca520 0x7fbd8c0ca9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:12.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.848+0000 7fbd8ad9d700 1 -- 172.21.15.81:0/2974085719 >> v1:172.21.15.83:6789/0 conn(0x7fbd8c069990 legacy=0x7fbd8c06af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:12.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.848+0000 7fbd8ad9d700 1 -- 172.21.15.81:0/2974085719 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd8c06a4b0 con 0x7fbd8c0695c0 2023-10-06T03:25:12.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.848+0000 7fbd8b59e700 1 --2- 172.21.15.81:0/2974085719 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd8c0ca520 0x7fbd8c0ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:25:12.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.848+0000 7fbd8ad9d700 1 --2- 172.21.15.81:0/2974085719 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd8c0695c0 0x7fbd8c159a60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c00bc30 tx=0x7fbd7c00b4c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58eead13d791ac4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:12.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.848+0000 7fbd89d9b700 1 -- 172.21.15.81:0/2974085719 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c005c10 con 0x7fbd8c0695c0 2023-10-06T03:25:12.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.848+0000 7fbd89d9b700 1 -- 172.21.15.81:0/2974085719 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd7c005d70 con 0x7fbd8c0695c0 2023-10-06T03:25:12.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.848+0000 7fbd89d9b700 1 -- 172.21.15.81:0/2974085719 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c00dbc0 con 0x7fbd8c0695c0 2023-10-06T03:25:12.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.849+0000 7fbd911ff700 1 -- 172.21.15.81:0/2974085719 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd8c0695c0 msgr2=0x7fbd8c159a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:12.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.849+0000 7fbd911ff700 1 --2- 172.21.15.81:0/2974085719 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd8c0695c0 0x7fbd8c159a60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c00bc30 tx=0x7fbd7c00b4c0 comp rx=0 tx=0).stop 2023-10-06T03:25:12.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.849+0000 7fbd911ff700 1 -- 172.21.15.81:0/2974085719 shutdown_connections 2023-10-06T03:25:12.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.849+0000 7fbd911ff700 1 --2- 172.21.15.81:0/2974085719 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd8c0ca520 0x7fbd8c0ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:12.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.849+0000 7fbd911ff700 1 --2- 172.21.15.81:0/2974085719 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd8c0695c0 0x7fbd8c159a60 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:12.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.849+0000 7fbd911ff700 1 -- 172.21.15.81:0/2974085719 >> 172.21.15.81:0/2974085719 conn(0x7fbd8c0cc090 msgr2=0x7fbd8c0cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:12.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.849+0000 7fbd911ff700 1 -- 172.21.15.81:0/2974085719 shutdown_connections 2023-10-06T03:25:12.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.849+0000 7fbd911ff700 1 -- 172.21.15.81:0/2974085719 wait complete. 2023-10-06T03:25:12.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.850+0000 7fbd911ff700 1 Processor -- start 2023-10-06T03:25:12.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.850+0000 7fbd911ff700 1 -- start start 2023-10-06T03:25:12.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.851+0000 7fbd911ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd8c0695c0 0x7fbd8c16cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:12.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.851+0000 7fbd911ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd8c069990 0x7fbd8c0aa200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:12.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.851+0000 7fbd911ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd8c0ca520 0x7fbd8c0ae120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:12.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.851+0000 7fbd911ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8c0aa740 con 0x7fbd8c0ca520 2023-10-06T03:25:12.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.851+0000 7fbd911ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8c16dd40 con 0x7fbd8c0695c0 2023-10-06T03:25:12.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.851+0000 7fbd911ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8c0b0170 con 0x7fbd8c069990 2023-10-06T03:25:12.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.852+0000 7fbd8b59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd8c0ca520 0x7fbd8c0ae120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:12.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.852+0000 7fbd8b59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd8c0ca520 0x7fbd8c0ae120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36232/0 (socket says 172.21.15.81:36232) 2023-10-06T03:25:12.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.852+0000 7fbd8b59e700 1 -- 172.21.15.81:0/2973381884 learned_addr learned my addr 172.21.15.81:0/2973381884 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:12.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.852+0000 7fbd8ad9d700 1 --2- 172.21.15.81:0/2973381884 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd8c0695c0 0x7fbd8c16cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:12.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.852+0000 7fbd8a59c700 1 --2- 172.21.15.81:0/2973381884 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd8c069990 0x7fbd8c0aa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:12.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.852+0000 7fbd8b59e700 1 -- 172.21.15.81:0/2973381884 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd8c069990 msgr2=0x7fbd8c0aa200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:12.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.852+0000 7fbd8b59e700 1 --2- 172.21.15.81:0/2973381884 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd8c069990 0x7fbd8c0aa200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:12.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.852+0000 7fbd8b59e700 1 -- 172.21.15.81:0/2973381884 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd8c0695c0 msgr2=0x7fbd8c16cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:12.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.852+0000 7fbd8b59e700 1 --2- 172.21.15.81:0/2973381884 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd8c0695c0 0x7fbd8c16cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:12.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.852+0000 7fbd8b59e700 1 -- 172.21.15.81:0/2973381884 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd84009a20 con 0x7fbd8c0ca520 2023-10-06T03:25:12.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.852+0000 7fbd8b59e700 1 --2- 172.21.15.81:0/2973381884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd8c0ca520 0x7fbd8c0ae120 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fbd84009f50 tx=0x7fbd8400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:12.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.852+0000 7fbd72ffd700 1 -- 172.21.15.81:0/2973381884 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd84009c80 con 0x7fbd8c0ca520 2023-10-06T03:25:12.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.853+0000 7fbd72ffd700 1 -- 172.21.15.81:0/2973381884 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd8400f040 con 0x7fbd8c0ca520 2023-10-06T03:25:12.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.853+0000 7fbd72ffd700 1 -- 172.21.15.81:0/2973381884 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8400cda0 con 0x7fbd8c0ca520 2023-10-06T03:25:12.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.853+0000 7fbd911ff700 1 -- 172.21.15.81:0/2973381884 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd7c00b720 con 0x7fbd8c0ca520 2023-10-06T03:25:12.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.853+0000 7fbd911ff700 1 -- 172.21.15.81:0/2973381884 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd8c16d780 con 0x7fbd8c0ca520 2023-10-06T03:25:12.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.854+0000 7fbd911ff700 1 -- 172.21.15.81:0/2973381884 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd8c04c3c0 con 0x7fbd8c0ca520 2023-10-06T03:25:12.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.855+0000 7fbd72ffd700 1 -- 172.21.15.81:0/2973381884 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbd84003020 con 0x7fbd8c0ca520 2023-10-06T03:25:12.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.856+0000 7fbd72ffd700 1 --2- 172.21.15.81:0/2973381884 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fbd78066f30 0x7fbd780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:12.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.856+0000 7fbd72ffd700 1 -- 172.21.15.81:0/2973381884 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fbd84084fa0 con 0x7fbd8c0ca520 2023-10-06T03:25:12.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.856+0000 7fbd8ad9d700 1 --2- 172.21.15.81:0/2973381884 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fbd78066f30 0x7fbd780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:12.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.857+0000 7fbd8ad9d700 1 --2- 172.21.15.81:0/2973381884 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fbd78066f30 0x7fbd780693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c00b500 tx=0x7fbd7c01a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:12.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:11.860+0000 7fbd72ffd700 1 -- 172.21.15.81:0/2973381884 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbd84051f20 con 0x7fbd8c0ca520 2023-10-06T03:25:12.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.051+0000 7fbd911ff700 1 -- 172.21.15.81:0/2973381884 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbd8c0ca300 con 0x7fbd8c0ca520 2023-10-06T03:25:12.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.052+0000 7fbd72ffd700 1 -- 172.21.15.81:0/2973381884 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbd84055540 con 0x7fbd8c0ca520 2023-10-06T03:25:12.173 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-10-06T03:25:12.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.054+0000 7fbd911ff700 1 -- 172.21.15.81:0/2973381884 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fbd78066f30 msgr2=0x7fbd780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:12.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.054+0000 7fbd911ff700 1 --2- 172.21.15.81:0/2973381884 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fbd78066f30 0x7fbd780693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c00b500 tx=0x7fbd7c01a000 comp rx=0 tx=0).stop 2023-10-06T03:25:12.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.054+0000 7fbd911ff700 1 -- 172.21.15.81:0/2973381884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd8c0ca520 msgr2=0x7fbd8c0ae120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:12.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.054+0000 7fbd911ff700 1 --2- 172.21.15.81:0/2973381884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd8c0ca520 0x7fbd8c0ae120 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fbd84009f50 tx=0x7fbd8400b040 comp rx=0 tx=0).stop 2023-10-06T03:25:12.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.054+0000 7fbd911ff700 1 -- 172.21.15.81:0/2973381884 shutdown_connections 2023-10-06T03:25:12.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.054+0000 7fbd911ff700 1 --2- 172.21.15.81:0/2973381884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd8c0ca520 0x7fbd8c0ae120 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:12.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.054+0000 7fbd911ff700 1 --2- 172.21.15.81:0/2973381884 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd8c0695c0 0x7fbd8c16cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:12.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.054+0000 7fbd911ff700 1 --2- 172.21.15.81:0/2973381884 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fbd78066f30 0x7fbd780693e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:12.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.054+0000 7fbd911ff700 1 --2- 172.21.15.81:0/2973381884 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd8c069990 0x7fbd8c0aa200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:12.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.054+0000 7fbd911ff700 1 -- 172.21.15.81:0/2973381884 >> 172.21.15.81:0/2973381884 conn(0x7fbd8c0cc090 msgr2=0x7fbd8c154b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:12.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.054+0000 7fbd911ff700 1 -- 172.21.15.81:0/2973381884 shutdown_connections 2023-10-06T03:25:12.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.054+0000 7fbd911ff700 1 -- 172.21.15.81:0/2973381884 wait complete. 2023-10-06T03:25:12.175 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:25:12.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.358+0000 7f4e90bff700 1 Processor -- start 2023-10-06T03:25:12.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.358+0000 7f4e90bff700 1 -- start start 2023-10-06T03:25:12.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.359+0000 7f4e90bff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4e8c159410 0x7f4e8c0b1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:12.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.359+0000 7f4e90bff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f4e8c1597e0 0x7f4e8c0b1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:12.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.359+0000 7f4e90bff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e8c0b3f00 con 0x7f4e8c0a8670 2023-10-06T03:25:12.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.359+0000 7f4e90bff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e8c0b32f0 con 0x7f4e8c159410 2023-10-06T03:25:12.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.359+0000 7f4e90bff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e8c0b35d0 con 0x7f4e8c1597e0 2023-10-06T03:25:12.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.360+0000 7f4e8a59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4e8c159410 0x7f4e8c0b1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:12.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.360+0000 7f4e8a59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4e8c159410 0x7f4e8c0b1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36234/0 (socket says 172.21.15.81:36234) 2023-10-06T03:25:12.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.360+0000 7f4e8a59c700 1 -- 172.21.15.81:0/4037094091 learned_addr learned my addr 172.21.15.81:0/4037094091 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:12.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.360+0000 7f4e89d9b700 1 --2- 172.21.15.81:0/4037094091 >> v2:172.21.15.83:3300/0 conn(0x7f4e8c1597e0 0x7f4e8c0b1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:12.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.360+0000 7f4e8a59c700 1 -- 172.21.15.81:0/4037094091 >> v2:172.21.15.83:3300/0 conn(0x7f4e8c1597e0 msgr2=0x7f4e8c0b1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:12.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.360+0000 7f4e8a59c700 1 --2- 172.21.15.81:0/4037094091 >> v2:172.21.15.83:3300/0 conn(0x7f4e8c1597e0 0x7f4e8c0b1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:12.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.360+0000 7f4e8a59c700 1 -- 172.21.15.81:0/4037094091 >> v1:172.21.15.83:6789/0 conn(0x7f4e8c0a8670 legacy=0x7f4e8c06cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:12.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.360+0000 7f4e8a59c700 1 -- 172.21.15.81:0/4037094091 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e8c0b38b0 con 0x7f4e8c159410 2023-10-06T03:25:12.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.360+0000 7f4e8a59c700 1 --2- 172.21.15.81:0/4037094091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e8c159410 0x7f4e8c0b1110 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c0ad7d0 tx=0x7f4e7c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c716609c00108e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:12.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.361+0000 7f4e8959a700 1 -- 172.21.15.81:0/4037094091 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c00b860 con 0x7f4e8c159410 2023-10-06T03:25:12.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.361+0000 7f4e8959a700 1 -- 172.21.15.81:0/4037094091 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e7c00b9c0 con 0x7f4e8c159410 2023-10-06T03:25:12.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.361+0000 7f4e8959a700 1 -- 172.21.15.81:0/4037094091 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c00bd60 con 0x7f4e8c159410 2023-10-06T03:25:12.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.361+0000 7f4e90bff700 1 -- 172.21.15.81:0/4037094091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e8c159410 msgr2=0x7f4e8c0b1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:12.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.361+0000 7f4e90bff700 1 --2- 172.21.15.81:0/4037094091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e8c159410 0x7f4e8c0b1110 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c0ad7d0 tx=0x7f4e7c009250 comp rx=0 tx=0).stop 2023-10-06T03:25:12.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.361+0000 7f4e90bff700 1 -- 172.21.15.81:0/4037094091 shutdown_connections 2023-10-06T03:25:12.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.361+0000 7f4e90bff700 1 --2- 172.21.15.81:0/4037094091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e8c159410 0x7f4e8c0b1110 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:12.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.361+0000 7f4e90bff700 1 --2- 172.21.15.81:0/4037094091 >> v2:172.21.15.83:3300/0 conn(0x7f4e8c1597e0 0x7f4e8c0b1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:12.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.361+0000 7f4e90bff700 1 -- 172.21.15.81:0/4037094091 >> 172.21.15.81:0/4037094091 conn(0x7f4e8c06b540 msgr2=0x7f4e8c06b940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:12.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.361+0000 7f4e90bff700 1 -- 172.21.15.81:0/4037094091 shutdown_connections 2023-10-06T03:25:12.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.361+0000 7f4e90bff700 1 -- 172.21.15.81:0/4037094091 wait complete. 2023-10-06T03:25:12.365 INFO:tasks.ceph.mds.a.smithi081.stderr:2023-10-06T03:25:12.362+0000 7f37d35f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T03:25:12.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.363+0000 7f4e90bff700 1 Processor -- start 2023-10-06T03:25:12.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.363+0000 7f4e90bff700 1 -- start start 2023-10-06T03:25:12.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.364+0000 7f4e90bff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4e8c0a8670 0x7f4e8c1524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:12.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.364+0000 7f4e90bff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4e8c159410 0x7f4e8c16a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:12.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.364+0000 7f4e90bff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e8c1597e0 0x7f4e8c14efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:12.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.364+0000 7f4e90bff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8c152a30 con 0x7f4e8c1597e0 2023-10-06T03:25:12.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.364+0000 7f4e90bff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8c152060 con 0x7f4e8c0a8670 2023-10-06T03:25:12.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.364+0000 7f4e90bff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8c16ab50 con 0x7f4e8c159410 2023-10-06T03:25:12.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.364+0000 7f4e8ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e8c1597e0 0x7f4e8c14efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:12.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.364+0000 7f4e89d9b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4e8c159410 0x7f4e8c16a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:12.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.364+0000 7f4e8ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e8c1597e0 0x7f4e8c14efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36244/0 (socket says 172.21.15.81:36244) 2023-10-06T03:25:12.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.364+0000 7f4e8ad9d700 1 -- 172.21.15.81:0/203804416 learned_addr learned my addr 172.21.15.81:0/203804416 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:12.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.364+0000 7f4e8a59c700 1 --2- 172.21.15.81:0/203804416 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4e8c0a8670 0x7f4e8c1524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:12.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.364+0000 7f4e8ad9d700 1 -- 172.21.15.81:0/203804416 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4e8c159410 msgr2=0x7f4e8c16a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:12.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.364+0000 7f4e8ad9d700 1 --2- 172.21.15.81:0/203804416 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4e8c159410 0x7f4e8c16a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:12.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.364+0000 7f4e8ad9d700 1 -- 172.21.15.81:0/203804416 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4e8c0a8670 msgr2=0x7f4e8c1524f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:12.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.364+0000 7f4e8ad9d700 1 --2- 172.21.15.81:0/203804416 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4e8c0a8670 0x7f4e8c1524f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:12.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.364+0000 7f4e8ad9d700 1 -- 172.21.15.81:0/203804416 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e7c0094f0 con 0x7f4e8c1597e0 2023-10-06T03:25:12.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.365+0000 7f4e8ad9d700 1 --2- 172.21.15.81:0/203804416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e8c1597e0 0x7f4e8c14efe0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4e8400c8e0 tx=0x7f4e84001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:12.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.365+0000 7f4e7a7fc700 1 -- 172.21.15.81:0/203804416 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e84012630 con 0x7f4e8c1597e0 2023-10-06T03:25:12.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.365+0000 7f4e7a7fc700 1 -- 172.21.15.81:0/203804416 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e84012790 con 0x7f4e8c1597e0 2023-10-06T03:25:12.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.365+0000 7f4e90bff700 1 -- 172.21.15.81:0/203804416 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e8c14f520 con 0x7f4e8c1597e0 2023-10-06T03:25:12.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.365+0000 7f4e7a7fc700 1 -- 172.21.15.81:0/203804416 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e84012b50 con 0x7f4e8c1597e0 2023-10-06T03:25:12.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.365+0000 7f4e90bff700 1 -- 172.21.15.81:0/203804416 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e8c151a10 con 0x7f4e8c1597e0 2023-10-06T03:25:12.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.366+0000 7f4e90bff700 1 -- 172.21.15.81:0/203804416 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e8c069f40 con 0x7f4e8c1597e0 2023-10-06T03:25:12.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.367+0000 7f4e7a7fc700 1 -- 172.21.15.81:0/203804416 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4e8401a3a0 con 0x7f4e8c1597e0 2023-10-06T03:25:12.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.368+0000 7f4e7a7fc700 1 --2- 172.21.15.81:0/203804416 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f4e6c066f30 0x7f4e6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:12.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.368+0000 7f4e7a7fc700 1 -- 172.21.15.81:0/203804416 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f4e84084a30 con 0x7f4e8c1597e0 2023-10-06T03:25:12.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.368+0000 7f4e8a59c700 1 --2- 172.21.15.81:0/203804416 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f4e6c066f30 0x7f4e6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:12.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.369+0000 7f4e8a59c700 1 --2- 172.21.15.81:0/203804416 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f4e6c066f30 0x7f4e6c0693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c0ad7d0 tx=0x7f4e7c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:12.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.372+0000 7f4e7a7fc700 1 -- 172.21.15.81:0/203804416 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4e840519b0 con 0x7f4e8c1597e0 2023-10-06T03:25:12.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.559+0000 7f4e90bff700 1 -- 172.21.15.81:0/203804416 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4e8c04c3c0 con 0x7f4e8c1597e0 2023-10-06T03:25:12.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.560+0000 7f4e7a7fc700 1 -- 172.21.15.81:0/203804416 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4e84054fd0 con 0x7f4e8c1597e0 2023-10-06T03:25:12.561 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-10-06T03:25:12.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.562+0000 7f4e90bff700 1 -- 172.21.15.81:0/203804416 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f4e6c066f30 msgr2=0x7f4e6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:12.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.562+0000 7f4e90bff700 1 --2- 172.21.15.81:0/203804416 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f4e6c066f30 0x7f4e6c0693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c0ad7d0 tx=0x7f4e7c017000 comp rx=0 tx=0).stop 2023-10-06T03:25:12.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.562+0000 7f4e90bff700 1 -- 172.21.15.81:0/203804416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e8c1597e0 msgr2=0x7f4e8c14efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:12.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.562+0000 7f4e90bff700 1 --2- 172.21.15.81:0/203804416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e8c1597e0 0x7f4e8c14efe0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4e8400c8e0 tx=0x7f4e84001710 comp rx=0 tx=0).stop 2023-10-06T03:25:12.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.562+0000 7f4e90bff700 1 -- 172.21.15.81:0/203804416 shutdown_connections 2023-10-06T03:25:12.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.562+0000 7f4e90bff700 1 --2- 172.21.15.81:0/203804416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e8c1597e0 0x7f4e8c14efe0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:12.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.562+0000 7f4e90bff700 1 --2- 172.21.15.81:0/203804416 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4e8c0a8670 0x7f4e8c1524f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:12.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.562+0000 7f4e90bff700 1 --2- 172.21.15.81:0/203804416 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f4e6c066f30 0x7f4e6c0693e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:12.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.562+0000 7f4e90bff700 1 --2- 172.21.15.81:0/203804416 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4e8c159410 0x7f4e8c16a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:12.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.562+0000 7f4e90bff700 1 -- 172.21.15.81:0/203804416 >> 172.21.15.81:0/203804416 conn(0x7f4e8c06b540 msgr2=0x7f4e8c069710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:12.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.562+0000 7f4e90bff700 1 -- 172.21.15.81:0/203804416 shutdown_connections 2023-10-06T03:25:12.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.562+0000 7f4e90bff700 1 -- 172.21.15.81:0/203804416 wait complete. 2023-10-06T03:25:12.581 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:25:12.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.761+0000 7f7fc75ff700 1 Processor -- start 2023-10-06T03:25:12.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.761+0000 7f7fc75ff700 1 -- start start 2023-10-06T03:25:12.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.763+0000 7f7fc75ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7fc01557f0 0x7f7fc0156c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:12.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.763+0000 7f7fc75ff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fc00c9c60 con 0x7f7fc0155bc0 2023-10-06T03:25:12.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.763+0000 7f7fc75ff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fc006dc60 con 0x7f7fc0069ee0 2023-10-06T03:25:12.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.763+0000 7f7fc75ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc006df20 con 0x7f7fc01557f0 2023-10-06T03:25:12.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.763+0000 7f7fc4b9a700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7fc0155bc0 0x7f7fc00c6cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53164/0 (socket says 172.21.15.81:53164) 2023-10-06T03:25:12.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.763+0000 7f7fc4b9a700 1 -- 172.21.15.81:0/3093194211 learned_addr learned my addr 172.21.15.81:0/3093194211 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:25:12.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.763+0000 7f7fc539b700 1 --2- 172.21.15.81:0/3093194211 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7fc01557f0 0x7f7fc0156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:12.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.763+0000 7f7fb7fff700 1 -- 172.21.15.81:0/3093194211 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1744307492 0 0) 0x7f7fc00c9c60 con 0x7f7fc0155bc0 2023-10-06T03:25:12.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.764+0000 7f7fb7fff700 1 -- 172.21.15.81:0/3093194211 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fac003570 con 0x7f7fc0155bc0 2023-10-06T03:25:12.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.764+0000 7f7fb7fff700 1 -- 172.21.15.81:0/3093194211 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 564725185 0 0) 0x7f7fc006dc60 con 0x7f7fc0069ee0 2023-10-06T03:25:12.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.764+0000 7f7fb7fff700 1 -- 172.21.15.81:0/3093194211 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fc00c9c60 con 0x7f7fc0069ee0 2023-10-06T03:25:12.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.764+0000 7f7fb7fff700 1 -- 172.21.15.81:0/3093194211 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3396778879 0 0) 0x7f7fac003570 con 0x7f7fc0155bc0 2023-10-06T03:25:12.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.764+0000 7f7fc539b700 1 -- 172.21.15.81:0/3093194211 >> v1:172.21.15.83:6789/0 conn(0x7f7fc0069ee0 legacy=0x7f7fc006e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:12.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.764+0000 7f7fc539b700 1 -- 172.21.15.81:0/3093194211 >> v1:172.21.15.81:6789/0 conn(0x7f7fc0155bc0 legacy=0x7f7fc00c6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:12.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.764+0000 7f7fc539b700 1 -- 172.21.15.81:0/3093194211 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc00c74e0 con 0x7f7fc01557f0 2023-10-06T03:25:12.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.764+0000 7f7fc539b700 1 --2- 172.21.15.81:0/3093194211 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7fc01557f0 0x7f7fc0156c90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc009910 tx=0x7f7fbc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72b42dc05b80790c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:12.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.764+0000 7f7fb7fff700 1 -- 172.21.15.81:0/3093194211 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb0001470 con 0x7f7fc01557f0 2023-10-06T03:25:12.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.764+0000 7f7fb7fff700 1 -- 172.21.15.81:0/3093194211 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fbc011420 con 0x7f7fc01557f0 2023-10-06T03:25:12.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.764+0000 7f7fb7fff700 1 -- 172.21.15.81:0/3093194211 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc0117c0 con 0x7f7fc01557f0 2023-10-06T03:25:12.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.765+0000 7f7fc75ff700 1 -- 172.21.15.81:0/3093194211 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7fc01557f0 msgr2=0x7f7fc0156c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:12.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.765+0000 7f7fc75ff700 1 --2- 172.21.15.81:0/3093194211 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7fc01557f0 0x7f7fc0156c90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc009910 tx=0x7f7fbc0091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:12.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.765+0000 7f7fc75ff700 1 -- 172.21.15.81:0/3093194211 shutdown_connections 2023-10-06T03:25:12.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.765+0000 7f7fc75ff700 1 --2- 172.21.15.81:0/3093194211 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7fc01557f0 0x7f7fc0156c90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:12.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.765+0000 7f7fc75ff700 1 -- 172.21.15.81:0/3093194211 >> 172.21.15.81:0/3093194211 conn(0x7f7fc00cc090 msgr2=0x7f7fc00cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:12.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.765+0000 7f7fc75ff700 1 -- 172.21.15.81:0/3093194211 shutdown_connections 2023-10-06T03:25:12.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.765+0000 7f7fc75ff700 1 -- 172.21.15.81:0/3093194211 wait complete. 2023-10-06T03:25:12.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.766+0000 7f7fc75ff700 1 Processor -- start 2023-10-06T03:25:12.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.767+0000 7f7fc75ff700 1 -- start start 2023-10-06T03:25:12.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.767+0000 7f7fc75ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7fc0069ee0 0x7f7fc00c5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:12.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.767+0000 7f7fc75ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fc01557f0 0x7f7fc00adf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:12.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.767+0000 7f7fc75ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7fc0155bc0 0x7f7fc00a9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:12.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.767+0000 7f7fc75ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc00acc00 con 0x7f7fc01557f0 2023-10-06T03:25:12.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.767+0000 7f7fc75ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc00acea0 con 0x7f7fc0155bc0 2023-10-06T03:25:12.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.767+0000 7f7fc75ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc00ad140 con 0x7f7fc0069ee0 2023-10-06T03:25:12.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.768+0000 7f7fc4b9a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fc01557f0 0x7f7fc00adf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:12.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.768+0000 7f7fc4b9a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fc01557f0 0x7f7fc00adf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36248/0 (socket says 172.21.15.81:36248) 2023-10-06T03:25:12.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.768+0000 7f7fc4b9a700 1 -- 172.21.15.81:0/2368262257 learned_addr learned my addr 172.21.15.81:0/2368262257 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:12.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.768+0000 7f7fc5b9c700 1 --2- 172.21.15.81:0/2368262257 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7fc0155bc0 0x7f7fc00a9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:12.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.768+0000 7f7fc539b700 1 --2- 172.21.15.81:0/2368262257 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7fc0069ee0 0x7f7fc00c5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:12.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.768+0000 7f7fc4b9a700 1 -- 172.21.15.81:0/2368262257 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7fc0069ee0 msgr2=0x7f7fc00c5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:12.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.768+0000 7f7fc4b9a700 1 --2- 172.21.15.81:0/2368262257 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7fc0069ee0 0x7f7fc00c5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:12.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.768+0000 7f7fc4b9a700 1 -- 172.21.15.81:0/2368262257 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7fc0155bc0 msgr2=0x7f7fc00a9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:12.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.768+0000 7f7fc4b9a700 1 --2- 172.21.15.81:0/2368262257 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7fc0155bc0 0x7f7fc00a9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:12.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.768+0000 7f7fc4b9a700 1 -- 172.21.15.81:0/2368262257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fbc009420 con 0x7f7fc01557f0 2023-10-06T03:25:12.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.768+0000 7f7fc4b9a700 1 --2- 172.21.15.81:0/2368262257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fc01557f0 0x7f7fc00adf00 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7fb000cb70 tx=0x7f7fb0001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:12.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.768+0000 7f7fb57fa700 1 -- 172.21.15.81:0/2368262257 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb0001d00 con 0x7f7fc01557f0 2023-10-06T03:25:12.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.769+0000 7f7fb57fa700 1 -- 172.21.15.81:0/2368262257 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb0007360 con 0x7f7fc01557f0 2023-10-06T03:25:12.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.769+0000 7f7fc75ff700 1 -- 172.21.15.81:0/2368262257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fc00ad420 con 0x7f7fc01557f0 2023-10-06T03:25:12.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.769+0000 7f7fb57fa700 1 -- 172.21.15.81:0/2368262257 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb0004830 con 0x7f7fc01557f0 2023-10-06T03:25:12.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.769+0000 7f7fc75ff700 1 -- 172.21.15.81:0/2368262257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fc00ad9e0 con 0x7f7fc01557f0 2023-10-06T03:25:12.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.770+0000 7f7fc75ff700 1 -- 172.21.15.81:0/2368262257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fc00adbd0 con 0x7f7fc01557f0 2023-10-06T03:25:12.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.770+0000 7f7fb57fa700 1 -- 172.21.15.81:0/2368262257 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7fb0004ba0 con 0x7f7fc01557f0 2023-10-06T03:25:12.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.771+0000 7f7fb57fa700 1 --2- 172.21.15.81:0/2368262257 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7fa4066f30 0x7f7fa40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:12.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.771+0000 7f7fb57fa700 1 -- 172.21.15.81:0/2368262257 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f7fb00840e0 con 0x7f7fc01557f0 2023-10-06T03:25:12.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.772+0000 7f7fc539b700 1 --2- 172.21.15.81:0/2368262257 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7fa4066f30 0x7f7fa40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:12.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.772+0000 7f7fc539b700 1 --2- 172.21.15.81:0/2368262257 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7fa4066f30 0x7f7fa40693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc0030c0 tx=0x7f7fbc016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:12.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:12.775+0000 7f7fb57fa700 1 -- 172.21.15.81:0/2368262257 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7fb00510e0 con 0x7f7fc01557f0 2023-10-06T03:25:13.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.007+0000 7f7fc75ff700 1 -- 172.21.15.81:0/2368262257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7fc004c3c0 con 0x7f7fc01557f0 2023-10-06T03:25:13.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.008+0000 7f7fb57fa700 1 -- 172.21.15.81:0/2368262257 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4594 (secure 0 0 0) 0x7f7fb0054700 con 0x7f7fc01557f0 2023-10-06T03:25:13.009 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:25:13.009 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":27,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5065,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6834/822949628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":822949628},{"type":"v1","addr":"172.21.15.83:6834","nonce":822949628}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5068,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3024690603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6833","nonce":3024690603},{"type":"v1","addr":"172.21.15.83:6835","nonce":3024690603}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5074,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2638072815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2638072815},{"type":"v1","addr":"172.21.15.81:6837","nonce":2638072815}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:25:02.863416+0000","modified":"2023-10-06T03:25:07.689931+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5322":{"gid":5322,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6835/2219056136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2219056136},{"type":"v1","addr":"172.21.15.81:6835","nonce":2219056136}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":2}]} 2023-10-06T03:25:13.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.010+0000 7f7fc75ff700 1 -- 172.21.15.81:0/2368262257 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7fa4066f30 msgr2=0x7f7fa40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:13.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.010+0000 7f7fc75ff700 1 --2- 172.21.15.81:0/2368262257 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7fa4066f30 0x7f7fa40693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc0030c0 tx=0x7f7fbc016000 comp rx=0 tx=0).stop 2023-10-06T03:25:13.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.010+0000 7f7fc75ff700 1 -- 172.21.15.81:0/2368262257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fc01557f0 msgr2=0x7f7fc00adf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:13.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.010+0000 7f7fc75ff700 1 --2- 172.21.15.81:0/2368262257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fc01557f0 0x7f7fc00adf00 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7fb000cb70 tx=0x7f7fb0001ab0 comp rx=0 tx=0).stop 2023-10-06T03:25:13.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.010+0000 7f7fc75ff700 1 -- 172.21.15.81:0/2368262257 shutdown_connections 2023-10-06T03:25:13.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.010+0000 7f7fc75ff700 1 --2- 172.21.15.81:0/2368262257 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7fc0155bc0 0x7f7fc00a9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:13.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.010+0000 7f7fc75ff700 1 --2- 172.21.15.81:0/2368262257 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7fa4066f30 0x7f7fa40693e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:13.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.011+0000 7f7fc75ff700 1 --2- 172.21.15.81:0/2368262257 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7fc0069ee0 0x7f7fc00c5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:13.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.011+0000 7f7fc75ff700 1 --2- 172.21.15.81:0/2368262257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fc01557f0 0x7f7fc00adf00 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:13.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.011+0000 7f7fc75ff700 1 -- 172.21.15.81:0/2368262257 >> 172.21.15.81:0/2368262257 conn(0x7f7fc00cc090 msgr2=0x7f7fc0158280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:13.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.011+0000 7f7fc75ff700 1 -- 172.21.15.81:0/2368262257 shutdown_connections 2023-10-06T03:25:13.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.011+0000 7f7fc75ff700 1 -- 172.21.15.81:0/2368262257 wait complete. 2023-10-06T03:25:13.013 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 27 2023-10-06T03:25:13.029 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:25:13.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.208+0000 7ff7bbfff700 1 Processor -- start 2023-10-06T03:25:13.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.208+0000 7ff7bbfff700 1 -- start start 2023-10-06T03:25:13.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.209+0000 7ff7bbfff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff7bc0ccd40 0x7ff7bc0b1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:13.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.209+0000 7ff7bbfff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7bc0b4760 con 0x7ff7bc0b2250 2023-10-06T03:25:13.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.209+0000 7ff7bbfff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7bc0cd320 con 0x7ff7bc0cc670 2023-10-06T03:25:13.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.209+0000 7ff7bbfff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7bc0b60f0 con 0x7ff7bc0ccd40 2023-10-06T03:25:13.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.209+0000 7ff7bb7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff7bc0b2250 0x7ff7bc0b4bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53176/0 (socket says 172.21.15.81:53176) 2023-10-06T03:25:13.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.209+0000 7ff7bb7fe700 1 -- 172.21.15.81:0/692104166 learned_addr learned my addr 172.21.15.81:0/692104166 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:25:13.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.210+0000 7ff7b3fff700 1 --2- 172.21.15.81:0/692104166 >> v2:172.21.15.83:3300/0 conn(0x7ff7bc0ccd40 0x7ff7bc0b1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:13.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.210+0000 7ff7ba7fc700 1 -- 172.21.15.81:0/692104166 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3231335091 0 0) 0x7ff7bc0b4760 con 0x7ff7bc0b2250 2023-10-06T03:25:13.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.210+0000 7ff7ba7fc700 1 -- 172.21.15.81:0/692104166 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7a8003570 con 0x7ff7bc0b2250 2023-10-06T03:25:13.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.210+0000 7ff7b3fff700 1 -- 172.21.15.81:0/692104166 >> v1:172.21.15.83:6789/0 conn(0x7ff7bc0cc670 legacy=0x7ff7bc15a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:13.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.210+0000 7ff7b3fff700 1 -- 172.21.15.81:0/692104166 >> v1:172.21.15.81:6789/0 conn(0x7ff7bc0b2250 legacy=0x7ff7bc0b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:13.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.210+0000 7ff7b3fff700 1 -- 172.21.15.81:0/692104166 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7bc0b2660 con 0x7ff7bc0ccd40 2023-10-06T03:25:13.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.210+0000 7ff7b3fff700 1 --2- 172.21.15.81:0/692104166 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7bc0ccd40 0x7ff7bc0b1d10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff7a40098e0 tx=0x7ff7a40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0b4b56aed14a251 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:13.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.211+0000 7ff7ba7fc700 1 -- 172.21.15.81:0/692104166 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a400b640 con 0x7ff7bc0ccd40 2023-10-06T03:25:13.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.211+0000 7ff7ba7fc700 1 -- 172.21.15.81:0/692104166 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a400b7a0 con 0x7ff7bc0ccd40 2023-10-06T03:25:13.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.211+0000 7ff7ba7fc700 1 -- 172.21.15.81:0/692104166 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a400bb40 con 0x7ff7bc0ccd40 2023-10-06T03:25:13.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.211+0000 7ff7bbfff700 1 -- 172.21.15.81:0/692104166 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7bc0ccd40 msgr2=0x7ff7bc0b1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:13.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.211+0000 7ff7bbfff700 1 --2- 172.21.15.81:0/692104166 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7bc0ccd40 0x7ff7bc0b1d10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff7a40098e0 tx=0x7ff7a40091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:13.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.211+0000 7ff7bbfff700 1 -- 172.21.15.81:0/692104166 shutdown_connections 2023-10-06T03:25:13.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.211+0000 7ff7bbfff700 1 --2- 172.21.15.81:0/692104166 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7bc0ccd40 0x7ff7bc0b1d10 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:13.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.211+0000 7ff7bbfff700 1 -- 172.21.15.81:0/692104166 >> 172.21.15.81:0/692104166 conn(0x7ff7bc06ed10 msgr2=0x7ff7bc06f110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:13.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.211+0000 7ff7bbfff700 1 -- 172.21.15.81:0/692104166 shutdown_connections 2023-10-06T03:25:13.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.211+0000 7ff7bbfff700 1 -- 172.21.15.81:0/692104166 wait complete. 2023-10-06T03:25:13.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.213+0000 7ff7bbfff700 1 Processor -- start 2023-10-06T03:25:13.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.213+0000 7ff7bbfff700 1 -- start start 2023-10-06T03:25:13.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.214+0000 7ff7bbfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7bc0b2250 0x7ff7bc16a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:13.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.214+0000 7ff7bbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7bc0cc670 0x7ff7bc0c5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:13.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.214+0000 7ff7bbfff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff7bc0ccd40 0x7ff7bc0c5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:13.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.214+0000 7ff7bbfff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc155bb0 con 0x7ff7bc0cc670 2023-10-06T03:25:13.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.214+0000 7ff7bbfff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc154fa0 con 0x7ff7bc0b2250 2023-10-06T03:25:13.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.214+0000 7ff7bbfff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc155280 con 0x7ff7bc0ccd40 2023-10-06T03:25:13.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.214+0000 7ff7b3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7bc0cc670 0x7ff7bc0c5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:13.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.214+0000 7ff7b3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7bc0cc670 0x7ff7bc0c5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36260/0 (socket says 172.21.15.81:36260) 2023-10-06T03:25:13.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.214+0000 7ff7b3fff700 1 -- 172.21.15.81:0/1116875267 learned_addr learned my addr 172.21.15.81:0/1116875267 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:13.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.214+0000 7ff7baffd700 1 --2- 172.21.15.81:0/1116875267 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7bc0b2250 0x7ff7bc16a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:13.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.214+0000 7ff7bb7fe700 1 --2- 172.21.15.81:0/1116875267 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff7bc0ccd40 0x7ff7bc0c5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:13.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.214+0000 7ff7b3fff700 1 -- 172.21.15.81:0/1116875267 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff7bc0ccd40 msgr2=0x7ff7bc0c5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:13.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.214+0000 7ff7b3fff700 1 --2- 172.21.15.81:0/1116875267 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff7bc0ccd40 0x7ff7bc0c5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:13.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.214+0000 7ff7b3fff700 1 -- 172.21.15.81:0/1116875267 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7bc0b2250 msgr2=0x7ff7bc16a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:13.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.214+0000 7ff7b3fff700 1 --2- 172.21.15.81:0/1116875267 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7bc0b2250 0x7ff7bc16a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:13.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.214+0000 7ff7b3fff700 1 -- 172.21.15.81:0/1116875267 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a4009420 con 0x7ff7bc0cc670 2023-10-06T03:25:13.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.214+0000 7ff7bb7fe700 1 --2- 172.21.15.81:0/1116875267 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff7bc0ccd40 0x7ff7bc0c5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:13.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.215+0000 7ff7b3fff700 1 --2- 172.21.15.81:0/1116875267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7bc0cc670 0x7ff7bc0c5a60 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc0d1450 tx=0x7ff7a4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:13.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.215+0000 7ff7b2ffd700 1 -- 172.21.15.81:0/1116875267 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a400bb20 con 0x7ff7bc0cc670 2023-10-06T03:25:13.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.215+0000 7ff7b2ffd700 1 -- 172.21.15.81:0/1116875267 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a4011420 con 0x7ff7bc0cc670 2023-10-06T03:25:13.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.215+0000 7ff7bbfff700 1 -- 172.21.15.81:0/1116875267 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7bc155560 con 0x7ff7bc0cc670 2023-10-06T03:25:13.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.215+0000 7ff7b2ffd700 1 -- 172.21.15.81:0/1116875267 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a40117a0 con 0x7ff7bc0cc670 2023-10-06T03:25:13.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.215+0000 7ff7bbfff700 1 -- 172.21.15.81:0/1116875267 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7bc16a650 con 0x7ff7bc0cc670 2023-10-06T03:25:13.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.216+0000 7ff7bbfff700 1 -- 172.21.15.81:0/1116875267 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7bc155d20 con 0x7ff7bc0cc670 2023-10-06T03:25:13.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.217+0000 7ff7b2ffd700 1 -- 172.21.15.81:0/1116875267 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff7a4011b50 con 0x7ff7bc0cc670 2023-10-06T03:25:13.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.218+0000 7ff7b2ffd700 1 --2- 172.21.15.81:0/1116875267 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff79c066f30 0x7ff79c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:13.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.218+0000 7ff7b2ffd700 1 -- 172.21.15.81:0/1116875267 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6464+0+0 (secure 0 0 0) 0x7ff7a4086000 con 0x7ff7bc0cc670 2023-10-06T03:25:13.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.218+0000 7ff7baffd700 1 --2- 172.21.15.81:0/1116875267 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff79c066f30 0x7ff79c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:13.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.218+0000 7ff7baffd700 1 --2- 172.21.15.81:0/1116875267 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff79c066f30 0x7ff79c0693e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc0c5580 tx=0x7ff7ac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:13.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.222+0000 7ff7b2ffd700 1 -- 172.21.15.81:0/1116875267 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff7a4052f00 con 0x7ff7bc0cc670 2023-10-06T03:25:13.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.414+0000 7ff7bbfff700 1 -- 172.21.15.81:0/1116875267 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7bc04c3c0 con 0x7ff7bc0cc670 2023-10-06T03:25:13.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.415+0000 7ff7b2ffd700 1 -- 172.21.15.81:0/1116875267 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+17152 (secure 0 0 0) 0x7ff7a4056520 con 0x7ff7bc0cc670 2023-10-06T03:25:13.416 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:25:13.416 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":40,"fsid":"1807b5d7-9be8-43ad-aaf8-99a4273430b3","created":"2023-10-06T03:23:20.805306+0000","modified":"2023-10-06T03:25:02.863295+0000","last_up_change":"2023-10-06T03:23:32.735796+0000","last_in_change":"2023-10-06T03:23:24.109024+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:33.198850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:33.606744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:24:50.339463+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T03:24:51.333980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"14fb667d-a677-4978-a477-80027f889d36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":85563},{"type":"v1","addr":"172.21.15.81:6818","nonce":85563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":85563},{"type":"v1","addr":"172.21.15.81:6822","nonce":85563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":85563},{"type":"v1","addr":"172.21.15.81:6830","nonce":85563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":85563},{"type":"v1","addr":"172.21.15.81:6826","nonce":85563}]},"public_addr":"172.21.15.81:6818/85563","cluster_addr":"172.21.15.81:6822/85563","heartbeat_back_addr":"172.21.15.81:6830/85563","heartbeat_front_addr":"172.21.15.81:6826/85563","state":["exists","up"]},{"osd":1,"uuid":"974d8a86-1829-4176-89ce-18e6038857f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":85561},{"type":"v1","addr":"172.21.15.81:6801","nonce":85561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":85561},{"type":"v1","addr":"172.21.15.81:6803","nonce":85561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":85561},{"type":"v1","addr":"172.21.15.81:6807","nonce":85561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":85561},{"type":"v1","addr":"172.21.15.81:6805","nonce":85561}]},"public_addr":"172.21.15.81:6801/85561","cluster_addr":"172.21.15.81:6803/85561","heartbeat_back_addr":"172.21.15.81:6807/85561","heartbeat_front_addr":"172.21.15.81:6805/85561","state":["exists","up"]},{"osd":2,"uuid":"ffbfe056-46bc-46e0-bf49-4d8f8650e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":85564},{"type":"v1","addr":"172.21.15.81:6809","nonce":85564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":85564},{"type":"v1","addr":"172.21.15.81:6811","nonce":85564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":85564},{"type":"v1","addr":"172.21.15.81:6815","nonce":85564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":85564},{"type":"v1","addr":"172.21.15.81:6813","nonce":85564}]},"public_addr":"172.21.15.81:6809/85564","cluster_addr":"172.21.15.81:6811/85564","heartbeat_back_addr":"172.21.15.81:6815/85564","heartbeat_front_addr":"172.21.15.81:6813/85564","state":["exists","up"]},{"osd":3,"uuid":"ef9a8314-3d37-4ea1-858a-e704d5695002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":85562},{"type":"v1","addr":"172.21.15.81:6819","nonce":85562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":85562},{"type":"v1","addr":"172.21.15.81:6823","nonce":85562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":85562},{"type":"v1","addr":"172.21.15.81:6831","nonce":85562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":85562},{"type":"v1","addr":"172.21.15.81:6827","nonce":85562}]},"public_addr":"172.21.15.81:6819/85562","cluster_addr":"172.21.15.81:6823/85562","heartbeat_back_addr":"172.21.15.81:6831/85562","heartbeat_front_addr":"172.21.15.81:6827/85562","state":["exists","up"]},{"osd":4,"uuid":"d83506a0-2c96-4bcb-a9fa-05e43dc329df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":85785},{"type":"v1","addr":"172.21.15.83:6801","nonce":85785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":85785},{"type":"v1","addr":"172.21.15.83:6803","nonce":85785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":85785},{"type":"v1","addr":"172.21.15.83:6807","nonce":85785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":85785},{"type":"v1","addr":"172.21.15.83:6805","nonce":85785}]},"public_addr":"172.21.15.83:6801/85785","cluster_addr":"172.21.15.83:6803/85785","heartbeat_back_addr":"172.21.15.83:6807/85785","heartbeat_front_addr":"172.21.15.83:6805/85785","state":["exists","up"]},{"osd":5,"uuid":"10687c63-a3d5-472f-acc0-4f61847b6e0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":85818},{"type":"v1","addr":"172.21.15.83:6825","nonce":85818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":85818},{"type":"v1","addr":"172.21.15.83:6827","nonce":85818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":85818},{"type":"v1","addr":"172.21.15.83:6831","nonce":85818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":85818},{"type":"v1","addr":"172.21.15.83:6829","nonce":85818}]},"public_addr":"172.21.15.83:6825/85818","cluster_addr":"172.21.15.83:6827/85818","heartbeat_back_addr":"172.21.15.83:6831/85818","heartbeat_front_addr":"172.21.15.83:6829/85818","state":["exists","up"]},{"osd":6,"uuid":"2e9daf76-5607-4a29-9a58-6e270700d223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":85787},{"type":"v1","addr":"172.21.15.83:6811","nonce":85787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":85787},{"type":"v1","addr":"172.21.15.83:6815","nonce":85787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":85787},{"type":"v1","addr":"172.21.15.83:6823","nonce":85787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6817","nonce":85787},{"type":"v1","addr":"172.21.15.83:6819","nonce":85787}]},"public_addr":"172.21.15.83:6811/85787","cluster_addr":"172.21.15.83:6815/85787","heartbeat_back_addr":"172.21.15.83:6823/85787","heartbeat_front_addr":"172.21.15.83:6819/85787","state":["exists","up"]},{"osd":7,"uuid":"5019e1ff-233a-4a5a-91ca-8afccb7ab6e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":85786},{"type":"v1","addr":"172.21.15.83:6810","nonce":85786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":85786},{"type":"v1","addr":"172.21.15.83:6814","nonce":85786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":85786},{"type":"v1","addr":"172.21.15.83:6822","nonce":85786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":85786},{"type":"v1","addr":"172.21.15.83:6818","nonce":85786}]},"public_addr":"172.21.15.83:6810/85786","cluster_addr":"172.21.15.83:6814/85786","heartbeat_back_addr":"172.21.15.83:6822/85786","heartbeat_front_addr":"172.21.15.83:6818/85786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.393431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.360031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.407428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.391613+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.403211+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.438142+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.496181+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.472323+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6835/2789471208":"2023-10-07T03:25:01.347009+0000","172.21.15.81:6834/2789471208":"2023-10-07T03:25:01.347009+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:25:13.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.417+0000 7ff7bbfff700 1 -- 172.21.15.81:0/1116875267 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff79c066f30 msgr2=0x7ff79c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:13.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.417+0000 7ff7bbfff700 1 --2- 172.21.15.81:0/1116875267 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff79c066f30 0x7ff79c0693e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc0c5580 tx=0x7ff7ac009040 comp rx=0 tx=0).stop 2023-10-06T03:25:13.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.417+0000 7ff7bbfff700 1 -- 172.21.15.81:0/1116875267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7bc0cc670 msgr2=0x7ff7bc0c5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:13.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.417+0000 7ff7bbfff700 1 --2- 172.21.15.81:0/1116875267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7bc0cc670 0x7ff7bc0c5a60 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc0d1450 tx=0x7ff7a4017000 comp rx=0 tx=0).stop 2023-10-06T03:25:13.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.417+0000 7ff7bbfff700 1 -- 172.21.15.81:0/1116875267 shutdown_connections 2023-10-06T03:25:13.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.417+0000 7ff7bbfff700 1 --2- 172.21.15.81:0/1116875267 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff79c066f30 0x7ff79c0693e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:13.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.417+0000 7ff7bbfff700 1 --2- 172.21.15.81:0/1116875267 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff7bc0ccd40 0x7ff7bc0c5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:13.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.417+0000 7ff7bbfff700 1 --2- 172.21.15.81:0/1116875267 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7bc0b2250 0x7ff7bc16a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:13.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.417+0000 7ff7bbfff700 1 --2- 172.21.15.81:0/1116875267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7bc0cc670 0x7ff7bc0c5a60 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:13.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.417+0000 7ff7bbfff700 1 -- 172.21.15.81:0/1116875267 >> 172.21.15.81:0/1116875267 conn(0x7ff7bc06ed10 msgr2=0x7ff7bc0b0490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:13.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.417+0000 7ff7bbfff700 1 -- 172.21.15.81:0/1116875267 shutdown_connections 2023-10-06T03:25:13.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.417+0000 7ff7bbfff700 1 -- 172.21.15.81:0/1116875267 wait complete. 2023-10-06T03:25:13.436 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T03:25:13.436 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:25:13.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.617+0000 7ff97499d700 1 Processor -- start 2023-10-06T03:25:13.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.617+0000 7ff97499d700 1 -- start start 2023-10-06T03:25:13.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.618+0000 7ff97499d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff9700ab7b0 0x7ff970156910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:13.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.618+0000 7ff97499d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff97006d2d0 0x7ff97006d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:13.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.618+0000 7ff97499d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9700ac5f0 con 0x7ff9700ace00 2023-10-06T03:25:13.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.618+0000 7ff97499d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9700ae330 con 0x7ff97006d2d0 2023-10-06T03:25:13.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.618+0000 7ff97499d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff970156e50 con 0x7ff9700ab7b0 2023-10-06T03:25:13.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.618+0000 7ff96ffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff97006d2d0 0x7ff97006d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:13.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.618+0000 7ff96ffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff97006d2d0 0x7ff97006d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36276/0 (socket says 172.21.15.81:36276) 2023-10-06T03:25:13.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.618+0000 7ff96ffff700 1 -- 172.21.15.81:0/3992606766 learned_addr learned my addr 172.21.15.81:0/3992606766 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:13.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.618+0000 7ff96f7fe700 1 --2- 172.21.15.81:0/3992606766 >> v2:172.21.15.83:3300/0 conn(0x7ff9700ab7b0 0x7ff970156910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:13.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.619+0000 7ff96ffff700 1 -- 172.21.15.81:0/3992606766 >> v2:172.21.15.83:3300/0 conn(0x7ff9700ab7b0 msgr2=0x7ff970156910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:13.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.619+0000 7ff96ffff700 1 --2- 172.21.15.81:0/3992606766 >> v2:172.21.15.83:3300/0 conn(0x7ff9700ab7b0 0x7ff970156910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:13.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.619+0000 7ff96ffff700 1 -- 172.21.15.81:0/3992606766 >> v1:172.21.15.83:6789/0 conn(0x7ff9700ace00 legacy=0x7ff9700abb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:13.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.619+0000 7ff96ffff700 1 -- 172.21.15.81:0/3992606766 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9700ad290 con 0x7ff97006d2d0 2023-10-06T03:25:13.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.619+0000 7ff96ffff700 1 --2- 172.21.15.81:0/3992606766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff97006d2d0 0x7ff97006d6e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff970069030 tx=0x7ff968009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cae17fdd09a06d7a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:13.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.619+0000 7ff96effd700 1 -- 172.21.15.81:0/3992606766 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96800e070 con 0x7ff97006d2d0 2023-10-06T03:25:13.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.619+0000 7ff96effd700 1 -- 172.21.15.81:0/3992606766 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff96800ba50 con 0x7ff97006d2d0 2023-10-06T03:25:13.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.619+0000 7ff96effd700 1 -- 172.21.15.81:0/3992606766 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9680092e0 con 0x7ff97006d2d0 2023-10-06T03:25:13.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.620+0000 7ff97499d700 1 -- 172.21.15.81:0/3992606766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff97006d2d0 msgr2=0x7ff97006d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:13.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.620+0000 7ff97499d700 1 --2- 172.21.15.81:0/3992606766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff97006d2d0 0x7ff97006d6e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff970069030 tx=0x7ff968009840 comp rx=0 tx=0).stop 2023-10-06T03:25:13.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.620+0000 7ff97499d700 1 -- 172.21.15.81:0/3992606766 shutdown_connections 2023-10-06T03:25:13.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.620+0000 7ff97499d700 1 --2- 172.21.15.81:0/3992606766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff97006d2d0 0x7ff97006d6e0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:13.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.620+0000 7ff97499d700 1 --2- 172.21.15.81:0/3992606766 >> v2:172.21.15.83:3300/0 conn(0x7ff9700ab7b0 0x7ff970156910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:13.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.620+0000 7ff97499d700 1 -- 172.21.15.81:0/3992606766 >> 172.21.15.81:0/3992606766 conn(0x7ff9700cbef0 msgr2=0x7ff9700cc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:13.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.620+0000 7ff97499d700 1 -- 172.21.15.81:0/3992606766 shutdown_connections 2023-10-06T03:25:13.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.620+0000 7ff97499d700 1 -- 172.21.15.81:0/3992606766 wait complete. 2023-10-06T03:25:13.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.622+0000 7ff97499d700 1 Processor -- start 2023-10-06T03:25:13.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.622+0000 7ff97499d700 1 -- start start 2023-10-06T03:25:13.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.622+0000 7ff97499d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff97006d2d0 0x7ff970149200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:13.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.623+0000 7ff97499d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff9700ab7b0 0x7ff97014a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:13.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.623+0000 7ff97499d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff9700ace00 0x7ff9700697f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:13.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.623+0000 7ff97499d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff970152410 con 0x7ff97006d2d0 2023-10-06T03:25:13.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.623+0000 7ff97499d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9701528a0 con 0x7ff9700ace00 2023-10-06T03:25:13.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.623+0000 7ff97499d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff970151800 con 0x7ff9700ab7b0 2023-10-06T03:25:13.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.623+0000 7ff96f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff97006d2d0 0x7ff970149200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:13.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.623+0000 7ff96f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff97006d2d0 0x7ff970149200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36292/0 (socket says 172.21.15.81:36292) 2023-10-06T03:25:13.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.623+0000 7ff96f7fe700 1 -- 172.21.15.81:0/2813824186 learned_addr learned my addr 172.21.15.81:0/2813824186 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:13.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.623+0000 7ff96ffff700 1 --2- 172.21.15.81:0/2813824186 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff9700ace00 0x7ff9700697f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:13.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.623+0000 7ff967fff700 1 --2- 172.21.15.81:0/2813824186 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff9700ab7b0 0x7ff97014a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:13.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.623+0000 7ff96f7fe700 1 -- 172.21.15.81:0/2813824186 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff9700ab7b0 msgr2=0x7ff97014a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:13.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.623+0000 7ff96f7fe700 1 --2- 172.21.15.81:0/2813824186 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff9700ab7b0 0x7ff97014a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:13.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.623+0000 7ff96f7fe700 1 -- 172.21.15.81:0/2813824186 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff9700ace00 msgr2=0x7ff9700697f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:13.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.623+0000 7ff96f7fe700 1 --2- 172.21.15.81:0/2813824186 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff9700ace00 0x7ff9700697f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:13.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.623+0000 7ff96f7fe700 1 -- 172.21.15.81:0/2813824186 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff968009ae0 con 0x7ff97006d2d0 2023-10-06T03:25:13.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.623+0000 7ff967fff700 1 --2- 172.21.15.81:0/2813824186 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff9700ab7b0 0x7ff97014a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:13.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.623+0000 7ff96f7fe700 1 --2- 172.21.15.81:0/2813824186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff97006d2d0 0x7ff970149200 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff96000d890 tx=0x7ff960008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:13.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.624+0000 7ff9677fe700 1 -- 172.21.15.81:0/2813824186 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9600125f0 con 0x7ff97006d2d0 2023-10-06T03:25:13.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.624+0000 7ff9677fe700 1 -- 172.21.15.81:0/2813824186 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff960012770 con 0x7ff97006d2d0 2023-10-06T03:25:13.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.624+0000 7ff97499d700 1 -- 172.21.15.81:0/2813824186 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff970151ae0 con 0x7ff97006d2d0 2023-10-06T03:25:13.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.624+0000 7ff9677fe700 1 -- 172.21.15.81:0/2813824186 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff960012b30 con 0x7ff97006d2d0 2023-10-06T03:25:13.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.624+0000 7ff97499d700 1 -- 172.21.15.81:0/2813824186 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9701520a0 con 0x7ff97006d2d0 2023-10-06T03:25:13.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.625+0000 7ff97499d700 1 -- 172.21.15.81:0/2813824186 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9700ad570 con 0x7ff97006d2d0 2023-10-06T03:25:13.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.625+0000 7ff9677fe700 1 -- 172.21.15.81:0/2813824186 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff96001e460 con 0x7ff97006d2d0 2023-10-06T03:25:13.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.626+0000 7ff9677fe700 1 --2- 172.21.15.81:0/2813824186 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff950066f30 0x7ff9500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:13.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.626+0000 7ff9677fe700 1 -- 172.21.15.81:0/2813824186 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6464+0+0 (secure 0 0 0) 0x7ff960084f20 con 0x7ff97006d2d0 2023-10-06T03:25:13.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.627+0000 7ff967fff700 1 --2- 172.21.15.81:0/2813824186 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff950066f30 0x7ff9500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:13.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.627+0000 7ff967fff700 1 --2- 172.21.15.81:0/2813824186 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff950066f30 0x7ff9500693e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff97006a580 tx=0x7ff958009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:13.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.630+0000 7ff9677fe700 1 -- 172.21.15.81:0/2813824186 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff960051ea0 con 0x7ff97006d2d0 2023-10-06T03:25:13.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.867+0000 7ff97499d700 1 -- 172.21.15.81:0/2813824186 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff97004bb80 con 0x7ff97006d2d0 2023-10-06T03:25:13.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.867+0000 7ff9677fe700 1 -- 172.21.15.81:0/2813824186 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4594 (secure 0 0 0) 0x7ff9600554c0 con 0x7ff97006d2d0 2023-10-06T03:25:13.868 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:25:13.868 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":27,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5065,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6834/822949628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":822949628},{"type":"v1","addr":"172.21.15.83:6834","nonce":822949628}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5068,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3024690603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6833","nonce":3024690603},{"type":"v1","addr":"172.21.15.83:6835","nonce":3024690603}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5074,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2638072815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2638072815},{"type":"v1","addr":"172.21.15.81:6837","nonce":2638072815}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:25:02.863416+0000","modified":"2023-10-06T03:25:07.689931+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5322":{"gid":5322,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6835/2219056136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2219056136},{"type":"v1","addr":"172.21.15.81:6835","nonce":2219056136}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":2}]} 2023-10-06T03:25:13.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.869+0000 7ff97499d700 1 -- 172.21.15.81:0/2813824186 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff950066f30 msgr2=0x7ff9500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:13.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.869+0000 7ff97499d700 1 --2- 172.21.15.81:0/2813824186 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff950066f30 0x7ff9500693e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff97006a580 tx=0x7ff958009040 comp rx=0 tx=0).stop 2023-10-06T03:25:13.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.869+0000 7ff97499d700 1 -- 172.21.15.81:0/2813824186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff97006d2d0 msgr2=0x7ff970149200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:13.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.869+0000 7ff97499d700 1 --2- 172.21.15.81:0/2813824186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff97006d2d0 0x7ff970149200 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff96000d890 tx=0x7ff960008040 comp rx=0 tx=0).stop 2023-10-06T03:25:13.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.869+0000 7ff97499d700 1 -- 172.21.15.81:0/2813824186 shutdown_connections 2023-10-06T03:25:13.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.869+0000 7ff97499d700 1 --2- 172.21.15.81:0/2813824186 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff9700ace00 0x7ff9700697f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:13.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.869+0000 7ff97499d700 1 --2- 172.21.15.81:0/2813824186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff97006d2d0 0x7ff970149200 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:13.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.869+0000 7ff97499d700 1 --2- 172.21.15.81:0/2813824186 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ff950066f30 0x7ff9500693e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:13.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.869+0000 7ff97499d700 1 --2- 172.21.15.81:0/2813824186 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff9700ab7b0 0x7ff97014a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:13.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.869+0000 7ff97499d700 1 -- 172.21.15.81:0/2813824186 >> 172.21.15.81:0/2813824186 conn(0x7ff9700cbef0 msgr2=0x7ff9700abb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:13.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.870+0000 7ff97499d700 1 -- 172.21.15.81:0/2813824186 shutdown_connections 2023-10-06T03:25:13.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:13.870+0000 7ff97499d700 1 -- 172.21.15.81:0/2813824186 wait complete. 2023-10-06T03:25:13.872 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 27 2023-10-06T03:25:13.888 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:25:14.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.067+0000 7fe17b59e700 1 Processor -- start 2023-10-06T03:25:14.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.067+0000 7fe17b59e700 1 -- start start 2023-10-06T03:25:14.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.068+0000 7fe17b59e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe17c0cc670 0x7fe17c0ccd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:14.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.068+0000 7fe17b59e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe17c0b2420 0x7fe17c15a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:14.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.068+0000 7fe17b59e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe17c0b4760 con 0x7fe17c15a450 2023-10-06T03:25:14.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.068+0000 7fe17b59e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe17c0b60f0 con 0x7fe17c0cc670 2023-10-06T03:25:14.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.068+0000 7fe17b59e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c0cd320 con 0x7fe17c0b2420 2023-10-06T03:25:14.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.069+0000 7fe17ad9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe17c0b2420 0x7fe17c15a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:14.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.069+0000 7fe17a59c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe17c0cc670 0x7fe17c0ccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:14.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.069+0000 7fe179d9b700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fe17c15a450 0x7fe17c0b1d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:43922/0 (socket says 172.21.15.81:43922) 2023-10-06T03:25:14.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.069+0000 7fe179d9b700 1 -- 172.21.15.81:0/1084098301 learned_addr learned my addr 172.21.15.81:0/1084098301 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:25:14.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.069+0000 7fe17a59c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe17c0cc670 0x7fe17c0ccd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:41518/0 (socket says 172.21.15.81:41518) 2023-10-06T03:25:14.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.069+0000 7fe17ad9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe17c0b2420 0x7fe17c15a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:44344/0 (socket says 172.21.15.81:44344) 2023-10-06T03:25:14.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.069+0000 7fe17a59c700 1 -- 172.21.15.81:0/1084098301 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe17c0b2420 msgr2=0x7fe17c15a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:14.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.069+0000 7fe17a59c700 1 --2- 172.21.15.81:0/1084098301 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe17c0b2420 0x7fe17c15a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:14.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.069+0000 7fe17a59c700 1 -- 172.21.15.81:0/1084098301 >> v1:172.21.15.83:6789/0 conn(0x7fe17c15a450 legacy=0x7fe17c0b1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:14.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.069+0000 7fe17a59c700 1 -- 172.21.15.81:0/1084098301 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe17c0b3e30 con 0x7fe17c0cc670 2023-10-06T03:25:14.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.070+0000 7fe17a59c700 1 --2- 172.21.15.81:0/1084098301 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe17c0cc670 0x7fe17c0ccd40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe16c0098e0 tx=0x7fe16c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfa80531213d4ab7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:14.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.070+0000 7fe17959a700 1 -- 172.21.15.81:0/1084098301 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16c011630 con 0x7fe17c0cc670 2023-10-06T03:25:14.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.070+0000 7fe17959a700 1 -- 172.21.15.81:0/1084098301 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe16c011790 con 0x7fe17c0cc670 2023-10-06T03:25:14.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.070+0000 7fe17959a700 1 -- 172.21.15.81:0/1084098301 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16c011b30 con 0x7fe17c0cc670 2023-10-06T03:25:14.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.070+0000 7fe17b59e700 1 -- 172.21.15.81:0/1084098301 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe17c0cc670 msgr2=0x7fe17c0ccd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:14.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.070+0000 7fe17b59e700 1 --2- 172.21.15.81:0/1084098301 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe17c0cc670 0x7fe17c0ccd40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe16c0098e0 tx=0x7fe16c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:14.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.070+0000 7fe17b59e700 1 -- 172.21.15.81:0/1084098301 shutdown_connections 2023-10-06T03:25:14.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.071+0000 7fe17b59e700 1 --2- 172.21.15.81:0/1084098301 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe17c0b2420 0x7fe17c15a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:14.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.071+0000 7fe17b59e700 1 --2- 172.21.15.81:0/1084098301 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe17c0cc670 0x7fe17c0ccd40 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:14.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.071+0000 7fe17b59e700 1 -- 172.21.15.81:0/1084098301 >> 172.21.15.81:0/1084098301 conn(0x7fe17c06ed10 msgr2=0x7fe17c06f110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:14.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.071+0000 7fe17b59e700 1 -- 172.21.15.81:0/1084098301 shutdown_connections 2023-10-06T03:25:14.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.071+0000 7fe17b59e700 1 -- 172.21.15.81:0/1084098301 wait complete. 2023-10-06T03:25:14.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.072+0000 7fe17b59e700 1 Processor -- start 2023-10-06T03:25:14.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.072+0000 7fe17b59e700 1 -- start start 2023-10-06T03:25:14.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.073+0000 7fe17b59e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe17c0b2420 0x7fe17c155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:14.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.073+0000 7fe17b59e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe17c0cc670 0x7fe17c142f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:14.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.073+0000 7fe17b59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe17c15a450 0x7fe17c169fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:14.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.073+0000 7fe17b59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c143470 con 0x7fe17c15a450 2023-10-06T03:25:14.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.073+0000 7fe17b59e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c16b7d0 con 0x7fe17c0cc670 2023-10-06T03:25:14.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.073+0000 7fe17b59e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c16abc0 con 0x7fe17c0b2420 2023-10-06T03:25:14.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.073+0000 7fe17ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe17c15a450 0x7fe17c169fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:14.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.073+0000 7fe17ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe17c15a450 0x7fe17c169fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36302/0 (socket says 172.21.15.81:36302) 2023-10-06T03:25:14.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.073+0000 7fe17ad9d700 1 -- 172.21.15.81:0/3139921512 learned_addr learned my addr 172.21.15.81:0/3139921512 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:14.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.073+0000 7fe17a59c700 1 --2- 172.21.15.81:0/3139921512 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe17c0b2420 0x7fe17c155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:14.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.074+0000 7fe179d9b700 1 --2- 172.21.15.81:0/3139921512 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe17c0cc670 0x7fe17c142f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:14.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.074+0000 7fe17ad9d700 1 -- 172.21.15.81:0/3139921512 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe17c0b2420 msgr2=0x7fe17c155ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:14.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.074+0000 7fe17ad9d700 1 --2- 172.21.15.81:0/3139921512 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe17c0b2420 0x7fe17c155ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:14.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.074+0000 7fe17ad9d700 1 -- 172.21.15.81:0/3139921512 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe17c0cc670 msgr2=0x7fe17c142f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:14.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.074+0000 7fe17ad9d700 1 --2- 172.21.15.81:0/3139921512 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe17c0cc670 0x7fe17c142f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:14.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.074+0000 7fe17ad9d700 1 -- 172.21.15.81:0/3139921512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe16c009420 con 0x7fe17c15a450 2023-10-06T03:25:14.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.074+0000 7fe17ad9d700 1 --2- 172.21.15.81:0/3139921512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe17c15a450 0x7fe17c169fb0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fe174009e90 tx=0x7fe17400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:14.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.074+0000 7fe16a7fc700 1 -- 172.21.15.81:0/3139921512 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17400cb70 con 0x7fe17c15a450 2023-10-06T03:25:14.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.074+0000 7fe16a7fc700 1 -- 172.21.15.81:0/3139921512 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe17400f040 con 0x7fe17c15a450 2023-10-06T03:25:14.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.074+0000 7fe17b59e700 1 -- 172.21.15.81:0/3139921512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe17c16aea0 con 0x7fe17c15a450 2023-10-06T03:25:14.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.074+0000 7fe16a7fc700 1 -- 172.21.15.81:0/3139921512 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe174014480 con 0x7fe17c15a450 2023-10-06T03:25:14.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.074+0000 7fe17b59e700 1 -- 172.21.15.81:0/3139921512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe17c16b460 con 0x7fe17c15a450 2023-10-06T03:25:14.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.075+0000 7fe17b59e700 1 -- 172.21.15.81:0/3139921512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe17c04c3c0 con 0x7fe17c15a450 2023-10-06T03:25:14.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.076+0000 7fe16a7fc700 1 -- 172.21.15.81:0/3139921512 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe174014830 con 0x7fe17c15a450 2023-10-06T03:25:14.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.077+0000 7fe16a7fc700 1 --2- 172.21.15.81:0/3139921512 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fe15c066f30 0x7fe15c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:14.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.077+0000 7fe16a7fc700 1 -- 172.21.15.81:0/3139921512 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fe174085270 con 0x7fe17c15a450 2023-10-06T03:25:14.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.077+0000 7fe17a59c700 1 --2- 172.21.15.81:0/3139921512 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fe15c066f30 0x7fe15c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:14.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.078+0000 7fe17a59c700 1 --2- 172.21.15.81:0/3139921512 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fe15c066f30 0x7fe15c0693e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe16c0093f0 tx=0x7fe16c016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:14.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.081+0000 7fe16a7fc700 1 -- 172.21.15.81:0/3139921512 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe1740521f0 con 0x7fe17c15a450 2023-10-06T03:25:14.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.314+0000 7fe17b59e700 1 -- 172.21.15.81:0/3139921512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe17c04bb80 con 0x7fe17c15a450 2023-10-06T03:25:14.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.315+0000 7fe16a7fc700 1 -- 172.21.15.81:0/3139921512 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4594 (secure 0 0 0) 0x7fe174055810 con 0x7fe17c15a450 2023-10-06T03:25:14.316 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:25:14.316 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":27,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5065,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6834/822949628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":822949628},{"type":"v1","addr":"172.21.15.83:6834","nonce":822949628}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5068,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3024690603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6833","nonce":3024690603},{"type":"v1","addr":"172.21.15.83:6835","nonce":3024690603}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5074,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2638072815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2638072815},{"type":"v1","addr":"172.21.15.81:6837","nonce":2638072815}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:25:02.863416+0000","modified":"2023-10-06T03:25:07.689931+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5322":{"gid":5322,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6835/2219056136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2219056136},{"type":"v1","addr":"172.21.15.81:6835","nonce":2219056136}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":2}]} 2023-10-06T03:25:14.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.317+0000 7fe17b59e700 1 -- 172.21.15.81:0/3139921512 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fe15c066f30 msgr2=0x7fe15c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:14.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.317+0000 7fe17b59e700 1 --2- 172.21.15.81:0/3139921512 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fe15c066f30 0x7fe15c0693e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe16c0093f0 tx=0x7fe16c016000 comp rx=0 tx=0).stop 2023-10-06T03:25:14.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.317+0000 7fe17b59e700 1 -- 172.21.15.81:0/3139921512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe17c15a450 msgr2=0x7fe17c169fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:14.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.317+0000 7fe17b59e700 1 --2- 172.21.15.81:0/3139921512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe17c15a450 0x7fe17c169fb0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fe174009e90 tx=0x7fe17400b040 comp rx=0 tx=0).stop 2023-10-06T03:25:14.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.317+0000 7fe17b59e700 1 -- 172.21.15.81:0/3139921512 shutdown_connections 2023-10-06T03:25:14.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.317+0000 7fe17b59e700 1 --2- 172.21.15.81:0/3139921512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe17c15a450 0x7fe17c169fb0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:14.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.317+0000 7fe17b59e700 1 --2- 172.21.15.81:0/3139921512 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fe15c066f30 0x7fe15c0693e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:14.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.317+0000 7fe17b59e700 1 --2- 172.21.15.81:0/3139921512 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe17c0b2420 0x7fe17c155ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:14.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.317+0000 7fe17b59e700 1 --2- 172.21.15.81:0/3139921512 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe17c0cc670 0x7fe17c142f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:14.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.317+0000 7fe17b59e700 1 -- 172.21.15.81:0/3139921512 >> 172.21.15.81:0/3139921512 conn(0x7fe17c06ed10 msgr2=0x7fe17c14ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:14.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.317+0000 7fe17b59e700 1 -- 172.21.15.81:0/3139921512 shutdown_connections 2023-10-06T03:25:14.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.317+0000 7fe17b59e700 1 -- 172.21.15.81:0/3139921512 wait complete. 2023-10-06T03:25:14.320 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 27 2023-10-06T03:25:14.335 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:25:14.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.514+0000 7f47a55ff700 1 Processor -- start 2023-10-06T03:25:14.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.515+0000 7f47a55ff700 1 -- start start 2023-10-06T03:25:14.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.516+0000 7f47a55ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47a013f9c0 0x7f47a00ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:14.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.516+0000 7f47a55ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f47a00cab60 0x7f47a0159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:14.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.516+0000 7f47a55ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f47a013fd90 0x7f47a015a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:14.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.516+0000 7f47a55ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47a00cafe0 con 0x7f47a013fd90 2023-10-06T03:25:14.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.516+0000 7f47a55ff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47a00cb2c0 con 0x7f47a00cab60 2023-10-06T03:25:14.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.516+0000 7f47a55ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a00cb5a0 con 0x7f47a013f9c0 2023-10-06T03:25:14.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.516+0000 7f479effd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47a013f9c0 0x7f47a00ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:14.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.516+0000 7f479f7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f47a013fd90 0x7f47a015a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:14.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.516+0000 7f479e7fc700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f47a00cab60 0x7f47a0159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:14.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.516+0000 7f479effd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47a013f9c0 0x7f47a00ca620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:44360/0 (socket says 172.21.15.81:44360) 2023-10-06T03:25:14.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.516+0000 7f479e7fc700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f47a00cab60 0x7f47a0159eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:41524/0 (socket says 172.21.15.81:41524) 2023-10-06T03:25:14.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.516+0000 7f479f7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f47a013fd90 0x7f47a015a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36316/0 (socket says 172.21.15.81:36316) 2023-10-06T03:25:14.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.516+0000 7f479effd700 1 -- 172.21.15.81:0/3039957651 learned_addr learned my addr 172.21.15.81:0/3039957651 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:14.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.517+0000 7f479f7fe700 1 -- 172.21.15.81:0/3039957651 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47a013f9c0 msgr2=0x7f47a00ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:14.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.517+0000 7f479f7fe700 1 --2- 172.21.15.81:0/3039957651 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47a013f9c0 0x7f47a00ca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:14.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.517+0000 7f479f7fe700 1 -- 172.21.15.81:0/3039957651 >> v2:172.21.15.83:3300/0 conn(0x7f47a00cab60 msgr2=0x7f47a0159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:14.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.517+0000 7f479f7fe700 1 --2- 172.21.15.81:0/3039957651 >> v2:172.21.15.83:3300/0 conn(0x7f47a00cab60 0x7f47a0159eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:14.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.517+0000 7f479f7fe700 1 -- 172.21.15.81:0/3039957651 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a00cb880 con 0x7f47a013fd90 2023-10-06T03:25:14.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.517+0000 7f479f7fe700 1 --2- 172.21.15.81:0/3039957651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47a013fd90 0x7f47a015a3f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f47a00c9ba0 tx=0x7f4798009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2cb757f4bf4008a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:14.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.517+0000 7f479dffb700 1 -- 172.21.15.81:0/3039957651 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479800e070 con 0x7f47a013fd90 2023-10-06T03:25:14.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.517+0000 7f479dffb700 1 -- 172.21.15.81:0/3039957651 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f479800bab0 con 0x7f47a013fd90 2023-10-06T03:25:14.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.517+0000 7f479dffb700 1 -- 172.21.15.81:0/3039957651 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479800be70 con 0x7f47a013fd90 2023-10-06T03:25:14.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.518+0000 7f47a55ff700 1 -- 172.21.15.81:0/3039957651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47a013fd90 msgr2=0x7f47a015a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:14.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.518+0000 7f47a55ff700 1 --2- 172.21.15.81:0/3039957651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47a013fd90 0x7f47a015a3f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f47a00c9ba0 tx=0x7f4798009780 comp rx=0 tx=0).stop 2023-10-06T03:25:14.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.518+0000 7f47a55ff700 1 -- 172.21.15.81:0/3039957651 shutdown_connections 2023-10-06T03:25:14.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.518+0000 7f47a55ff700 1 --2- 172.21.15.81:0/3039957651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47a013fd90 0x7f47a015a3f0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:14.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.518+0000 7f47a55ff700 1 --2- 172.21.15.81:0/3039957651 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47a013f9c0 0x7f47a00ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:14.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.518+0000 7f47a55ff700 1 --2- 172.21.15.81:0/3039957651 >> v2:172.21.15.83:3300/0 conn(0x7f47a00cab60 0x7f47a0159eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:14.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.518+0000 7f47a55ff700 1 -- 172.21.15.81:0/3039957651 >> 172.21.15.81:0/3039957651 conn(0x7f47a00cc090 msgr2=0x7f47a00cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:14.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.518+0000 7f47a55ff700 1 -- 172.21.15.81:0/3039957651 shutdown_connections 2023-10-06T03:25:14.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.518+0000 7f47a55ff700 1 -- 172.21.15.81:0/3039957651 wait complete. 2023-10-06T03:25:14.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.519+0000 7f47a55ff700 1 Processor -- start 2023-10-06T03:25:14.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.520+0000 7f47a55ff700 1 -- start start 2023-10-06T03:25:14.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.520+0000 7f47a55ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47a013f9c0 0x7f47a00acd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:14.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.520+0000 7f47a55ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47a013fd90 0x7f47a00ae060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:14.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.520+0000 7f47a55ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47a00ae5a0 0x7f47a00b0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:14.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.520+0000 7f47a55ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a01678d0 con 0x7f47a013fd90 2023-10-06T03:25:14.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.520+0000 7f47a55ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a0167bb0 con 0x7f47a013f9c0 2023-10-06T03:25:14.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.520+0000 7f47a55ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a0167e90 con 0x7f47a00ae5a0 2023-10-06T03:25:14.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.521+0000 7f479e7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47a013fd90 0x7f47a00ae060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:14.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.521+0000 7f479e7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47a013fd90 0x7f47a00ae060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36328/0 (socket says 172.21.15.81:36328) 2023-10-06T03:25:14.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.521+0000 7f479e7fc700 1 -- 172.21.15.81:0/2166878742 learned_addr learned my addr 172.21.15.81:0/2166878742 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:14.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.521+0000 7f479effd700 1 --2- 172.21.15.81:0/2166878742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47a013f9c0 0x7f47a00acd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:14.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.521+0000 7f479f7fe700 1 --2- 172.21.15.81:0/2166878742 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47a00ae5a0 0x7f47a00b0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:14.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.521+0000 7f479e7fc700 1 -- 172.21.15.81:0/2166878742 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47a00ae5a0 msgr2=0x7f47a00b0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:14.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.521+0000 7f479e7fc700 1 --2- 172.21.15.81:0/2166878742 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47a00ae5a0 0x7f47a00b0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:14.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.521+0000 7f479e7fc700 1 -- 172.21.15.81:0/2166878742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47a013f9c0 msgr2=0x7f47a00acd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:14.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.521+0000 7f479e7fc700 1 --2- 172.21.15.81:0/2166878742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47a013f9c0 0x7f47a00acd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:14.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.521+0000 7f479e7fc700 1 -- 172.21.15.81:0/2166878742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4798009a20 con 0x7f47a013fd90 2023-10-06T03:25:14.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.521+0000 7f479e7fc700 1 --2- 172.21.15.81:0/2166878742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47a013fd90 0x7f47a00ae060 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f479400ec80 tx=0x7f47940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:14.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.522+0000 7f4786ffd700 1 -- 172.21.15.81:0/2166878742 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479400c9d0 con 0x7f47a013fd90 2023-10-06T03:25:14.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.522+0000 7f4786ffd700 1 -- 172.21.15.81:0/2166878742 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f479400cb30 con 0x7f47a013fd90 2023-10-06T03:25:14.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.522+0000 7f4786ffd700 1 -- 172.21.15.81:0/2166878742 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4794013470 con 0x7f47a013fd90 2023-10-06T03:25:14.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.522+0000 7f47a55ff700 1 -- 172.21.15.81:0/2166878742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47a0168170 con 0x7f47a013fd90 2023-10-06T03:25:14.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.522+0000 7f47a55ff700 1 -- 172.21.15.81:0/2166878742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47a0167660 con 0x7f47a013fd90 2023-10-06T03:25:14.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.523+0000 7f47a55ff700 1 -- 172.21.15.81:0/2166878742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47a016aaf0 con 0x7f47a013fd90 2023-10-06T03:25:14.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.523+0000 7f4786ffd700 1 -- 172.21.15.81:0/2166878742 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4794013820 con 0x7f47a013fd90 2023-10-06T03:25:14.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.525+0000 7f4786ffd700 1 --2- 172.21.15.81:0/2166878742 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f478c066f30 0x7f478c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:14.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.525+0000 7f4786ffd700 1 -- 172.21.15.81:0/2166878742 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f4794084c10 con 0x7f47a013fd90 2023-10-06T03:25:14.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.525+0000 7f479effd700 1 --2- 172.21.15.81:0/2166878742 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f478c066f30 0x7f478c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:14.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.525+0000 7f479effd700 1 --2- 172.21.15.81:0/2166878742 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f478c066f30 0x7f478c0693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4790006d40 tx=0x7f4790008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:14.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.528+0000 7f4786ffd700 1 -- 172.21.15.81:0/2166878742 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f47a016aaf0 con 0x7f47a013fd90 2023-10-06T03:25:14.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.720+0000 7f47a55ff700 1 -- 172.21.15.81:0/2166878742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47a016aaf0 con 0x7f47a013fd90 2023-10-06T03:25:14.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.721+0000 7f4786ffd700 1 -- 172.21.15.81:0/2166878742 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+17152 (secure 0 0 0) 0x7f47a016aaf0 con 0x7f47a013fd90 2023-10-06T03:25:14.722 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:25:14.722 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":40,"fsid":"1807b5d7-9be8-43ad-aaf8-99a4273430b3","created":"2023-10-06T03:23:20.805306+0000","modified":"2023-10-06T03:25:02.863295+0000","last_up_change":"2023-10-06T03:23:32.735796+0000","last_in_change":"2023-10-06T03:23:24.109024+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:33.198850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:33.606744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:24:50.339463+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T03:24:51.333980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"14fb667d-a677-4978-a477-80027f889d36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":85563},{"type":"v1","addr":"172.21.15.81:6818","nonce":85563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":85563},{"type":"v1","addr":"172.21.15.81:6822","nonce":85563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":85563},{"type":"v1","addr":"172.21.15.81:6830","nonce":85563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":85563},{"type":"v1","addr":"172.21.15.81:6826","nonce":85563}]},"public_addr":"172.21.15.81:6818/85563","cluster_addr":"172.21.15.81:6822/85563","heartbeat_back_addr":"172.21.15.81:6830/85563","heartbeat_front_addr":"172.21.15.81:6826/85563","state":["exists","up"]},{"osd":1,"uuid":"974d8a86-1829-4176-89ce-18e6038857f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":85561},{"type":"v1","addr":"172.21.15.81:6801","nonce":85561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":85561},{"type":"v1","addr":"172.21.15.81:6803","nonce":85561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":85561},{"type":"v1","addr":"172.21.15.81:6807","nonce":85561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":85561},{"type":"v1","addr":"172.21.15.81:6805","nonce":85561}]},"public_addr":"172.21.15.81:6801/85561","cluster_addr":"172.21.15.81:6803/85561","heartbeat_back_addr":"172.21.15.81:6807/85561","heartbeat_front_addr":"172.21.15.81:6805/85561","state":["exists","up"]},{"osd":2,"uuid":"ffbfe056-46bc-46e0-bf49-4d8f8650e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":85564},{"type":"v1","addr":"172.21.15.81:6809","nonce":85564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":85564},{"type":"v1","addr":"172.21.15.81:6811","nonce":85564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":85564},{"type":"v1","addr":"172.21.15.81:6815","nonce":85564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":85564},{"type":"v1","addr":"172.21.15.81:6813","nonce":85564}]},"public_addr":"172.21.15.81:6809/85564","cluster_addr":"172.21.15.81:6811/85564","heartbeat_back_addr":"172.21.15.81:6815/85564","heartbeat_front_addr":"172.21.15.81:6813/85564","state":["exists","up"]},{"osd":3,"uuid":"ef9a8314-3d37-4ea1-858a-e704d5695002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":85562},{"type":"v1","addr":"172.21.15.81:6819","nonce":85562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":85562},{"type":"v1","addr":"172.21.15.81:6823","nonce":85562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":85562},{"type":"v1","addr":"172.21.15.81:6831","nonce":85562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":85562},{"type":"v1","addr":"172.21.15.81:6827","nonce":85562}]},"public_addr":"172.21.15.81:6819/85562","cluster_addr":"172.21.15.81:6823/85562","heartbeat_back_addr":"172.21.15.81:6831/85562","heartbeat_front_addr":"172.21.15.81:6827/85562","state":["exists","up"]},{"osd":4,"uuid":"d83506a0-2c96-4bcb-a9fa-05e43dc329df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":85785},{"type":"v1","addr":"172.21.15.83:6801","nonce":85785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":85785},{"type":"v1","addr":"172.21.15.83:6803","nonce":85785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":85785},{"type":"v1","addr":"172.21.15.83:6807","nonce":85785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":85785},{"type":"v1","addr":"172.21.15.83:6805","nonce":85785}]},"public_addr":"172.21.15.83:6801/85785","cluster_addr":"172.21.15.83:6803/85785","heartbeat_back_addr":"172.21.15.83:6807/85785","heartbeat_front_addr":"172.21.15.83:6805/85785","state":["exists","up"]},{"osd":5,"uuid":"10687c63-a3d5-472f-acc0-4f61847b6e0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":85818},{"type":"v1","addr":"172.21.15.83:6825","nonce":85818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":85818},{"type":"v1","addr":"172.21.15.83:6827","nonce":85818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":85818},{"type":"v1","addr":"172.21.15.83:6831","nonce":85818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":85818},{"type":"v1","addr":"172.21.15.83:6829","nonce":85818}]},"public_addr":"172.21.15.83:6825/85818","cluster_addr":"172.21.15.83:6827/85818","heartbeat_back_addr":"172.21.15.83:6831/85818","heartbeat_front_addr":"172.21.15.83:6829/85818","state":["exists","up"]},{"osd":6,"uuid":"2e9daf76-5607-4a29-9a58-6e270700d223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":85787},{"type":"v1","addr":"172.21.15.83:6811","nonce":85787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":85787},{"type":"v1","addr":"172.21.15.83:6815","nonce":85787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":85787},{"type":"v1","addr":"172.21.15.83:6823","nonce":85787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6817","nonce":85787},{"type":"v1","addr":"172.21.15.83:6819","nonce":85787}]},"public_addr":"172.21.15.83:6811/85787","cluster_addr":"172.21.15.83:6815/85787","heartbeat_back_addr":"172.21.15.83:6823/85787","heartbeat_front_addr":"172.21.15.83:6819/85787","state":["exists","up"]},{"osd":7,"uuid":"5019e1ff-233a-4a5a-91ca-8afccb7ab6e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":85786},{"type":"v1","addr":"172.21.15.83:6810","nonce":85786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":85786},{"type":"v1","addr":"172.21.15.83:6814","nonce":85786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":85786},{"type":"v1","addr":"172.21.15.83:6822","nonce":85786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":85786},{"type":"v1","addr":"172.21.15.83:6818","nonce":85786}]},"public_addr":"172.21.15.83:6810/85786","cluster_addr":"172.21.15.83:6814/85786","heartbeat_back_addr":"172.21.15.83:6822/85786","heartbeat_front_addr":"172.21.15.83:6818/85786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.393431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.360031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.407428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.391613+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.403211+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.438142+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.496181+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.472323+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6835/2789471208":"2023-10-07T03:25:01.347009+0000","172.21.15.81:6834/2789471208":"2023-10-07T03:25:01.347009+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:25:14.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.723+0000 7f47a55ff700 1 -- 172.21.15.81:0/2166878742 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f478c066f30 msgr2=0x7f478c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:14.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.723+0000 7f47a55ff700 1 --2- 172.21.15.81:0/2166878742 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f478c066f30 0x7f478c0693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4790006d40 tx=0x7f4790008040 comp rx=0 tx=0).stop 2023-10-06T03:25:14.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.723+0000 7f47a55ff700 1 -- 172.21.15.81:0/2166878742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47a013fd90 msgr2=0x7f47a00ae060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:14.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.723+0000 7f47a55ff700 1 --2- 172.21.15.81:0/2166878742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47a013fd90 0x7f47a00ae060 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f479400ec80 tx=0x7f47940091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:14.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.724+0000 7f47a55ff700 1 -- 172.21.15.81:0/2166878742 shutdown_connections 2023-10-06T03:25:14.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.724+0000 7f47a55ff700 1 --2- 172.21.15.81:0/2166878742 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f478c066f30 0x7f478c0693e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:14.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.724+0000 7f47a55ff700 1 --2- 172.21.15.81:0/2166878742 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47a00ae5a0 0x7f47a00b0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:14.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.724+0000 7f47a55ff700 1 --2- 172.21.15.81:0/2166878742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47a013f9c0 0x7f47a00acd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:14.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.724+0000 7f47a55ff700 1 --2- 172.21.15.81:0/2166878742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47a013fd90 0x7f47a00ae060 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:14.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.724+0000 7f47a55ff700 1 -- 172.21.15.81:0/2166878742 >> 172.21.15.81:0/2166878742 conn(0x7f47a00cc090 msgr2=0x7f47a00c7430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:14.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.724+0000 7f47a55ff700 1 -- 172.21.15.81:0/2166878742 shutdown_connections 2023-10-06T03:25:14.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.724+0000 7f47a55ff700 1 -- 172.21.15.81:0/2166878742 wait complete. 2023-10-06T03:25:14.742 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T03:25:14.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.922+0000 7f9d49bff700 1 Processor -- start 2023-10-06T03:25:14.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.922+0000 7f9d49bff700 1 -- start start 2023-10-06T03:25:14.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.924+0000 7f9d49bff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9d4406d680 0x7f9d440c6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:14.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.924+0000 7f9d49bff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9d440aee50 0x7f9d44140710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:14.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.924+0000 7f9d49bff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d4406a190 con 0x7f9d4406da50 2023-10-06T03:25:14.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.924+0000 7f9d49bff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d44069650 con 0x7f9d4406d680 2023-10-06T03:25:14.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.924+0000 7f9d49bff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d44069860 con 0x7f9d440aee50 2023-10-06T03:25:14.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.924+0000 7f9d437fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9d4406d680 0x7f9d440c6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:14.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.924+0000 7f9d42ffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9d4406da50 0x7f9d440c7aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53188/0 (socket says 172.21.15.81:53188) 2023-10-06T03:25:14.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.924+0000 7f9d42ffd700 1 -- 172.21.15.81:0/2917124549 learned_addr learned my addr 172.21.15.81:0/2917124549 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:25:14.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.924+0000 7f9d43fff700 1 --2- 172.21.15.81:0/2917124549 >> v2:172.21.15.83:3300/0 conn(0x7f9d440aee50 0x7f9d44140710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:14.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.924+0000 7f9d437fe700 1 -- 172.21.15.81:0/2917124549 >> v2:172.21.15.83:3300/0 conn(0x7f9d440aee50 msgr2=0x7f9d44140710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:14.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.924+0000 7f9d437fe700 1 --2- 172.21.15.81:0/2917124549 >> v2:172.21.15.83:3300/0 conn(0x7f9d440aee50 0x7f9d44140710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:14.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.924+0000 7f9d437fe700 1 -- 172.21.15.81:0/2917124549 >> v1:172.21.15.81:6789/0 conn(0x7f9d4406da50 legacy=0x7f9d440c7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:14.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.924+0000 7f9d427fc700 1 -- 172.21.15.81:0/2917124549 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3821007553 0 0) 0x7f9d4406a190 con 0x7f9d4406da50 2023-10-06T03:25:14.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.924+0000 7f9d437fe700 1 -- 172.21.15.81:0/2917124549 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d44069b40 con 0x7f9d4406d680 2023-10-06T03:25:14.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.925+0000 7f9d437fe700 1 --2- 172.21.15.81:0/2917124549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d4406d680 0x7f9d440c6b10 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9d44065390 tx=0x7f9d340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db4c9a7f97379a70 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:14.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.925+0000 7f9d427fc700 1 -- 172.21.15.81:0/2917124549 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3400b6b0 con 0x7f9d4406d680 2023-10-06T03:25:14.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.925+0000 7f9d427fc700 1 -- 172.21.15.81:0/2917124549 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d3400b810 con 0x7f9d4406d680 2023-10-06T03:25:14.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.925+0000 7f9d427fc700 1 -- 172.21.15.81:0/2917124549 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3400bbb0 con 0x7f9d4406d680 2023-10-06T03:25:14.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.925+0000 7f9d49bff700 1 -- 172.21.15.81:0/2917124549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d4406d680 msgr2=0x7f9d440c6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:14.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.925+0000 7f9d49bff700 1 --2- 172.21.15.81:0/2917124549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d4406d680 0x7f9d440c6b10 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9d44065390 tx=0x7f9d340091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:14.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.926+0000 7f9d49bff700 1 -- 172.21.15.81:0/2917124549 shutdown_connections 2023-10-06T03:25:14.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.926+0000 7f9d49bff700 1 --2- 172.21.15.81:0/2917124549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d4406d680 0x7f9d440c6b10 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:14.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.926+0000 7f9d49bff700 1 --2- 172.21.15.81:0/2917124549 >> v2:172.21.15.83:3300/0 conn(0x7f9d440aee50 0x7f9d44140710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:14.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.926+0000 7f9d49bff700 1 -- 172.21.15.81:0/2917124549 >> 172.21.15.81:0/2917124549 conn(0x7f9d440cc090 msgr2=0x7f9d440cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:14.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.926+0000 7f9d49bff700 1 -- 172.21.15.81:0/2917124549 shutdown_connections 2023-10-06T03:25:14.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.926+0000 7f9d49bff700 1 -- 172.21.15.81:0/2917124549 wait complete. 2023-10-06T03:25:14.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.927+0000 7f9d49bff700 1 Processor -- start 2023-10-06T03:25:14.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.927+0000 7f9d49bff700 1 -- start start 2023-10-06T03:25:14.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.928+0000 7f9d49bff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9d4406d680 0x7f9d4413ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:14.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.928+0000 7f9d49bff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d4406da50 0x7f9d440af290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:14.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.928+0000 7f9d49bff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9d440aee50 0x7f9d44167fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:14.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.928+0000 7f9d49bff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d440ac6e0 con 0x7f9d4406da50 2023-10-06T03:25:14.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.928+0000 7f9d49bff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d440ac9c0 con 0x7f9d4406d680 2023-10-06T03:25:14.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.928+0000 7f9d49bff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d440acca0 con 0x7f9d440aee50 2023-10-06T03:25:14.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.928+0000 7f9d42ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d4406da50 0x7f9d440af290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:14.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.928+0000 7f9d42ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d4406da50 0x7f9d440af290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36356/0 (socket says 172.21.15.81:36356) 2023-10-06T03:25:14.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.928+0000 7f9d42ffd700 1 -- 172.21.15.81:0/850631515 learned_addr learned my addr 172.21.15.81:0/850631515 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:14.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.928+0000 7f9d437fe700 1 --2- 172.21.15.81:0/850631515 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9d4406d680 0x7f9d4413ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:14.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.929+0000 7f9d43fff700 1 --2- 172.21.15.81:0/850631515 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9d440aee50 0x7f9d44167fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:14.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.929+0000 7f9d42ffd700 1 -- 172.21.15.81:0/850631515 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9d440aee50 msgr2=0x7f9d44167fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:14.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.929+0000 7f9d42ffd700 1 --2- 172.21.15.81:0/850631515 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9d440aee50 0x7f9d44167fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:14.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.929+0000 7f9d42ffd700 1 -- 172.21.15.81:0/850631515 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9d4406d680 msgr2=0x7f9d4413ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:14.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.929+0000 7f9d42ffd700 1 --2- 172.21.15.81:0/850631515 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9d4406d680 0x7f9d4413ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:14.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.929+0000 7f9d42ffd700 1 -- 172.21.15.81:0/850631515 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d34009420 con 0x7f9d4406da50 2023-10-06T03:25:14.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.929+0000 7f9d42ffd700 1 --2- 172.21.15.81:0/850631515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d4406da50 0x7f9d440af290 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f9d3800c7e0 tx=0x7f9d38007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:14.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.929+0000 7f9d2b7fe700 1 -- 172.21.15.81:0/850631515 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d38005b30 con 0x7f9d4406da50 2023-10-06T03:25:14.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.929+0000 7f9d2b7fe700 1 -- 172.21.15.81:0/850631515 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d38005c90 con 0x7f9d4406da50 2023-10-06T03:25:14.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.929+0000 7f9d49bff700 1 -- 172.21.15.81:0/850631515 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d44167a90 con 0x7f9d4406da50 2023-10-06T03:25:14.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.929+0000 7f9d2b7fe700 1 -- 172.21.15.81:0/850631515 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d38007300 con 0x7f9d4406da50 2023-10-06T03:25:14.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.929+0000 7f9d49bff700 1 -- 172.21.15.81:0/850631515 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d440ac320 con 0x7f9d4406da50 2023-10-06T03:25:14.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.930+0000 7f9d49bff700 1 -- 172.21.15.81:0/850631515 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d44167cd0 con 0x7f9d4406da50 2023-10-06T03:25:14.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.931+0000 7f9d2b7fe700 1 -- 172.21.15.81:0/850631515 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9d380076b0 con 0x7f9d4406da50 2023-10-06T03:25:14.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.932+0000 7f9d2b7fe700 1 --2- 172.21.15.81:0/850631515 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f9d30066f30 0x7f9d300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:14.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.932+0000 7f9d2b7fe700 1 -- 172.21.15.81:0/850631515 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f9d38083d90 con 0x7f9d4406da50 2023-10-06T03:25:14.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.932+0000 7f9d437fe700 1 --2- 172.21.15.81:0/850631515 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f9d30066f30 0x7f9d300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:14.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.933+0000 7f9d437fe700 1 --2- 172.21.15.81:0/850631515 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f9d30066f30 0x7f9d300693e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9d340093f0 tx=0x7f9d34017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:14.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:14.936+0000 7f9d2b7fe700 1 -- 172.21.15.81:0/850631515 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9d44167cd0 con 0x7f9d4406da50 2023-10-06T03:25:15.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.168+0000 7f9d49bff700 1 -- 172.21.15.81:0/850631515 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f9d44167c80 con 0x7f9d4406da50 2023-10-06T03:25:15.169 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-10-06T03:25:15.169+0000 7f96a11f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T03:25:15.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.173+0000 7f9d2b7fe700 1 -- 172.21.15.81:0/850631515 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v28) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9d38017090 con 0x7f9d4406da50 2023-10-06T03:25:15.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.176+0000 7f9d49bff700 1 -- 172.21.15.81:0/850631515 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f9d30066f30 msgr2=0x7f9d300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:15.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.176+0000 7f9d49bff700 1 --2- 172.21.15.81:0/850631515 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f9d30066f30 0x7f9d300693e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9d340093f0 tx=0x7f9d34017000 comp rx=0 tx=0).stop 2023-10-06T03:25:15.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.176+0000 7f9d49bff700 1 -- 172.21.15.81:0/850631515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d4406da50 msgr2=0x7f9d440af290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:15.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.176+0000 7f9d49bff700 1 --2- 172.21.15.81:0/850631515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d4406da50 0x7f9d440af290 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f9d3800c7e0 tx=0x7f9d38007df0 comp rx=0 tx=0).stop 2023-10-06T03:25:15.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.176+0000 7f9d49bff700 1 -- 172.21.15.81:0/850631515 shutdown_connections 2023-10-06T03:25:15.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.176+0000 7f9d49bff700 1 --2- 172.21.15.81:0/850631515 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f9d30066f30 0x7f9d300693e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:15.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.176+0000 7f9d49bff700 1 --2- 172.21.15.81:0/850631515 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9d440aee50 0x7f9d44167fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:15.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.176+0000 7f9d49bff700 1 --2- 172.21.15.81:0/850631515 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9d4406d680 0x7f9d4413ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:15.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.176+0000 7f9d49bff700 1 --2- 172.21.15.81:0/850631515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d4406da50 0x7f9d440af290 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:15.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.176+0000 7f9d49bff700 1 -- 172.21.15.81:0/850631515 >> 172.21.15.81:0/850631515 conn(0x7f9d440cc090 msgr2=0x7f9d4413d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:15.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.177+0000 7f9d49bff700 1 -- 172.21.15.81:0/850631515 shutdown_connections 2023-10-06T03:25:15.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.177+0000 7f9d49bff700 1 -- 172.21.15.81:0/850631515 wait complete. 2023-10-06T03:25:15.179 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T03:25:15.180 INFO:tasks.ceph.mds.a.smithi081.stderr: -70> 2023-10-06T03:25:12.362+0000 7f37d35f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T03:25:15.195 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T03:25:15.215 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2023-10-06T03:25:15.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.376+0000 7fc2133ff700 1 Processor -- start 2023-10-06T03:25:15.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.376+0000 7fc2133ff700 1 -- start start 2023-10-06T03:25:15.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.377+0000 7fc2133ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc20c13fd70 0x7fc20c0ca640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:15.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.377+0000 7fc2133ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc20c15a0c0 0x7fc20c15a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:15.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.377+0000 7fc2133ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc20c15aa80 0x7fc20c06e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:15.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.377+0000 7fc2133ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc20c0cb580 con 0x7fc20c15a0c0 2023-10-06T03:25:15.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.377+0000 7fc2133ff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc20c0c6800 con 0x7fc20c13fd70 2023-10-06T03:25:15.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.377+0000 7fc2133ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc20c15af00 con 0x7fc20c15aa80 2023-10-06T03:25:15.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.378+0000 7fc21099a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc20c15a0c0 0x7fc20c15a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:15.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.378+0000 7fc21119b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc20c13fd70 0x7fc20c0ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:15.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.378+0000 7fc21199c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc20c15aa80 0x7fc20c06e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:15.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.378+0000 7fc21099a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc20c15a0c0 0x7fc20c15a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36376/0 (socket says 172.21.15.81:36376) 2023-10-06T03:25:15.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.378+0000 7fc21099a700 1 -- 172.21.15.81:0/231218938 learned_addr learned my addr 172.21.15.81:0/231218938 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:15.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.378+0000 7fc21099a700 1 -- 172.21.15.81:0/231218938 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc20c15aa80 msgr2=0x7fc20c06e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:15.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.378+0000 7fc21099a700 1 --2- 172.21.15.81:0/231218938 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc20c15aa80 0x7fc20c06e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:15.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.378+0000 7fc21099a700 1 -- 172.21.15.81:0/231218938 >> v2:172.21.15.83:3300/0 conn(0x7fc20c13fd70 msgr2=0x7fc20c0ca640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:15.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.378+0000 7fc21099a700 1 --2- 172.21.15.81:0/231218938 >> v2:172.21.15.83:3300/0 conn(0x7fc20c13fd70 0x7fc20c0ca640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:15.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.378+0000 7fc21099a700 1 -- 172.21.15.81:0/231218938 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc20c069880 con 0x7fc20c15a0c0 2023-10-06T03:25:15.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.378+0000 7fc21119b700 1 --2- 172.21.15.81:0/231218938 >> v2:172.21.15.83:3300/0 conn(0x7fc20c13fd70 0x7fc20c0ca640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:25:15.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.378+0000 7fc21099a700 1 --2- 172.21.15.81:0/231218938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc20c15a0c0 0x7fc20c15a540 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fc20c0cd1a0 tx=0x7fc1fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f25368d0bad9599 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:15.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.379+0000 7fc203fff700 1 -- 172.21.15.81:0/231218938 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc00b640 con 0x7fc20c15a0c0 2023-10-06T03:25:15.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.379+0000 7fc203fff700 1 -- 172.21.15.81:0/231218938 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1fc00b7a0 con 0x7fc20c15a0c0 2023-10-06T03:25:15.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.379+0000 7fc203fff700 1 -- 172.21.15.81:0/231218938 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc00bb60 con 0x7fc20c15a0c0 2023-10-06T03:25:15.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.379+0000 7fc2133ff700 1 -- 172.21.15.81:0/231218938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc20c15a0c0 msgr2=0x7fc20c15a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:15.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.379+0000 7fc2133ff700 1 --2- 172.21.15.81:0/231218938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc20c15a0c0 0x7fc20c15a540 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fc20c0cd1a0 tx=0x7fc1fc009250 comp rx=0 tx=0).stop 2023-10-06T03:25:15.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.379+0000 7fc2133ff700 1 -- 172.21.15.81:0/231218938 shutdown_connections 2023-10-06T03:25:15.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.379+0000 7fc2133ff700 1 --2- 172.21.15.81:0/231218938 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc20c15aa80 0x7fc20c06e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:15.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.379+0000 7fc2133ff700 1 --2- 172.21.15.81:0/231218938 >> v2:172.21.15.83:3300/0 conn(0x7fc20c13fd70 0x7fc20c0ca640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:15.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.379+0000 7fc2133ff700 1 --2- 172.21.15.81:0/231218938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc20c15a0c0 0x7fc20c15a540 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:15.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.379+0000 7fc2133ff700 1 -- 172.21.15.81:0/231218938 >> 172.21.15.81:0/231218938 conn(0x7fc20c0cc090 msgr2=0x7fc20c0cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:15.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.379+0000 7fc2133ff700 1 -- 172.21.15.81:0/231218938 shutdown_connections 2023-10-06T03:25:15.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.379+0000 7fc2133ff700 1 -- 172.21.15.81:0/231218938 wait complete. 2023-10-06T03:25:15.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.381+0000 7fc2133ff700 1 Processor -- start 2023-10-06T03:25:15.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.381+0000 7fc2133ff700 1 -- start start 2023-10-06T03:25:15.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.382+0000 7fc2133ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc20c13fd70 0x7fc20c13b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:15.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.382+0000 7fc2133ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc20c15a0c0 0x7fc20c13ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:15.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.382+0000 7fc2133ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc20c15aa80 0x7fc20c0c4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:15.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.382+0000 7fc2133ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc20c0c3b00 con 0x7fc20c13fd70 2023-10-06T03:25:15.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.382+0000 7fc2133ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc20c0c4380 con 0x7fc20c15aa80 2023-10-06T03:25:15.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.382+0000 7fc2133ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc20c0b1d00 con 0x7fc20c15a0c0 2023-10-06T03:25:15.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.382+0000 7fc21119b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc20c13fd70 0x7fc20c13b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:15.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.382+0000 7fc21119b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc20c13fd70 0x7fc20c13b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36386/0 (socket says 172.21.15.81:36386) 2023-10-06T03:25:15.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.382+0000 7fc21119b700 1 -- 172.21.15.81:0/1361231412 learned_addr learned my addr 172.21.15.81:0/1361231412 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:15.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.382+0000 7fc21119b700 1 -- 172.21.15.81:0/1361231412 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc20c15a0c0 msgr2=0x7fc20c13ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:15.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.382+0000 7fc21119b700 1 --2- 172.21.15.81:0/1361231412 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc20c15a0c0 0x7fc20c13ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:15.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.382+0000 7fc21199c700 1 --2- 172.21.15.81:0/1361231412 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc20c15aa80 0x7fc20c0c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:15.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.382+0000 7fc21119b700 1 -- 172.21.15.81:0/1361231412 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc20c15aa80 msgr2=0x7fc20c0c4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:15.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.382+0000 7fc21119b700 1 --2- 172.21.15.81:0/1361231412 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc20c15aa80 0x7fc20c0c4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:15.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.382+0000 7fc21119b700 1 -- 172.21.15.81:0/1361231412 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2080093c0 con 0x7fc20c13fd70 2023-10-06T03:25:15.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.382+0000 7fc21119b700 1 --2- 172.21.15.81:0/1361231412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc20c13fd70 0x7fc20c13b9f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc20800ec80 tx=0x7fc208009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:15.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.383+0000 7fc2017fa700 1 -- 172.21.15.81:0/1361231412 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc208005a00 con 0x7fc20c13fd70 2023-10-06T03:25:15.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.383+0000 7fc2017fa700 1 -- 172.21.15.81:0/1361231412 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc208005b60 con 0x7fc20c13fd70 2023-10-06T03:25:15.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.383+0000 7fc2133ff700 1 -- 172.21.15.81:0/1361231412 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1fc0094f0 con 0x7fc20c13fd70 2023-10-06T03:25:15.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.383+0000 7fc2017fa700 1 -- 172.21.15.81:0/1361231412 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20800c9d0 con 0x7fc20c13fd70 2023-10-06T03:25:15.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.383+0000 7fc2133ff700 1 -- 172.21.15.81:0/1361231412 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc20c0c4010 con 0x7fc20c13fd70 2023-10-06T03:25:15.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.384+0000 7fc2133ff700 1 -- 172.21.15.81:0/1361231412 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc20c04c3c0 con 0x7fc20c13fd70 2023-10-06T03:25:15.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.385+0000 7fc2017fa700 1 -- 172.21.15.81:0/1361231412 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc20800cd80 con 0x7fc20c13fd70 2023-10-06T03:25:15.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.385+0000 7fc2017fa700 1 --2- 172.21.15.81:0/1361231412 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc1f0066f30 0x7fc1f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:15.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.386+0000 7fc2017fa700 1 -- 172.21.15.81:0/1361231412 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6550+0+0 (secure 0 0 0) 0x7fc208084e90 con 0x7fc20c13fd70 2023-10-06T03:25:15.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.386+0000 7fc21099a700 1 --2- 172.21.15.81:0/1361231412 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc1f0066f30 0x7fc1f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:15.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.386+0000 7fc21099a700 1 --2- 172.21.15.81:0/1361231412 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc1f0066f30 0x7fc1f00693e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc20c0cd1a0 tx=0x7fc1fc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:15.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.389+0000 7fc2017fa700 1 -- 172.21.15.81:0/1361231412 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc208051d10 con 0x7fc20c13fd70 2023-10-06T03:25:15.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:15.624+0000 7fc2133ff700 1 -- 172.21.15.81:0/1361231412 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc20c068f40 con 0x7fc20c13fd70 2023-10-06T03:25:16.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.175+0000 7fc2017fa700 1 -- 172.21.15.81:0/1361231412 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v29) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc208055330 con 0x7fc20c13fd70 2023-10-06T03:25:16.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.178+0000 7fc2133ff700 1 -- 172.21.15.81:0/1361231412 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc1f0066f30 msgr2=0x7fc1f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:16.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.178+0000 7fc2133ff700 1 --2- 172.21.15.81:0/1361231412 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc1f0066f30 0x7fc1f00693e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc20c0cd1a0 tx=0x7fc1fc017000 comp rx=0 tx=0).stop 2023-10-06T03:25:16.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.178+0000 7fc2133ff700 1 -- 172.21.15.81:0/1361231412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc20c13fd70 msgr2=0x7fc20c13b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:16.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.178+0000 7fc2133ff700 1 --2- 172.21.15.81:0/1361231412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc20c13fd70 0x7fc20c13b9f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc20800ec80 tx=0x7fc208009120 comp rx=0 tx=0).stop 2023-10-06T03:25:16.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.178+0000 7fc2133ff700 1 -- 172.21.15.81:0/1361231412 shutdown_connections 2023-10-06T03:25:16.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.178+0000 7fc2133ff700 1 --2- 172.21.15.81:0/1361231412 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc20c15aa80 0x7fc20c0c4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:16.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.178+0000 7fc2133ff700 1 --2- 172.21.15.81:0/1361231412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc20c13fd70 0x7fc20c13b9f0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:16.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.178+0000 7fc2133ff700 1 --2- 172.21.15.81:0/1361231412 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc1f0066f30 0x7fc1f00693e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:16.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.178+0000 7fc2133ff700 1 --2- 172.21.15.81:0/1361231412 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc20c15a0c0 0x7fc20c13ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:16.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.178+0000 7fc2133ff700 1 -- 172.21.15.81:0/1361231412 >> 172.21.15.81:0/1361231412 conn(0x7fc20c0cc090 msgr2=0x7fc20c0cc460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:16.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.178+0000 7fc2133ff700 1 -- 172.21.15.81:0/1361231412 shutdown_connections 2023-10-06T03:25:16.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.179+0000 7fc2133ff700 1 -- 172.21.15.81:0/1361231412 wait complete. 2023-10-06T03:25:16.199 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T03:25:16.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.424+0000 7fa9e23ff700 1 Processor -- start 2023-10-06T03:25:16.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.424+0000 7fa9e23ff700 1 -- start start 2023-10-06T03:25:16.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.425+0000 7fa9e23ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa9dc13f980 0x7fa9dc0c1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:16.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.425+0000 7fa9e23ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa9dc13fd50 0x7fa9dc0c70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:16.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.425+0000 7fa9e23ff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9dc0c75e0 con 0x7fa9dc159e90 2023-10-06T03:25:16.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.425+0000 7fa9e23ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9dc0c8490 con 0x7fa9dc13fd50 2023-10-06T03:25:16.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.425+0000 7fa9e23ff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9dc0c7880 con 0x7fa9dc13f980 2023-10-06T03:25:16.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.426+0000 7fa9db7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa9dc13fd50 0x7fa9dc0c70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:16.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.426+0000 7fa9e099c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa9dc159e90 0x7fa9dc06e300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53196/0 (socket says 172.21.15.81:53196) 2023-10-06T03:25:16.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.426+0000 7fa9e099c700 1 -- 172.21.15.81:0/967995353 learned_addr learned my addr 172.21.15.81:0/967995353 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:25:16.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.426+0000 7fa9dbfff700 1 --2- 172.21.15.81:0/967995353 >> v2:172.21.15.83:3300/0 conn(0x7fa9dc13f980 0x7fa9dc0c1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:16.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.426+0000 7fa9db7fe700 1 -- 172.21.15.81:0/967995353 >> v2:172.21.15.83:3300/0 conn(0x7fa9dc13f980 msgr2=0x7fa9dc0c1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:16.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.426+0000 7fa9db7fe700 1 --2- 172.21.15.81:0/967995353 >> v2:172.21.15.83:3300/0 conn(0x7fa9dc13f980 0x7fa9dc0c1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:16.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.426+0000 7fa9db7fe700 1 -- 172.21.15.81:0/967995353 >> v1:172.21.15.81:6789/0 conn(0x7fa9dc159e90 legacy=0x7fa9dc06e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:16.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.426+0000 7fa9db7fe700 1 -- 172.21.15.81:0/967995353 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9dc0c7b60 con 0x7fa9dc13fd50 2023-10-06T03:25:16.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.426+0000 7fa9daffd700 1 -- 172.21.15.81:0/967995353 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3369826124 0 0) 0x7fa9dc0c75e0 con 0x7fa9dc159e90 2023-10-06T03:25:16.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.426+0000 7fa9db7fe700 1 --2- 172.21.15.81:0/967995353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9dc13fd50 0x7fa9dc0c70a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc0c8a20 tx=0x7fa9d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e89a3060236fbc6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:16.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.426+0000 7fa9daffd700 1 -- 172.21.15.81:0/967995353 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d000b6b0 con 0x7fa9dc13fd50 2023-10-06T03:25:16.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.427+0000 7fa9daffd700 1 -- 172.21.15.81:0/967995353 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d000b810 con 0x7fa9dc13fd50 2023-10-06T03:25:16.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.427+0000 7fa9daffd700 1 -- 172.21.15.81:0/967995353 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d000bbb0 con 0x7fa9dc13fd50 2023-10-06T03:25:16.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.427+0000 7fa9e23ff700 1 -- 172.21.15.81:0/967995353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9dc13fd50 msgr2=0x7fa9dc0c70a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:16.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.427+0000 7fa9e23ff700 1 --2- 172.21.15.81:0/967995353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9dc13fd50 0x7fa9dc0c70a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc0c8a20 tx=0x7fa9d00091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:16.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.427+0000 7fa9e23ff700 1 -- 172.21.15.81:0/967995353 shutdown_connections 2023-10-06T03:25:16.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.427+0000 7fa9e23ff700 1 --2- 172.21.15.81:0/967995353 >> v2:172.21.15.83:3300/0 conn(0x7fa9dc13f980 0x7fa9dc0c1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:16.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.427+0000 7fa9e23ff700 1 --2- 172.21.15.81:0/967995353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9dc13fd50 0x7fa9dc0c70a0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:16.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.427+0000 7fa9e23ff700 1 -- 172.21.15.81:0/967995353 >> 172.21.15.81:0/967995353 conn(0x7fa9dc0cc050 msgr2=0x7fa9dc0cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:16.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.427+0000 7fa9e23ff700 1 -- 172.21.15.81:0/967995353 shutdown_connections 2023-10-06T03:25:16.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.427+0000 7fa9e23ff700 1 -- 172.21.15.81:0/967995353 wait complete. 2023-10-06T03:25:16.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.429+0000 7fa9e23ff700 1 Processor -- start 2023-10-06T03:25:16.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.429+0000 7fa9e23ff700 1 -- start start 2023-10-06T03:25:16.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.430+0000 7fa9e23ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9dc13f980 0x7fa9dc1552b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:16.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.430+0000 7fa9e23ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa9dc13fd50 0x7fa9dc1557f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:16.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.430+0000 7fa9e23ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa9dc159e90 0x7fa9dc1592a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:16.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.430+0000 7fa9e23ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc16aa10 con 0x7fa9dc13f980 2023-10-06T03:25:16.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.430+0000 7fa9e23ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc1699f0 con 0x7fa9dc13fd50 2023-10-06T03:25:16.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.430+0000 7fa9e23ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc169c70 con 0x7fa9dc159e90 2023-10-06T03:25:16.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.430+0000 7fa9dbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9dc13f980 0x7fa9dc1552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:16.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.430+0000 7fa9dbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9dc13f980 0x7fa9dc1552b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36412/0 (socket says 172.21.15.81:36412) 2023-10-06T03:25:16.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.430+0000 7fa9dbfff700 1 -- 172.21.15.81:0/590990468 learned_addr learned my addr 172.21.15.81:0/590990468 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:16.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.430+0000 7fa9db7fe700 1 --2- 172.21.15.81:0/590990468 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa9dc13fd50 0x7fa9dc1557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:16.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.430+0000 7fa9e099c700 1 --2- 172.21.15.81:0/590990468 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa9dc159e90 0x7fa9dc1592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:16.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.430+0000 7fa9dbfff700 1 -- 172.21.15.81:0/590990468 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa9dc159e90 msgr2=0x7fa9dc1592a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:16.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.430+0000 7fa9dbfff700 1 --2- 172.21.15.81:0/590990468 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa9dc159e90 0x7fa9dc1592a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:16.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.430+0000 7fa9dbfff700 1 -- 172.21.15.81:0/590990468 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa9dc13fd50 msgr2=0x7fa9dc1557f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:16.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.430+0000 7fa9dbfff700 1 --2- 172.21.15.81:0/590990468 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa9dc13fd50 0x7fa9dc1557f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:16.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.430+0000 7fa9dbfff700 1 -- 172.21.15.81:0/590990468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d0009420 con 0x7fa9dc13f980 2023-10-06T03:25:16.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.430+0000 7fa9db7fe700 1 --2- 172.21.15.81:0/590990468 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa9dc13fd50 0x7fa9dc1557f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:16.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.430+0000 7fa9dbfff700 1 --2- 172.21.15.81:0/590990468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9dc13f980 0x7fa9dc1552b0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc00d890 tx=0x7fa9cc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:16.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.431+0000 7fa9c3fff700 1 -- 172.21.15.81:0/590990468 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc00b600 con 0x7fa9dc13f980 2023-10-06T03:25:16.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.431+0000 7fa9c3fff700 1 -- 172.21.15.81:0/590990468 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9cc00b760 con 0x7fa9dc13f980 2023-10-06T03:25:16.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.431+0000 7fa9c3fff700 1 -- 172.21.15.81:0/590990468 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc00bae0 con 0x7fa9dc13f980 2023-10-06T03:25:16.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.431+0000 7fa9e23ff700 1 -- 172.21.15.81:0/590990468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9dc169f50 con 0x7fa9dc13f980 2023-10-06T03:25:16.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.431+0000 7fa9e23ff700 1 -- 172.21.15.81:0/590990468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9dc1597e0 con 0x7fa9dc13f980 2023-10-06T03:25:16.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.432+0000 7fa9e23ff700 1 -- 172.21.15.81:0/590990468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9dc04c3c0 con 0x7fa9dc13f980 2023-10-06T03:25:16.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.433+0000 7fa9c3fff700 1 -- 172.21.15.81:0/590990468 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa9cc01e460 con 0x7fa9dc13f980 2023-10-06T03:25:16.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.433+0000 7fa9c3fff700 1 --2- 172.21.15.81:0/590990468 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa9c8066f30 0x7fa9c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:16.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.434+0000 7fa9c3fff700 1 -- 172.21.15.81:0/590990468 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6550+0+0 (secure 0 0 0) 0x7fa9cc084fe0 con 0x7fa9dc13f980 2023-10-06T03:25:16.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.434+0000 7fa9db7fe700 1 --2- 172.21.15.81:0/590990468 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa9c8066f30 0x7fa9c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:16.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.434+0000 7fa9db7fe700 1 --2- 172.21.15.81:0/590990468 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa9c8066f30 0x7fa9c80693e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa9d00093f0 tx=0x7fa9d0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:16.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.438+0000 7fa9c3fff700 1 -- 172.21.15.81:0/590990468 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa9cc051e80 con 0x7fa9dc13f980 2023-10-06T03:25:16.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:16.626+0000 7fa9e23ff700 1 -- 172.21.15.81:0/590990468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa9dc0c7e40 con 0x7fa9dc13f980 2023-10-06T03:25:17.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.181+0000 7fa9c3fff700 1 -- 172.21.15.81:0/590990468 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v42) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa9cc0554a0 con 0x7fa9dc13f980 2023-10-06T03:25:17.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.184+0000 7fa9e23ff700 1 -- 172.21.15.81:0/590990468 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa9c8066f30 msgr2=0x7fa9c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:17.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.184+0000 7fa9e23ff700 1 --2- 172.21.15.81:0/590990468 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa9c8066f30 0x7fa9c80693e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa9d00093f0 tx=0x7fa9d0017000 comp rx=0 tx=0).stop 2023-10-06T03:25:17.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.184+0000 7fa9e23ff700 1 -- 172.21.15.81:0/590990468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9dc13f980 msgr2=0x7fa9dc1552b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:17.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.184+0000 7fa9e23ff700 1 --2- 172.21.15.81:0/590990468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9dc13f980 0x7fa9dc1552b0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc00d890 tx=0x7fa9cc008040 comp rx=0 tx=0).stop 2023-10-06T03:25:17.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.184+0000 7fa9e23ff700 1 -- 172.21.15.81:0/590990468 shutdown_connections 2023-10-06T03:25:17.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.184+0000 7fa9e23ff700 1 --2- 172.21.15.81:0/590990468 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa9c8066f30 0x7fa9c80693e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:17.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.184+0000 7fa9e23ff700 1 --2- 172.21.15.81:0/590990468 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa9dc159e90 0x7fa9dc1592a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:17.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.184+0000 7fa9e23ff700 1 --2- 172.21.15.81:0/590990468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9dc13f980 0x7fa9dc1552b0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:17.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.184+0000 7fa9e23ff700 1 --2- 172.21.15.81:0/590990468 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa9dc13fd50 0x7fa9dc1557f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:17.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.184+0000 7fa9e23ff700 1 -- 172.21.15.81:0/590990468 >> 172.21.15.81:0/590990468 conn(0x7fa9dc0cc050 msgr2=0x7fa9dc15a290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:17.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.184+0000 7fa9e23ff700 1 -- 172.21.15.81:0/590990468 shutdown_connections 2023-10-06T03:25:17.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.184+0000 7fa9e23ff700 1 -- 172.21.15.81:0/590990468 wait complete. 2023-10-06T03:25:17.187 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2023-10-06T03:25:17.203 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T03:25:17.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.384+0000 7fc03e1ff700 1 Processor -- start 2023-10-06T03:25:17.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.384+0000 7fc03e1ff700 1 -- start start 2023-10-06T03:25:17.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.385+0000 7fc03e1ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc03813fd50 0x7fc0380c1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:17.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.386+0000 7fc03e1ff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0380c7880 con 0x7fc038159e90 2023-10-06T03:25:17.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.386+0000 7fc03e1ff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0380c7b60 con 0x7fc03813f980 2023-10-06T03:25:17.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.386+0000 7fc03e1ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0380c8490 con 0x7fc03813fd50 2023-10-06T03:25:17.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.386+0000 7fc037fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc038159e90 0x7fc0380ca000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53210/0 (socket says 172.21.15.81:53210) 2023-10-06T03:25:17.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.386+0000 7fc037fff700 1 -- 172.21.15.81:0/3180058078 learned_addr learned my addr 172.21.15.81:0/3180058078 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:25:17.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.386+0000 7fc02ffff700 1 --2- 172.21.15.81:0/3180058078 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc03813fd50 0x7fc0380c1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:17.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.386+0000 7fc036ffd700 1 -- 172.21.15.81:0/3180058078 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3478459908 0 0) 0x7fc0380c7880 con 0x7fc038159e90 2023-10-06T03:25:17.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.386+0000 7fc036ffd700 1 -- 172.21.15.81:0/3180058078 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc024003570 con 0x7fc038159e90 2023-10-06T03:25:17.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.386+0000 7fc036ffd700 1 -- 172.21.15.81:0/3180058078 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2052782612 0 0) 0x7fc0380c7b60 con 0x7fc03813f980 2023-10-06T03:25:17.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.386+0000 7fc036ffd700 1 -- 172.21.15.81:0/3180058078 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0380c7880 con 0x7fc03813f980 2023-10-06T03:25:17.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.387+0000 7fc036ffd700 1 -- 172.21.15.81:0/3180058078 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 276006950 0 0) 0x7fc024003570 con 0x7fc038159e90 2023-10-06T03:25:17.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.387+0000 7fc02ffff700 1 -- 172.21.15.81:0/3180058078 >> v1:172.21.15.83:6789/0 conn(0x7fc03813f980 legacy=0x7fc0380c70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:17.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.387+0000 7fc02ffff700 1 -- 172.21.15.81:0/3180058078 >> v1:172.21.15.81:6789/0 conn(0x7fc038159e90 legacy=0x7fc0380ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:17.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.387+0000 7fc02ffff700 1 -- 172.21.15.81:0/3180058078 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0380c7e40 con 0x7fc03813fd50 2023-10-06T03:25:17.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.387+0000 7fc02ffff700 1 --2- 172.21.15.81:0/3180058078 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc03813fd50 0x7fc0380c1090 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc020009910 tx=0x7fc0200091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e757345fff06032f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:17.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.387+0000 7fc036ffd700 1 -- 172.21.15.81:0/3180058078 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0300017f0 con 0x7fc03813fd50 2023-10-06T03:25:17.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.387+0000 7fc036ffd700 1 -- 172.21.15.81:0/3180058078 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc020011420 con 0x7fc03813fd50 2023-10-06T03:25:17.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.387+0000 7fc036ffd700 1 -- 172.21.15.81:0/3180058078 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0200117c0 con 0x7fc03813fd50 2023-10-06T03:25:17.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.388+0000 7fc03e1ff700 1 -- 172.21.15.81:0/3180058078 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc03813fd50 msgr2=0x7fc0380c1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:17.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.388+0000 7fc03e1ff700 1 --2- 172.21.15.81:0/3180058078 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc03813fd50 0x7fc0380c1090 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc020009910 tx=0x7fc0200091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:17.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.388+0000 7fc03e1ff700 1 -- 172.21.15.81:0/3180058078 shutdown_connections 2023-10-06T03:25:17.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.388+0000 7fc03e1ff700 1 --2- 172.21.15.81:0/3180058078 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc03813fd50 0x7fc0380c1090 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:17.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.388+0000 7fc03e1ff700 1 -- 172.21.15.81:0/3180058078 >> 172.21.15.81:0/3180058078 conn(0x7fc0380cc050 msgr2=0x7fc0380cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:17.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.388+0000 7fc03e1ff700 1 -- 172.21.15.81:0/3180058078 shutdown_connections 2023-10-06T03:25:17.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.388+0000 7fc03e1ff700 1 -- 172.21.15.81:0/3180058078 wait complete. 2023-10-06T03:25:17.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.389+0000 7fc03e1ff700 1 Processor -- start 2023-10-06T03:25:17.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.389+0000 7fc03e1ff700 1 -- start start 2023-10-06T03:25:17.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.390+0000 7fc03e1ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc03813f980 0x7fc0380b1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:17.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.390+0000 7fc03e1ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc03813fd50 0x7fc038133570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:17.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.390+0000 7fc03e1ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc038159e90 0x7fc0380aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:17.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.390+0000 7fc03e1ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc038156920 con 0x7fc03813f980 2023-10-06T03:25:17.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.390+0000 7fc03e1ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc038159350 con 0x7fc03813fd50 2023-10-06T03:25:17.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.390+0000 7fc03e1ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc038159630 con 0x7fc038159e90 2023-10-06T03:25:17.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.390+0000 7fc0377fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc03813f980 0x7fc0380b1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:17.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.390+0000 7fc0377fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc03813f980 0x7fc0380b1380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36426/0 (socket says 172.21.15.81:36426) 2023-10-06T03:25:17.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.390+0000 7fc0377fe700 1 -- 172.21.15.81:0/2822758941 learned_addr learned my addr 172.21.15.81:0/2822758941 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:17.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.391+0000 7fc02ffff700 1 --2- 172.21.15.81:0/2822758941 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc03813fd50 0x7fc038133570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:17.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.391+0000 7fc037fff700 1 --2- 172.21.15.81:0/2822758941 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc038159e90 0x7fc0380aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:17.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.391+0000 7fc0377fe700 1 -- 172.21.15.81:0/2822758941 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc038159e90 msgr2=0x7fc0380aedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:17.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.391+0000 7fc0377fe700 1 --2- 172.21.15.81:0/2822758941 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc038159e90 0x7fc0380aedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:17.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.391+0000 7fc0377fe700 1 -- 172.21.15.81:0/2822758941 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc03813fd50 msgr2=0x7fc038133570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:17.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.391+0000 7fc0377fe700 1 --2- 172.21.15.81:0/2822758941 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc03813fd50 0x7fc038133570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:17.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.391+0000 7fc0377fe700 1 -- 172.21.15.81:0/2822758941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc020009420 con 0x7fc03813f980 2023-10-06T03:25:17.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.391+0000 7fc0377fe700 1 --2- 172.21.15.81:0/2822758941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc03813f980 0x7fc0380b1380 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fc02800c790 tx=0x7fc028007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:17.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.391+0000 7fc02f7fe700 1 -- 172.21.15.81:0/2822758941 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc028010510 con 0x7fc03813f980 2023-10-06T03:25:17.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.391+0000 7fc02f7fe700 1 -- 172.21.15.81:0/2822758941 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc028010670 con 0x7fc03813f980 2023-10-06T03:25:17.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.391+0000 7fc03e1ff700 1 -- 172.21.15.81:0/2822758941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc038156bc0 con 0x7fc03813f980 2023-10-06T03:25:17.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.391+0000 7fc02f7fe700 1 -- 172.21.15.81:0/2822758941 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc028010a10 con 0x7fc03813f980 2023-10-06T03:25:17.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.391+0000 7fc03e1ff700 1 -- 172.21.15.81:0/2822758941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc038155ff0 con 0x7fc03813f980 2023-10-06T03:25:17.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.392+0000 7fc03e1ff700 1 -- 172.21.15.81:0/2822758941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0380b1eb0 con 0x7fc03813f980 2023-10-06T03:25:17.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.393+0000 7fc02f7fe700 1 -- 172.21.15.81:0/2822758941 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc02801b400 con 0x7fc03813f980 2023-10-06T03:25:17.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.395+0000 7fc02f7fe700 1 --2- 172.21.15.81:0/2822758941 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc018066f30 0x7fc0180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:17.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.395+0000 7fc02f7fe700 1 -- 172.21.15.81:0/2822758941 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6112+0+0 (secure 0 0 0) 0x7fc028084510 con 0x7fc03813f980 2023-10-06T03:25:17.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.395+0000 7fc02ffff700 1 --2- 172.21.15.81:0/2822758941 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc018066f30 0x7fc0180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:17.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.395+0000 7fc02ffff700 1 --2- 172.21.15.81:0/2822758941 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc018066f30 0x7fc0180693e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc0200030c0 tx=0x7fc020016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:17.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.399+0000 7fc02f7fe700 1 -- 172.21.15.81:0/2822758941 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc028051570 con 0x7fc03813f980 2023-10-06T03:25:17.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:17.588+0000 7fc03e1ff700 1 -- 172.21.15.81:0/2822758941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc0381570e0 con 0x7fc03813f980 2023-10-06T03:25:18.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.187+0000 7fc02f7fe700 1 -- 172.21.15.81:0/2822758941 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v43) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc028054b90 con 0x7fc03813f980 2023-10-06T03:25:18.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.191+0000 7fc03e1ff700 1 -- 172.21.15.81:0/2822758941 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc018066f30 msgr2=0x7fc0180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:18.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.191+0000 7fc03e1ff700 1 --2- 172.21.15.81:0/2822758941 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc018066f30 0x7fc0180693e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc0200030c0 tx=0x7fc020016000 comp rx=0 tx=0).stop 2023-10-06T03:25:18.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.191+0000 7fc03e1ff700 1 -- 172.21.15.81:0/2822758941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc03813f980 msgr2=0x7fc0380b1380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:18.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.191+0000 7fc03e1ff700 1 --2- 172.21.15.81:0/2822758941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc03813f980 0x7fc0380b1380 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fc02800c790 tx=0x7fc028007e10 comp rx=0 tx=0).stop 2023-10-06T03:25:18.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.191+0000 7fc03e1ff700 1 -- 172.21.15.81:0/2822758941 shutdown_connections 2023-10-06T03:25:18.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.191+0000 7fc03e1ff700 1 --2- 172.21.15.81:0/2822758941 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc018066f30 0x7fc0180693e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:18.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.191+0000 7fc03e1ff700 1 --2- 172.21.15.81:0/2822758941 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc038159e90 0x7fc0380aedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:18.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.191+0000 7fc03e1ff700 1 --2- 172.21.15.81:0/2822758941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc03813f980 0x7fc0380b1380 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:18.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.191+0000 7fc03e1ff700 1 --2- 172.21.15.81:0/2822758941 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc03813fd50 0x7fc038133570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:18.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.191+0000 7fc03e1ff700 1 -- 172.21.15.81:0/2822758941 >> 172.21.15.81:0/2822758941 conn(0x7fc0380cc050 msgr2=0x7fc0380c6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:18.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.191+0000 7fc03e1ff700 1 -- 172.21.15.81:0/2822758941 shutdown_connections 2023-10-06T03:25:18.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.191+0000 7fc03e1ff700 1 -- 172.21.15.81:0/2822758941 wait complete. 2023-10-06T03:25:18.194 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2023-10-06T03:25:18.220 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T03:25:18.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.402+0000 7fc99759d700 1 Processor -- start 2023-10-06T03:25:18.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.402+0000 7fc99759d700 1 -- start start 2023-10-06T03:25:18.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.403+0000 7fc99759d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc990159420 0x7fc9900c7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:18.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.403+0000 7fc99759d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc990068d00 0x7fc9900c7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:18.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.403+0000 7fc99759d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9900c8a40 con 0x7fc9901597f0 2023-10-06T03:25:18.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.403+0000 7fc99759d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc990069da0 con 0x7fc990068d00 2023-10-06T03:25:18.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.403+0000 7fc99759d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9900c81a0 con 0x7fc990159420 2023-10-06T03:25:18.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.403+0000 7fc996d9c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc990068d00 0x7fc9900c7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:18.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.403+0000 7fc995d9a700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc9901597f0 0x7fc9900685f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53212/0 (socket says 172.21.15.81:53212) 2023-10-06T03:25:18.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.404+0000 7fc995d9a700 1 -- 172.21.15.81:0/3537285133 learned_addr learned my addr 172.21.15.81:0/3537285133 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:25:18.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.404+0000 7fc99659b700 1 --2- 172.21.15.81:0/3537285133 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc990159420 0x7fc9900c7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:18.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.404+0000 7fc996d9c700 1 -- 172.21.15.81:0/3537285133 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc990159420 msgr2=0x7fc9900c7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:18.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.404+0000 7fc996d9c700 1 --2- 172.21.15.81:0/3537285133 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc990159420 0x7fc9900c7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:18.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.404+0000 7fc996d9c700 1 -- 172.21.15.81:0/3537285133 >> v1:172.21.15.81:6789/0 conn(0x7fc9901597f0 legacy=0x7fc9900685f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:18.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.404+0000 7fc995599700 1 -- 172.21.15.81:0/3537285133 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3717662249 0 0) 0x7fc9900c8a40 con 0x7fc9901597f0 2023-10-06T03:25:18.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.404+0000 7fc996d9c700 1 -- 172.21.15.81:0/3537285133 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9900c8480 con 0x7fc990068d00 2023-10-06T03:25:18.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.404+0000 7fc996d9c700 1 --2- 172.21.15.81:0/3537285133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc990068d00 0x7fc9900c7b80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc988009e60 tx=0x7fc988009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60038b9d91799ed server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:18.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.404+0000 7fc995599700 1 -- 172.21.15.81:0/3537285133 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98800e070 con 0x7fc990068d00 2023-10-06T03:25:18.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.404+0000 7fc995599700 1 -- 172.21.15.81:0/3537285133 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc98800bc30 con 0x7fc990068d00 2023-10-06T03:25:18.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.404+0000 7fc995599700 1 -- 172.21.15.81:0/3537285133 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc988012430 con 0x7fc990068d00 2023-10-06T03:25:18.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.405+0000 7fc99759d700 1 -- 172.21.15.81:0/3537285133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc990068d00 msgr2=0x7fc9900c7b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:18.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.405+0000 7fc99759d700 1 --2- 172.21.15.81:0/3537285133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc990068d00 0x7fc9900c7b80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc988009e60 tx=0x7fc988009780 comp rx=0 tx=0).stop 2023-10-06T03:25:18.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.405+0000 7fc99759d700 1 -- 172.21.15.81:0/3537285133 shutdown_connections 2023-10-06T03:25:18.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.405+0000 7fc99759d700 1 --2- 172.21.15.81:0/3537285133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc990068d00 0x7fc9900c7b80 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:18.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.405+0000 7fc99759d700 1 --2- 172.21.15.81:0/3537285133 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc990159420 0x7fc9900c7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:18.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.405+0000 7fc99759d700 1 -- 172.21.15.81:0/3537285133 >> 172.21.15.81:0/3537285133 conn(0x7fc9900c9c80 msgr2=0x7fc99006dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:18.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.405+0000 7fc99759d700 1 -- 172.21.15.81:0/3537285133 shutdown_connections 2023-10-06T03:25:18.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.405+0000 7fc99759d700 1 -- 172.21.15.81:0/3537285133 wait complete. 2023-10-06T03:25:18.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.406+0000 7fc99759d700 1 Processor -- start 2023-10-06T03:25:18.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.407+0000 7fc99759d700 1 -- start start 2023-10-06T03:25:18.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.407+0000 7fc99759d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc990068d00 0x7fc99014af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:18.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.407+0000 7fc99759d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc990159420 0x7fc9900abe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:18.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.408+0000 7fc99759d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9901597f0 0x7fc99006a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:18.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.408+0000 7fc99759d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc990148640 con 0x7fc9901597f0 2023-10-06T03:25:18.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.408+0000 7fc99759d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9900ad4b0 con 0x7fc990068d00 2023-10-06T03:25:18.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.408+0000 7fc99759d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9900ac8a0 con 0x7fc990159420 2023-10-06T03:25:18.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.408+0000 7fc996d9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9901597f0 0x7fc99006a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:18.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.408+0000 7fc996d9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9901597f0 0x7fc99006a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36444/0 (socket says 172.21.15.81:36444) 2023-10-06T03:25:18.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.408+0000 7fc996d9c700 1 -- 172.21.15.81:0/2372873483 learned_addr learned my addr 172.21.15.81:0/2372873483 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:18.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.408+0000 7fc995d9a700 1 --2- 172.21.15.81:0/2372873483 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc990159420 0x7fc9900abe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:18.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.408+0000 7fc99659b700 1 --2- 172.21.15.81:0/2372873483 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc990068d00 0x7fc99014af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:18.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.408+0000 7fc996d9c700 1 -- 172.21.15.81:0/2372873483 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc990159420 msgr2=0x7fc9900abe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:18.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.408+0000 7fc996d9c700 1 --2- 172.21.15.81:0/2372873483 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc990159420 0x7fc9900abe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:18.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.408+0000 7fc996d9c700 1 -- 172.21.15.81:0/2372873483 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc990068d00 msgr2=0x7fc99014af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:18.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.408+0000 7fc996d9c700 1 --2- 172.21.15.81:0/2372873483 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc990068d00 0x7fc99014af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:18.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.408+0000 7fc996d9c700 1 -- 172.21.15.81:0/2372873483 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc988009a20 con 0x7fc9901597f0 2023-10-06T03:25:18.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.408+0000 7fc99659b700 1 --2- 172.21.15.81:0/2372873483 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc990068d00 0x7fc99014af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:18.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.408+0000 7fc996d9c700 1 --2- 172.21.15.81:0/2372873483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9901597f0 0x7fc99006a740 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fc988013000 tx=0x7fc988019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:18.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.409+0000 7fc9867fc700 1 -- 172.21.15.81:0/2372873483 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc988027470 con 0x7fc9901597f0 2023-10-06T03:25:18.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.409+0000 7fc9867fc700 1 -- 172.21.15.81:0/2372873483 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc988027610 con 0x7fc9901597f0 2023-10-06T03:25:18.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.409+0000 7fc99759d700 1 -- 172.21.15.81:0/2372873483 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9900acb80 con 0x7fc9901597f0 2023-10-06T03:25:18.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.409+0000 7fc9867fc700 1 -- 172.21.15.81:0/2372873483 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9880279d0 con 0x7fc9901597f0 2023-10-06T03:25:18.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.409+0000 7fc99759d700 1 -- 172.21.15.81:0/2372873483 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9900ad140 con 0x7fc9901597f0 2023-10-06T03:25:18.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.410+0000 7fc99759d700 1 -- 172.21.15.81:0/2372873483 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9900ad620 con 0x7fc9901597f0 2023-10-06T03:25:18.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.411+0000 7fc9867fc700 1 -- 172.21.15.81:0/2372873483 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc988024070 con 0x7fc9901597f0 2023-10-06T03:25:18.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.411+0000 7fc9867fc700 1 --2- 172.21.15.81:0/2372873483 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc974066f30 0x7fc9740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:18.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.411+0000 7fc9867fc700 1 -- 172.21.15.81:0/2372873483 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5698+0+0 (secure 0 0 0) 0x7fc988086ce0 con 0x7fc9901597f0 2023-10-06T03:25:18.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.412+0000 7fc99659b700 1 --2- 172.21.15.81:0/2372873483 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc974066f30 0x7fc9740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:18.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.412+0000 7fc99659b700 1 --2- 172.21.15.81:0/2372873483 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc974066f30 0x7fc9740693e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc98c006fd0 tx=0x7fc98c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:18.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.416+0000 7fc9867fc700 1 -- 172.21.15.81:0/2372873483 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc988053eb0 con 0x7fc9901597f0 2023-10-06T03:25:18.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.609+0000 7fc99759d700 1 -- 172.21.15.81:0/2372873483 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fc99004c3c0 con 0x7fc9901597f0 2023-10-06T03:25:18.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.613+0000 7fc9867fc700 1 -- 172.21.15.81:0/2372873483 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc98802c0a0 con 0x7fc9901597f0 2023-10-06T03:25:18.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.615+0000 7fc99759d700 1 -- 172.21.15.81:0/2372873483 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc974066f30 msgr2=0x7fc9740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:18.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.615+0000 7fc99759d700 1 --2- 172.21.15.81:0/2372873483 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc974066f30 0x7fc9740693e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc98c006fd0 tx=0x7fc98c008040 comp rx=0 tx=0).stop 2023-10-06T03:25:18.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.615+0000 7fc99759d700 1 -- 172.21.15.81:0/2372873483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9901597f0 msgr2=0x7fc99006a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:18.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.615+0000 7fc99759d700 1 --2- 172.21.15.81:0/2372873483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9901597f0 0x7fc99006a740 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fc988013000 tx=0x7fc988019000 comp rx=0 tx=0).stop 2023-10-06T03:25:18.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.615+0000 7fc99759d700 1 -- 172.21.15.81:0/2372873483 shutdown_connections 2023-10-06T03:25:18.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.615+0000 7fc99759d700 1 --2- 172.21.15.81:0/2372873483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9901597f0 0x7fc99006a740 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:18.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.615+0000 7fc99759d700 1 --2- 172.21.15.81:0/2372873483 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc990068d00 0x7fc99014af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:18.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.615+0000 7fc99759d700 1 --2- 172.21.15.81:0/2372873483 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc974066f30 0x7fc9740693e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:18.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.615+0000 7fc99759d700 1 --2- 172.21.15.81:0/2372873483 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc990159420 0x7fc9900abe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:18.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.615+0000 7fc99759d700 1 -- 172.21.15.81:0/2372873483 >> 172.21.15.81:0/2372873483 conn(0x7fc9900c9c80 msgr2=0x7fc9900c7640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:18.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.615+0000 7fc99759d700 1 -- 172.21.15.81:0/2372873483 shutdown_connections 2023-10-06T03:25:18.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.615+0000 7fc99759d700 1 -- 172.21.15.81:0/2372873483 wait complete. 2023-10-06T03:25:18.634 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_recovery_fs.TestFSRecovery.test_recover_fs_after_fsmap_removal' 2023-10-06T03:25:18.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.812+0000 7f38913ff700 1 Processor -- start 2023-10-06T03:25:18.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.813+0000 7f38913ff700 1 -- start start 2023-10-06T03:25:18.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.814+0000 7f38913ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f388c13f9c0 0x7f388c0ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:18.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.814+0000 7f38913ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f388c15a5c0 0x7f388c0c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:18.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.814+0000 7f38913ff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f388c0cafe0 con 0x7f388c0cab60 2023-10-06T03:25:18.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.814+0000 7f38913ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f388c0cb2c0 con 0x7f388c15a5c0 2023-10-06T03:25:18.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.814+0000 7f38913ff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f388c0cb5a0 con 0x7f388c13f9c0 2023-10-06T03:25:18.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.814+0000 7f388b7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f388c15a5c0 0x7f388c0c6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:18.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.814+0000 7f3883fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f388c0cab60 0x7f388c159eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53224/0 (socket says 172.21.15.81:53224) 2023-10-06T03:25:18.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.814+0000 7f3883fff700 1 -- 172.21.15.81:0/1963480198 learned_addr learned my addr 172.21.15.81:0/1963480198 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:25:18.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.814+0000 7f388b7fe700 1 -- 172.21.15.81:0/1963480198 >> v2:172.21.15.83:3300/0 conn(0x7f388c13f9c0 msgr2=0x7f388c0ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:18.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.814+0000 7f388affd700 1 --2- 172.21.15.81:0/1963480198 >> v2:172.21.15.83:3300/0 conn(0x7f388c13f9c0 0x7f388c0ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:18.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.814+0000 7f388b7fe700 1 --2- 172.21.15.81:0/1963480198 >> v2:172.21.15.83:3300/0 conn(0x7f388c13f9c0 0x7f388c0ca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:18.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.815+0000 7f388b7fe700 1 -- 172.21.15.81:0/1963480198 >> v1:172.21.15.81:6789/0 conn(0x7f388c0cab60 legacy=0x7f388c159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:18.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.815+0000 7f388b7fe700 1 -- 172.21.15.81:0/1963480198 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f388c0cb880 con 0x7f388c15a5c0 2023-10-06T03:25:18.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.815+0000 7f388affd700 1 --2- 172.21.15.81:0/1963480198 >> v2:172.21.15.83:3300/0 conn(0x7f388c13f9c0 0x7f388c0ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:18.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.814+0000 7f388a7fc700 1 -- 172.21.15.81:0/1963480198 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1754826347 0 0) 0x7f388c0cafe0 con 0x7f388c0cab60 2023-10-06T03:25:18.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.815+0000 7f388b7fe700 1 --2- 172.21.15.81:0/1963480198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f388c15a5c0 0x7f388c0c6ab0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f388c069010 tx=0x7f3884009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=615f7faf83f3635b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:18.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.815+0000 7f388a7fc700 1 -- 172.21.15.81:0/1963480198 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388400e070 con 0x7f388c15a5c0 2023-10-06T03:25:18.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.815+0000 7f388a7fc700 1 -- 172.21.15.81:0/1963480198 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f388400bc30 con 0x7f388c15a5c0 2023-10-06T03:25:18.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.815+0000 7f388a7fc700 1 -- 172.21.15.81:0/1963480198 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3884012430 con 0x7f388c15a5c0 2023-10-06T03:25:18.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.815+0000 7f38913ff700 1 -- 172.21.15.81:0/1963480198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f388c15a5c0 msgr2=0x7f388c0c6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:18.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.815+0000 7f38913ff700 1 --2- 172.21.15.81:0/1963480198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f388c15a5c0 0x7f388c0c6ab0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f388c069010 tx=0x7f3884009780 comp rx=0 tx=0).stop 2023-10-06T03:25:18.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.816+0000 7f38913ff700 1 -- 172.21.15.81:0/1963480198 shutdown_connections 2023-10-06T03:25:18.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.816+0000 7f38913ff700 1 --2- 172.21.15.81:0/1963480198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f388c15a5c0 0x7f388c0c6ab0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:18.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.816+0000 7f38913ff700 1 --2- 172.21.15.81:0/1963480198 >> v2:172.21.15.83:3300/0 conn(0x7f388c13f9c0 0x7f388c0ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:18.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.816+0000 7f38913ff700 1 -- 172.21.15.81:0/1963480198 >> 172.21.15.81:0/1963480198 conn(0x7f388c0cc090 msgr2=0x7f388c0cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:18.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.816+0000 7f38913ff700 1 -- 172.21.15.81:0/1963480198 shutdown_connections 2023-10-06T03:25:18.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.816+0000 7f38913ff700 1 -- 172.21.15.81:0/1963480198 wait complete. 2023-10-06T03:25:18.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.817+0000 7f38913ff700 1 Processor -- start 2023-10-06T03:25:18.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.817+0000 7f38913ff700 1 -- start start 2023-10-06T03:25:18.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.818+0000 7f38913ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f388c13f9c0 0x7f388c0ab910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:18.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.818+0000 7f38913ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f388c15a5c0 0x7f388c0c5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:18.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.818+0000 7f38913ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f388c15c0f0 0x7f388c0ad020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:18.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.818+0000 7f38913ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f388c0c5fa0 con 0x7f388c15c0f0 2023-10-06T03:25:18.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.818+0000 7f38913ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f388c0abf80 con 0x7f388c13f9c0 2023-10-06T03:25:18.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.818+0000 7f38913ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f388c0ac260 con 0x7f388c15a5c0 2023-10-06T03:25:18.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.818+0000 7f388b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f388c15c0f0 0x7f388c0ad020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:18.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.819+0000 7f388b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f388c15c0f0 0x7f388c0ad020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36472/0 (socket says 172.21.15.81:36472) 2023-10-06T03:25:18.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.819+0000 7f388b7fe700 1 -- 172.21.15.81:0/2361642965 learned_addr learned my addr 172.21.15.81:0/2361642965 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:18.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.819+0000 7f388affd700 1 --2- 172.21.15.81:0/2361642965 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f388c13f9c0 0x7f388c0ab910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:18.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.819+0000 7f3883fff700 1 --2- 172.21.15.81:0/2361642965 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f388c15a5c0 0x7f388c0c5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:18.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.819+0000 7f388b7fe700 1 -- 172.21.15.81:0/2361642965 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f388c15a5c0 msgr2=0x7f388c0c5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:18.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.819+0000 7f388b7fe700 1 --2- 172.21.15.81:0/2361642965 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f388c15a5c0 0x7f388c0c5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:18.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.819+0000 7f388b7fe700 1 -- 172.21.15.81:0/2361642965 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f388c13f9c0 msgr2=0x7f388c0ab910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:18.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.819+0000 7f388b7fe700 1 --2- 172.21.15.81:0/2361642965 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f388c13f9c0 0x7f388c0ab910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:18.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.819+0000 7f388b7fe700 1 -- 172.21.15.81:0/2361642965 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3884009a20 con 0x7f388c15c0f0 2023-10-06T03:25:18.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.819+0000 7f388b7fe700 1 --2- 172.21.15.81:0/2361642965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f388c15c0f0 0x7f388c0ad020 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f38840097c0 tx=0x7f3884019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:18.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.819+0000 7f3882ffd700 1 -- 172.21.15.81:0/2361642965 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3884012e10 con 0x7f388c15c0f0 2023-10-06T03:25:18.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.820+0000 7f3882ffd700 1 -- 172.21.15.81:0/2361642965 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f388401e630 con 0x7f388c15c0f0 2023-10-06T03:25:18.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.820+0000 7f3882ffd700 1 -- 172.21.15.81:0/2361642965 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388401e9f0 con 0x7f388c15c0f0 2023-10-06T03:25:18.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.820+0000 7f38913ff700 1 -- 172.21.15.81:0/2361642965 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f388c0ac540 con 0x7f388c15c0f0 2023-10-06T03:25:18.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.820+0000 7f38913ff700 1 -- 172.21.15.81:0/2361642965 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f388c0acb00 con 0x7f388c15c0f0 2023-10-06T03:25:18.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.821+0000 7f38913ff700 1 -- 172.21.15.81:0/2361642965 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f388c04c3c0 con 0x7f388c15c0f0 2023-10-06T03:25:18.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.821+0000 7f3882ffd700 1 -- 172.21.15.81:0/2361642965 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3884024070 con 0x7f388c15c0f0 2023-10-06T03:25:18.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.822+0000 7f3882ffd700 1 --2- 172.21.15.81:0/2361642965 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f386c066f30 0x7f386c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:18.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.822+0000 7f3882ffd700 1 -- 172.21.15.81:0/2361642965 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f3884086cc0 con 0x7f388c15c0f0 2023-10-06T03:25:18.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.822+0000 7f388affd700 1 --2- 172.21.15.81:0/2361642965 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f386c066f30 0x7f386c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:18.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.823+0000 7f388affd700 1 --2- 172.21.15.81:0/2361642965 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f386c066f30 0x7f386c0693e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f387c00adc0 tx=0x7f387c006f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:18.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:18.827+0000 7f3882ffd700 1 -- 172.21.15.81:0/2361642965 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3884053f30 con 0x7f388c15c0f0 2023-10-06T03:25:19.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:19.092+0000 7f38913ff700 1 -- 172.21.15.81:0/2361642965 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_recovery_fs.TestFSRecovery.test_recover_fs_after_fsmap_removal"]} v 0) v1 -- 0x7f388c0accf0 con 0x7f388c15c0f0 2023-10-06T03:25:19.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:19.188+0000 7f3882ffd700 1 -- 172.21.15.81:0/2361642965 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_recovery_fs.TestFSRecovery.test_recover_fs_after_fsmap_removal"]}]=0 v113) v1 ==== 159+0+0 (secure 0 0 0) 0x7f3884057550 con 0x7f388c15c0f0 2023-10-06T03:25:19.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:19.190+0000 7f38913ff700 1 -- 172.21.15.81:0/2361642965 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f386c066f30 msgr2=0x7f386c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:19.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:19.190+0000 7f38913ff700 1 --2- 172.21.15.81:0/2361642965 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f386c066f30 0x7f386c0693e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f387c00adc0 tx=0x7f387c006f90 comp rx=0 tx=0).stop 2023-10-06T03:25:19.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:19.190+0000 7f38913ff700 1 -- 172.21.15.81:0/2361642965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f388c15c0f0 msgr2=0x7f388c0ad020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:19.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:19.190+0000 7f38913ff700 1 --2- 172.21.15.81:0/2361642965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f388c15c0f0 0x7f388c0ad020 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f38840097c0 tx=0x7f3884019000 comp rx=0 tx=0).stop 2023-10-06T03:25:19.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:19.191+0000 7f38913ff700 1 -- 172.21.15.81:0/2361642965 shutdown_connections 2023-10-06T03:25:19.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:19.191+0000 7f38913ff700 1 --2- 172.21.15.81:0/2361642965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f388c15c0f0 0x7f388c0ad020 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:19.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:19.191+0000 7f38913ff700 1 --2- 172.21.15.81:0/2361642965 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f388c13f9c0 0x7f388c0ab910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:19.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:19.191+0000 7f38913ff700 1 --2- 172.21.15.81:0/2361642965 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f386c066f30 0x7f386c0693e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:19.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:19.191+0000 7f38913ff700 1 --2- 172.21.15.81:0/2361642965 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f388c15a5c0 0x7f388c0c5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:19.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:19.191+0000 7f38913ff700 1 -- 172.21.15.81:0/2361642965 >> 172.21.15.81:0/2361642965 conn(0x7f388c0cc090 msgr2=0x7f388c0cc460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:19.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:19.191+0000 7f38913ff700 1 -- 172.21.15.81:0/2361642965 shutdown_connections 2023-10-06T03:25:19.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:19.191+0000 7f38913ff700 1 -- 172.21.15.81:0/2361642965 wait complete. 2023-10-06T03:25:19.209 INFO:tasks.cephfs_test_runner:test_recover_fs_after_fsmap_removal (tasks.cephfs.test_recovery_fs.TestFSRecovery) ... ok 2023-10-06T03:25:19.209 INFO:tasks.cephfs_test_runner: 2023-10-06T03:25:19.209 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-06T03:25:19.209 INFO:tasks.cephfs_test_runner:Ran 1 test in 47.327s 2023-10-06T03:25:19.209 INFO:tasks.cephfs_test_runner: 2023-10-06T03:25:19.209 INFO:tasks.cephfs_test_runner:OK 2023-10-06T03:25:19.209 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-06T03:25:19.221 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-06T03:25:19.237 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-06T03:25:19.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:19.237 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-10-06T03:25:19.273 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T03:25:19.273 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T03:25:19.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:19.274 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T03:25:19.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:19.374 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T03:25:19.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:19.443 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2023-10-06T03:25:19.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:19.561 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-10-06T03:25:19.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:19.600 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2023-10-06T03:25:19.706 INFO:teuthology.orchestra.run.smithi081.stderr:Cannot find device "ceph-brx" 2023-10-06T03:25:19.709 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:25:19.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:19.709 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2023-10-06T03:25:19.750 INFO:teuthology.orchestra.run.smithi083.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T03:25:19.751 INFO:teuthology.orchestra.run.smithi083.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T03:25:19.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:19.751 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T03:25:19.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:19.856 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T03:25:19.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:19.938 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link delete ceph-brx 2023-10-06T03:25:20.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:20.048 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2023-10-06T03:25:20.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:25:20.086 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link delete ceph-brx 2023-10-06T03:25:20.191 INFO:teuthology.orchestra.run.smithi083.stderr:Cannot find device "ceph-brx" 2023-10-06T03:25:20.194 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:25:20.195 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-06T03:25:20.204 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-10-06T03:25:20.205 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:25:20.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.388+0000 7f494559d700 1 Processor -- start 2023-10-06T03:25:20.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.388+0000 7f494559d700 1 -- start start 2023-10-06T03:25:20.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.389+0000 7f494559d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4940156220 0x7f49400ab7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:20.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.389+0000 7f494559d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f494006eaf0 0x7f49401565f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:20.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.389+0000 7f494559d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49400b0910 con 0x7f49400a6730 2023-10-06T03:25:20.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.389+0000 7f494559d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49400b0390 con 0x7f4940156220 2023-10-06T03:25:20.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.389+0000 7f494559d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4940157800 con 0x7f494006eaf0 2023-10-06T03:25:20.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.389+0000 7f493ffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4940156220 0x7f49400ab7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:20.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.389+0000 7f493ffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4940156220 0x7f49400ab7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35316/0 (socket says 172.21.15.81:35316) 2023-10-06T03:25:20.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.389+0000 7f493ffff700 1 -- 172.21.15.81:0/4114804220 learned_addr learned my addr 172.21.15.81:0/4114804220 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:20.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.389+0000 7f4944d9c700 1 --2- 172.21.15.81:0/4114804220 >> v2:172.21.15.83:3300/0 conn(0x7f494006eaf0 0x7f49401565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:20.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.390+0000 7f493ffff700 1 -- 172.21.15.81:0/4114804220 >> v2:172.21.15.83:3300/0 conn(0x7f494006eaf0 msgr2=0x7f49401565f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:20.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.390+0000 7f493ffff700 1 --2- 172.21.15.81:0/4114804220 >> v2:172.21.15.83:3300/0 conn(0x7f494006eaf0 0x7f49401565f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:20.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.390+0000 7f493ffff700 1 -- 172.21.15.81:0/4114804220 >> v1:172.21.15.83:6789/0 conn(0x7f49400a6730 legacy=0x7f494006e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:20.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.390+0000 7f493ffff700 1 -- 172.21.15.81:0/4114804220 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4940157240 con 0x7f4940156220 2023-10-06T03:25:20.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.390+0000 7f493ffff700 1 --2- 172.21.15.81:0/4114804220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4940156220 0x7f49400ab7b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f4940068bf0 tx=0x7f4930009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f2c56c3d3381458 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:20.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.390+0000 7f493effd700 1 -- 172.21.15.81:0/4114804220 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4930009e70 con 0x7f4940156220 2023-10-06T03:25:20.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.390+0000 7f493effd700 1 -- 172.21.15.81:0/4114804220 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493000b860 con 0x7f4940156220 2023-10-06T03:25:20.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.390+0000 7f493effd700 1 -- 172.21.15.81:0/4114804220 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493000bc00 con 0x7f4940156220 2023-10-06T03:25:20.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.391+0000 7f494559d700 1 -- 172.21.15.81:0/4114804220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4940156220 msgr2=0x7f49400ab7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:20.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.391+0000 7f494559d700 1 --2- 172.21.15.81:0/4114804220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4940156220 0x7f49400ab7b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f4940068bf0 tx=0x7f4930009250 comp rx=0 tx=0).stop 2023-10-06T03:25:20.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.391+0000 7f494559d700 1 -- 172.21.15.81:0/4114804220 shutdown_connections 2023-10-06T03:25:20.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.391+0000 7f494559d700 1 --2- 172.21.15.81:0/4114804220 >> v2:172.21.15.83:3300/0 conn(0x7f494006eaf0 0x7f49401565f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:20.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.391+0000 7f494559d700 1 --2- 172.21.15.81:0/4114804220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4940156220 0x7f49400ab7b0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:20.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.391+0000 7f494559d700 1 -- 172.21.15.81:0/4114804220 >> 172.21.15.81:0/4114804220 conn(0x7f49400cbef0 msgr2=0x7f49400cc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:20.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.391+0000 7f494559d700 1 -- 172.21.15.81:0/4114804220 shutdown_connections 2023-10-06T03:25:20.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.391+0000 7f494559d700 1 -- 172.21.15.81:0/4114804220 wait complete. 2023-10-06T03:25:20.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.392+0000 7f494559d700 1 Processor -- start 2023-10-06T03:25:20.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.393+0000 7f494559d700 1 -- start start 2023-10-06T03:25:20.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.393+0000 7f494559d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f494006eaf0 0x7f494016acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:20.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.393+0000 7f494559d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f49400a6730 0x7f4940168740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:20.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.394+0000 7f494559d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4940156220 0x7f4940153fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:20.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.394+0000 7f494559d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4940168ee0 con 0x7f4940156220 2023-10-06T03:25:20.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.394+0000 7f494559d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4940168c80 con 0x7f494006eaf0 2023-10-06T03:25:20.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.394+0000 7f494559d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49400a73f0 con 0x7f49400a6730 2023-10-06T03:25:20.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.394+0000 7f493ffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f494006eaf0 0x7f494016acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:20.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.394+0000 7f4944d9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4940156220 0x7f4940153fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:20.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.394+0000 7f4944d9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4940156220 0x7f4940153fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35318/0 (socket says 172.21.15.81:35318) 2023-10-06T03:25:20.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.394+0000 7f493ffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f494006eaf0 0x7f494016acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.81:34936/0 (socket says 172.21.15.81:34936) 2023-10-06T03:25:20.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.394+0000 7f4944d9c700 1 -- 172.21.15.81:0/763040713 learned_addr learned my addr 172.21.15.81:0/763040713 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:20.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.394+0000 7f493f7fe700 1 --2- 172.21.15.81:0/763040713 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f49400a6730 0x7f4940168740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:20.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.394+0000 7f4944d9c700 1 -- 172.21.15.81:0/763040713 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f49400a6730 msgr2=0x7f4940168740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:20.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.394+0000 7f4944d9c700 1 --2- 172.21.15.81:0/763040713 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f49400a6730 0x7f4940168740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:20.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.394+0000 7f4944d9c700 1 -- 172.21.15.81:0/763040713 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f494006eaf0 msgr2=0x7f494016acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:20.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.394+0000 7f4944d9c700 1 --2- 172.21.15.81:0/763040713 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f494006eaf0 0x7f494016acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:20.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.394+0000 7f4944d9c700 1 -- 172.21.15.81:0/763040713 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49300094f0 con 0x7f4940156220 2023-10-06T03:25:20.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.394+0000 7f4944d9c700 1 --2- 172.21.15.81:0/763040713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4940156220 0x7f4940153fe0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f4938009ef0 tx=0x7f493800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:20.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.395+0000 7f4927fff700 1 -- 172.21.15.81:0/763040713 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493800cb70 con 0x7f4940156220 2023-10-06T03:25:20.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.395+0000 7f4927fff700 1 -- 172.21.15.81:0/763040713 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493800f040 con 0x7f4940156220 2023-10-06T03:25:20.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.395+0000 7f494559d700 1 -- 172.21.15.81:0/763040713 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49400a76d0 con 0x7f4940156220 2023-10-06T03:25:20.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.395+0000 7f4927fff700 1 -- 172.21.15.81:0/763040713 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4938014480 con 0x7f4940156220 2023-10-06T03:25:20.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.395+0000 7f494559d700 1 -- 172.21.15.81:0/763040713 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49400a7c90 con 0x7f4940156220 2023-10-06T03:25:20.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.396+0000 7f494559d700 1 -- 172.21.15.81:0/763040713 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49400a7eb0 con 0x7f4940156220 2023-10-06T03:25:20.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.397+0000 7f4927fff700 1 -- 172.21.15.81:0/763040713 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4938014830 con 0x7f4940156220 2023-10-06T03:25:20.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.397+0000 7f4927fff700 1 --2- 172.21.15.81:0/763040713 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f492c066f30 0x7f492c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:20.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.397+0000 7f4927fff700 1 -- 172.21.15.81:0/763040713 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f49380851f0 con 0x7f4940156220 2023-10-06T03:25:20.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.398+0000 7f493ffff700 1 --2- 172.21.15.81:0/763040713 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f492c066f30 0x7f492c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:20.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.398+0000 7f493ffff700 1 --2- 172.21.15.81:0/763040713 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f492c066f30 0x7f492c0693e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4940068bf0 tx=0x7f4930017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:20.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.401+0000 7f4927fff700 1 -- 172.21.15.81:0/763040713 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f49380523c0 con 0x7f4940156220 2023-10-06T03:25:20.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.595+0000 7f494559d700 1 -- 172.21.15.81:0/763040713 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4940157520 con 0x7f4940156220 2023-10-06T03:25:20.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.596+0000 7f4927fff700 1 -- 172.21.15.81:0/763040713 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+14066 (secure 0 0 0) 0x7f49380559e0 con 0x7f4940156220 2023-10-06T03:25:20.597 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:25:20.597 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":43,"fsid":"1807b5d7-9be8-43ad-aaf8-99a4273430b3","created":"2023-10-06T03:23:20.805306+0000","modified":"2023-10-06T03:25:18.180246+0000","last_up_change":"2023-10-06T03:23:32.735796+0000","last_in_change":"2023-10-06T03:23:24.109024+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:33.198850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:33.606744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"14fb667d-a677-4978-a477-80027f889d36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":85563},{"type":"v1","addr":"172.21.15.81:6818","nonce":85563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":85563},{"type":"v1","addr":"172.21.15.81:6822","nonce":85563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":85563},{"type":"v1","addr":"172.21.15.81:6830","nonce":85563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":85563},{"type":"v1","addr":"172.21.15.81:6826","nonce":85563}]},"public_addr":"172.21.15.81:6818/85563","cluster_addr":"172.21.15.81:6822/85563","heartbeat_back_addr":"172.21.15.81:6830/85563","heartbeat_front_addr":"172.21.15.81:6826/85563","state":["exists","up"]},{"osd":1,"uuid":"974d8a86-1829-4176-89ce-18e6038857f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":85561},{"type":"v1","addr":"172.21.15.81:6801","nonce":85561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":85561},{"type":"v1","addr":"172.21.15.81:6803","nonce":85561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":85561},{"type":"v1","addr":"172.21.15.81:6807","nonce":85561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":85561},{"type":"v1","addr":"172.21.15.81:6805","nonce":85561}]},"public_addr":"172.21.15.81:6801/85561","cluster_addr":"172.21.15.81:6803/85561","heartbeat_back_addr":"172.21.15.81:6807/85561","heartbeat_front_addr":"172.21.15.81:6805/85561","state":["exists","up"]},{"osd":2,"uuid":"ffbfe056-46bc-46e0-bf49-4d8f8650e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":85564},{"type":"v1","addr":"172.21.15.81:6809","nonce":85564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":85564},{"type":"v1","addr":"172.21.15.81:6811","nonce":85564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":85564},{"type":"v1","addr":"172.21.15.81:6815","nonce":85564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":85564},{"type":"v1","addr":"172.21.15.81:6813","nonce":85564}]},"public_addr":"172.21.15.81:6809/85564","cluster_addr":"172.21.15.81:6811/85564","heartbeat_back_addr":"172.21.15.81:6815/85564","heartbeat_front_addr":"172.21.15.81:6813/85564","state":["exists","up"]},{"osd":3,"uuid":"ef9a8314-3d37-4ea1-858a-e704d5695002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":85562},{"type":"v1","addr":"172.21.15.81:6819","nonce":85562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":85562},{"type":"v1","addr":"172.21.15.81:6823","nonce":85562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":85562},{"type":"v1","addr":"172.21.15.81:6831","nonce":85562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":85562},{"type":"v1","addr":"172.21.15.81:6827","nonce":85562}]},"public_addr":"172.21.15.81:6819/85562","cluster_addr":"172.21.15.81:6823/85562","heartbeat_back_addr":"172.21.15.81:6831/85562","heartbeat_front_addr":"172.21.15.81:6827/85562","state":["exists","up"]},{"osd":4,"uuid":"d83506a0-2c96-4bcb-a9fa-05e43dc329df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":85785},{"type":"v1","addr":"172.21.15.83:6801","nonce":85785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":85785},{"type":"v1","addr":"172.21.15.83:6803","nonce":85785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":85785},{"type":"v1","addr":"172.21.15.83:6807","nonce":85785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":85785},{"type":"v1","addr":"172.21.15.83:6805","nonce":85785}]},"public_addr":"172.21.15.83:6801/85785","cluster_addr":"172.21.15.83:6803/85785","heartbeat_back_addr":"172.21.15.83:6807/85785","heartbeat_front_addr":"172.21.15.83:6805/85785","state":["exists","up"]},{"osd":5,"uuid":"10687c63-a3d5-472f-acc0-4f61847b6e0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":85818},{"type":"v1","addr":"172.21.15.83:6825","nonce":85818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":85818},{"type":"v1","addr":"172.21.15.83:6827","nonce":85818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":85818},{"type":"v1","addr":"172.21.15.83:6831","nonce":85818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":85818},{"type":"v1","addr":"172.21.15.83:6829","nonce":85818}]},"public_addr":"172.21.15.83:6825/85818","cluster_addr":"172.21.15.83:6827/85818","heartbeat_back_addr":"172.21.15.83:6831/85818","heartbeat_front_addr":"172.21.15.83:6829/85818","state":["exists","up"]},{"osd":6,"uuid":"2e9daf76-5607-4a29-9a58-6e270700d223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":85787},{"type":"v1","addr":"172.21.15.83:6811","nonce":85787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":85787},{"type":"v1","addr":"172.21.15.83:6815","nonce":85787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":85787},{"type":"v1","addr":"172.21.15.83:6823","nonce":85787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6817","nonce":85787},{"type":"v1","addr":"172.21.15.83:6819","nonce":85787}]},"public_addr":"172.21.15.83:6811/85787","cluster_addr":"172.21.15.83:6815/85787","heartbeat_back_addr":"172.21.15.83:6823/85787","heartbeat_front_addr":"172.21.15.83:6819/85787","state":["exists","up"]},{"osd":7,"uuid":"5019e1ff-233a-4a5a-91ca-8afccb7ab6e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":85786},{"type":"v1","addr":"172.21.15.83:6810","nonce":85786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":85786},{"type":"v1","addr":"172.21.15.83:6814","nonce":85786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":85786},{"type":"v1","addr":"172.21.15.83:6822","nonce":85786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":85786},{"type":"v1","addr":"172.21.15.83:6818","nonce":85786}]},"public_addr":"172.21.15.83:6810/85786","cluster_addr":"172.21.15.83:6814/85786","heartbeat_back_addr":"172.21.15.83:6822/85786","heartbeat_front_addr":"172.21.15.83:6818/85786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.393431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.360031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.407428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.391613+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.403211+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.438142+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.496181+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.472323+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6835/2219056136":"2023-10-07T03:25:15.169216+0000","172.21.15.81:6834/2789471208":"2023-10-07T03:25:01.347009+0000","172.21.15.81:6834/2219056136":"2023-10-07T03:25:15.169216+0000","172.21.15.81:6835/2789471208":"2023-10-07T03:25:01.347009+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:25:20.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.598+0000 7f494559d700 1 -- 172.21.15.81:0/763040713 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f492c066f30 msgr2=0x7f492c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:20.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.598+0000 7f494559d700 1 --2- 172.21.15.81:0/763040713 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f492c066f30 0x7f492c0693e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4940068bf0 tx=0x7f4930017000 comp rx=0 tx=0).stop 2023-10-06T03:25:20.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.598+0000 7f494559d700 1 -- 172.21.15.81:0/763040713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4940156220 msgr2=0x7f4940153fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:20.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.598+0000 7f494559d700 1 --2- 172.21.15.81:0/763040713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4940156220 0x7f4940153fe0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f4938009ef0 tx=0x7f493800b040 comp rx=0 tx=0).stop 2023-10-06T03:25:20.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.598+0000 7f494559d700 1 -- 172.21.15.81:0/763040713 shutdown_connections 2023-10-06T03:25:20.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.598+0000 7f494559d700 1 --2- 172.21.15.81:0/763040713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4940156220 0x7f4940153fe0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:20.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.598+0000 7f494559d700 1 --2- 172.21.15.81:0/763040713 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f494006eaf0 0x7f494016acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:20.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.598+0000 7f494559d700 1 --2- 172.21.15.81:0/763040713 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f492c066f30 0x7f492c0693e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:20.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.598+0000 7f494559d700 1 --2- 172.21.15.81:0/763040713 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f49400a6730 0x7f4940168740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:20.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.598+0000 7f494559d700 1 -- 172.21.15.81:0/763040713 >> 172.21.15.81:0/763040713 conn(0x7f49400cbef0 msgr2=0x7f494006d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:20.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.598+0000 7f494559d700 1 -- 172.21.15.81:0/763040713 shutdown_connections 2023-10-06T03:25:20.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.598+0000 7f494559d700 1 -- 172.21.15.81:0/763040713 wait complete. 2023-10-06T03:25:20.617 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-06T03:25:20.617 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:25:20.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.798+0000 7fb9ad39d700 1 Processor -- start 2023-10-06T03:25:20.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.798+0000 7fb9ad39d700 1 -- start start 2023-10-06T03:25:20.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.799+0000 7fb9ad39d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb9a813c1a0 0x7fb9a80cbd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:20.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.799+0000 7fb9ad39d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb9a813c570 0x7fb9a80698c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:20.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.799+0000 7fb9ad39d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9a8069430 con 0x7fb9a80cdc00 2023-10-06T03:25:20.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.799+0000 7fb9ad39d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9a8068820 con 0x7fb9a813c570 2023-10-06T03:25:20.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.799+0000 7fb9ad39d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9a8068b00 con 0x7fb9a813c1a0 2023-10-06T03:25:20.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.799+0000 7fb9acb9c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb9a813c570 0x7fb9a80698c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:20.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.800+0000 7fb9acb9c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb9a813c570 0x7fb9a80698c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35328/0 (socket says 172.21.15.81:35328) 2023-10-06T03:25:20.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.800+0000 7fb9acb9c700 1 -- 172.21.15.81:0/3918519085 learned_addr learned my addr 172.21.15.81:0/3918519085 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:20.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.800+0000 7fb9a7fff700 1 --2- 172.21.15.81:0/3918519085 >> v2:172.21.15.83:3300/0 conn(0x7fb9a813c1a0 0x7fb9a80cbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:20.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.800+0000 7fb9acb9c700 1 -- 172.21.15.81:0/3918519085 >> v2:172.21.15.83:3300/0 conn(0x7fb9a813c1a0 msgr2=0x7fb9a80cbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:20.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.800+0000 7fb9acb9c700 1 --2- 172.21.15.81:0/3918519085 >> v2:172.21.15.83:3300/0 conn(0x7fb9a813c1a0 0x7fb9a80cbd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:20.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.800+0000 7fb9acb9c700 1 -- 172.21.15.81:0/3918519085 >> v1:172.21.15.83:6789/0 conn(0x7fb9a80cdc00 legacy=0x7fb9a806cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:20.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.800+0000 7fb9a6ffd700 1 -- 172.21.15.81:0/3918519085 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1241009133 0 0) 0x7fb9a8069430 con 0x7fb9a80cdc00 2023-10-06T03:25:20.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.800+0000 7fb9acb9c700 1 -- 172.21.15.81:0/3918519085 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a8068de0 con 0x7fb9a813c570 2023-10-06T03:25:20.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.800+0000 7fb9acb9c700 1 --2- 172.21.15.81:0/3918519085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9a813c570 0x7fb9a80698c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fb9a80cdfd0 tx=0x7fb9a0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e82954614223c750 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:20.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.800+0000 7fb9a6ffd700 1 -- 172.21.15.81:0/3918519085 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a000e070 con 0x7fb9a813c570 2023-10-06T03:25:20.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.800+0000 7fb9a6ffd700 1 -- 172.21.15.81:0/3918519085 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a000ba20 con 0x7fb9a813c570 2023-10-06T03:25:20.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.801+0000 7fb9a6ffd700 1 -- 172.21.15.81:0/3918519085 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a00092e0 con 0x7fb9a813c570 2023-10-06T03:25:20.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.801+0000 7fb9ad39d700 1 -- 172.21.15.81:0/3918519085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9a813c570 msgr2=0x7fb9a80698c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:20.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.801+0000 7fb9ad39d700 1 --2- 172.21.15.81:0/3918519085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9a813c570 0x7fb9a80698c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fb9a80cdfd0 tx=0x7fb9a0009840 comp rx=0 tx=0).stop 2023-10-06T03:25:20.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.801+0000 7fb9ad39d700 1 -- 172.21.15.81:0/3918519085 shutdown_connections 2023-10-06T03:25:20.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.801+0000 7fb9ad39d700 1 --2- 172.21.15.81:0/3918519085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9a813c570 0x7fb9a80698c0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:20.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.801+0000 7fb9ad39d700 1 --2- 172.21.15.81:0/3918519085 >> v2:172.21.15.83:3300/0 conn(0x7fb9a813c1a0 0x7fb9a80cbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:20.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.801+0000 7fb9ad39d700 1 -- 172.21.15.81:0/3918519085 >> 172.21.15.81:0/3918519085 conn(0x7fb9a806b520 msgr2=0x7fb9a806b920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:20.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.801+0000 7fb9ad39d700 1 -- 172.21.15.81:0/3918519085 shutdown_connections 2023-10-06T03:25:20.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.801+0000 7fb9ad39d700 1 -- 172.21.15.81:0/3918519085 wait complete. 2023-10-06T03:25:20.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.803+0000 7fb9ad39d700 1 Processor -- start 2023-10-06T03:25:20.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.803+0000 7fb9ad39d700 1 -- start start 2023-10-06T03:25:20.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.804+0000 7fb9ad39d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb9a80cdc00 0x7fb9a813ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:20.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.804+0000 7fb9ad39d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9a813c1a0 0x7fb9a80c5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:20.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.804+0000 7fb9ad39d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb9a813c570 0x7fb9a814fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:20.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.804+0000 7fb9ad39d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a80b1460 con 0x7fb9a813c1a0 2023-10-06T03:25:20.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.804+0000 7fb9ad39d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a80c7c40 con 0x7fb9a813c570 2023-10-06T03:25:20.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.804+0000 7fb9ad39d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a816a220 con 0x7fb9a80cdc00 2023-10-06T03:25:20.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.804+0000 7fb9a77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9a813c1a0 0x7fb9a80c5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:20.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.804+0000 7fb9a77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9a813c1a0 0x7fb9a80c5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35344/0 (socket says 172.21.15.81:35344) 2023-10-06T03:25:20.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.804+0000 7fb9a77fe700 1 -- 172.21.15.81:0/577896989 learned_addr learned my addr 172.21.15.81:0/577896989 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:20.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.804+0000 7fb9acb9c700 1 --2- 172.21.15.81:0/577896989 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb9a813c570 0x7fb9a814fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:20.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.804+0000 7fb9a7fff700 1 --2- 172.21.15.81:0/577896989 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb9a80cdc00 0x7fb9a813ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:20.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.804+0000 7fb9a77fe700 1 -- 172.21.15.81:0/577896989 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb9a80cdc00 msgr2=0x7fb9a813ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:20.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.804+0000 7fb9a77fe700 1 --2- 172.21.15.81:0/577896989 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb9a80cdc00 0x7fb9a813ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:20.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.804+0000 7fb9a77fe700 1 -- 172.21.15.81:0/577896989 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb9a813c570 msgr2=0x7fb9a814fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:20.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.804+0000 7fb9a77fe700 1 --2- 172.21.15.81:0/577896989 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb9a813c570 0x7fb9a814fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:20.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.804+0000 7fb9a77fe700 1 -- 172.21.15.81:0/577896989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a0009ae0 con 0x7fb9a813c1a0 2023-10-06T03:25:20.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.805+0000 7fb9a77fe700 1 --2- 172.21.15.81:0/577896989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9a813c1a0 0x7fb9a80c5120 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fb99c00c530 tx=0x7fb99c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:20.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.805+0000 7fb98ffff700 1 -- 172.21.15.81:0/577896989 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99c011590 con 0x7fb9a813c1a0 2023-10-06T03:25:20.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.805+0000 7fb98ffff700 1 -- 172.21.15.81:0/577896989 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb99c0116f0 con 0x7fb9a813c1a0 2023-10-06T03:25:20.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.805+0000 7fb98ffff700 1 -- 172.21.15.81:0/577896989 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99c011ab0 con 0x7fb9a813c1a0 2023-10-06T03:25:20.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.805+0000 7fb9ad39d700 1 -- 172.21.15.81:0/577896989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9a816a500 con 0x7fb9a813c1a0 2023-10-06T03:25:20.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.805+0000 7fb9ad39d700 1 -- 172.21.15.81:0/577896989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9a80b10f0 con 0x7fb9a813c1a0 2023-10-06T03:25:20.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.806+0000 7fb9ad39d700 1 -- 172.21.15.81:0/577896989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9a80b1610 con 0x7fb9a813c1a0 2023-10-06T03:25:20.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.807+0000 7fb98ffff700 1 -- 172.21.15.81:0/577896989 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb99c001010 con 0x7fb9a813c1a0 2023-10-06T03:25:20.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.808+0000 7fb98ffff700 1 --2- 172.21.15.81:0/577896989 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb994066f60 0x7fb994069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:20.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.808+0000 7fb98ffff700 1 -- 172.21.15.81:0/577896989 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5698+0+0 (secure 0 0 0) 0x7fb99c083a50 con 0x7fb9a813c1a0 2023-10-06T03:25:20.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.808+0000 7fb9a7fff700 1 --2- 172.21.15.81:0/577896989 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb994066f60 0x7fb994069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:20.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.809+0000 7fb9a7fff700 1 --2- 172.21.15.81:0/577896989 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb994066f60 0x7fb994069410 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb9a80c46f0 tx=0x7fb998008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:20.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:20.812+0000 7fb98ffff700 1 -- 172.21.15.81:0/577896989 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb9a80b1610 con 0x7fb9a813c1a0 2023-10-06T03:25:21.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.002+0000 7fb9ad39d700 1 -- 172.21.15.81:0/577896989 --> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb9a816a390 con 0x7fb994066f60 2023-10-06T03:25:21.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.005+0000 7fb98ffff700 1 -- 172.21.15.81:0/577896989 <== mgr.4100 v2:172.21.15.81:6832/85286 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73030 (secure 0 0 0) 0x7fb9a816a390 con 0x7fb994066f60 2023-10-06T03:25:21.007 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:25:21.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.008+0000 7fb9ad39d700 1 -- 172.21.15.81:0/577896989 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb994066f60 msgr2=0x7fb994069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:21.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.008+0000 7fb9ad39d700 1 --2- 172.21.15.81:0/577896989 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb994066f60 0x7fb994069410 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb9a80c46f0 tx=0x7fb998008040 comp rx=0 tx=0).stop 2023-10-06T03:25:21.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.008+0000 7fb9ad39d700 1 -- 172.21.15.81:0/577896989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9a813c1a0 msgr2=0x7fb9a80c5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:21.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.008+0000 7fb9ad39d700 1 --2- 172.21.15.81:0/577896989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9a813c1a0 0x7fb9a80c5120 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fb99c00c530 tx=0x7fb99c00c8f0 comp rx=0 tx=0).stop 2023-10-06T03:25:21.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.008+0000 7fb9ad39d700 1 -- 172.21.15.81:0/577896989 shutdown_connections 2023-10-06T03:25:21.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.008+0000 7fb9ad39d700 1 --2- 172.21.15.81:0/577896989 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb9a813c570 0x7fb9a814fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:21.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.008+0000 7fb9ad39d700 1 --2- 172.21.15.81:0/577896989 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb994066f60 0x7fb994069410 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:21.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.008+0000 7fb9ad39d700 1 --2- 172.21.15.81:0/577896989 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb9a80cdc00 0x7fb9a813ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:21.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.008+0000 7fb9ad39d700 1 --2- 172.21.15.81:0/577896989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9a813c1a0 0x7fb9a80c5120 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:21.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.008+0000 7fb9ad39d700 1 -- 172.21.15.81:0/577896989 >> 172.21.15.81:0/577896989 conn(0x7fb9a806b520 msgr2=0x7fb9a8152130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:21.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.008+0000 7fb9ad39d700 1 -- 172.21.15.81:0/577896989 shutdown_connections 2023-10-06T03:25:21.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.008+0000 7fb9ad39d700 1 -- 172.21.15.81:0/577896989 wait complete. 2023-10-06T03:25:21.010 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-06T03:25:21.026 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2023-10-06T03:25:19.573624+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2383356,"kb_used_data":5052,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752591364,"statfs":{"total":773094113280,"available":770653556736,"internally_reserved":0,"allocated":5173248,"data_stored":2996409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-7101,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-50,"num_read_kb":-56,"num_write":-51,"num_write_kb":-22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000901"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":36,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:25:17.183372+0000","last_change":"2023-10-06T03:23:35.397971+0000","last_active":"2023-10-06T03:25:17.183372+0000","last_peered":"2023-10-06T03:25:17.183372+0000","last_clean":"2023-10-06T03:25:17.183372+0000","last_became_active":"2023-10-06T03:23:35.397649+0000","last_became_peered":"2023-10-06T03:23:35.397649+0000","last_unstale":"2023-10-06T03:25:17.183372+0000","last_undegraded":"2023-10-06T03:25:17.183372+0000","last_fullsized":"2023-10-06T03:25:17.183372+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:11.974461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":34,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:25:17.600352+0000","last_change":"2023-10-06T03:23:34.866196+0000","last_active":"2023-10-06T03:25:17.600352+0000","last_peered":"2023-10-06T03:25:17.600352+0000","last_clean":"2023-10-06T03:25:17.600352+0000","last_became_active":"2023-10-06T03:23:34.865914+0000","last_became_peered":"2023-10-06T03:23:34.865914+0000","last_unstale":"2023-10-06T03:25:17.600352+0000","last_undegraded":"2023-10-06T03:25:17.600352+0000","last_fullsized":"2023-10-06T03:25:17.600352+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:11.974461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":35,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:25:17.182175+0000","last_change":"2023-10-06T03:23:34.874380+0000","last_active":"2023-10-06T03:25:17.182175+0000","last_peered":"2023-10-06T03:25:17.182175+0000","last_clean":"2023-10-06T03:25:17.182175+0000","last_became_active":"2023-10-06T03:23:34.873972+0000","last_became_peered":"2023-10-06T03:23:34.873972+0000","last_unstale":"2023-10-06T03:25:17.182175+0000","last_undegraded":"2023-10-06T03:25:17.182175+0000","last_fullsized":"2023-10-06T03:25:17.182175+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:30.204999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":183,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:25:17.597762+0000","last_change":"2023-10-06T03:23:34.864626+0000","last_active":"2023-10-06T03:25:17.597762+0000","last_peered":"2023-10-06T03:25:17.597762+0000","last_clean":"2023-10-06T03:25:17.597762+0000","last_became_active":"2023-10-06T03:23:34.863539+0000","last_became_peered":"2023-10-06T03:23:34.863539+0000","last_unstale":"2023-10-06T03:25:17.597762+0000","last_undegraded":"2023-10-06T03:25:17.597762+0000","last_fullsized":"2023-10-06T03:25:17.597762+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:11.750836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:25:17.598525+0000","last_change":"2023-10-06T03:23:34.864399+0000","last_active":"2023-10-06T03:25:17.598525+0000","last_peered":"2023-10-06T03:25:17.598525+0000","last_clean":"2023-10-06T03:25:17.598525+0000","last_became_active":"2023-10-06T03:23:34.863991+0000","last_became_peered":"2023-10-06T03:23:34.863991+0000","last_unstale":"2023-10-06T03:25:17.598525+0000","last_undegraded":"2023-10-06T03:25:17.598525+0000","last_fullsized":"2023-10-06T03:25:17.598525+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:56:32.358597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:25:17.597613+0000","last_change":"2023-10-06T03:23:34.865125+0000","last_active":"2023-10-06T03:25:17.597613+0000","last_peered":"2023-10-06T03:25:17.597613+0000","last_clean":"2023-10-06T03:25:17.597613+0000","last_became_active":"2023-10-06T03:23:34.864752+0000","last_became_peered":"2023-10-06T03:23:34.864752+0000","last_unstale":"2023-10-06T03:25:17.597613+0000","last_undegraded":"2023-10-06T03:25:17.597613+0000","last_fullsized":"2023-10-06T03:25:17.597613+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:00.374963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":36,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:25:17.183773+0000","last_change":"2023-10-06T03:23:34.864329+0000","last_active":"2023-10-06T03:25:17.183773+0000","last_peered":"2023-10-06T03:25:17.183773+0000","last_clean":"2023-10-06T03:25:17.183773+0000","last_became_active":"2023-10-06T03:23:34.863953+0000","last_became_peered":"2023-10-06T03:23:34.863953+0000","last_unstale":"2023-10-06T03:25:17.183773+0000","last_undegraded":"2023-10-06T03:25:17.183773+0000","last_fullsized":"2023-10-06T03:25:17.183773+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:30.204999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":32,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:25:17.600169+0000","last_change":"2023-10-06T03:23:34.873939+0000","last_active":"2023-10-06T03:25:17.600169+0000","last_peered":"2023-10-06T03:25:17.600169+0000","last_clean":"2023-10-06T03:25:17.600169+0000","last_became_active":"2023-10-06T03:23:34.873623+0000","last_became_peered":"2023-10-06T03:23:34.873623+0000","last_unstale":"2023-10-06T03:25:17.600169+0000","last_undegraded":"2023-10-06T03:25:17.600169+0000","last_fullsized":"2023-10-06T03:25:17.600169+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:30.204999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":32,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:25:17.600722+0000","last_change":"2023-10-06T03:23:34.872453+0000","last_active":"2023-10-06T03:25:17.600722+0000","last_peered":"2023-10-06T03:25:17.600722+0000","last_clean":"2023-10-06T03:25:17.600722+0000","last_became_active":"2023-10-06T03:23:34.872139+0000","last_became_peered":"2023-10-06T03:23:34.872139+0000","last_unstale":"2023-10-06T03:25:17.600722+0000","last_undegraded":"2023-10-06T03:25:17.600722+0000","last_fullsized":"2023-10-06T03:25:17.600722+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:25:46.214290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298364,"kb_used_data":1076,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073476,"statfs":{"total":96636764160,"available":96331239424,"internally_reserved":0,"allocated":1101824,"data_stored":821441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.59799999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.66400000000000003}]},{"osd":2,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.58099999999999996}]},{"osd":3,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.71099999999999997}]},{"osd":4,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.77500000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.72299999999999998}]},{"osd":6,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.73799999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297768,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074072,"statfs":{"total":96636764160,"available":96331849728,"internally_reserved":0,"allocated":491520,"data_stored":223409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.64200000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.441}]},{"osd":2,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.57399999999999995}]},{"osd":3,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.61599999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.53800000000000003}]},{"osd":5,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.626}]},{"osd":7,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.52000000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298348,"kb_used_data":1060,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073492,"statfs":{"total":96636764160,"available":96331255808,"internally_reserved":0,"allocated":1085440,"data_stored":815129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:35 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.43099999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:24:35 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.46200000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:24:35 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.47899999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:24:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.83999999999999997}]},{"osd":5,"last update":"Fri Oct 6 03:24:35 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.64700000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:24:35 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.63},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.78300000000000003}]},{"osd":7,"last update":"Fri Oct 6 03:24:35 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.65700000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297772,"kb_used_data":484,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074068,"statfs":{"total":96636764160,"available":96331845632,"internally_reserved":0,"allocated":495616,"data_stored":224762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.40200000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.32700000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.376},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.42099999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.68200000000000005}]},{"osd":5,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.749}]},{"osd":6,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.82899999999999996}]},{"osd":7,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.80700000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297768,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074072,"statfs":{"total":96636764160,"available":96331849728,"internally_reserved":0,"allocated":491520,"data_stored":224761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.433}]},{"osd":1,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.504}]},{"osd":3,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":0.48099999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.71499999999999997}]},{"osd":5,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.629},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.70199999999999996}]},{"osd":6,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.754}]},{"osd":7,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.65700000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297784,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074056,"statfs":{"total":96636764160,"available":96331833344,"internally_reserved":0,"allocated":507904,"data_stored":231073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.45200000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.501},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.39300000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.37},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.41199999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.85099999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.625},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.75900000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.68300000000000005}]},{"osd":7,"last update":"Fri Oct 6 03:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.73099999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297784,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074056,"statfs":{"total":96636764160,"available":96331833344,"internally_reserved":0,"allocated":507904,"data_stored":231073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.69999999999999996}]},{"osd":1,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.66700000000000004}]},{"osd":2,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":2.0539999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.61499999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.751},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.46700000000000003}]},{"osd":5,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":1.3080000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.64000000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":1.6930000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.76900000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":2.1179999999999999},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":1.6140000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297768,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074072,"statfs":{"total":96636764160,"available":96331849728,"internally_reserved":0,"allocated":491520,"data_stored":224761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.66600000000000004}]},{"osd":1,"last update":"Fri Oct 6 03:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.73299999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.82699999999999996}]},{"osd":3,"last update":"Fri Oct 6 03:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.91800000000000004}]},{"osd":4,"last update":"Fri Oct 6 03:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.77700000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":0.85299999999999998}]},{"osd":7,"last update":"Fri Oct 6 03:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.94599999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:25:21.028 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:25:21.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.209+0000 7fc2617ff700 1 Processor -- start 2023-10-06T03:25:21.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.209+0000 7fc2617ff700 1 -- start start 2023-10-06T03:25:21.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.210+0000 7fc2617ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc25c13fd90 0x7fc25c159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:21.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.210+0000 7fc2617ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc25c15a3f0 0x7fc25c0c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:21.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.210+0000 7fc2617ff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc25c0cad30 con 0x7fc25c13f9c0 2023-10-06T03:25:21.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.210+0000 7fc2617ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc25c15a870 con 0x7fc25c15a3f0 2023-10-06T03:25:21.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.210+0000 7fc2617ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc25c0cafe0 con 0x7fc25c13fd90 2023-10-06T03:25:21.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.211+0000 7fc25b7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc25c15a3f0 0x7fc25c0c6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:21.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.211+0000 7fc25b7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc25c15a3f0 0x7fc25c0c6ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35352/0 (socket says 172.21.15.81:35352) 2023-10-06T03:25:21.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.211+0000 7fc25b7fe700 1 -- 172.21.15.81:0/1334557219 learned_addr learned my addr 172.21.15.81:0/1334557219 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:21.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.211+0000 7fc25a7fc700 1 --2- 172.21.15.81:0/1334557219 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc25c13fd90 0x7fc25c159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:21.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.211+0000 7fc25b7fe700 1 -- 172.21.15.81:0/1334557219 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc25c13fd90 msgr2=0x7fc25c159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:21.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.211+0000 7fc25b7fe700 1 --2- 172.21.15.81:0/1334557219 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc25c13fd90 0x7fc25c159eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:21.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.211+0000 7fc25b7fe700 1 -- 172.21.15.81:0/1334557219 >> v1:172.21.15.83:6789/0 conn(0x7fc25c13f9c0 legacy=0x7fc25c0ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:21.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.211+0000 7fc25b7fe700 1 -- 172.21.15.81:0/1334557219 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc25c0cb2c0 con 0x7fc25c15a3f0 2023-10-06T03:25:21.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.211+0000 7fc25b7fe700 1 --2- 172.21.15.81:0/1334557219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc25c15a3f0 0x7fc25c0c6ab0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fc2540099b0 tx=0x7fc254009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2afd851fa8684900 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:21.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.212+0000 7fc259ffb700 1 -- 172.21.15.81:0/1334557219 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25400b820 con 0x7fc25c15a3f0 2023-10-06T03:25:21.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.212+0000 7fc259ffb700 1 -- 172.21.15.81:0/1334557219 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc25400b980 con 0x7fc25c15a3f0 2023-10-06T03:25:21.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.212+0000 7fc259ffb700 1 -- 172.21.15.81:0/1334557219 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25400bd20 con 0x7fc25c15a3f0 2023-10-06T03:25:21.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.212+0000 7fc2617ff700 1 -- 172.21.15.81:0/1334557219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc25c15a3f0 msgr2=0x7fc25c0c6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:21.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.212+0000 7fc2617ff700 1 --2- 172.21.15.81:0/1334557219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc25c15a3f0 0x7fc25c0c6ab0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fc2540099b0 tx=0x7fc254009250 comp rx=0 tx=0).stop 2023-10-06T03:25:21.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.212+0000 7fc2617ff700 1 -- 172.21.15.81:0/1334557219 shutdown_connections 2023-10-06T03:25:21.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.212+0000 7fc2617ff700 1 --2- 172.21.15.81:0/1334557219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc25c15a3f0 0x7fc25c0c6ab0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:21.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.212+0000 7fc2617ff700 1 --2- 172.21.15.81:0/1334557219 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc25c13fd90 0x7fc25c159eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:21.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.212+0000 7fc2617ff700 1 -- 172.21.15.81:0/1334557219 >> 172.21.15.81:0/1334557219 conn(0x7fc25c0cc090 msgr2=0x7fc25c0cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:21.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.212+0000 7fc2617ff700 1 -- 172.21.15.81:0/1334557219 shutdown_connections 2023-10-06T03:25:21.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.212+0000 7fc2617ff700 1 -- 172.21.15.81:0/1334557219 wait complete. 2023-10-06T03:25:21.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.214+0000 7fc2617ff700 1 Processor -- start 2023-10-06T03:25:21.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.214+0000 7fc2617ff700 1 -- start start 2023-10-06T03:25:21.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.215+0000 7fc2617ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc25c13f9c0 0x7fc25c0aee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:21.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.215+0000 7fc2617ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc25c13fd90 0x7fc25c0ac010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:21.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.215+0000 7fc2617ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc25c15a3f0 0x7fc25c0adab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:21.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.215+0000 7fc2617ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc25c0b0720 con 0x7fc25c13f9c0 2023-10-06T03:25:21.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.215+0000 7fc2617ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc25c0af680 con 0x7fc25c15a3f0 2023-10-06T03:25:21.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.215+0000 7fc2617ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc25c0af960 con 0x7fc25c13fd90 2023-10-06T03:25:21.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.215+0000 7fc25affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc25c13f9c0 0x7fc25c0aee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:21.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.215+0000 7fc25affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc25c13f9c0 0x7fc25c0aee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35362/0 (socket says 172.21.15.81:35362) 2023-10-06T03:25:21.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.215+0000 7fc25affd700 1 -- 172.21.15.81:0/4019505302 learned_addr learned my addr 172.21.15.81:0/4019505302 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:21.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.215+0000 7fc25affd700 1 -- 172.21.15.81:0/4019505302 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc25c13fd90 msgr2=0x7fc25c0ac010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:21.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.215+0000 7fc25a7fc700 1 --2- 172.21.15.81:0/4019505302 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc25c13fd90 0x7fc25c0ac010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:21.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.215+0000 7fc25b7fe700 1 --2- 172.21.15.81:0/4019505302 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc25c15a3f0 0x7fc25c0adab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:21.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.215+0000 7fc25affd700 1 --2- 172.21.15.81:0/4019505302 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc25c13fd90 0x7fc25c0ac010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:21.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.215+0000 7fc25affd700 1 -- 172.21.15.81:0/4019505302 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc25c15a3f0 msgr2=0x7fc25c0adab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:21.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.215+0000 7fc25affd700 1 --2- 172.21.15.81:0/4019505302 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc25c15a3f0 0x7fc25c0adab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:21.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.215+0000 7fc25affd700 1 -- 172.21.15.81:0/4019505302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2540094f0 con 0x7fc25c13f9c0 2023-10-06T03:25:21.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.216+0000 7fc25a7fc700 1 --2- 172.21.15.81:0/4019505302 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc25c13fd90 0x7fc25c0ac010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:21.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.216+0000 7fc25b7fe700 1 --2- 172.21.15.81:0/4019505302 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc25c15a3f0 0x7fc25c0adab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:21.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.216+0000 7fc25affd700 1 --2- 172.21.15.81:0/4019505302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc25c13f9c0 0x7fc25c0aee30 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fc24c00c950 tx=0x7fc24c002760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:21.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.216+0000 7fc242ffd700 1 -- 172.21.15.81:0/4019505302 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24c00a7e0 con 0x7fc25c13f9c0 2023-10-06T03:25:21.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.216+0000 7fc242ffd700 1 -- 172.21.15.81:0/4019505302 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc24c00a940 con 0x7fc25c13f9c0 2023-10-06T03:25:21.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.216+0000 7fc2617ff700 1 -- 172.21.15.81:0/4019505302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc25c0afc40 con 0x7fc25c13f9c0 2023-10-06T03:25:21.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.216+0000 7fc242ffd700 1 -- 172.21.15.81:0/4019505302 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24c00ad00 con 0x7fc25c13f9c0 2023-10-06T03:25:21.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.216+0000 7fc2617ff700 1 -- 172.21.15.81:0/4019505302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc25c0b0200 con 0x7fc25c13f9c0 2023-10-06T03:25:21.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.217+0000 7fc2617ff700 1 -- 172.21.15.81:0/4019505302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc25c04c3c0 con 0x7fc25c13f9c0 2023-10-06T03:25:21.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.218+0000 7fc242ffd700 1 -- 172.21.15.81:0/4019505302 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc24c012630 con 0x7fc25c13f9c0 2023-10-06T03:25:21.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.219+0000 7fc242ffd700 1 --2- 172.21.15.81:0/4019505302 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc248066f30 0x7fc2480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:21.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.219+0000 7fc242ffd700 1 -- 172.21.15.81:0/4019505302 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5698+0+0 (secure 0 0 0) 0x7fc24c0849a0 con 0x7fc25c13f9c0 2023-10-06T03:25:21.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.219+0000 7fc25a7fc700 1 --2- 172.21.15.81:0/4019505302 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc248066f30 0x7fc2480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:21.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.220+0000 7fc25a7fc700 1 --2- 172.21.15.81:0/4019505302 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc248066f30 0x7fc2480693e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc250006fd0 tx=0x7fc250008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:21.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.223+0000 7fc242ffd700 1 -- 172.21.15.81:0/4019505302 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc24c051c10 con 0x7fc25c13f9c0 2023-10-06T03:25:21.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.409+0000 7fc2617ff700 1 -- 172.21.15.81:0/4019505302 --> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc25c0cb5a0 con 0x7fc248066f30 2023-10-06T03:25:21.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.412+0000 7fc242ffd700 1 -- 172.21.15.81:0/4019505302 <== mgr.4100 v2:172.21.15.81:6832/85286 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73030 (secure 0 0 0) 0x7fc25c0cb5a0 con 0x7fc248066f30 2023-10-06T03:25:21.414 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:25:21.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.414+0000 7fc2617ff700 1 -- 172.21.15.81:0/4019505302 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc248066f30 msgr2=0x7fc2480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:21.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.414+0000 7fc2617ff700 1 --2- 172.21.15.81:0/4019505302 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc248066f30 0x7fc2480693e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc250006fd0 tx=0x7fc250008040 comp rx=0 tx=0).stop 2023-10-06T03:25:21.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.414+0000 7fc2617ff700 1 -- 172.21.15.81:0/4019505302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc25c13f9c0 msgr2=0x7fc25c0aee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:21.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.414+0000 7fc2617ff700 1 --2- 172.21.15.81:0/4019505302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc25c13f9c0 0x7fc25c0aee30 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fc24c00c950 tx=0x7fc24c002760 comp rx=0 tx=0).stop 2023-10-06T03:25:21.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.414+0000 7fc2617ff700 1 -- 172.21.15.81:0/4019505302 shutdown_connections 2023-10-06T03:25:21.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.414+0000 7fc2617ff700 1 --2- 172.21.15.81:0/4019505302 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc25c15a3f0 0x7fc25c0adab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:21.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.414+0000 7fc2617ff700 1 --2- 172.21.15.81:0/4019505302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc25c13f9c0 0x7fc25c0aee30 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:21.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.414+0000 7fc2617ff700 1 --2- 172.21.15.81:0/4019505302 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc248066f30 0x7fc2480693e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:21.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.414+0000 7fc2617ff700 1 --2- 172.21.15.81:0/4019505302 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc25c13fd90 0x7fc25c0ac010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:21.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.414+0000 7fc2617ff700 1 -- 172.21.15.81:0/4019505302 >> 172.21.15.81:0/4019505302 conn(0x7fc25c0cc090 msgr2=0x7fc25c0c7bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:21.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.414+0000 7fc2617ff700 1 -- 172.21.15.81:0/4019505302 shutdown_connections 2023-10-06T03:25:21.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.414+0000 7fc2617ff700 1 -- 172.21.15.81:0/4019505302 wait complete. 2023-10-06T03:25:21.418 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-06T03:25:21.432 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2023-10-06T03:25:19.573624+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2383356,"kb_used_data":5052,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752591364,"statfs":{"total":773094113280,"available":770653556736,"internally_reserved":0,"allocated":5173248,"data_stored":2996409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-7101,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-50,"num_read_kb":-56,"num_write":-51,"num_write_kb":-22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000901"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":36,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:25:17.183372+0000","last_change":"2023-10-06T03:23:35.397971+0000","last_active":"2023-10-06T03:25:17.183372+0000","last_peered":"2023-10-06T03:25:17.183372+0000","last_clean":"2023-10-06T03:25:17.183372+0000","last_became_active":"2023-10-06T03:23:35.397649+0000","last_became_peered":"2023-10-06T03:23:35.397649+0000","last_unstale":"2023-10-06T03:25:17.183372+0000","last_undegraded":"2023-10-06T03:25:17.183372+0000","last_fullsized":"2023-10-06T03:25:17.183372+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:11.974461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":34,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:25:17.600352+0000","last_change":"2023-10-06T03:23:34.866196+0000","last_active":"2023-10-06T03:25:17.600352+0000","last_peered":"2023-10-06T03:25:17.600352+0000","last_clean":"2023-10-06T03:25:17.600352+0000","last_became_active":"2023-10-06T03:23:34.865914+0000","last_became_peered":"2023-10-06T03:23:34.865914+0000","last_unstale":"2023-10-06T03:25:17.600352+0000","last_undegraded":"2023-10-06T03:25:17.600352+0000","last_fullsized":"2023-10-06T03:25:17.600352+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:11.974461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":35,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:25:17.182175+0000","last_change":"2023-10-06T03:23:34.874380+0000","last_active":"2023-10-06T03:25:17.182175+0000","last_peered":"2023-10-06T03:25:17.182175+0000","last_clean":"2023-10-06T03:25:17.182175+0000","last_became_active":"2023-10-06T03:23:34.873972+0000","last_became_peered":"2023-10-06T03:23:34.873972+0000","last_unstale":"2023-10-06T03:25:17.182175+0000","last_undegraded":"2023-10-06T03:25:17.182175+0000","last_fullsized":"2023-10-06T03:25:17.182175+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:30.204999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":183,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:25:17.597762+0000","last_change":"2023-10-06T03:23:34.864626+0000","last_active":"2023-10-06T03:25:17.597762+0000","last_peered":"2023-10-06T03:25:17.597762+0000","last_clean":"2023-10-06T03:25:17.597762+0000","last_became_active":"2023-10-06T03:23:34.863539+0000","last_became_peered":"2023-10-06T03:23:34.863539+0000","last_unstale":"2023-10-06T03:25:17.597762+0000","last_undegraded":"2023-10-06T03:25:17.597762+0000","last_fullsized":"2023-10-06T03:25:17.597762+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:11.750836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:25:17.598525+0000","last_change":"2023-10-06T03:23:34.864399+0000","last_active":"2023-10-06T03:25:17.598525+0000","last_peered":"2023-10-06T03:25:17.598525+0000","last_clean":"2023-10-06T03:25:17.598525+0000","last_became_active":"2023-10-06T03:23:34.863991+0000","last_became_peered":"2023-10-06T03:23:34.863991+0000","last_unstale":"2023-10-06T03:25:17.598525+0000","last_undegraded":"2023-10-06T03:25:17.598525+0000","last_fullsized":"2023-10-06T03:25:17.598525+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:56:32.358597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:25:17.597613+0000","last_change":"2023-10-06T03:23:34.865125+0000","last_active":"2023-10-06T03:25:17.597613+0000","last_peered":"2023-10-06T03:25:17.597613+0000","last_clean":"2023-10-06T03:25:17.597613+0000","last_became_active":"2023-10-06T03:23:34.864752+0000","last_became_peered":"2023-10-06T03:23:34.864752+0000","last_unstale":"2023-10-06T03:25:17.597613+0000","last_undegraded":"2023-10-06T03:25:17.597613+0000","last_fullsized":"2023-10-06T03:25:17.597613+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:00.374963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":36,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:25:17.183773+0000","last_change":"2023-10-06T03:23:34.864329+0000","last_active":"2023-10-06T03:25:17.183773+0000","last_peered":"2023-10-06T03:25:17.183773+0000","last_clean":"2023-10-06T03:25:17.183773+0000","last_became_active":"2023-10-06T03:23:34.863953+0000","last_became_peered":"2023-10-06T03:23:34.863953+0000","last_unstale":"2023-10-06T03:25:17.183773+0000","last_undegraded":"2023-10-06T03:25:17.183773+0000","last_fullsized":"2023-10-06T03:25:17.183773+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:30.204999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":32,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:25:17.600169+0000","last_change":"2023-10-06T03:23:34.873939+0000","last_active":"2023-10-06T03:25:17.600169+0000","last_peered":"2023-10-06T03:25:17.600169+0000","last_clean":"2023-10-06T03:25:17.600169+0000","last_became_active":"2023-10-06T03:23:34.873623+0000","last_became_peered":"2023-10-06T03:23:34.873623+0000","last_unstale":"2023-10-06T03:25:17.600169+0000","last_undegraded":"2023-10-06T03:25:17.600169+0000","last_fullsized":"2023-10-06T03:25:17.600169+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:30.204999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":32,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:25:17.600722+0000","last_change":"2023-10-06T03:23:34.872453+0000","last_active":"2023-10-06T03:25:17.600722+0000","last_peered":"2023-10-06T03:25:17.600722+0000","last_clean":"2023-10-06T03:25:17.600722+0000","last_became_active":"2023-10-06T03:23:34.872139+0000","last_became_peered":"2023-10-06T03:23:34.872139+0000","last_unstale":"2023-10-06T03:25:17.600722+0000","last_undegraded":"2023-10-06T03:25:17.600722+0000","last_fullsized":"2023-10-06T03:25:17.600722+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:25:46.214290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298364,"kb_used_data":1076,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073476,"statfs":{"total":96636764160,"available":96331239424,"internally_reserved":0,"allocated":1101824,"data_stored":821441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.59799999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.66400000000000003}]},{"osd":2,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.58099999999999996}]},{"osd":3,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.71099999999999997}]},{"osd":4,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.77500000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.72299999999999998}]},{"osd":6,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.73799999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297768,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074072,"statfs":{"total":96636764160,"available":96331849728,"internally_reserved":0,"allocated":491520,"data_stored":223409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.64200000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.441}]},{"osd":2,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.57399999999999995}]},{"osd":3,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.61599999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.53800000000000003}]},{"osd":5,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.626}]},{"osd":7,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.52000000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298348,"kb_used_data":1060,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073492,"statfs":{"total":96636764160,"available":96331255808,"internally_reserved":0,"allocated":1085440,"data_stored":815129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:35 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.43099999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:24:35 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.46200000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:24:35 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.47899999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:24:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.83999999999999997}]},{"osd":5,"last update":"Fri Oct 6 03:24:35 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.64700000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:24:35 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.63},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.78300000000000003}]},{"osd":7,"last update":"Fri Oct 6 03:24:35 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.65700000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297772,"kb_used_data":484,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074068,"statfs":{"total":96636764160,"available":96331845632,"internally_reserved":0,"allocated":495616,"data_stored":224762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.40200000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.32700000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.376},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.42099999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.68200000000000005}]},{"osd":5,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.749}]},{"osd":6,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.82899999999999996}]},{"osd":7,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.80700000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297768,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074072,"statfs":{"total":96636764160,"available":96331849728,"internally_reserved":0,"allocated":491520,"data_stored":224761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.433}]},{"osd":1,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.504}]},{"osd":3,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":0.48099999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.71499999999999997}]},{"osd":5,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.629},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.70199999999999996}]},{"osd":6,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.754}]},{"osd":7,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.65700000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297784,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074056,"statfs":{"total":96636764160,"available":96331833344,"internally_reserved":0,"allocated":507904,"data_stored":231073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.45200000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.501},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.39300000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.37},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.41199999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.85099999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.625},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.75900000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.68300000000000005}]},{"osd":7,"last update":"Fri Oct 6 03:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.73099999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297784,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074056,"statfs":{"total":96636764160,"available":96331833344,"internally_reserved":0,"allocated":507904,"data_stored":231073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.69999999999999996}]},{"osd":1,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.66700000000000004}]},{"osd":2,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":2.0539999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.61499999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.751},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.46700000000000003}]},{"osd":5,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":1.3080000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.64000000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":1.6930000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.76900000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":2.1179999999999999},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":1.6140000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297768,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074072,"statfs":{"total":96636764160,"available":96331849728,"internally_reserved":0,"allocated":491520,"data_stored":224761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.66600000000000004}]},{"osd":1,"last update":"Fri Oct 6 03:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.73299999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.82699999999999996}]},{"osd":3,"last update":"Fri Oct 6 03:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.91800000000000004}]},{"osd":4,"last update":"Fri Oct 6 03:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.77700000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":0.85299999999999998}]},{"osd":7,"last update":"Fri Oct 6 03:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.94599999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:25:21.435 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-06T03:25:21.435 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:25:21.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.615+0000 7effe83ff700 1 Processor -- start 2023-10-06T03:25:21.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.615+0000 7effe83ff700 1 -- start start 2023-10-06T03:25:21.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.617+0000 7effe83ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7effe01557f0 0x7effe0156c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:21.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.617+0000 7effe83ff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effe00c9c60 con 0x7effe0069ee0 2023-10-06T03:25:21.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.617+0000 7effe83ff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effe006dc60 con 0x7effe0155bc0 2023-10-06T03:25:21.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.617+0000 7effe83ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effe006df20 con 0x7effe01557f0 2023-10-06T03:25:21.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.617+0000 7effe699c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7effe0069ee0 0x7effe006e370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39704/0 (socket says 172.21.15.81:39704) 2023-10-06T03:25:21.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.617+0000 7effe699c700 1 -- 172.21.15.81:0/1172922993 learned_addr learned my addr 172.21.15.81:0/1172922993 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:25:21.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.617+0000 7effe619b700 1 --2- 172.21.15.81:0/1172922993 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7effe01557f0 0x7effe0156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:21.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.618+0000 7effe5199700 1 -- 172.21.15.81:0/1172922993 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1924862765 0 0) 0x7effe00c9c60 con 0x7effe0069ee0 2023-10-06T03:25:21.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.618+0000 7effe5199700 1 -- 172.21.15.81:0/1172922993 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effcc003570 con 0x7effe0069ee0 2023-10-06T03:25:21.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.618+0000 7effe5199700 1 -- 172.21.15.81:0/1172922993 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2991631198 0 0) 0x7effe006dc60 con 0x7effe0155bc0 2023-10-06T03:25:21.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.618+0000 7effe5199700 1 -- 172.21.15.81:0/1172922993 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effe00c9c60 con 0x7effe0155bc0 2023-10-06T03:25:21.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.618+0000 7effe619b700 1 -- 172.21.15.81:0/1172922993 >> v1:172.21.15.83:6789/0 conn(0x7effe0155bc0 legacy=0x7effe00c6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:21.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.618+0000 7effe619b700 1 -- 172.21.15.81:0/1172922993 >> v1:172.21.15.81:6789/0 conn(0x7effe0069ee0 legacy=0x7effe006e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:21.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.618+0000 7effe619b700 1 -- 172.21.15.81:0/1172922993 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe00c74e0 con 0x7effe01557f0 2023-10-06T03:25:21.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.618+0000 7effe619b700 1 --2- 172.21.15.81:0/1172922993 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7effe01557f0 0x7effe0156c90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7effdc009910 tx=0x7effdc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d90e2f250056a3b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:21.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.618+0000 7effe5199700 1 -- 172.21.15.81:0/1172922993 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effdc011630 con 0x7effe01557f0 2023-10-06T03:25:21.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.618+0000 7effe5199700 1 -- 172.21.15.81:0/1172922993 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effdc011790 con 0x7effe01557f0 2023-10-06T03:25:21.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.618+0000 7effe5199700 1 -- 172.21.15.81:0/1172922993 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effdc011b30 con 0x7effe01557f0 2023-10-06T03:25:21.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.619+0000 7effe83ff700 1 -- 172.21.15.81:0/1172922993 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7effe01557f0 msgr2=0x7effe0156c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:21.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.619+0000 7effe83ff700 1 --2- 172.21.15.81:0/1172922993 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7effe01557f0 0x7effe0156c90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7effdc009910 tx=0x7effdc0091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:21.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.619+0000 7effe83ff700 1 -- 172.21.15.81:0/1172922993 shutdown_connections 2023-10-06T03:25:21.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.619+0000 7effe83ff700 1 --2- 172.21.15.81:0/1172922993 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7effe01557f0 0x7effe0156c90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:21.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.619+0000 7effe83ff700 1 -- 172.21.15.81:0/1172922993 >> 172.21.15.81:0/1172922993 conn(0x7effe00cc090 msgr2=0x7effe00cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:21.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.619+0000 7effe83ff700 1 -- 172.21.15.81:0/1172922993 shutdown_connections 2023-10-06T03:25:21.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.619+0000 7effe83ff700 1 -- 172.21.15.81:0/1172922993 wait complete. 2023-10-06T03:25:21.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.620+0000 7effe83ff700 1 Processor -- start 2023-10-06T03:25:21.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.621+0000 7effe83ff700 1 -- start start 2023-10-06T03:25:21.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.621+0000 7effe83ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7effe0069ee0 0x7effe00acd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:21.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.621+0000 7effe83ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7effe01557f0 0x7effe00ad250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:21.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.621+0000 7effe83ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effe0155bc0 0x7effe00c3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:21.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.621+0000 7effe83ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe00ad790 con 0x7effe0155bc0 2023-10-06T03:25:21.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.621+0000 7effe83ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe00aea20 con 0x7effe0069ee0 2023-10-06T03:25:21.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.621+0000 7effe83ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effe00ae590 con 0x7effe01557f0 2023-10-06T03:25:21.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.622+0000 7effe699c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effe0155bc0 0x7effe00c3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:21.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.622+0000 7effe699c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effe0155bc0 0x7effe00c3140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35368/0 (socket says 172.21.15.81:35368) 2023-10-06T03:25:21.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.622+0000 7effe699c700 1 -- 172.21.15.81:0/3129427406 learned_addr learned my addr 172.21.15.81:0/3129427406 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:21.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.622+0000 7effe619b700 1 --2- 172.21.15.81:0/3129427406 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7effe0069ee0 0x7effe00acd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:21.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.622+0000 7effe699c700 1 -- 172.21.15.81:0/3129427406 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7effe01557f0 msgr2=0x7effe00ad250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:21.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.622+0000 7effe599a700 1 --2- 172.21.15.81:0/3129427406 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7effe01557f0 0x7effe00ad250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:21.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.622+0000 7effe699c700 1 --2- 172.21.15.81:0/3129427406 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7effe01557f0 0x7effe00ad250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:21.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.622+0000 7effe699c700 1 -- 172.21.15.81:0/3129427406 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7effe0069ee0 msgr2=0x7effe00acd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:21.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.622+0000 7effe699c700 1 --2- 172.21.15.81:0/3129427406 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7effe0069ee0 0x7effe00acd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:21.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.622+0000 7effe699c700 1 -- 172.21.15.81:0/3129427406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effdc009420 con 0x7effe0155bc0 2023-10-06T03:25:21.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.622+0000 7effe619b700 1 --2- 172.21.15.81:0/3129427406 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7effe0069ee0 0x7effe00acd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:21.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.622+0000 7effe599a700 1 --2- 172.21.15.81:0/3129427406 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7effe01557f0 0x7effe00ad250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:21.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.622+0000 7effe699c700 1 --2- 172.21.15.81:0/3129427406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effe0155bc0 0x7effe00c3140 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7effd800cc70 tx=0x7effd8001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:21.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.623+0000 7effd67fc700 1 -- 172.21.15.81:0/3129427406 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd800ce80 con 0x7effe0155bc0 2023-10-06T03:25:21.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.623+0000 7effd67fc700 1 -- 172.21.15.81:0/3129427406 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd800aad0 con 0x7effe0155bc0 2023-10-06T03:25:21.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.623+0000 7effd67fc700 1 -- 172.21.15.81:0/3129427406 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd800ae50 con 0x7effe0155bc0 2023-10-06T03:25:21.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.623+0000 7effe83ff700 1 -- 172.21.15.81:0/3129427406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effe00c5640 con 0x7effe0155bc0 2023-10-06T03:25:21.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.623+0000 7effe83ff700 1 -- 172.21.15.81:0/3129427406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effe00adf40 con 0x7effe0155bc0 2023-10-06T03:25:21.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.624+0000 7effe83ff700 1 -- 172.21.15.81:0/3129427406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effe004c3c0 con 0x7effe0155bc0 2023-10-06T03:25:21.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.625+0000 7effd67fc700 1 -- 172.21.15.81:0/3129427406 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7effd8007300 con 0x7effe0155bc0 2023-10-06T03:25:21.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.625+0000 7effd67fc700 1 --2- 172.21.15.81:0/3129427406 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7effc4066f30 0x7effc40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:21.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.625+0000 7effd67fc700 1 -- 172.21.15.81:0/3129427406 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5698+0+0 (secure 0 0 0) 0x7effd8084990 con 0x7effe0155bc0 2023-10-06T03:25:21.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.626+0000 7effe619b700 1 --2- 172.21.15.81:0/3129427406 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7effc4066f30 0x7effc40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:21.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.626+0000 7effe619b700 1 --2- 172.21.15.81:0/3129427406 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7effc4066f30 0x7effc40693e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7effdc009860 tx=0x7effdc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:21.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.629+0000 7effd67fc700 1 -- 172.21.15.81:0/3129427406 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7effd8051be0 con 0x7effe0155bc0 2023-10-06T03:25:21.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.815+0000 7effe83ff700 1 -- 172.21.15.81:0/3129427406 --> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7effe00cae00 con 0x7effc4066f30 2023-10-06T03:25:21.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.818+0000 7effd67fc700 1 -- 172.21.15.81:0/3129427406 <== mgr.4100 v2:172.21.15.81:6832/85286 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73030 (secure 0 0 0) 0x7effe00cae00 con 0x7effc4066f30 2023-10-06T03:25:21.820 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:25:21.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.820+0000 7effe83ff700 1 -- 172.21.15.81:0/3129427406 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7effc4066f30 msgr2=0x7effc40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:21.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.820+0000 7effe83ff700 1 --2- 172.21.15.81:0/3129427406 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7effc4066f30 0x7effc40693e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7effdc009860 tx=0x7effdc017000 comp rx=0 tx=0).stop 2023-10-06T03:25:21.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.820+0000 7effe83ff700 1 -- 172.21.15.81:0/3129427406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effe0155bc0 msgr2=0x7effe00c3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:21.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.820+0000 7effe83ff700 1 --2- 172.21.15.81:0/3129427406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effe0155bc0 0x7effe00c3140 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7effd800cc70 tx=0x7effd8001a40 comp rx=0 tx=0).stop 2023-10-06T03:25:21.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.821+0000 7effe83ff700 1 -- 172.21.15.81:0/3129427406 shutdown_connections 2023-10-06T03:25:21.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.821+0000 7effe83ff700 1 --2- 172.21.15.81:0/3129427406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effe0155bc0 0x7effe00c3140 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:21.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.821+0000 7effe83ff700 1 --2- 172.21.15.81:0/3129427406 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7effe0069ee0 0x7effe00acd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:21.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.821+0000 7effe83ff700 1 --2- 172.21.15.81:0/3129427406 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7effc4066f30 0x7effc40693e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:21.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.821+0000 7effe83ff700 1 --2- 172.21.15.81:0/3129427406 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7effe01557f0 0x7effe00ad250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:21.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.821+0000 7effe83ff700 1 -- 172.21.15.81:0/3129427406 >> 172.21.15.81:0/3129427406 conn(0x7effe00cc090 msgr2=0x7effe0063500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:21.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.821+0000 7effe83ff700 1 -- 172.21.15.81:0/3129427406 shutdown_connections 2023-10-06T03:25:21.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:21.821+0000 7effe83ff700 1 -- 172.21.15.81:0/3129427406 wait complete. 2023-10-06T03:25:21.823 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-06T03:25:21.839 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2023-10-06T03:25:21.573884+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2383356,"kb_used_data":5052,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752591364,"statfs":{"total":773094113280,"available":770653556736,"internally_reserved":0,"allocated":5173248,"data_stored":2996409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8934,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-51,"num_read_kb":-57,"num_write":-54,"num_write_kb":-25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.401637"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":36,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:25:17.183372+0000","last_change":"2023-10-06T03:23:35.397971+0000","last_active":"2023-10-06T03:25:17.183372+0000","last_peered":"2023-10-06T03:25:17.183372+0000","last_clean":"2023-10-06T03:25:17.183372+0000","last_became_active":"2023-10-06T03:23:35.397649+0000","last_became_peered":"2023-10-06T03:23:35.397649+0000","last_unstale":"2023-10-06T03:25:17.183372+0000","last_undegraded":"2023-10-06T03:25:17.183372+0000","last_fullsized":"2023-10-06T03:25:17.183372+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:11.974461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":34,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:25:17.600352+0000","last_change":"2023-10-06T03:23:34.866196+0000","last_active":"2023-10-06T03:25:17.600352+0000","last_peered":"2023-10-06T03:25:17.600352+0000","last_clean":"2023-10-06T03:25:17.600352+0000","last_became_active":"2023-10-06T03:23:34.865914+0000","last_became_peered":"2023-10-06T03:23:34.865914+0000","last_unstale":"2023-10-06T03:25:17.600352+0000","last_undegraded":"2023-10-06T03:25:17.600352+0000","last_fullsized":"2023-10-06T03:25:17.600352+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:11.974461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":35,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:25:17.182175+0000","last_change":"2023-10-06T03:23:34.874380+0000","last_active":"2023-10-06T03:25:17.182175+0000","last_peered":"2023-10-06T03:25:17.182175+0000","last_clean":"2023-10-06T03:25:17.182175+0000","last_became_active":"2023-10-06T03:23:34.873972+0000","last_became_peered":"2023-10-06T03:23:34.873972+0000","last_unstale":"2023-10-06T03:25:17.182175+0000","last_undegraded":"2023-10-06T03:25:17.182175+0000","last_fullsized":"2023-10-06T03:25:17.182175+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:30.204999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":183,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:25:17.597762+0000","last_change":"2023-10-06T03:23:34.864626+0000","last_active":"2023-10-06T03:25:17.597762+0000","last_peered":"2023-10-06T03:25:17.597762+0000","last_clean":"2023-10-06T03:25:17.597762+0000","last_became_active":"2023-10-06T03:23:34.863539+0000","last_became_peered":"2023-10-06T03:23:34.863539+0000","last_unstale":"2023-10-06T03:25:17.597762+0000","last_undegraded":"2023-10-06T03:25:17.597762+0000","last_fullsized":"2023-10-06T03:25:17.597762+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:11.750836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:25:17.598525+0000","last_change":"2023-10-06T03:23:34.864399+0000","last_active":"2023-10-06T03:25:17.598525+0000","last_peered":"2023-10-06T03:25:17.598525+0000","last_clean":"2023-10-06T03:25:17.598525+0000","last_became_active":"2023-10-06T03:23:34.863991+0000","last_became_peered":"2023-10-06T03:23:34.863991+0000","last_unstale":"2023-10-06T03:25:17.598525+0000","last_undegraded":"2023-10-06T03:25:17.598525+0000","last_fullsized":"2023-10-06T03:25:17.598525+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:56:32.358597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:25:17.597613+0000","last_change":"2023-10-06T03:23:34.865125+0000","last_active":"2023-10-06T03:25:17.597613+0000","last_peered":"2023-10-06T03:25:17.597613+0000","last_clean":"2023-10-06T03:25:17.597613+0000","last_became_active":"2023-10-06T03:23:34.864752+0000","last_became_peered":"2023-10-06T03:23:34.864752+0000","last_unstale":"2023-10-06T03:25:17.597613+0000","last_undegraded":"2023-10-06T03:25:17.597613+0000","last_fullsized":"2023-10-06T03:25:17.597613+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:00.374963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":36,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:25:17.183773+0000","last_change":"2023-10-06T03:23:34.864329+0000","last_active":"2023-10-06T03:25:17.183773+0000","last_peered":"2023-10-06T03:25:17.183773+0000","last_clean":"2023-10-06T03:25:17.183773+0000","last_became_active":"2023-10-06T03:23:34.863953+0000","last_became_peered":"2023-10-06T03:23:34.863953+0000","last_unstale":"2023-10-06T03:25:17.183773+0000","last_undegraded":"2023-10-06T03:25:17.183773+0000","last_fullsized":"2023-10-06T03:25:17.183773+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:30.204999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":32,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:25:17.600169+0000","last_change":"2023-10-06T03:23:34.873939+0000","last_active":"2023-10-06T03:25:17.600169+0000","last_peered":"2023-10-06T03:25:17.600169+0000","last_clean":"2023-10-06T03:25:17.600169+0000","last_became_active":"2023-10-06T03:23:34.873623+0000","last_became_peered":"2023-10-06T03:23:34.873623+0000","last_unstale":"2023-10-06T03:25:17.600169+0000","last_undegraded":"2023-10-06T03:25:17.600169+0000","last_fullsized":"2023-10-06T03:25:17.600169+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:30.204999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":32,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:25:17.600722+0000","last_change":"2023-10-06T03:23:34.872453+0000","last_active":"2023-10-06T03:25:17.600722+0000","last_peered":"2023-10-06T03:25:17.600722+0000","last_clean":"2023-10-06T03:25:17.600722+0000","last_became_active":"2023-10-06T03:23:34.872139+0000","last_became_peered":"2023-10-06T03:23:34.872139+0000","last_unstale":"2023-10-06T03:25:17.600722+0000","last_undegraded":"2023-10-06T03:25:17.600722+0000","last_fullsized":"2023-10-06T03:25:17.600722+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:25:46.214290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298364,"kb_used_data":1076,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073476,"statfs":{"total":96636764160,"available":96331239424,"internally_reserved":0,"allocated":1101824,"data_stored":821441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.59799999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.66400000000000003}]},{"osd":2,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.58099999999999996}]},{"osd":3,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.71099999999999997}]},{"osd":4,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.77500000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.72299999999999998}]},{"osd":6,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.73799999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297768,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074072,"statfs":{"total":96636764160,"available":96331849728,"internally_reserved":0,"allocated":491520,"data_stored":223409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.64200000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.441}]},{"osd":2,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.57399999999999995}]},{"osd":3,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.61599999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.53800000000000003}]},{"osd":5,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.626}]},{"osd":7,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.52000000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298348,"kb_used_data":1060,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073492,"statfs":{"total":96636764160,"available":96331255808,"internally_reserved":0,"allocated":1085440,"data_stored":815129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:35 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.43099999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:24:35 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.46200000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:24:35 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.47899999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:24:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.83999999999999997}]},{"osd":5,"last update":"Fri Oct 6 03:24:35 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.64700000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:24:35 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.63},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.78300000000000003}]},{"osd":7,"last update":"Fri Oct 6 03:24:35 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.65700000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297772,"kb_used_data":484,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074068,"statfs":{"total":96636764160,"available":96331845632,"internally_reserved":0,"allocated":495616,"data_stored":224762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.40200000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.32700000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.376},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.42099999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.68200000000000005}]},{"osd":5,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.749}]},{"osd":6,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.82899999999999996}]},{"osd":7,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.80700000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297768,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074072,"statfs":{"total":96636764160,"available":96331849728,"internally_reserved":0,"allocated":491520,"data_stored":224761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.433}]},{"osd":1,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.504}]},{"osd":3,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":0.48099999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.71499999999999997}]},{"osd":5,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.629},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.70199999999999996}]},{"osd":6,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.754}]},{"osd":7,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.65700000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297784,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074056,"statfs":{"total":96636764160,"available":96331833344,"internally_reserved":0,"allocated":507904,"data_stored":231073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.45200000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.501},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.39300000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.37},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.41199999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.85099999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.625},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.75900000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.68300000000000005}]},{"osd":7,"last update":"Fri Oct 6 03:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.73099999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297784,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074056,"statfs":{"total":96636764160,"available":96331833344,"internally_reserved":0,"allocated":507904,"data_stored":231073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.69999999999999996}]},{"osd":1,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.66700000000000004}]},{"osd":2,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":2.0539999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.61499999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.751},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.46700000000000003}]},{"osd":5,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":1.3080000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.64000000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":1.6930000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.76900000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":2.1179999999999999},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":1.6140000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297768,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074072,"statfs":{"total":96636764160,"available":96331849728,"internally_reserved":0,"allocated":491520,"data_stored":224761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.66600000000000004}]},{"osd":1,"last update":"Fri Oct 6 03:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.73299999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.82699999999999996}]},{"osd":3,"last update":"Fri Oct 6 03:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.91800000000000004}]},{"osd":4,"last update":"Fri Oct 6 03:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.77700000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":0.85299999999999998}]},{"osd":7,"last update":"Fri Oct 6 03:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.94599999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:25:21.841 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:25:22.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.020+0000 7f451abff700 1 Processor -- start 2023-10-06T03:25:22.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.020+0000 7f451abff700 1 -- start start 2023-10-06T03:25:22.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.021+0000 7f451abff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f451413f9c0 0x7f45140ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:22.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.022+0000 7f451abff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45140cafe0 con 0x7f451415a5c0 2023-10-06T03:25:22.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.022+0000 7f451abff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45140cb2c0 con 0x7f45140cab60 2023-10-06T03:25:22.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.022+0000 7f451abff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45140cb5a0 con 0x7f451413f9c0 2023-10-06T03:25:22.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.022+0000 7f451919c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f451415a5c0 0x7f45140c6ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39712/0 (socket says 172.21.15.81:39712) 2023-10-06T03:25:22.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.022+0000 7f451919c700 1 -- 172.21.15.81:0/256550542 learned_addr learned my addr 172.21.15.81:0/256550542 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:25:22.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.022+0000 7f451899b700 1 --2- 172.21.15.81:0/256550542 >> v2:172.21.15.83:3300/0 conn(0x7f451413f9c0 0x7f45140ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:22.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.022+0000 7f45137fe700 1 -- 172.21.15.81:0/256550542 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2608095921 0 0) 0x7f45140cafe0 con 0x7f451415a5c0 2023-10-06T03:25:22.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.022+0000 7f45137fe700 1 -- 172.21.15.81:0/256550542 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4504003570 con 0x7f451415a5c0 2023-10-06T03:25:22.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.022+0000 7f451899b700 1 -- 172.21.15.81:0/256550542 >> v1:172.21.15.83:6789/0 conn(0x7f45140cab60 legacy=0x7f4514159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:22.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.022+0000 7f45137fe700 1 -- 172.21.15.81:0/256550542 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3438895813 0 0) 0x7f45140cb2c0 con 0x7f45140cab60 2023-10-06T03:25:22.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.022+0000 7f451899b700 1 -- 172.21.15.81:0/256550542 >> v1:172.21.15.81:6789/0 conn(0x7f451415a5c0 legacy=0x7f45140c6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:22.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.022+0000 7f451899b700 1 -- 172.21.15.81:0/256550542 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45140cb880 con 0x7f451413f9c0 2023-10-06T03:25:22.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.023+0000 7f451899b700 1 --2- 172.21.15.81:0/256550542 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f451413f9c0 0x7f45140ca620 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f45080098e0 tx=0x7f45080091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a94baef4aa6f4a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:22.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.023+0000 7f45137fe700 1 -- 172.21.15.81:0/256550542 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450800b640 con 0x7f451413f9c0 2023-10-06T03:25:22.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.023+0000 7f45137fe700 1 -- 172.21.15.81:0/256550542 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f450800b7a0 con 0x7f451413f9c0 2023-10-06T03:25:22.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.023+0000 7f45137fe700 1 -- 172.21.15.81:0/256550542 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450800bb40 con 0x7f451413f9c0 2023-10-06T03:25:22.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.024+0000 7f451abff700 1 -- 172.21.15.81:0/256550542 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f451413f9c0 msgr2=0x7f45140ca620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:22.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.024+0000 7f451abff700 1 --2- 172.21.15.81:0/256550542 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f451413f9c0 0x7f45140ca620 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f45080098e0 tx=0x7f45080091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:22.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.024+0000 7f451abff700 1 -- 172.21.15.81:0/256550542 shutdown_connections 2023-10-06T03:25:22.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.024+0000 7f451abff700 1 --2- 172.21.15.81:0/256550542 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f451413f9c0 0x7f45140ca620 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:22.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.024+0000 7f451abff700 1 -- 172.21.15.81:0/256550542 >> 172.21.15.81:0/256550542 conn(0x7f45140cc090 msgr2=0x7f45140cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:22.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.024+0000 7f451abff700 1 -- 172.21.15.81:0/256550542 shutdown_connections 2023-10-06T03:25:22.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.024+0000 7f451abff700 1 -- 172.21.15.81:0/256550542 wait complete. 2023-10-06T03:25:22.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.025+0000 7f451abff700 1 Processor -- start 2023-10-06T03:25:22.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.025+0000 7f451abff700 1 -- start start 2023-10-06T03:25:22.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.026+0000 7f451abff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f451413f9c0 0x7f4514139ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:22.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.026+0000 7f451abff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f451415a5c0 0x7f45140aee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:22.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.026+0000 7f451abff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45140af370 0x7f451413ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:22.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.026+0000 7f451abff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f451413a400 con 0x7f45140af370 2023-10-06T03:25:22.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.026+0000 7f451abff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45141698f0 con 0x7f451415a5c0 2023-10-06T03:25:22.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.026+0000 7f451abff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4514169bd0 con 0x7f451413f9c0 2023-10-06T03:25:22.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.027+0000 7f451919c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45140af370 0x7f451413ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:22.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.027+0000 7f451919c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45140af370 0x7f451413ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35372/0 (socket says 172.21.15.81:35372) 2023-10-06T03:25:22.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.027+0000 7f451919c700 1 -- 172.21.15.81:0/2558973918 learned_addr learned my addr 172.21.15.81:0/2558973918 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:22.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.027+0000 7f451899b700 1 --2- 172.21.15.81:0/2558973918 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f451413f9c0 0x7f4514139ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:22.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.027+0000 7f4513fff700 1 --2- 172.21.15.81:0/2558973918 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f451415a5c0 0x7f45140aee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:22.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.027+0000 7f451919c700 1 -- 172.21.15.81:0/2558973918 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f451413f9c0 msgr2=0x7f4514139ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:22.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.027+0000 7f451919c700 1 --2- 172.21.15.81:0/2558973918 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f451413f9c0 0x7f4514139ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:22.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.027+0000 7f451919c700 1 -- 172.21.15.81:0/2558973918 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f451415a5c0 msgr2=0x7f45140aee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:22.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.027+0000 7f451919c700 1 --2- 172.21.15.81:0/2558973918 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f451415a5c0 0x7f45140aee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:22.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.027+0000 7f451919c700 1 -- 172.21.15.81:0/2558973918 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4508009420 con 0x7f45140af370 2023-10-06T03:25:22.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.027+0000 7f451919c700 1 --2- 172.21.15.81:0/2558973918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45140af370 0x7f451413ab40 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f450c00cc40 tx=0x7f450c001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:22.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.028+0000 7f4510ff9700 1 -- 172.21.15.81:0/2558973918 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450c00a8b0 con 0x7f45140af370 2023-10-06T03:25:22.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.028+0000 7f4510ff9700 1 -- 172.21.15.81:0/2558973918 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f450c00aa10 con 0x7f45140af370 2023-10-06T03:25:22.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.028+0000 7f4510ff9700 1 -- 172.21.15.81:0/2558973918 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450c00ad90 con 0x7f45140af370 2023-10-06T03:25:22.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.028+0000 7f451abff700 1 -- 172.21.15.81:0/2558973918 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4514169eb0 con 0x7f45140af370 2023-10-06T03:25:22.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.028+0000 7f451abff700 1 -- 172.21.15.81:0/2558973918 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f451416a470 con 0x7f45140af370 2023-10-06T03:25:22.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.029+0000 7f451abff700 1 -- 172.21.15.81:0/2558973918 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f451404c3c0 con 0x7f45140af370 2023-10-06T03:25:22.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.030+0000 7f4510ff9700 1 -- 172.21.15.81:0/2558973918 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f450c007300 con 0x7f45140af370 2023-10-06T03:25:22.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.030+0000 7f4510ff9700 1 --2- 172.21.15.81:0/2558973918 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f44f8066f30 0x7f44f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:22.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.031+0000 7f4510ff9700 1 -- 172.21.15.81:0/2558973918 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f450c0848b0 con 0x7f45140af370 2023-10-06T03:25:22.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.031+0000 7f451899b700 1 --2- 172.21.15.81:0/2558973918 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f44f8066f30 0x7f44f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:22.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.031+0000 7f451899b700 1 --2- 172.21.15.81:0/2558973918 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f44f8066f30 0x7f44f80693e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f45080093f0 tx=0x7f4508017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:22.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.034+0000 7f4510ff9700 1 -- 172.21.15.81:0/2558973918 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f450c051a70 con 0x7f45140af370 2023-10-06T03:25:22.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.225+0000 7f451abff700 1 -- 172.21.15.81:0/2558973918 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f451406f720 con 0x7f45140af370 2023-10-06T03:25:22.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.226+0000 7f4510ff9700 1 -- 172.21.15.81:0/2558973918 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+14066 (secure 0 0 0) 0x7f450c055090 con 0x7f45140af370 2023-10-06T03:25:22.227 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:25:22.227 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":43,"fsid":"1807b5d7-9be8-43ad-aaf8-99a4273430b3","created":"2023-10-06T03:23:20.805306+0000","modified":"2023-10-06T03:25:18.180246+0000","last_up_change":"2023-10-06T03:23:32.735796+0000","last_in_change":"2023-10-06T03:23:24.109024+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T03:23:33.198850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T03:23:33.606744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"14fb667d-a677-4978-a477-80027f889d36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":85563},{"type":"v1","addr":"172.21.15.81:6818","nonce":85563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":85563},{"type":"v1","addr":"172.21.15.81:6822","nonce":85563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":85563},{"type":"v1","addr":"172.21.15.81:6830","nonce":85563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":85563},{"type":"v1","addr":"172.21.15.81:6826","nonce":85563}]},"public_addr":"172.21.15.81:6818/85563","cluster_addr":"172.21.15.81:6822/85563","heartbeat_back_addr":"172.21.15.81:6830/85563","heartbeat_front_addr":"172.21.15.81:6826/85563","state":["exists","up"]},{"osd":1,"uuid":"974d8a86-1829-4176-89ce-18e6038857f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":85561},{"type":"v1","addr":"172.21.15.81:6801","nonce":85561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":85561},{"type":"v1","addr":"172.21.15.81:6803","nonce":85561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":85561},{"type":"v1","addr":"172.21.15.81:6807","nonce":85561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":85561},{"type":"v1","addr":"172.21.15.81:6805","nonce":85561}]},"public_addr":"172.21.15.81:6801/85561","cluster_addr":"172.21.15.81:6803/85561","heartbeat_back_addr":"172.21.15.81:6807/85561","heartbeat_front_addr":"172.21.15.81:6805/85561","state":["exists","up"]},{"osd":2,"uuid":"ffbfe056-46bc-46e0-bf49-4d8f8650e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":85564},{"type":"v1","addr":"172.21.15.81:6809","nonce":85564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":85564},{"type":"v1","addr":"172.21.15.81:6811","nonce":85564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":85564},{"type":"v1","addr":"172.21.15.81:6815","nonce":85564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":85564},{"type":"v1","addr":"172.21.15.81:6813","nonce":85564}]},"public_addr":"172.21.15.81:6809/85564","cluster_addr":"172.21.15.81:6811/85564","heartbeat_back_addr":"172.21.15.81:6815/85564","heartbeat_front_addr":"172.21.15.81:6813/85564","state":["exists","up"]},{"osd":3,"uuid":"ef9a8314-3d37-4ea1-858a-e704d5695002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":85562},{"type":"v1","addr":"172.21.15.81:6819","nonce":85562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":85562},{"type":"v1","addr":"172.21.15.81:6823","nonce":85562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":85562},{"type":"v1","addr":"172.21.15.81:6831","nonce":85562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":85562},{"type":"v1","addr":"172.21.15.81:6827","nonce":85562}]},"public_addr":"172.21.15.81:6819/85562","cluster_addr":"172.21.15.81:6823/85562","heartbeat_back_addr":"172.21.15.81:6831/85562","heartbeat_front_addr":"172.21.15.81:6827/85562","state":["exists","up"]},{"osd":4,"uuid":"d83506a0-2c96-4bcb-a9fa-05e43dc329df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":85785},{"type":"v1","addr":"172.21.15.83:6801","nonce":85785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":85785},{"type":"v1","addr":"172.21.15.83:6803","nonce":85785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":85785},{"type":"v1","addr":"172.21.15.83:6807","nonce":85785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":85785},{"type":"v1","addr":"172.21.15.83:6805","nonce":85785}]},"public_addr":"172.21.15.83:6801/85785","cluster_addr":"172.21.15.83:6803/85785","heartbeat_back_addr":"172.21.15.83:6807/85785","heartbeat_front_addr":"172.21.15.83:6805/85785","state":["exists","up"]},{"osd":5,"uuid":"10687c63-a3d5-472f-acc0-4f61847b6e0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":85818},{"type":"v1","addr":"172.21.15.83:6825","nonce":85818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":85818},{"type":"v1","addr":"172.21.15.83:6827","nonce":85818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":85818},{"type":"v1","addr":"172.21.15.83:6831","nonce":85818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":85818},{"type":"v1","addr":"172.21.15.83:6829","nonce":85818}]},"public_addr":"172.21.15.83:6825/85818","cluster_addr":"172.21.15.83:6827/85818","heartbeat_back_addr":"172.21.15.83:6831/85818","heartbeat_front_addr":"172.21.15.83:6829/85818","state":["exists","up"]},{"osd":6,"uuid":"2e9daf76-5607-4a29-9a58-6e270700d223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":85787},{"type":"v1","addr":"172.21.15.83:6811","nonce":85787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":85787},{"type":"v1","addr":"172.21.15.83:6815","nonce":85787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":85787},{"type":"v1","addr":"172.21.15.83:6823","nonce":85787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6817","nonce":85787},{"type":"v1","addr":"172.21.15.83:6819","nonce":85787}]},"public_addr":"172.21.15.83:6811/85787","cluster_addr":"172.21.15.83:6815/85787","heartbeat_back_addr":"172.21.15.83:6823/85787","heartbeat_front_addr":"172.21.15.83:6819/85787","state":["exists","up"]},{"osd":7,"uuid":"5019e1ff-233a-4a5a-91ca-8afccb7ab6e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":85786},{"type":"v1","addr":"172.21.15.83:6810","nonce":85786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":85786},{"type":"v1","addr":"172.21.15.83:6814","nonce":85786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":85786},{"type":"v1","addr":"172.21.15.83:6822","nonce":85786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":85786},{"type":"v1","addr":"172.21.15.83:6818","nonce":85786}]},"public_addr":"172.21.15.83:6810/85786","cluster_addr":"172.21.15.83:6814/85786","heartbeat_back_addr":"172.21.15.83:6822/85786","heartbeat_front_addr":"172.21.15.83:6818/85786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.393431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.360031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.407428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.391613+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.403211+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.438142+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.496181+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:23:29.472323+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6835/2219056136":"2023-10-07T03:25:15.169216+0000","172.21.15.81:6834/2789471208":"2023-10-07T03:25:01.347009+0000","172.21.15.81:6834/2219056136":"2023-10-07T03:25:15.169216+0000","172.21.15.81:6835/2789471208":"2023-10-07T03:25:01.347009+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:25:22.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.228+0000 7f451abff700 1 -- 172.21.15.81:0/2558973918 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f44f8066f30 msgr2=0x7f44f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:22.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.228+0000 7f451abff700 1 --2- 172.21.15.81:0/2558973918 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f44f8066f30 0x7f44f80693e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f45080093f0 tx=0x7f4508017000 comp rx=0 tx=0).stop 2023-10-06T03:25:22.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.228+0000 7f451abff700 1 -- 172.21.15.81:0/2558973918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45140af370 msgr2=0x7f451413ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:22.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.228+0000 7f451abff700 1 --2- 172.21.15.81:0/2558973918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45140af370 0x7f451413ab40 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f450c00cc40 tx=0x7f450c001a00 comp rx=0 tx=0).stop 2023-10-06T03:25:22.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.228+0000 7f451abff700 1 -- 172.21.15.81:0/2558973918 shutdown_connections 2023-10-06T03:25:22.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.228+0000 7f451abff700 1 --2- 172.21.15.81:0/2558973918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45140af370 0x7f451413ab40 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:22.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.228+0000 7f451abff700 1 --2- 172.21.15.81:0/2558973918 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f44f8066f30 0x7f44f80693e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:22.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.228+0000 7f451abff700 1 --2- 172.21.15.81:0/2558973918 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f451413f9c0 0x7f4514139ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:22.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.228+0000 7f451abff700 1 --2- 172.21.15.81:0/2558973918 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f451415a5c0 0x7f45140aee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:22.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.228+0000 7f451abff700 1 -- 172.21.15.81:0/2558973918 >> 172.21.15.81:0/2558973918 conn(0x7f45140cc090 msgr2=0x7f45140c7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:22.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.229+0000 7f451abff700 1 -- 172.21.15.81:0/2558973918 shutdown_connections 2023-10-06T03:25:22.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:22.229+0000 7f451abff700 1 -- 172.21.15.81:0/2558973918 wait complete. 2023-10-06T03:25:23.248 INFO:tasks.ceph:Scrubbing osd.0 2023-10-06T03:25:23.248 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:25:23.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.442+0000 7f98429ff700 1 Processor -- start 2023-10-06T03:25:23.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.442+0000 7f98429ff700 1 -- start start 2023-10-06T03:25:23.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.443+0000 7f98429ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f983c0af9b0 0x7f983c0cfe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:23.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.443+0000 7f98429ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f983c0ce820 0x7f983c0ccca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:23.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.443+0000 7f98429ff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f983c0cf980 con 0x7f983c0af5e0 2023-10-06T03:25:23.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.443+0000 7f98429ff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f983c0ced70 con 0x7f983c0ce820 2023-10-06T03:25:23.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.443+0000 7f98429ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f983c0cf050 con 0x7f983c0af9b0 2023-10-06T03:25:23.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.443+0000 7f983bfff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f983c0af5e0 0x7f983c15db30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39714/0 (socket says 172.21.15.81:39714) 2023-10-06T03:25:23.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.443+0000 7f983bfff700 1 -- 172.21.15.81:0/958381560 learned_addr learned my addr 172.21.15.81:0/958381560 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:25:23.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.444+0000 7f983b7fe700 1 --2- 172.21.15.81:0/958381560 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f983c0af9b0 0x7f983c0cfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:23.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.444+0000 7f9840f9c700 1 --2- 172.21.15.81:0/958381560 >> v2:172.21.15.83:3300/0 conn(0x7f983c0ce820 0x7f983c0ccca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:23.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.444+0000 7f983affd700 1 -- 172.21.15.81:0/958381560 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3593782846 0 0) 0x7f983c0cf980 con 0x7f983c0af5e0 2023-10-06T03:25:23.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.444+0000 7f983affd700 1 -- 172.21.15.81:0/958381560 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9824003570 con 0x7f983c0af5e0 2023-10-06T03:25:23.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.444+0000 7f983affd700 1 -- 172.21.15.81:0/958381560 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1915870668 0 0) 0x7f9824003570 con 0x7f983c0af5e0 2023-10-06T03:25:23.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.444+0000 7f983affd700 1 -- 172.21.15.81:0/958381560 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f983c0af9b0 msgr2=0x7f983c0cfe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:23.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.444+0000 7f983affd700 1 --2- 172.21.15.81:0/958381560 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f983c0af9b0 0x7f983c0cfe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:23.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.444+0000 7f983affd700 1 -- 172.21.15.81:0/958381560 >> v2:172.21.15.83:3300/0 conn(0x7f983c0ce820 msgr2=0x7f983c0ccca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:23.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.444+0000 7f983affd700 1 --2- 172.21.15.81:0/958381560 >> v2:172.21.15.83:3300/0 conn(0x7f983c0ce820 0x7f983c0ccca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:23.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.444+0000 7f983affd700 1 -- 172.21.15.81:0/958381560 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f983c0cf330 con 0x7f983c0af5e0 2023-10-06T03:25:23.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.444+0000 7f983affd700 1 -- 172.21.15.81:0/958381560 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2513016936 0 0) 0x7f982c001470 con 0x7f983c0af5e0 2023-10-06T03:25:23.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.444+0000 7f983affd700 1 -- 172.21.15.81:0/958381560 >> v1:172.21.15.81:6789/0 conn(0x7f983c0af5e0 legacy=0x7f983c15db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:23.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.444+0000 7f983affd700 1 --2- 172.21.15.81:0/958381560 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f983c0af9b0 0x7f9824003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:23.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.444+0000 7f983affd700 1 --2- 172.21.15.81:0/958381560 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9824003fe0 0x7f9824004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:23.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.444+0000 7f983affd700 1 --2- 172.21.15.81:0/958381560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9824004d50 0x7f98240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:23.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.444+0000 7f983affd700 1 -- 172.21.15.81:0/958381560 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f983c0ced70 con 0x7f9824004d50 2023-10-06T03:25:23.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.444+0000 7f983affd700 1 -- 172.21.15.81:0/958381560 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f983c0cf050 con 0x7f9824003fe0 2023-10-06T03:25:23.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.444+0000 7f983affd700 1 -- 172.21.15.81:0/958381560 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f982400ba90 con 0x7f983c0af9b0 2023-10-06T03:25:23.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.445+0000 7f9840f9c700 1 --2- 172.21.15.81:0/958381560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9824004d50 0x7f98240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:23.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.445+0000 7f983bfff700 1 --2- 172.21.15.81:0/958381560 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f983c0af9b0 0x7f9824003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:23.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.445+0000 7f983b7fe700 1 --2- 172.21.15.81:0/958381560 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9824003fe0 0x7f9824004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:23.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.445+0000 7f9840f9c700 1 -- 172.21.15.81:0/958381560 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f983c0af9b0 msgr2=0x7f9824003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:23.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.445+0000 7f9840f9c700 1 --2- 172.21.15.81:0/958381560 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f983c0af9b0 0x7f9824003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:23.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.445+0000 7f9840f9c700 1 -- 172.21.15.81:0/958381560 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9824003fe0 msgr2=0x7f9824004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:23.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.445+0000 7f9840f9c700 1 --2- 172.21.15.81:0/958381560 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9824003fe0 0x7f9824004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:23.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.445+0000 7f9840f9c700 1 -- 172.21.15.81:0/958381560 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9824003570 con 0x7f9824004d50 2023-10-06T03:25:23.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.445+0000 7f9840f9c700 1 --2- 172.21.15.81:0/958381560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9824004d50 0x7f98240051c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f983c0ceca0 tx=0x7f983400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f530d739de44b268 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:23.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.446+0000 7f983affd700 1 -- 172.21.15.81:0/958381560 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983400ea30 con 0x7f9824004d50 2023-10-06T03:25:23.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.446+0000 7f983affd700 1 -- 172.21.15.81:0/958381560 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f983400f040 con 0x7f9824004d50 2023-10-06T03:25:23.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.446+0000 7f983affd700 1 -- 172.21.15.81:0/958381560 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983400ede0 con 0x7f9824004d50 2023-10-06T03:25:23.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.446+0000 7f98429ff700 1 -- 172.21.15.81:0/958381560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9824004d50 msgr2=0x7f98240051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:23.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.446+0000 7f98429ff700 1 --2- 172.21.15.81:0/958381560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9824004d50 0x7f98240051c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f983c0ceca0 tx=0x7f983400b040 comp rx=0 tx=0).stop 2023-10-06T03:25:23.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.446+0000 7f9840f9c700 1 -- 172.21.15.81:0/958381560 reap_dead start 2023-10-06T03:25:23.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.446+0000 7f98429ff700 1 -- 172.21.15.81:0/958381560 shutdown_connections 2023-10-06T03:25:23.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.446+0000 7f98429ff700 1 -- 172.21.15.81:0/958381560 >> 172.21.15.81:0/958381560 conn(0x7f983c06ed10 msgr2=0x7f983c06f110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:23.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.446+0000 7f98429ff700 1 -- 172.21.15.81:0/958381560 shutdown_connections 2023-10-06T03:25:23.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.446+0000 7f98429ff700 1 -- 172.21.15.81:0/958381560 wait complete. 2023-10-06T03:25:23.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.448+0000 7f98429ff700 1 Processor -- start 2023-10-06T03:25:23.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.448+0000 7f98429ff700 1 -- start start 2023-10-06T03:25:23.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.449+0000 7f98429ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9824004d50 0x7f983c1415d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:23.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.449+0000 7f98429ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f983c155590 0x7f983c0c7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:23.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.449+0000 7f98429ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f983c0c9190 0x7f983c0c95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:23.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.449+0000 7f98429ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f983c15acd0 con 0x7f9824004d50 2023-10-06T03:25:23.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.449+0000 7f98429ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f983c141b10 con 0x7f983c155590 2023-10-06T03:25:23.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.449+0000 7f98429ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f983c15a0c0 con 0x7f983c0c9190 2023-10-06T03:25:23.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.449+0000 7f983bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9824004d50 0x7f983c1415d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:23.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.449+0000 7f983bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9824004d50 0x7f983c1415d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35384/0 (socket says 172.21.15.81:35384) 2023-10-06T03:25:23.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.449+0000 7f983bfff700 1 -- 172.21.15.81:0/3975215700 learned_addr learned my addr 172.21.15.81:0/3975215700 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:23.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.449+0000 7f983bfff700 1 -- 172.21.15.81:0/3975215700 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f983c0c9190 msgr2=0x7f983c0c95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:23.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.449+0000 7f9840f9c700 1 --2- 172.21.15.81:0/3975215700 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f983c0c9190 0x7f983c0c95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:23.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.449+0000 7f983b7fe700 1 --2- 172.21.15.81:0/3975215700 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f983c155590 0x7f983c0c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:23.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.449+0000 7f983bfff700 1 --2- 172.21.15.81:0/3975215700 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f983c0c9190 0x7f983c0c95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:23.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.449+0000 7f983bfff700 1 -- 172.21.15.81:0/3975215700 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f983c155590 msgr2=0x7f983c0c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:23.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.449+0000 7f983bfff700 1 --2- 172.21.15.81:0/3975215700 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f983c155590 0x7f983c0c7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:23.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.449+0000 7f983bfff700 1 -- 172.21.15.81:0/3975215700 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f983c15a3a0 con 0x7f9824004d50 2023-10-06T03:25:23.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.449+0000 7f9840f9c700 1 --2- 172.21.15.81:0/3975215700 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f983c0c9190 0x7f983c0c95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:23.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.449+0000 7f983b7fe700 1 --2- 172.21.15.81:0/3975215700 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f983c155590 0x7f983c0c7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:23.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.450+0000 7f983bfff700 1 --2- 172.21.15.81:0/3975215700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9824004d50 0x7f983c1415d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f982c001d20 tx=0x7f982c001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:23.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.450+0000 7f9823fff700 1 -- 172.21.15.81:0/3975215700 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982c018030 con 0x7f9824004d50 2023-10-06T03:25:23.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.450+0000 7f9823fff700 1 -- 172.21.15.81:0/3975215700 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f982c00f8d0 con 0x7f9824004d50 2023-10-06T03:25:23.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.450+0000 7f9823fff700 1 -- 172.21.15.81:0/3975215700 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982c00fc70 con 0x7f9824004d50 2023-10-06T03:25:23.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.450+0000 7f98429ff700 1 -- 172.21.15.81:0/3975215700 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f983c15a680 con 0x7f9824004d50 2023-10-06T03:25:23.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.450+0000 7f98429ff700 1 -- 172.21.15.81:0/3975215700 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f983c0c9b30 con 0x7f9824004d50 2023-10-06T03:25:23.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.451+0000 7f98429ff700 1 -- 172.21.15.81:0/3975215700 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f983c04c3c0 con 0x7f9824004d50 2023-10-06T03:25:23.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.452+0000 7f9823fff700 1 -- 172.21.15.81:0/3975215700 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f982c01b070 con 0x7f9824004d50 2023-10-06T03:25:23.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.452+0000 7f9823fff700 1 --2- 172.21.15.81:0/3975215700 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f9828066f60 0x7f9828069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:23.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.453+0000 7f9823fff700 1 -- 172.21.15.81:0/3975215700 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f982c019070 con 0x7f9824004d50 2023-10-06T03:25:23.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.453+0000 7f983b7fe700 1 --2- 172.21.15.81:0/3975215700 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f9828066f60 0x7f9828069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:23.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.453+0000 7f9823fff700 1 --2- 172.21.15.81:0/3975215700 >> [v2:172.21.15.81:6816/85563,v1:172.21.15.81:6818/85563] conn(0x7f982806d920 0x7f982806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:23.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.453+0000 7f9823fff700 1 -- 172.21.15.81:0/3975215700 --> [v2:172.21.15.81:6816/85563,v1:172.21.15.81:6818/85563] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9828070420 con 0x7f982806d920 2023-10-06T03:25:23.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.453+0000 7f9823fff700 1 -- 172.21.15.81:0/3975215700 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f982c086810 con 0x7f9824004d50 2023-10-06T03:25:23.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.453+0000 7f9840f9c700 1 --2- 172.21.15.81:0/3975215700 >> [v2:172.21.15.81:6816/85563,v1:172.21.15.81:6818/85563] conn(0x7f982806d920 0x7f982806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:23.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.453+0000 7f983b7fe700 1 --2- 172.21.15.81:0/3975215700 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f9828066f60 0x7f9828069410 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f983c155960 tx=0x7f9830008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:23.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.454+0000 7f9840f9c700 1 --2- 172.21.15.81:0/3975215700 >> [v2:172.21.15.81:6816/85563,v1:172.21.15.81:6818/85563] conn(0x7f982806d920 0x7f982806fd50 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:23.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.454+0000 7f9823fff700 1 -- 172.21.15.81:0/3975215700 <== osd.0 v2:172.21.15.81:6816/85563 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f9828070420 con 0x7f982806d920 2023-10-06T03:25:23.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.469+0000 7f98429ff700 1 -- 172.21.15.81:0/3975215700 --> [v2:172.21.15.81:6816/85563,v1:172.21.15.81:6818/85563] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f983c0cf610 con 0x7f982806d920 2023-10-06T03:25:23.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.469+0000 7f9823fff700 1 -- 172.21.15.81:0/3975215700 <== osd.0 v2:172.21.15.81:6816/85563 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f983c0cf610 con 0x7f982806d920 2023-10-06T03:25:23.470 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T03:25:23.470 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:25:23.470 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T03:25:23.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.469+0000 7f98429ff700 1 -- 172.21.15.81:0/3975215700 >> [v2:172.21.15.81:6816/85563,v1:172.21.15.81:6818/85563] conn(0x7f982806d920 msgr2=0x7f982806fd50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:23.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.469+0000 7f98429ff700 1 --2- 172.21.15.81:0/3975215700 >> [v2:172.21.15.81:6816/85563,v1:172.21.15.81:6818/85563] conn(0x7f982806d920 0x7f982806fd50 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:23.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.469+0000 7f98429ff700 1 -- 172.21.15.81:0/3975215700 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f9828066f60 msgr2=0x7f9828069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:23.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.469+0000 7f98429ff700 1 --2- 172.21.15.81:0/3975215700 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f9828066f60 0x7f9828069410 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f983c155960 tx=0x7f9830008040 comp rx=0 tx=0).stop 2023-10-06T03:25:23.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.469+0000 7f98429ff700 1 -- 172.21.15.81:0/3975215700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9824004d50 msgr2=0x7f983c1415d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:23.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.469+0000 7f98429ff700 1 --2- 172.21.15.81:0/3975215700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9824004d50 0x7f983c1415d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f982c001d20 tx=0x7f982c001e90 comp rx=0 tx=0).stop 2023-10-06T03:25:23.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.469+0000 7f9840f9c700 1 -- 172.21.15.81:0/3975215700 reap_dead start 2023-10-06T03:25:23.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.470+0000 7f98429ff700 1 -- 172.21.15.81:0/3975215700 shutdown_connections 2023-10-06T03:25:23.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.470+0000 7f98429ff700 1 -- 172.21.15.81:0/3975215700 >> 172.21.15.81:0/3975215700 conn(0x7f983c06ed10 msgr2=0x7f983c0c5210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:23.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.470+0000 7f98429ff700 1 -- 172.21.15.81:0/3975215700 shutdown_connections 2023-10-06T03:25:23.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.470+0000 7f98429ff700 1 -- 172.21.15.81:0/3975215700 wait complete. 2023-10-06T03:25:23.487 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-06T03:25:23.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.669+0000 7f3bfc1ff700 1 Processor -- start 2023-10-06T03:25:23.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.669+0000 7f3bfc1ff700 1 -- start start 2023-10-06T03:25:23.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.671+0000 7f3bfc1ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3bf4155bc0 0x7f3bf4156c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:23.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.671+0000 7f3bfc1ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f3bf4069ee0 0x7f3bf406a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:23.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.671+0000 7f3bfc1ff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bf40c9c60 con 0x7f3bf41557f0 2023-10-06T03:25:23.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.671+0000 7f3bfc1ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bf406df20 con 0x7f3bf4155bc0 2023-10-06T03:25:23.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.671+0000 7f3bfc1ff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bf406a860 con 0x7f3bf4069ee0 2023-10-06T03:25:23.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.671+0000 7f3bf979a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3bf4155bc0 0x7f3bf4156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:23.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.671+0000 7f3bf979a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3bf4155bc0 0x7f3bf4156c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35388/0 (socket says 172.21.15.81:35388) 2023-10-06T03:25:23.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.671+0000 7f3bf979a700 1 -- 172.21.15.81:0/3781845708 learned_addr learned my addr 172.21.15.81:0/3781845708 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:23.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.671+0000 7f3bfa79c700 1 --2- 172.21.15.81:0/3781845708 >> v2:172.21.15.83:3300/0 conn(0x7f3bf4069ee0 0x7f3bf406a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:23.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.671+0000 7f3bf979a700 1 -- 172.21.15.81:0/3781845708 >> v2:172.21.15.83:3300/0 conn(0x7f3bf4069ee0 msgr2=0x7f3bf406a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:23.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.671+0000 7f3bf979a700 1 --2- 172.21.15.81:0/3781845708 >> v2:172.21.15.83:3300/0 conn(0x7f3bf4069ee0 0x7f3bf406a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:23.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.671+0000 7f3bf979a700 1 -- 172.21.15.81:0/3781845708 >> v1:172.21.15.83:6789/0 conn(0x7f3bf41557f0 legacy=0x7f3bf40c6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:23.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.671+0000 7f3bf979a700 1 -- 172.21.15.81:0/3781845708 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf406dc60 con 0x7f3bf4155bc0 2023-10-06T03:25:23.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.672+0000 7f3bf979a700 1 --2- 172.21.15.81:0/3781845708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bf4155bc0 0x7f3bf4156c90 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f3bf40aebb0 tx=0x7f3be400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6b95355e73a859a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:23.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.672+0000 7f3bf8f99700 1 -- 172.21.15.81:0/3781845708 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be400dc50 con 0x7f3bf4155bc0 2023-10-06T03:25:23.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.672+0000 7f3bf8f99700 1 -- 172.21.15.81:0/3781845708 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be400ddb0 con 0x7f3bf4155bc0 2023-10-06T03:25:23.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.672+0000 7f3bf8f99700 1 -- 172.21.15.81:0/3781845708 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be40196d0 con 0x7f3bf4155bc0 2023-10-06T03:25:23.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.672+0000 7f3bfc1ff700 1 -- 172.21.15.81:0/3781845708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bf4155bc0 msgr2=0x7f3bf4156c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:23.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.672+0000 7f3bfc1ff700 1 --2- 172.21.15.81:0/3781845708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bf4155bc0 0x7f3bf4156c90 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f3bf40aebb0 tx=0x7f3be400b4f0 comp rx=0 tx=0).stop 2023-10-06T03:25:23.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.672+0000 7f3bfc1ff700 1 -- 172.21.15.81:0/3781845708 shutdown_connections 2023-10-06T03:25:23.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.672+0000 7f3bfc1ff700 1 --2- 172.21.15.81:0/3781845708 >> v2:172.21.15.83:3300/0 conn(0x7f3bf4069ee0 0x7f3bf406a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:23.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.672+0000 7f3bfc1ff700 1 --2- 172.21.15.81:0/3781845708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bf4155bc0 0x7f3bf4156c90 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:23.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.672+0000 7f3bfc1ff700 1 -- 172.21.15.81:0/3781845708 >> 172.21.15.81:0/3781845708 conn(0x7f3bf40cc090 msgr2=0x7f3bf40cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:23.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.673+0000 7f3bfc1ff700 1 -- 172.21.15.81:0/3781845708 shutdown_connections 2023-10-06T03:25:23.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.673+0000 7f3bfc1ff700 1 -- 172.21.15.81:0/3781845708 wait complete. 2023-10-06T03:25:23.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.674+0000 7f3bfc1ff700 1 Processor -- start 2023-10-06T03:25:23.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.674+0000 7f3bfc1ff700 1 -- start start 2023-10-06T03:25:23.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.675+0000 7f3bfc1ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3bf4069ee0 0x7f3bf40b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:23.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.675+0000 7f3bfc1ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3bf41557f0 0x7f3bf414fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:23.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.675+0000 7f3bfc1ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bf4155bc0 0x7f3bf41572b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:23.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.675+0000 7f3bfc1ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf416cfe0 con 0x7f3bf4155bc0 2023-10-06T03:25:23.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.675+0000 7f3bfc1ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf40af380 con 0x7f3bf4069ee0 2023-10-06T03:25:23.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.675+0000 7f3bfc1ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf416d230 con 0x7f3bf41557f0 2023-10-06T03:25:23.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.675+0000 7f3bfa79c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bf4155bc0 0x7f3bf41572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:23.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.675+0000 7f3bfa79c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bf4155bc0 0x7f3bf41572b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35390/0 (socket says 172.21.15.81:35390) 2023-10-06T03:25:23.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.675+0000 7f3bfa79c700 1 -- 172.21.15.81:0/1228204921 learned_addr learned my addr 172.21.15.81:0/1228204921 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:23.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.675+0000 7f3bf979a700 1 --2- 172.21.15.81:0/1228204921 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3bf41557f0 0x7f3bf414fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:23.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.675+0000 7f3bf9f9b700 1 --2- 172.21.15.81:0/1228204921 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3bf4069ee0 0x7f3bf40b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:23.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.676+0000 7f3bfa79c700 1 -- 172.21.15.81:0/1228204921 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3bf41557f0 msgr2=0x7f3bf414fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:23.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.676+0000 7f3bfa79c700 1 --2- 172.21.15.81:0/1228204921 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3bf41557f0 0x7f3bf414fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:23.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.676+0000 7f3bfa79c700 1 -- 172.21.15.81:0/1228204921 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3bf4069ee0 msgr2=0x7f3bf40b18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:23.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.676+0000 7f3bfa79c700 1 --2- 172.21.15.81:0/1228204921 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3bf4069ee0 0x7f3bf40b18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:23.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.676+0000 7f3bfa79c700 1 -- 172.21.15.81:0/1228204921 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be400b790 con 0x7f3bf4155bc0 2023-10-06T03:25:23.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.676+0000 7f3bfa79c700 1 --2- 172.21.15.81:0/1228204921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bf4155bc0 0x7f3bf41572b0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f3bec007f20 tx=0x7f3bec009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:23.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.676+0000 7f3be9ffb700 1 -- 172.21.15.81:0/1228204921 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bec00eb90 con 0x7f3bf4155bc0 2023-10-06T03:25:23.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.676+0000 7f3be9ffb700 1 -- 172.21.15.81:0/1228204921 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bec00ed10 con 0x7f3bf4155bc0 2023-10-06T03:25:23.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.676+0000 7f3be9ffb700 1 -- 172.21.15.81:0/1228204921 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bec014670 con 0x7f3bf4155bc0 2023-10-06T03:25:23.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.676+0000 7f3bfc1ff700 1 -- 172.21.15.81:0/1228204921 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bf416d510 con 0x7f3bf4155bc0 2023-10-06T03:25:23.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.676+0000 7f3bfc1ff700 1 -- 172.21.15.81:0/1228204921 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bf40b1e20 con 0x7f3bf4155bc0 2023-10-06T03:25:23.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.677+0000 7f3bfc1ff700 1 -- 172.21.15.81:0/1228204921 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bf404c3c0 con 0x7f3bf4155bc0 2023-10-06T03:25:23.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.678+0000 7f3be9ffb700 1 -- 172.21.15.81:0/1228204921 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3bec0149e0 con 0x7f3bf4155bc0 2023-10-06T03:25:23.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.679+0000 7f3be9ffb700 1 --2- 172.21.15.81:0/1228204921 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f3bd8066f30 0x7f3bd80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:23.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.679+0000 7f3be9ffb700 1 -- 172.21.15.81:0/1228204921 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f3bec084bd0 con 0x7f3bf4155bc0 2023-10-06T03:25:23.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.679+0000 7f3bf9f9b700 1 --2- 172.21.15.81:0/1228204921 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f3bd8066f30 0x7f3bd80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:23.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.680+0000 7f3bf9f9b700 1 --2- 172.21.15.81:0/1228204921 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f3bd8066f30 0x7f3bd80693e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0003a80 tx=0x7f3bf0007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:23.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.683+0000 7f3be9ffb700 1 -- 172.21.15.81:0/1228204921 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3bec051da0 con 0x7f3bf4155bc0 2023-10-06T03:25:23.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.874+0000 7f3bfc1ff700 1 -- 172.21.15.81:0/1228204921 --> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f3bf4065720 con 0x7f3bd8066f30 2023-10-06T03:25:23.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.874+0000 7f3be9ffb700 1 -- 172.21.15.81:0/1228204921 <== mgr.4100 v2:172.21.15.81:6832/85286 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3bf4065720 con 0x7f3bd8066f30 2023-10-06T03:25:23.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.877+0000 7f3bfc1ff700 1 -- 172.21.15.81:0/1228204921 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f3bd8066f30 msgr2=0x7f3bd80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:23.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.877+0000 7f3bfc1ff700 1 --2- 172.21.15.81:0/1228204921 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f3bd8066f30 0x7f3bd80693e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0003a80 tx=0x7f3bf0007ec0 comp rx=0 tx=0).stop 2023-10-06T03:25:23.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.877+0000 7f3bfc1ff700 1 -- 172.21.15.81:0/1228204921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bf4155bc0 msgr2=0x7f3bf41572b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:23.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.877+0000 7f3bfc1ff700 1 --2- 172.21.15.81:0/1228204921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bf4155bc0 0x7f3bf41572b0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f3bec007f20 tx=0x7f3bec009860 comp rx=0 tx=0).stop 2023-10-06T03:25:23.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.877+0000 7f3bfc1ff700 1 -- 172.21.15.81:0/1228204921 shutdown_connections 2023-10-06T03:25:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.877+0000 7f3bfc1ff700 1 --2- 172.21.15.81:0/1228204921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bf4155bc0 0x7f3bf41572b0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.877+0000 7f3bfc1ff700 1 --2- 172.21.15.81:0/1228204921 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3bf4069ee0 0x7f3bf40b18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.877+0000 7f3bfc1ff700 1 --2- 172.21.15.81:0/1228204921 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f3bd8066f30 0x7f3bd80693e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.877+0000 7f3bfc1ff700 1 --2- 172.21.15.81:0/1228204921 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3bf41557f0 0x7f3bf414fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.877+0000 7f3bfc1ff700 1 -- 172.21.15.81:0/1228204921 >> 172.21.15.81:0/1228204921 conn(0x7f3bf40cc090 msgr2=0x7f3bf4063500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.877+0000 7f3bfc1ff700 1 -- 172.21.15.81:0/1228204921 shutdown_connections 2023-10-06T03:25:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:23.877+0000 7f3bfc1ff700 1 -- 172.21.15.81:0/1228204921 wait complete. 2023-10-06T03:25:23.880 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 0 to deep-scrub 2023-10-06T03:25:23.895 INFO:tasks.ceph:Scrubbing osd.1 2023-10-06T03:25:23.895 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:25:24.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.078+0000 7fecfdfff700 1 Processor -- start 2023-10-06T03:25:24.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.078+0000 7fecfdfff700 1 -- start start 2023-10-06T03:25:24.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.080+0000 7fecfdfff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fecf813f980 0x7fecf80c1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:24.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.080+0000 7fecfdfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fecf813fd50 0x7fecf80c70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:24.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.080+0000 7fecfdfff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecf80c75e0 con 0x7fecf8159e90 2023-10-06T03:25:24.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.080+0000 7fecfdfff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecf80c8490 con 0x7fecf813fd50 2023-10-06T03:25:24.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.080+0000 7fecfdfff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecf80c7880 con 0x7fecf813f980 2023-10-06T03:25:24.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.080+0000 7fecf6ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fecf813fd50 0x7fecf80c70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:24.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.080+0000 7fecf6ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fecf813fd50 0x7fecf80c70a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35402/0 (socket says 172.21.15.81:35402) 2023-10-06T03:25:24.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.080+0000 7fecf6ffd700 1 -- 172.21.15.81:0/826619670 learned_addr learned my addr 172.21.15.81:0/826619670 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:24.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.080+0000 7fecf77fe700 1 --2- 172.21.15.81:0/826619670 >> v2:172.21.15.83:3300/0 conn(0x7fecf813f980 0x7fecf80c1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:24.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.080+0000 7fecf6ffd700 1 -- 172.21.15.81:0/826619670 >> v2:172.21.15.83:3300/0 conn(0x7fecf813f980 msgr2=0x7fecf80c1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:24.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.080+0000 7fecf6ffd700 1 --2- 172.21.15.81:0/826619670 >> v2:172.21.15.83:3300/0 conn(0x7fecf813f980 0x7fecf80c1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:24.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.080+0000 7fecf6ffd700 1 -- 172.21.15.81:0/826619670 >> v1:172.21.15.83:6789/0 conn(0x7fecf8159e90 legacy=0x7fecf806e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:24.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.081+0000 7fecf6ffd700 1 -- 172.21.15.81:0/826619670 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf80c7b60 con 0x7fecf813fd50 2023-10-06T03:25:24.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.081+0000 7fecf77fe700 1 --2- 172.21.15.81:0/826619670 >> v2:172.21.15.83:3300/0 conn(0x7fecf813f980 0x7fecf80c1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:24.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.081+0000 7fecf6ffd700 1 --2- 172.21.15.81:0/826619670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecf813fd50 0x7fecf80c70a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fecf80c8a20 tx=0x7fecec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74c64e4d3b660aee server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:24.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.081+0000 7fecf67fc700 1 -- 172.21.15.81:0/826619670 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecec00b860 con 0x7fecf813fd50 2023-10-06T03:25:24.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.081+0000 7fecf67fc700 1 -- 172.21.15.81:0/826619670 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecec00b9c0 con 0x7fecf813fd50 2023-10-06T03:25:24.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.081+0000 7fecf67fc700 1 -- 172.21.15.81:0/826619670 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecec00bd60 con 0x7fecf813fd50 2023-10-06T03:25:24.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.082+0000 7fecfdfff700 1 -- 172.21.15.81:0/826619670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecf813fd50 msgr2=0x7fecf80c70a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:24.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.082+0000 7fecfdfff700 1 --2- 172.21.15.81:0/826619670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecf813fd50 0x7fecf80c70a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fecf80c8a20 tx=0x7fecec009250 comp rx=0 tx=0).stop 2023-10-06T03:25:24.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.082+0000 7fecfdfff700 1 -- 172.21.15.81:0/826619670 shutdown_connections 2023-10-06T03:25:24.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.082+0000 7fecfdfff700 1 --2- 172.21.15.81:0/826619670 >> v2:172.21.15.83:3300/0 conn(0x7fecf813f980 0x7fecf80c1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:24.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.082+0000 7fecfdfff700 1 --2- 172.21.15.81:0/826619670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecf813fd50 0x7fecf80c70a0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:24.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.082+0000 7fecfdfff700 1 -- 172.21.15.81:0/826619670 >> 172.21.15.81:0/826619670 conn(0x7fecf80cc050 msgr2=0x7fecf80cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:24.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.082+0000 7fecfdfff700 1 -- 172.21.15.81:0/826619670 shutdown_connections 2023-10-06T03:25:24.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.082+0000 7fecfdfff700 1 -- 172.21.15.81:0/826619670 wait complete. 2023-10-06T03:25:24.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.083+0000 7fecfdfff700 1 Processor -- start 2023-10-06T03:25:24.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.083+0000 7fecfdfff700 1 -- start start 2023-10-06T03:25:24.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.084+0000 7fecfdfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fecf813f980 0x7fecf8155a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:24.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.084+0000 7fecfdfff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fecf813fd50 0x7fecf813af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:24.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.084+0000 7fecfdfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecf8159e90 0x7fecf813b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:24.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.084+0000 7fecfdfff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf80afef0 con 0x7fecf8159e90 2023-10-06T03:25:24.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.084+0000 7fecfdfff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf80aee90 con 0x7fecf813f980 2023-10-06T03:25:24.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.084+0000 7fecfdfff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecf80af130 con 0x7fecf813fd50 2023-10-06T03:25:24.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.085+0000 7fecf7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecf8159e90 0x7fecf813b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:24.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.085+0000 7fecf7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecf8159e90 0x7fecf813b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35408/0 (socket says 172.21.15.81:35408) 2023-10-06T03:25:24.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.085+0000 7fecf7fff700 1 -- 172.21.15.81:0/703293856 learned_addr learned my addr 172.21.15.81:0/703293856 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:24.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.085+0000 7fecf6ffd700 1 --2- 172.21.15.81:0/703293856 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fecf813fd50 0x7fecf813af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:24.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.085+0000 7fecf7fff700 1 -- 172.21.15.81:0/703293856 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fecf813fd50 msgr2=0x7fecf813af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:24.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.085+0000 7fecf7fff700 1 --2- 172.21.15.81:0/703293856 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fecf813fd50 0x7fecf813af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:24.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.085+0000 7fecf77fe700 1 --2- 172.21.15.81:0/703293856 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fecf813f980 0x7fecf8155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:24.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.085+0000 7fecf7fff700 1 -- 172.21.15.81:0/703293856 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fecf813f980 msgr2=0x7fecf8155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:24.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.085+0000 7fecf7fff700 1 --2- 172.21.15.81:0/703293856 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fecf813f980 0x7fecf8155a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:24.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.085+0000 7fecf7fff700 1 -- 172.21.15.81:0/703293856 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecec0094f0 con 0x7fecf8159e90 2023-10-06T03:25:24.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.085+0000 7fecf77fe700 1 --2- 172.21.15.81:0/703293856 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fecf813f980 0x7fecf8155a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:24.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.085+0000 7fecf7fff700 1 --2- 172.21.15.81:0/703293856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecf8159e90 0x7fecf813b4b0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fecf000c840 tx=0x7fecf0001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:24.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.085+0000 7fecdf7fe700 1 -- 172.21.15.81:0/703293856 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf0012630 con 0x7fecf8159e90 2023-10-06T03:25:24.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.086+0000 7fecdf7fe700 1 -- 172.21.15.81:0/703293856 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf00127b0 con 0x7fecf8159e90 2023-10-06T03:25:24.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.086+0000 7fecdf7fe700 1 -- 172.21.15.81:0/703293856 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf0012b70 con 0x7fecf8159e90 2023-10-06T03:25:24.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.086+0000 7fecfdfff700 1 -- 172.21.15.81:0/703293856 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecf80af410 con 0x7fecf8159e90 2023-10-06T03:25:24.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.086+0000 7fecfdfff700 1 -- 172.21.15.81:0/703293856 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecf80af9d0 con 0x7fecf8159e90 2023-10-06T03:25:24.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.086+0000 7fecfdfff700 1 -- 172.21.15.81:0/703293856 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fecf804c3c0 con 0x7fecf8159e90 2023-10-06T03:25:24.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.088+0000 7fecdf7fe700 1 -- 172.21.15.81:0/703293856 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fecf0003030 con 0x7fecf8159e90 2023-10-06T03:25:24.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.088+0000 7fecdf7fe700 1 --2- 172.21.15.81:0/703293856 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fece4066f30 0x7fece40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:24.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.089+0000 7fecdf7fe700 1 -- 172.21.15.81:0/703293856 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5698+0+0 (secure 0 0 0) 0x7fecf00844f0 con 0x7fecf8159e90 2023-10-06T03:25:24.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.089+0000 7fecf77fe700 1 --2- 172.21.15.81:0/703293856 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fece4066f30 0x7fece40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:24.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.089+0000 7fecdf7fe700 1 --2- 172.21.15.81:0/703293856 >> [v2:172.21.15.81:6800/85561,v1:172.21.15.81:6801/85561] conn(0x7fece406d8f0 0x7fece406fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:24.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.089+0000 7fecdf7fe700 1 -- 172.21.15.81:0/703293856 --> [v2:172.21.15.81:6800/85561,v1:172.21.15.81:6801/85561] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fece40703f0 con 0x7fece406d8f0 2023-10-06T03:25:24.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.089+0000 7fecdf7fe700 1 -- 172.21.15.81:0/703293856 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fecf0086aa0 con 0x7fecf8159e90 2023-10-06T03:25:24.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.089+0000 7fecf6ffd700 1 --2- 172.21.15.81:0/703293856 >> [v2:172.21.15.81:6800/85561,v1:172.21.15.81:6801/85561] conn(0x7fece406d8f0 0x7fece406fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:24.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.089+0000 7fecf77fe700 1 --2- 172.21.15.81:0/703293856 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fece4066f30 0x7fece40693e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fece8006f00 tx=0x7fece8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:24.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.089+0000 7fecf6ffd700 1 --2- 172.21.15.81:0/703293856 >> [v2:172.21.15.81:6800/85561,v1:172.21.15.81:6801/85561] conn(0x7fece406d8f0 0x7fece406fd20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:24.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.090+0000 7fecdf7fe700 1 -- 172.21.15.81:0/703293856 <== osd.1 v2:172.21.15.81:6800/85561 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fece40703f0 con 0x7fece406d8f0 2023-10-06T03:25:24.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.104+0000 7fecfdfff700 1 -- 172.21.15.81:0/703293856 --> [v2:172.21.15.81:6800/85561,v1:172.21.15.81:6801/85561] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fecf80c7e40 con 0x7fece406d8f0 2023-10-06T03:25:24.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.104+0000 7fecdf7fe700 1 -- 172.21.15.81:0/703293856 <== osd.1 v2:172.21.15.81:6800/85561 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fecf80c7e40 con 0x7fece406d8f0 2023-10-06T03:25:24.106 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T03:25:24.106 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:25:24.106 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T03:25:24.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.105+0000 7fecfdfff700 1 -- 172.21.15.81:0/703293856 >> [v2:172.21.15.81:6800/85561,v1:172.21.15.81:6801/85561] conn(0x7fece406d8f0 msgr2=0x7fece406fd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:24.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.105+0000 7fecfdfff700 1 --2- 172.21.15.81:0/703293856 >> [v2:172.21.15.81:6800/85561,v1:172.21.15.81:6801/85561] conn(0x7fece406d8f0 0x7fece406fd20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:24.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.105+0000 7fecfdfff700 1 -- 172.21.15.81:0/703293856 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fece4066f30 msgr2=0x7fece40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:24.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.105+0000 7fecfdfff700 1 --2- 172.21.15.81:0/703293856 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fece4066f30 0x7fece40693e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fece8006f00 tx=0x7fece8008040 comp rx=0 tx=0).stop 2023-10-06T03:25:24.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.105+0000 7fecfdfff700 1 -- 172.21.15.81:0/703293856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecf8159e90 msgr2=0x7fecf813b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:24.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.105+0000 7fecfdfff700 1 --2- 172.21.15.81:0/703293856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecf8159e90 0x7fecf813b4b0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fecf000c840 tx=0x7fecf0001670 comp rx=0 tx=0).stop 2023-10-06T03:25:24.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.105+0000 7fecf7fff700 1 -- 172.21.15.81:0/703293856 reap_dead start 2023-10-06T03:25:24.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.105+0000 7fecfdfff700 1 -- 172.21.15.81:0/703293856 shutdown_connections 2023-10-06T03:25:24.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.105+0000 7fecfdfff700 1 -- 172.21.15.81:0/703293856 >> 172.21.15.81:0/703293856 conn(0x7fecf80cc050 msgr2=0x7fecf806ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:24.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.105+0000 7fecfdfff700 1 -- 172.21.15.81:0/703293856 shutdown_connections 2023-10-06T03:25:24.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.105+0000 7fecfdfff700 1 -- 172.21.15.81:0/703293856 wait complete. 2023-10-06T03:25:24.122 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-06T03:25:24.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.304+0000 7f2a7979d700 1 Processor -- start 2023-10-06T03:25:24.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.304+0000 7f2a7979d700 1 -- start start 2023-10-06T03:25:24.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.305+0000 7f2a7979d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2a740cc670 0x7f2a740ccd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:24.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.305+0000 7f2a7979d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2a7415a450 0x7f2a7415a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:24.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.305+0000 7f2a7979d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a740b4760 con 0x7f2a740b1d10 2023-10-06T03:25:24.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.305+0000 7f2a7979d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a740b60f0 con 0x7f2a740cc670 2023-10-06T03:25:24.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.305+0000 7f2a7979d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a740cd320 con 0x7f2a7415a450 2023-10-06T03:25:24.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.306+0000 7f2a73fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2a740cc670 0x7f2a740ccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:24.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.306+0000 7f2a78f9c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2a740b1d10 0x7f2a740b2120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39724/0 (socket says 172.21.15.81:39724) 2023-10-06T03:25:24.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.306+0000 7f2a78f9c700 1 -- 172.21.15.81:0/1654044156 learned_addr learned my addr 172.21.15.81:0/1654044156 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:25:24.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.306+0000 7f2a6bfff700 1 --2- 172.21.15.81:0/1654044156 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2a7415a450 0x7f2a7415a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:24.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.306+0000 7f2a73fff700 1 -- 172.21.15.81:0/1654044156 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2a7415a450 msgr2=0x7f2a7415a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:24.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.306+0000 7f2a73fff700 1 --2- 172.21.15.81:0/1654044156 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2a7415a450 0x7f2a7415a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:24.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.306+0000 7f2a73fff700 1 -- 172.21.15.81:0/1654044156 >> v1:172.21.15.81:6789/0 conn(0x7f2a740b1d10 legacy=0x7f2a740b2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:24.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.306+0000 7f2a73fff700 1 -- 172.21.15.81:0/1654044156 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a740b3e30 con 0x7f2a740cc670 2023-10-06T03:25:24.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.306+0000 7f2a73fff700 1 --2- 172.21.15.81:0/1654044156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a740cc670 0x7f2a740ccd40 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f2a640098e0 tx=0x7f2a640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6cc6ea393b9022b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:24.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.306+0000 7f2a737fe700 1 -- 172.21.15.81:0/1654044156 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a64009e80 con 0x7f2a740cc670 2023-10-06T03:25:24.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.307+0000 7f2a737fe700 1 -- 172.21.15.81:0/1654044156 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a6400b860 con 0x7f2a740cc670 2023-10-06T03:25:24.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.307+0000 7f2a737fe700 1 -- 172.21.15.81:0/1654044156 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6400bbe0 con 0x7f2a740cc670 2023-10-06T03:25:24.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.307+0000 7f2a7979d700 1 -- 172.21.15.81:0/1654044156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a740cc670 msgr2=0x7f2a740ccd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:24.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.307+0000 7f2a7979d700 1 --2- 172.21.15.81:0/1654044156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a740cc670 0x7f2a740ccd40 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f2a640098e0 tx=0x7f2a640091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:24.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.307+0000 7f2a7979d700 1 -- 172.21.15.81:0/1654044156 shutdown_connections 2023-10-06T03:25:24.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.307+0000 7f2a7979d700 1 --2- 172.21.15.81:0/1654044156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a740cc670 0x7f2a740ccd40 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:24.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.307+0000 7f2a7979d700 1 --2- 172.21.15.81:0/1654044156 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2a7415a450 0x7f2a7415a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:24.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.307+0000 7f2a7979d700 1 -- 172.21.15.81:0/1654044156 >> 172.21.15.81:0/1654044156 conn(0x7f2a7406ed10 msgr2=0x7f2a7406f110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:24.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.307+0000 7f2a7979d700 1 -- 172.21.15.81:0/1654044156 shutdown_connections 2023-10-06T03:25:24.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.307+0000 7f2a7979d700 1 -- 172.21.15.81:0/1654044156 wait complete. 2023-10-06T03:25:24.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.309+0000 7f2a7979d700 1 Processor -- start 2023-10-06T03:25:24.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.309+0000 7f2a7979d700 1 -- start start 2023-10-06T03:25:24.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.309+0000 7f2a7979d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2a740b1d10 0x7f2a7413ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:24.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.310+0000 7f2a7979d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a740cc670 0x7f2a7414a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:24.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.310+0000 7f2a7979d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2a7415a450 0x7f2a7414cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:24.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.310+0000 7f2a7979d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7413b2e0 con 0x7f2a740cc670 2023-10-06T03:25:24.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.310+0000 7f2a7979d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a74149bf0 con 0x7f2a740b1d10 2023-10-06T03:25:24.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.310+0000 7f2a7979d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7414e520 con 0x7f2a7415a450 2023-10-06T03:25:24.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.310+0000 7f2a6bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a740cc670 0x7f2a7414a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:24.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.310+0000 7f2a6bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a740cc670 0x7f2a7414a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35426/0 (socket says 172.21.15.81:35426) 2023-10-06T03:25:24.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.310+0000 7f2a6bfff700 1 -- 172.21.15.81:0/3628009237 learned_addr learned my addr 172.21.15.81:0/3628009237 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:24.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.310+0000 7f2a73fff700 1 --2- 172.21.15.81:0/3628009237 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2a740b1d10 0x7f2a7413ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:24.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.310+0000 7f2a78f9c700 1 --2- 172.21.15.81:0/3628009237 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2a7415a450 0x7f2a7414cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:24.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.310+0000 7f2a6bfff700 1 -- 172.21.15.81:0/3628009237 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2a7415a450 msgr2=0x7f2a7414cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:24.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.310+0000 7f2a6bfff700 1 --2- 172.21.15.81:0/3628009237 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2a7415a450 0x7f2a7414cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:24.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.310+0000 7f2a6bfff700 1 -- 172.21.15.81:0/3628009237 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2a740b1d10 msgr2=0x7f2a7413ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:24.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.310+0000 7f2a6bfff700 1 --2- 172.21.15.81:0/3628009237 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2a740b1d10 0x7f2a7413ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:24.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.310+0000 7f2a6bfff700 1 -- 172.21.15.81:0/3628009237 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a64009420 con 0x7f2a740cc670 2023-10-06T03:25:24.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.310+0000 7f2a6bfff700 1 --2- 172.21.15.81:0/3628009237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a740cc670 0x7f2a7414a080 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c00d860 tx=0x7f2a5c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:24.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.311+0000 7f2a70ff9700 1 -- 172.21.15.81:0/3628009237 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c009610 con 0x7f2a740cc670 2023-10-06T03:25:24.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.311+0000 7f2a70ff9700 1 -- 172.21.15.81:0/3628009237 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a5c009770 con 0x7f2a740cc670 2023-10-06T03:25:24.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.311+0000 7f2a7979d700 1 -- 172.21.15.81:0/3628009237 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a74148fe0 con 0x7f2a740cc670 2023-10-06T03:25:24.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.311+0000 7f2a70ff9700 1 -- 172.21.15.81:0/3628009237 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c009b30 con 0x7f2a740cc670 2023-10-06T03:25:24.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.311+0000 7f2a7979d700 1 -- 172.21.15.81:0/3628009237 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a741495a0 con 0x7f2a740cc670 2023-10-06T03:25:24.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.312+0000 7f2a7979d700 1 -- 172.21.15.81:0/3628009237 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a74149d80 con 0x7f2a740cc670 2023-10-06T03:25:24.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.313+0000 7f2a70ff9700 1 -- 172.21.15.81:0/3628009237 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2a5c01e460 con 0x7f2a740cc670 2023-10-06T03:25:24.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.314+0000 7f2a70ff9700 1 --2- 172.21.15.81:0/3628009237 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2a54066f30 0x7f2a540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:24.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.314+0000 7f2a70ff9700 1 -- 172.21.15.81:0/3628009237 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f2a5c084c00 con 0x7f2a740cc670 2023-10-06T03:25:24.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.314+0000 7f2a73fff700 1 --2- 172.21.15.81:0/3628009237 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2a54066f30 0x7f2a540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:24.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.315+0000 7f2a73fff700 1 --2- 172.21.15.81:0/3628009237 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2a54066f30 0x7f2a540693e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2a640091e0 tx=0x7f2a64017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:24.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.318+0000 7f2a70ff9700 1 -- 172.21.15.81:0/3628009237 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2a5c08b080 con 0x7f2a740cc670 2023-10-06T03:25:24.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.510+0000 7f2a7979d700 1 -- 172.21.15.81:0/3628009237 --> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f2a7404c3c0 con 0x7f2a54066f30 2023-10-06T03:25:24.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.511+0000 7f2a70ff9700 1 -- 172.21.15.81:0/3628009237 <== mgr.4100 v2:172.21.15.81:6832/85286 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2a7404c3c0 con 0x7f2a54066f30 2023-10-06T03:25:24.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.513+0000 7f2a7979d700 1 -- 172.21.15.81:0/3628009237 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2a54066f30 msgr2=0x7f2a540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:24.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.513+0000 7f2a7979d700 1 --2- 172.21.15.81:0/3628009237 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2a54066f30 0x7f2a540693e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2a640091e0 tx=0x7f2a64017000 comp rx=0 tx=0).stop 2023-10-06T03:25:24.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.513+0000 7f2a7979d700 1 -- 172.21.15.81:0/3628009237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a740cc670 msgr2=0x7f2a7414a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:24.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.513+0000 7f2a7979d700 1 --2- 172.21.15.81:0/3628009237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a740cc670 0x7f2a7414a080 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c00d860 tx=0x7f2a5c008040 comp rx=0 tx=0).stop 2023-10-06T03:25:24.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.513+0000 7f2a7979d700 1 -- 172.21.15.81:0/3628009237 shutdown_connections 2023-10-06T03:25:24.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.513+0000 7f2a7979d700 1 --2- 172.21.15.81:0/3628009237 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f2a54066f30 0x7f2a540693e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:24.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.513+0000 7f2a7979d700 1 --2- 172.21.15.81:0/3628009237 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2a7415a450 0x7f2a7414cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:24.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.513+0000 7f2a7979d700 1 --2- 172.21.15.81:0/3628009237 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2a740b1d10 0x7f2a7413ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:24.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.513+0000 7f2a7979d700 1 --2- 172.21.15.81:0/3628009237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a740cc670 0x7f2a7414a080 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:24.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.513+0000 7f2a7979d700 1 -- 172.21.15.81:0/3628009237 >> 172.21.15.81:0/3628009237 conn(0x7f2a7406ed10 msgr2=0x7f2a740b2100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:24.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.513+0000 7f2a7979d700 1 -- 172.21.15.81:0/3628009237 shutdown_connections 2023-10-06T03:25:24.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.514+0000 7f2a7979d700 1 -- 172.21.15.81:0/3628009237 wait complete. 2023-10-06T03:25:24.516 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 1 to deep-scrub 2023-10-06T03:25:24.532 INFO:tasks.ceph:Scrubbing osd.2 2023-10-06T03:25:24.532 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:25:24.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.715+0000 7fa54599d700 1 Processor -- start 2023-10-06T03:25:24.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.715+0000 7fa54599d700 1 -- start start 2023-10-06T03:25:24.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.716+0000 7fa54599d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa5400c99b0 0x7fa540159720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:24.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.716+0000 7fa54599d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa540155400 0x7fa540155860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:24.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.716+0000 7fa54599d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5400c6980 con 0x7fa5400c9d80 2023-10-06T03:25:24.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.716+0000 7fa54599d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5400aba30 con 0x7fa5400c99b0 2023-10-06T03:25:24.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.716+0000 7fa54599d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5400c6f40 con 0x7fa540155400 2023-10-06T03:25:24.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.716+0000 7fa54499b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa5400c99b0 0x7fa540159720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:24.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.716+0000 7fa53ffff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa5400c9d80 0x7fa5400cabf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39734/0 (socket says 172.21.15.81:39734) 2023-10-06T03:25:24.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.716+0000 7fa53ffff700 1 -- 172.21.15.81:0/2014969820 learned_addr learned my addr 172.21.15.81:0/2014969820 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:25:24.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.716+0000 7fa54519c700 1 --2- 172.21.15.81:0/2014969820 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa540155400 0x7fa540155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:24.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.717+0000 7fa54499b700 1 -- 172.21.15.81:0/2014969820 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa540155400 msgr2=0x7fa540155860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:24.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.717+0000 7fa54499b700 1 --2- 172.21.15.81:0/2014969820 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa540155400 0x7fa540155860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:24.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.717+0000 7fa54499b700 1 -- 172.21.15.81:0/2014969820 >> v1:172.21.15.81:6789/0 conn(0x7fa5400c9d80 legacy=0x7fa5400cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:24.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.717+0000 7fa54499b700 1 -- 172.21.15.81:0/2014969820 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa540155da0 con 0x7fa5400c99b0 2023-10-06T03:25:24.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.717+0000 7fa53f7fe700 1 -- 172.21.15.81:0/2014969820 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3260569762 0 0) 0x7fa5400c6980 con 0x7fa5400c9d80 2023-10-06T03:25:24.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.717+0000 7fa54499b700 1 --2- 172.21.15.81:0/2014969820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5400c99b0 0x7fa540159720 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fa5340098e0 tx=0x7fa5340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52ae9fc9c23fe9cd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:24.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.717+0000 7fa53f7fe700 1 -- 172.21.15.81:0/2014969820 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53400b640 con 0x7fa5400c99b0 2023-10-06T03:25:24.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.717+0000 7fa53f7fe700 1 -- 172.21.15.81:0/2014969820 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa53400b7a0 con 0x7fa5400c99b0 2023-10-06T03:25:24.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.717+0000 7fa53f7fe700 1 -- 172.21.15.81:0/2014969820 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53400bb40 con 0x7fa5400c99b0 2023-10-06T03:25:24.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.718+0000 7fa54599d700 1 -- 172.21.15.81:0/2014969820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5400c99b0 msgr2=0x7fa540159720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:24.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.718+0000 7fa54599d700 1 --2- 172.21.15.81:0/2014969820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5400c99b0 0x7fa540159720 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fa5340098e0 tx=0x7fa5340091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:24.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.718+0000 7fa54599d700 1 -- 172.21.15.81:0/2014969820 shutdown_connections 2023-10-06T03:25:24.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.718+0000 7fa54599d700 1 --2- 172.21.15.81:0/2014969820 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa540155400 0x7fa540155860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:24.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.718+0000 7fa54599d700 1 --2- 172.21.15.81:0/2014969820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5400c99b0 0x7fa540159720 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:24.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.718+0000 7fa54599d700 1 -- 172.21.15.81:0/2014969820 >> 172.21.15.81:0/2014969820 conn(0x7fa5400cbe80 msgr2=0x7fa5400cc280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:24.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.718+0000 7fa54599d700 1 -- 172.21.15.81:0/2014969820 shutdown_connections 2023-10-06T03:25:24.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.718+0000 7fa54599d700 1 -- 172.21.15.81:0/2014969820 wait complete. 2023-10-06T03:25:24.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.719+0000 7fa54599d700 1 Processor -- start 2023-10-06T03:25:24.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.719+0000 7fa54599d700 1 -- start start 2023-10-06T03:25:24.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.720+0000 7fa54599d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa5400c99b0 0x7fa5400b1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:24.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.720+0000 7fa54599d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5400c9d80 0x7fa540169aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:24.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.720+0000 7fa54599d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa540155400 0x7fa5400c3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:24.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.720+0000 7fa54599d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5400b1300 con 0x7fa5400c9d80 2023-10-06T03:25:24.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.720+0000 7fa54599d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5400b06f0 con 0x7fa5400c99b0 2023-10-06T03:25:24.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.720+0000 7fa54599d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5400b09d0 con 0x7fa540155400 2023-10-06T03:25:24.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.721+0000 7fa53ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5400c9d80 0x7fa540169aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:24.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.721+0000 7fa53ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5400c9d80 0x7fa540169aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35454/0 (socket says 172.21.15.81:35454) 2023-10-06T03:25:24.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.721+0000 7fa53ffff700 1 -- 172.21.15.81:0/3738608441 learned_addr learned my addr 172.21.15.81:0/3738608441 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:24.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.721+0000 7fa53ffff700 1 -- 172.21.15.81:0/3738608441 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa540155400 msgr2=0x7fa5400c3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:24.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.721+0000 7fa53ffff700 1 --2- 172.21.15.81:0/3738608441 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa540155400 0x7fa5400c3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:24.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.721+0000 7fa53ffff700 1 -- 172.21.15.81:0/3738608441 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa5400c99b0 msgr2=0x7fa5400b1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:24.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.721+0000 7fa53ffff700 1 --2- 172.21.15.81:0/3738608441 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa5400c99b0 0x7fa5400b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:24.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.721+0000 7fa53ffff700 1 -- 172.21.15.81:0/3738608441 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa534009420 con 0x7fa5400c9d80 2023-10-06T03:25:24.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.721+0000 7fa53ffff700 1 --2- 172.21.15.81:0/3738608441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5400c9d80 0x7fa540169aa0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fa52c00c7e0 tx=0x7fa52c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:24.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.721+0000 7fa53cff9700 1 -- 172.21.15.81:0/3738608441 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52c005b30 con 0x7fa5400c9d80 2023-10-06T03:25:24.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.721+0000 7fa53cff9700 1 -- 172.21.15.81:0/3738608441 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa52c005c90 con 0x7fa5400c9d80 2023-10-06T03:25:24.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.721+0000 7fa53cff9700 1 -- 172.21.15.81:0/3738608441 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52c007300 con 0x7fa5400c9d80 2023-10-06T03:25:24.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.721+0000 7fa54599d700 1 -- 172.21.15.81:0/3738608441 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5400b0cb0 con 0x7fa5400c9d80 2023-10-06T03:25:24.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.722+0000 7fa54599d700 1 -- 172.21.15.81:0/3738608441 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa540169fe0 con 0x7fa5400c9d80 2023-10-06T03:25:24.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.722+0000 7fa54599d700 1 -- 172.21.15.81:0/3738608441 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa54004c3c0 con 0x7fa5400c9d80 2023-10-06T03:25:24.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.723+0000 7fa53cff9700 1 -- 172.21.15.81:0/3738608441 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa52c01b400 con 0x7fa5400c9d80 2023-10-06T03:25:24.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.724+0000 7fa53cff9700 1 --2- 172.21.15.81:0/3738608441 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa524066f30 0x7fa5240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:24.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.724+0000 7fa53cff9700 1 -- 172.21.15.81:0/3738608441 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5698+0+0 (secure 0 0 0) 0x7fa52c084020 con 0x7fa5400c9d80 2023-10-06T03:25:24.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.724+0000 7fa54499b700 1 --2- 172.21.15.81:0/3738608441 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa524066f30 0x7fa5240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:24.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.724+0000 7fa53cff9700 1 --2- 172.21.15.81:0/3738608441 >> [v2:172.21.15.81:6808/85564,v1:172.21.15.81:6809/85564] conn(0x7fa52406d8f0 0x7fa52406fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:24.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.724+0000 7fa53cff9700 1 -- 172.21.15.81:0/3738608441 --> [v2:172.21.15.81:6808/85564,v1:172.21.15.81:6809/85564] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa5240703f0 con 0x7fa52406d8f0 2023-10-06T03:25:24.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.724+0000 7fa53cff9700 1 -- 172.21.15.81:0/3738608441 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa52c086660 con 0x7fa5400c9d80 2023-10-06T03:25:24.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.725+0000 7fa54519c700 1 --2- 172.21.15.81:0/3738608441 >> [v2:172.21.15.81:6808/85564,v1:172.21.15.81:6809/85564] conn(0x7fa52406d8f0 0x7fa52406fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:24.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.725+0000 7fa54499b700 1 --2- 172.21.15.81:0/3738608441 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa524066f30 0x7fa5240693e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa5400b0400 tx=0x7fa534017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:24.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.725+0000 7fa54519c700 1 --2- 172.21.15.81:0/3738608441 >> [v2:172.21.15.81:6808/85564,v1:172.21.15.81:6809/85564] conn(0x7fa52406d8f0 0x7fa52406fd20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:24.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.726+0000 7fa53cff9700 1 -- 172.21.15.81:0/3738608441 <== osd.2 v2:172.21.15.81:6808/85564 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fa5240703f0 con 0x7fa52406d8f0 2023-10-06T03:25:24.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.740+0000 7fa54599d700 1 -- 172.21.15.81:0/3738608441 --> [v2:172.21.15.81:6808/85564,v1:172.21.15.81:6809/85564] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa5400cb710 con 0x7fa52406d8f0 2023-10-06T03:25:24.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.741+0000 7fa53cff9700 1 -- 172.21.15.81:0/3738608441 <== osd.2 v2:172.21.15.81:6808/85564 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fa5400cb710 con 0x7fa52406d8f0 2023-10-06T03:25:24.742 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T03:25:24.742 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:25:24.742 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T03:25:24.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.741+0000 7fa54599d700 1 -- 172.21.15.81:0/3738608441 >> [v2:172.21.15.81:6808/85564,v1:172.21.15.81:6809/85564] conn(0x7fa52406d8f0 msgr2=0x7fa52406fd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:24.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.741+0000 7fa54599d700 1 --2- 172.21.15.81:0/3738608441 >> [v2:172.21.15.81:6808/85564,v1:172.21.15.81:6809/85564] conn(0x7fa52406d8f0 0x7fa52406fd20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:24.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.741+0000 7fa54599d700 1 -- 172.21.15.81:0/3738608441 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa524066f30 msgr2=0x7fa5240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:24.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.741+0000 7fa54599d700 1 --2- 172.21.15.81:0/3738608441 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fa524066f30 0x7fa5240693e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa5400b0400 tx=0x7fa534017000 comp rx=0 tx=0).stop 2023-10-06T03:25:24.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.741+0000 7fa54599d700 1 -- 172.21.15.81:0/3738608441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5400c9d80 msgr2=0x7fa540169aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:24.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.741+0000 7fa54599d700 1 --2- 172.21.15.81:0/3738608441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5400c9d80 0x7fa540169aa0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fa52c00c7e0 tx=0x7fa52c007df0 comp rx=0 tx=0).stop 2023-10-06T03:25:24.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.741+0000 7fa54519c700 1 -- 172.21.15.81:0/3738608441 reap_dead start 2023-10-06T03:25:24.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.741+0000 7fa54599d700 1 -- 172.21.15.81:0/3738608441 shutdown_connections 2023-10-06T03:25:24.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.741+0000 7fa54599d700 1 -- 172.21.15.81:0/3738608441 >> 172.21.15.81:0/3738608441 conn(0x7fa5400cbe80 msgr2=0x7fa5400ca200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:24.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.742+0000 7fa54599d700 1 -- 172.21.15.81:0/3738608441 shutdown_connections 2023-10-06T03:25:24.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.742+0000 7fa54599d700 1 -- 172.21.15.81:0/3738608441 wait complete. 2023-10-06T03:25:24.759 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-06T03:25:24.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.940+0000 7fb1557ff700 1 Processor -- start 2023-10-06T03:25:24.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.940+0000 7fb1557ff700 1 -- start start 2023-10-06T03:25:24.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.941+0000 7fb1557ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb15013f9c0 0x7fb1500ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:24.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.941+0000 7fb1557ff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1500cafe0 con 0x7fb15015a5c0 2023-10-06T03:25:24.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.941+0000 7fb1557ff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1500cb2c0 con 0x7fb1500cab60 2023-10-06T03:25:24.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.941+0000 7fb1557ff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1500cb5a0 con 0x7fb15013f9c0 2023-10-06T03:25:24.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.942+0000 7fb14f7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb15015a5c0 0x7fb1500c6ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39736/0 (socket says 172.21.15.81:39736) 2023-10-06T03:25:24.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.942+0000 7fb14f7fe700 1 -- 172.21.15.81:0/3487068268 learned_addr learned my addr 172.21.15.81:0/3487068268 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:25:24.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.942+0000 7fb14effd700 1 --2- 172.21.15.81:0/3487068268 >> v2:172.21.15.83:3300/0 conn(0x7fb15013f9c0 0x7fb1500ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:24.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.942+0000 7fb14dffb700 1 -- 172.21.15.81:0/3487068268 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3685951917 0 0) 0x7fb1500cafe0 con 0x7fb15015a5c0 2023-10-06T03:25:24.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.942+0000 7fb14dffb700 1 -- 172.21.15.81:0/3487068268 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb138003570 con 0x7fb15015a5c0 2023-10-06T03:25:24.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.942+0000 7fb14effd700 1 -- 172.21.15.81:0/3487068268 >> v1:172.21.15.83:6789/0 conn(0x7fb1500cab60 legacy=0x7fb150159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:24.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.942+0000 7fb14effd700 1 -- 172.21.15.81:0/3487068268 >> v1:172.21.15.81:6789/0 conn(0x7fb15015a5c0 legacy=0x7fb1500c6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:24.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.942+0000 7fb14effd700 1 -- 172.21.15.81:0/3487068268 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1500cb880 con 0x7fb15013f9c0 2023-10-06T03:25:24.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.943+0000 7fb14effd700 1 --2- 172.21.15.81:0/3487068268 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb15013f9c0 0x7fb1500ca620 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb1400098e0 tx=0x7fb1400091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36dc6a562621bc14 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:24.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.943+0000 7fb14dffb700 1 -- 172.21.15.81:0/3487068268 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14000b640 con 0x7fb15013f9c0 2023-10-06T03:25:24.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.943+0000 7fb14dffb700 1 -- 172.21.15.81:0/3487068268 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb14000b7a0 con 0x7fb15013f9c0 2023-10-06T03:25:24.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.943+0000 7fb14dffb700 1 -- 172.21.15.81:0/3487068268 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14000bb40 con 0x7fb15013f9c0 2023-10-06T03:25:24.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.943+0000 7fb1557ff700 1 -- 172.21.15.81:0/3487068268 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb15013f9c0 msgr2=0x7fb1500ca620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:24.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.943+0000 7fb1557ff700 1 --2- 172.21.15.81:0/3487068268 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb15013f9c0 0x7fb1500ca620 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb1400098e0 tx=0x7fb1400091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:24.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.943+0000 7fb1557ff700 1 -- 172.21.15.81:0/3487068268 shutdown_connections 2023-10-06T03:25:24.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.943+0000 7fb1557ff700 1 --2- 172.21.15.81:0/3487068268 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb15013f9c0 0x7fb1500ca620 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:24.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.943+0000 7fb1557ff700 1 -- 172.21.15.81:0/3487068268 >> 172.21.15.81:0/3487068268 conn(0x7fb1500cc090 msgr2=0x7fb1500cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:24.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.943+0000 7fb1557ff700 1 -- 172.21.15.81:0/3487068268 shutdown_connections 2023-10-06T03:25:24.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.944+0000 7fb1557ff700 1 -- 172.21.15.81:0/3487068268 wait complete. 2023-10-06T03:25:24.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.945+0000 7fb1557ff700 1 Processor -- start 2023-10-06T03:25:24.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.945+0000 7fb1557ff700 1 -- start start 2023-10-06T03:25:24.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.946+0000 7fb1557ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb15013f9c0 0x7fb1501667e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:24.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.946+0000 7fb1557ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb15015a5c0 0x7fb1500ad130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:24.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.946+0000 7fb1557ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb150156370 0x7fb150168c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:24.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.946+0000 7fb1557ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb150159460 con 0x7fb150156370 2023-10-06T03:25:24.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.946+0000 7fb1557ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1500adc40 con 0x7fb15013f9c0 2023-10-06T03:25:24.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.946+0000 7fb1557ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1500c3b10 con 0x7fb15015a5c0 2023-10-06T03:25:24.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.946+0000 7fb14f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb150156370 0x7fb150168c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:24.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.946+0000 7fb14f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb150156370 0x7fb150168c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35466/0 (socket says 172.21.15.81:35466) 2023-10-06T03:25:24.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.946+0000 7fb14f7fe700 1 -- 172.21.15.81:0/1817969325 learned_addr learned my addr 172.21.15.81:0/1817969325 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:24.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.946+0000 7fb14effd700 1 --2- 172.21.15.81:0/1817969325 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb15013f9c0 0x7fb1501667e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:24.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.946+0000 7fb14e7fc700 1 --2- 172.21.15.81:0/1817969325 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb15015a5c0 0x7fb1500ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:24.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.947+0000 7fb14f7fe700 1 -- 172.21.15.81:0/1817969325 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb15015a5c0 msgr2=0x7fb1500ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:24.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.947+0000 7fb14f7fe700 1 --2- 172.21.15.81:0/1817969325 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb15015a5c0 0x7fb1500ad130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:24.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.947+0000 7fb14f7fe700 1 -- 172.21.15.81:0/1817969325 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb15013f9c0 msgr2=0x7fb1501667e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:24.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.947+0000 7fb14f7fe700 1 --2- 172.21.15.81:0/1817969325 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb15013f9c0 0x7fb1501667e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:24.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.947+0000 7fb14f7fe700 1 -- 172.21.15.81:0/1817969325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb140009420 con 0x7fb150156370 2023-10-06T03:25:24.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.947+0000 7fb14e7fc700 1 --2- 172.21.15.81:0/1817969325 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb15015a5c0 0x7fb1500ad130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:24.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.947+0000 7fb14f7fe700 1 --2- 172.21.15.81:0/1817969325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb150156370 0x7fb150168c10 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fb14800cc40 tx=0x7fb148001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:24.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.947+0000 7fb136ffd700 1 -- 172.21.15.81:0/1817969325 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14800a8b0 con 0x7fb150156370 2023-10-06T03:25:24.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.947+0000 7fb136ffd700 1 -- 172.21.15.81:0/1817969325 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb14800aa10 con 0x7fb150156370 2023-10-06T03:25:24.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.947+0000 7fb1557ff700 1 -- 172.21.15.81:0/1817969325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1500c5910 con 0x7fb150156370 2023-10-06T03:25:24.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.947+0000 7fb136ffd700 1 -- 172.21.15.81:0/1817969325 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14800ad90 con 0x7fb150156370 2023-10-06T03:25:24.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.947+0000 7fb1557ff700 1 -- 172.21.15.81:0/1817969325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1500c34c0 con 0x7fb150156370 2023-10-06T03:25:24.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.948+0000 7fb1557ff700 1 -- 172.21.15.81:0/1817969325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb15004c3c0 con 0x7fb150156370 2023-10-06T03:25:24.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.949+0000 7fb136ffd700 1 -- 172.21.15.81:0/1817969325 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb148007300 con 0x7fb150156370 2023-10-06T03:25:24.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.950+0000 7fb136ffd700 1 --2- 172.21.15.81:0/1817969325 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb13c066f30 0x7fb13c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:24.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.950+0000 7fb136ffd700 1 -- 172.21.15.81:0/1817969325 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5698+0+0 (secure 0 0 0) 0x7fb148084940 con 0x7fb150156370 2023-10-06T03:25:24.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.950+0000 7fb14effd700 1 --2- 172.21.15.81:0/1817969325 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb13c066f30 0x7fb13c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:24.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.951+0000 7fb14effd700 1 --2- 172.21.15.81:0/1817969325 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb13c066f30 0x7fb13c0693e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb1400093f0 tx=0x7fb140017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:24.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:24.954+0000 7fb136ffd700 1 -- 172.21.15.81:0/1817969325 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb148051b90 con 0x7fb150156370 2023-10-06T03:25:25.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.144+0000 7fb1557ff700 1 -- 172.21.15.81:0/1817969325 --> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fb15006f720 con 0x7fb13c066f30 2023-10-06T03:25:25.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.145+0000 7fb136ffd700 1 -- 172.21.15.81:0/1817969325 <== mgr.4100 v2:172.21.15.81:6832/85286 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb15006f720 con 0x7fb13c066f30 2023-10-06T03:25:25.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.147+0000 7fb1557ff700 1 -- 172.21.15.81:0/1817969325 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb13c066f30 msgr2=0x7fb13c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:25.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.147+0000 7fb1557ff700 1 --2- 172.21.15.81:0/1817969325 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb13c066f30 0x7fb13c0693e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb1400093f0 tx=0x7fb140017000 comp rx=0 tx=0).stop 2023-10-06T03:25:25.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.147+0000 7fb1557ff700 1 -- 172.21.15.81:0/1817969325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb150156370 msgr2=0x7fb150168c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:25.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.147+0000 7fb1557ff700 1 --2- 172.21.15.81:0/1817969325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb150156370 0x7fb150168c10 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fb14800cc40 tx=0x7fb148001a00 comp rx=0 tx=0).stop 2023-10-06T03:25:25.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.147+0000 7fb1557ff700 1 -- 172.21.15.81:0/1817969325 shutdown_connections 2023-10-06T03:25:25.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.147+0000 7fb1557ff700 1 --2- 172.21.15.81:0/1817969325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb150156370 0x7fb150168c10 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.147+0000 7fb1557ff700 1 --2- 172.21.15.81:0/1817969325 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb15013f9c0 0x7fb1501667e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.147+0000 7fb1557ff700 1 --2- 172.21.15.81:0/1817969325 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb13c066f30 0x7fb13c0693e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.147+0000 7fb1557ff700 1 --2- 172.21.15.81:0/1817969325 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb15015a5c0 0x7fb1500ad130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.147+0000 7fb1557ff700 1 -- 172.21.15.81:0/1817969325 >> 172.21.15.81:0/1817969325 conn(0x7fb1500cc090 msgr2=0x7fb1500c7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:25.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.147+0000 7fb1557ff700 1 -- 172.21.15.81:0/1817969325 shutdown_connections 2023-10-06T03:25:25.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.147+0000 7fb1557ff700 1 -- 172.21.15.81:0/1817969325 wait complete. 2023-10-06T03:25:25.150 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 2 to deep-scrub 2023-10-06T03:25:25.166 INFO:tasks.ceph:Scrubbing osd.3 2023-10-06T03:25:25.166 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:25:25.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.349+0000 7fe48699d700 1 Processor -- start 2023-10-06T03:25:25.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.349+0000 7fe48699d700 1 -- start start 2023-10-06T03:25:25.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.351+0000 7fe48699d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe480159af0 0x7fe480155400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:25.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.351+0000 7fe48699d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe480155940 0x7fe4800c73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:25.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.351+0000 7fe48699d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4800c6980 con 0x7fe480159720 2023-10-06T03:25:25.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.351+0000 7fe48699d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4800aba30 con 0x7fe480159af0 2023-10-06T03:25:25.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.351+0000 7fe48699d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4800c6f40 con 0x7fe480155940 2023-10-06T03:25:25.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.351+0000 7fe48519a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe480159af0 0x7fe480155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:25.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.351+0000 7fe48519a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe480159af0 0x7fe480155400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35470/0 (socket says 172.21.15.81:35470) 2023-10-06T03:25:25.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.351+0000 7fe48519a700 1 -- 172.21.15.81:0/1842683665 learned_addr learned my addr 172.21.15.81:0/1842683665 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:25.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.351+0000 7fe48619c700 1 --2- 172.21.15.81:0/1842683665 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe480155940 0x7fe4800c73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:25.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.351+0000 7fe48519a700 1 -- 172.21.15.81:0/1842683665 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe480155940 msgr2=0x7fe4800c73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:25.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.351+0000 7fe48519a700 1 --2- 172.21.15.81:0/1842683665 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe480155940 0x7fe4800c73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.351+0000 7fe48519a700 1 -- 172.21.15.81:0/1842683665 >> v1:172.21.15.83:6789/0 conn(0x7fe480159720 legacy=0x7fe4800cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:25.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.351+0000 7fe48519a700 1 -- 172.21.15.81:0/1842683665 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4800cb710 con 0x7fe480159af0 2023-10-06T03:25:25.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.352+0000 7fe48619c700 1 --2- 172.21.15.81:0/1842683665 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe480155940 0x7fe4800c73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:25.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.352+0000 7fe48519a700 1 --2- 172.21.15.81:0/1842683665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe480159af0 0x7fe480155400 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe4700099b0 tx=0x7fe470009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dc4d80d35767120 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:25.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.352+0000 7fe484999700 1 -- 172.21.15.81:0/1842683665 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47000b860 con 0x7fe480159af0 2023-10-06T03:25:25.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.352+0000 7fe484999700 1 -- 172.21.15.81:0/1842683665 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe47000b9c0 con 0x7fe480159af0 2023-10-06T03:25:25.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.352+0000 7fe484999700 1 -- 172.21.15.81:0/1842683665 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47000bd60 con 0x7fe480159af0 2023-10-06T03:25:25.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.353+0000 7fe48699d700 1 -- 172.21.15.81:0/1842683665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe480159af0 msgr2=0x7fe480155400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:25.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.353+0000 7fe48699d700 1 --2- 172.21.15.81:0/1842683665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe480159af0 0x7fe480155400 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe4700099b0 tx=0x7fe470009250 comp rx=0 tx=0).stop 2023-10-06T03:25:25.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.353+0000 7fe48699d700 1 -- 172.21.15.81:0/1842683665 shutdown_connections 2023-10-06T03:25:25.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.353+0000 7fe48699d700 1 --2- 172.21.15.81:0/1842683665 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe480155940 0x7fe4800c73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.353+0000 7fe48699d700 1 --2- 172.21.15.81:0/1842683665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe480159af0 0x7fe480155400 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.353+0000 7fe48699d700 1 -- 172.21.15.81:0/1842683665 >> 172.21.15.81:0/1842683665 conn(0x7fe4800cbe80 msgr2=0x7fe4800cc280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:25.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.353+0000 7fe48699d700 1 -- 172.21.15.81:0/1842683665 shutdown_connections 2023-10-06T03:25:25.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.353+0000 7fe48699d700 1 -- 172.21.15.81:0/1842683665 wait complete. 2023-10-06T03:25:25.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.354+0000 7fe48699d700 1 Processor -- start 2023-10-06T03:25:25.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.354+0000 7fe48699d700 1 -- start start 2023-10-06T03:25:25.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.355+0000 7fe48699d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe480155940 0x7fe480158e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:25.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.355+0000 7fe48699d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe480159720 0x7fe48016adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:25.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.355+0000 7fe48699d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe480159af0 0x7fe48014e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:25.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.355+0000 7fe48699d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe480167b00 con 0x7fe480159720 2023-10-06T03:25:25.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.355+0000 7fe48699d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48016b2f0 con 0x7fe480155940 2023-10-06T03:25:25.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.355+0000 7fe48699d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4801677b0 con 0x7fe480159af0 2023-10-06T03:25:25.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.355+0000 7fe48519a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe480159720 0x7fe48016adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:25.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.355+0000 7fe48519a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe480159720 0x7fe48016adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35484/0 (socket says 172.21.15.81:35484) 2023-10-06T03:25:25.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.355+0000 7fe48519a700 1 -- 172.21.15.81:0/1899747860 learned_addr learned my addr 172.21.15.81:0/1899747860 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:25.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.355+0000 7fe48599b700 1 --2- 172.21.15.81:0/1899747860 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe480155940 0x7fe480158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:25.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.355+0000 7fe48619c700 1 --2- 172.21.15.81:0/1899747860 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe480159af0 0x7fe48014e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:25.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.356+0000 7fe48519a700 1 -- 172.21.15.81:0/1899747860 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe480159af0 msgr2=0x7fe48014e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:25.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.356+0000 7fe48519a700 1 --2- 172.21.15.81:0/1899747860 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe480159af0 0x7fe48014e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.356+0000 7fe48519a700 1 -- 172.21.15.81:0/1899747860 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe480155940 msgr2=0x7fe480158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:25.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.356+0000 7fe48519a700 1 --2- 172.21.15.81:0/1899747860 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe480155940 0x7fe480158e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.356+0000 7fe48519a700 1 -- 172.21.15.81:0/1899747860 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4700094f0 con 0x7fe480159720 2023-10-06T03:25:25.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.356+0000 7fe48519a700 1 --2- 172.21.15.81:0/1899747860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe480159720 0x7fe48016adb0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe470009290 tx=0x7fe470017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:25.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.356+0000 7fe475ffb700 1 -- 172.21.15.81:0/1899747860 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe470011e40 con 0x7fe480159720 2023-10-06T03:25:25.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.356+0000 7fe475ffb700 1 -- 172.21.15.81:0/1899747860 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe470024440 con 0x7fe480159720 2023-10-06T03:25:25.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.356+0000 7fe48699d700 1 -- 172.21.15.81:0/1899747860 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe48016b590 con 0x7fe480159720 2023-10-06T03:25:25.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.356+0000 7fe475ffb700 1 -- 172.21.15.81:0/1899747860 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe470024800 con 0x7fe480159720 2023-10-06T03:25:25.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.357+0000 7fe48699d700 1 -- 172.21.15.81:0/1899747860 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe48016bb50 con 0x7fe480159720 2023-10-06T03:25:25.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.357+0000 7fe48699d700 1 -- 172.21.15.81:0/1899747860 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe48004c3c0 con 0x7fe480159720 2023-10-06T03:25:25.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.358+0000 7fe475ffb700 1 -- 172.21.15.81:0/1899747860 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe47001a420 con 0x7fe480159720 2023-10-06T03:25:25.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.359+0000 7fe475ffb700 1 --2- 172.21.15.81:0/1899747860 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fe464066f30 0x7fe4640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:25.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.359+0000 7fe475ffb700 1 -- 172.21.15.81:0/1899747860 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5698+0+0 (secure 0 0 0) 0x7fe470086dc0 con 0x7fe480159720 2023-10-06T03:25:25.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.359+0000 7fe48599b700 1 --2- 172.21.15.81:0/1899747860 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fe464066f30 0x7fe4640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:25.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.359+0000 7fe475ffb700 1 --2- 172.21.15.81:0/1899747860 >> [v2:172.21.15.81:6817/85562,v1:172.21.15.81:6819/85562] conn(0x7fe46406d8f0 0x7fe46406fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:25.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.359+0000 7fe475ffb700 1 -- 172.21.15.81:0/1899747860 --> [v2:172.21.15.81:6817/85562,v1:172.21.15.81:6819/85562] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe4640703f0 con 0x7fe46406d8f0 2023-10-06T03:25:25.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.360+0000 7fe475ffb700 1 -- 172.21.15.81:0/1899747860 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe4700870b0 con 0x7fe480159720 2023-10-06T03:25:25.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.360+0000 7fe48619c700 1 --2- 172.21.15.81:0/1899747860 >> [v2:172.21.15.81:6817/85562,v1:172.21.15.81:6819/85562] conn(0x7fe46406d8f0 0x7fe46406fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:25.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.360+0000 7fe48599b700 1 --2- 172.21.15.81:0/1899747860 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fe464066f30 0x7fe4640693e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe480158730 tx=0x7fe47c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:25.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.360+0000 7fe48619c700 1 --2- 172.21.15.81:0/1899747860 >> [v2:172.21.15.81:6817/85562,v1:172.21.15.81:6819/85562] conn(0x7fe46406d8f0 0x7fe46406fd20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:25.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.361+0000 7fe475ffb700 1 -- 172.21.15.81:0/1899747860 <== osd.3 v2:172.21.15.81:6817/85562 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fe4640703f0 con 0x7fe46406d8f0 2023-10-06T03:25:25.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.375+0000 7fe48699d700 1 -- 172.21.15.81:0/1899747860 --> [v2:172.21.15.81:6817/85562,v1:172.21.15.81:6819/85562] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe4800cb9f0 con 0x7fe46406d8f0 2023-10-06T03:25:25.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.375+0000 7fe475ffb700 1 -- 172.21.15.81:0/1899747860 <== osd.3 v2:172.21.15.81:6817/85562 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe4800cb9f0 con 0x7fe46406d8f0 2023-10-06T03:25:25.378 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T03:25:25.378 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:25:25.378 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T03:25:25.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.376+0000 7fe48699d700 1 -- 172.21.15.81:0/1899747860 >> [v2:172.21.15.81:6817/85562,v1:172.21.15.81:6819/85562] conn(0x7fe46406d8f0 msgr2=0x7fe46406fd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:25.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.376+0000 7fe48699d700 1 --2- 172.21.15.81:0/1899747860 >> [v2:172.21.15.81:6817/85562,v1:172.21.15.81:6819/85562] conn(0x7fe46406d8f0 0x7fe46406fd20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.376+0000 7fe48699d700 1 -- 172.21.15.81:0/1899747860 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fe464066f30 msgr2=0x7fe4640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:25.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.376+0000 7fe48699d700 1 --2- 172.21.15.81:0/1899747860 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fe464066f30 0x7fe4640693e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe480158730 tx=0x7fe47c009040 comp rx=0 tx=0).stop 2023-10-06T03:25:25.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.376+0000 7fe48699d700 1 -- 172.21.15.81:0/1899747860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe480159720 msgr2=0x7fe48016adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:25.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.376+0000 7fe48699d700 1 --2- 172.21.15.81:0/1899747860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe480159720 0x7fe48016adb0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe470009290 tx=0x7fe470017000 comp rx=0 tx=0).stop 2023-10-06T03:25:25.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.376+0000 7fe48619c700 1 -- 172.21.15.81:0/1899747860 reap_dead start 2023-10-06T03:25:25.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.376+0000 7fe48699d700 1 -- 172.21.15.81:0/1899747860 shutdown_connections 2023-10-06T03:25:25.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.376+0000 7fe48699d700 1 -- 172.21.15.81:0/1899747860 >> 172.21.15.81:0/1899747860 conn(0x7fe4800cbe80 msgr2=0x7fe480150a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:25.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.376+0000 7fe48699d700 1 -- 172.21.15.81:0/1899747860 shutdown_connections 2023-10-06T03:25:25.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.376+0000 7fe48699d700 1 -- 172.21.15.81:0/1899747860 wait complete. 2023-10-06T03:25:25.393 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-06T03:25:25.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.574+0000 7f43d09fe700 1 Processor -- start 2023-10-06T03:25:25.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.574+0000 7f43d09fe700 1 -- start start 2023-10-06T03:25:25.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.575+0000 7f43d09fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f43cc0cc670 0x7f43cc0ccd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:25.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.575+0000 7f43d09fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f43cc15a450 0x7f43cc15a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:25.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.575+0000 7f43d09fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f43cc0b1d10 0x7f43cc0b2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:25.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.575+0000 7f43d09fe700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43cc0b60f0 con 0x7f43cc0cc670 2023-10-06T03:25:25.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.575+0000 7f43d09fe700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43cc0b4760 con 0x7f43cc15a450 2023-10-06T03:25:25.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.575+0000 7f43d09fe700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc0cd320 con 0x7f43cc0b1d10 2023-10-06T03:25:25.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.576+0000 7f43cad9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f43cc0cc670 0x7f43cc0ccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:25.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.576+0000 7f43cad9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f43cc0cc670 0x7f43cc0ccd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35486/0 (socket says 172.21.15.81:35486) 2023-10-06T03:25:25.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.576+0000 7f43cad9d700 1 -- 172.21.15.81:0/2503033537 learned_addr learned my addr 172.21.15.81:0/2503033537 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:25.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.576+0000 7f43ca59c700 1 --2- 172.21.15.81:0/2503033537 >> v2:172.21.15.83:3300/0 conn(0x7f43cc15a450 0x7f43cc15a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:25.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.576+0000 7f43cb59e700 1 --2- 172.21.15.81:0/2503033537 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f43cc0b1d10 0x7f43cc0b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:25.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.576+0000 7f43cad9d700 1 -- 172.21.15.81:0/2503033537 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f43cc0b1d10 msgr2=0x7f43cc0b2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:25.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.576+0000 7f43cad9d700 1 --2- 172.21.15.81:0/2503033537 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f43cc0b1d10 0x7f43cc0b2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.576+0000 7f43cad9d700 1 -- 172.21.15.81:0/2503033537 >> v2:172.21.15.83:3300/0 conn(0x7f43cc15a450 msgr2=0x7f43cc15a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:25.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.576+0000 7f43cad9d700 1 --2- 172.21.15.81:0/2503033537 >> v2:172.21.15.83:3300/0 conn(0x7f43cc15a450 0x7f43cc15a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.576+0000 7f43cad9d700 1 -- 172.21.15.81:0/2503033537 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43cc0b2660 con 0x7f43cc0cc670 2023-10-06T03:25:25.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.577+0000 7f43cad9d700 1 --2- 172.21.15.81:0/2503033537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43cc0cc670 0x7f43cc0ccd40 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f43cc0b5d10 tx=0x7f43bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=276f4199d4bb2e9e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:25.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.577+0000 7f43c9d9b700 1 -- 172.21.15.81:0/2503033537 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc00b640 con 0x7f43cc0cc670 2023-10-06T03:25:25.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.577+0000 7f43c9d9b700 1 -- 172.21.15.81:0/2503033537 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43bc00b7a0 con 0x7f43cc0cc670 2023-10-06T03:25:25.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.577+0000 7f43c9d9b700 1 -- 172.21.15.81:0/2503033537 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc00bb60 con 0x7f43cc0cc670 2023-10-06T03:25:25.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.577+0000 7f43d09fe700 1 -- 172.21.15.81:0/2503033537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43cc0cc670 msgr2=0x7f43cc0ccd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:25.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.577+0000 7f43d09fe700 1 --2- 172.21.15.81:0/2503033537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43cc0cc670 0x7f43cc0ccd40 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f43cc0b5d10 tx=0x7f43bc009250 comp rx=0 tx=0).stop 2023-10-06T03:25:25.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.577+0000 7f43d09fe700 1 -- 172.21.15.81:0/2503033537 shutdown_connections 2023-10-06T03:25:25.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.577+0000 7f43d09fe700 1 --2- 172.21.15.81:0/2503033537 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f43cc0b1d10 0x7f43cc0b2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.577+0000 7f43d09fe700 1 --2- 172.21.15.81:0/2503033537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43cc0cc670 0x7f43cc0ccd40 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.577+0000 7f43d09fe700 1 --2- 172.21.15.81:0/2503033537 >> v2:172.21.15.83:3300/0 conn(0x7f43cc15a450 0x7f43cc15a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.577+0000 7f43d09fe700 1 -- 172.21.15.81:0/2503033537 >> 172.21.15.81:0/2503033537 conn(0x7f43cc06ed10 msgr2=0x7f43cc06f110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:25.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.578+0000 7f43d09fe700 1 -- 172.21.15.81:0/2503033537 shutdown_connections 2023-10-06T03:25:25.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.578+0000 7f43d09fe700 1 -- 172.21.15.81:0/2503033537 wait complete. 2023-10-06T03:25:25.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.579+0000 7f43d09fe700 1 Processor -- start 2023-10-06T03:25:25.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.579+0000 7f43d09fe700 1 -- start start 2023-10-06T03:25:25.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.580+0000 7f43d09fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43cc0b1d10 0x7f43cc14e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:25.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.580+0000 7f43d09fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43cc0cc670 0x7f43cc1509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:25.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.580+0000 7f43d09fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f43cc15a450 0x7f43cc151540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:25.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.580+0000 7f43d09fe700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc0c9a80 con 0x7f43cc0cc670 2023-10-06T03:25:25.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.580+0000 7f43d09fe700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc0c8e70 con 0x7f43cc0b1d10 2023-10-06T03:25:25.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.580+0000 7f43d09fe700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc0c9150 con 0x7f43cc15a450 2023-10-06T03:25:25.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.580+0000 7f43ca59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43cc0cc670 0x7f43cc1509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:25.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.580+0000 7f43ca59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43cc0cc670 0x7f43cc1509b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35502/0 (socket says 172.21.15.81:35502) 2023-10-06T03:25:25.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.580+0000 7f43ca59c700 1 -- 172.21.15.81:0/1837770970 learned_addr learned my addr 172.21.15.81:0/1837770970 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:25.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.580+0000 7f43cad9d700 1 --2- 172.21.15.81:0/1837770970 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43cc0b1d10 0x7f43cc14e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:25.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.580+0000 7f43cb59e700 1 --2- 172.21.15.81:0/1837770970 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f43cc15a450 0x7f43cc151540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:25.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.581+0000 7f43ca59c700 1 -- 172.21.15.81:0/1837770970 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f43cc15a450 msgr2=0x7f43cc151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:25.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.581+0000 7f43ca59c700 1 --2- 172.21.15.81:0/1837770970 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f43cc15a450 0x7f43cc151540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.581+0000 7f43ca59c700 1 -- 172.21.15.81:0/1837770970 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43cc0b1d10 msgr2=0x7f43cc14e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:25.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.581+0000 7f43ca59c700 1 --2- 172.21.15.81:0/1837770970 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43cc0b1d10 0x7f43cc14e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.581+0000 7f43ca59c700 1 -- 172.21.15.81:0/1837770970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43bc0094f0 con 0x7f43cc0cc670 2023-10-06T03:25:25.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.581+0000 7f43ca59c700 1 --2- 172.21.15.81:0/1837770970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43cc0cc670 0x7f43cc1509b0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f43c000e930 tx=0x7f43c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:25.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.581+0000 7f43b2ffd700 1 -- 172.21.15.81:0/1837770970 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c0013680 con 0x7f43cc0cc670 2023-10-06T03:25:25.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.581+0000 7f43b2ffd700 1 -- 172.21.15.81:0/1837770970 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c00137e0 con 0x7f43cc0cc670 2023-10-06T03:25:25.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.581+0000 7f43d09fe700 1 -- 172.21.15.81:0/1837770970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43cc0c9430 con 0x7f43cc0cc670 2023-10-06T03:25:25.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.581+0000 7f43b2ffd700 1 -- 172.21.15.81:0/1837770970 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c0013b80 con 0x7f43cc0cc670 2023-10-06T03:25:25.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.581+0000 7f43d09fe700 1 -- 172.21.15.81:0/1837770970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43cc14edd0 con 0x7f43cc0cc670 2023-10-06T03:25:25.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.582+0000 7f43d09fe700 1 -- 172.21.15.81:0/1837770970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43cc0ca430 con 0x7f43cc0cc670 2023-10-06T03:25:25.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.584+0000 7f43b2ffd700 1 -- 172.21.15.81:0/1837770970 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f43c000c3e0 con 0x7f43cc0cc670 2023-10-06T03:25:25.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.584+0000 7f43b2ffd700 1 --2- 172.21.15.81:0/1837770970 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f43b8066f30 0x7f43b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:25.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.584+0000 7f43b2ffd700 1 -- 172.21.15.81:0/1837770970 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f43c00845e0 con 0x7f43cc0cc670 2023-10-06T03:25:25.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.585+0000 7f43cad9d700 1 --2- 172.21.15.81:0/1837770970 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f43b8066f30 0x7f43b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:25.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.585+0000 7f43cad9d700 1 --2- 172.21.15.81:0/1837770970 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f43b8066f30 0x7f43b80693e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f43cc0b5d10 tx=0x7f43bc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:25.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.588+0000 7f43b2ffd700 1 -- 172.21.15.81:0/1837770970 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f43cc0ca430 con 0x7f43cc0cc670 2023-10-06T03:25:25.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.781+0000 7f43d09fe700 1 -- 172.21.15.81:0/1837770970 --> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f43cc0ca430 con 0x7f43b8066f30 2023-10-06T03:25:25.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.782+0000 7f43b2ffd700 1 -- 172.21.15.81:0/1837770970 <== mgr.4100 v2:172.21.15.81:6832/85286 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f43cc0ca430 con 0x7f43b8066f30 2023-10-06T03:25:25.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.784+0000 7f43d09fe700 1 -- 172.21.15.81:0/1837770970 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f43b8066f30 msgr2=0x7f43b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:25.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.784+0000 7f43d09fe700 1 --2- 172.21.15.81:0/1837770970 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f43b8066f30 0x7f43b80693e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f43cc0b5d10 tx=0x7f43bc017000 comp rx=0 tx=0).stop 2023-10-06T03:25:25.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.784+0000 7f43d09fe700 1 -- 172.21.15.81:0/1837770970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43cc0cc670 msgr2=0x7f43cc1509b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:25.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.784+0000 7f43d09fe700 1 --2- 172.21.15.81:0/1837770970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43cc0cc670 0x7f43cc1509b0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f43c000e930 tx=0x7f43c00091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.784+0000 7f43d09fe700 1 -- 172.21.15.81:0/1837770970 shutdown_connections 2023-10-06T03:25:25.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.784+0000 7f43d09fe700 1 --2- 172.21.15.81:0/1837770970 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f43b8066f30 0x7f43b80693e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.784+0000 7f43d09fe700 1 --2- 172.21.15.81:0/1837770970 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f43cc15a450 0x7f43cc151540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.784+0000 7f43d09fe700 1 --2- 172.21.15.81:0/1837770970 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43cc0b1d10 0x7f43cc14e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.784+0000 7f43d09fe700 1 --2- 172.21.15.81:0/1837770970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43cc0cc670 0x7f43cc1509b0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.784+0000 7f43d09fe700 1 -- 172.21.15.81:0/1837770970 >> 172.21.15.81:0/1837770970 conn(0x7f43cc06ed10 msgr2=0x7f43cc14feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:25.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.784+0000 7f43d09fe700 1 -- 172.21.15.81:0/1837770970 shutdown_connections 2023-10-06T03:25:25.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.784+0000 7f43d09fe700 1 -- 172.21.15.81:0/1837770970 wait complete. 2023-10-06T03:25:25.788 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 3 to deep-scrub 2023-10-06T03:25:25.802 INFO:tasks.ceph:Scrubbing osd.4 2023-10-06T03:25:25.802 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:25:25.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.986+0000 7fc4985ff700 1 Processor -- start 2023-10-06T03:25:25.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.986+0000 7fc4985ff700 1 -- start start 2023-10-06T03:25:25.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.988+0000 7fc4985ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc490140990 0x7fc4900c0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:25.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.988+0000 7fc4985ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc490140d60 0x7fc4900c1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:25.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.988+0000 7fc4985ff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc490157cf0 con 0x7fc49006d4a0 2023-10-06T03:25:25.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.988+0000 7fc4985ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4900c1960 con 0x7fc490140990 2023-10-06T03:25:25.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.988+0000 7fc4985ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4900c1c40 con 0x7fc490140d60 2023-10-06T03:25:25.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.988+0000 7fc49639b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc490140990 0x7fc4900c0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:25.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.988+0000 7fc49639b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc490140990 0x7fc4900c0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35514/0 (socket says 172.21.15.81:35514) 2023-10-06T03:25:25.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.988+0000 7fc49639b700 1 -- 172.21.15.81:0/939444847 learned_addr learned my addr 172.21.15.81:0/939444847 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:25.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.988+0000 7fc495b9a700 1 --2- 172.21.15.81:0/939444847 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc490140d60 0x7fc4900c1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:25.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.988+0000 7fc49639b700 1 -- 172.21.15.81:0/939444847 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc490140d60 msgr2=0x7fc4900c1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:25.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.988+0000 7fc49639b700 1 --2- 172.21.15.81:0/939444847 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc490140d60 0x7fc4900c1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.988+0000 7fc49639b700 1 -- 172.21.15.81:0/939444847 >> v1:172.21.15.83:6789/0 conn(0x7fc49006d4a0 legacy=0x7fc49015af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:25.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.988+0000 7fc49639b700 1 -- 172.21.15.81:0/939444847 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4900c2570 con 0x7fc490140990 2023-10-06T03:25:25.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.989+0000 7fc49639b700 1 --2- 172.21.15.81:0/939444847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc490140990 0x7fc4900c0df0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fc48c0099b0 tx=0x7fc48c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f7a996295efcaa0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:25.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.989+0000 7fc495399700 1 -- 172.21.15.81:0/939444847 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48c00b820 con 0x7fc490140990 2023-10-06T03:25:25.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.989+0000 7fc495399700 1 -- 172.21.15.81:0/939444847 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc48c00b980 con 0x7fc490140990 2023-10-06T03:25:25.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.989+0000 7fc495399700 1 -- 172.21.15.81:0/939444847 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48c00bd20 con 0x7fc490140990 2023-10-06T03:25:25.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.989+0000 7fc4985ff700 1 -- 172.21.15.81:0/939444847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc490140990 msgr2=0x7fc4900c0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:25.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.989+0000 7fc4985ff700 1 --2- 172.21.15.81:0/939444847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc490140990 0x7fc4900c0df0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fc48c0099b0 tx=0x7fc48c009250 comp rx=0 tx=0).stop 2023-10-06T03:25:25.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.990+0000 7fc4985ff700 1 -- 172.21.15.81:0/939444847 shutdown_connections 2023-10-06T03:25:25.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.990+0000 7fc4985ff700 1 --2- 172.21.15.81:0/939444847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc490140990 0x7fc4900c0df0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.990+0000 7fc4985ff700 1 --2- 172.21.15.81:0/939444847 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc490140d60 0x7fc4900c1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.990+0000 7fc4985ff700 1 -- 172.21.15.81:0/939444847 >> 172.21.15.81:0/939444847 conn(0x7fc4900cc050 msgr2=0x7fc4900cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:25.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.990+0000 7fc4985ff700 1 -- 172.21.15.81:0/939444847 shutdown_connections 2023-10-06T03:25:25.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.990+0000 7fc4985ff700 1 -- 172.21.15.81:0/939444847 wait complete. 2023-10-06T03:25:25.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.991+0000 7fc4985ff700 1 Processor -- start 2023-10-06T03:25:25.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.991+0000 7fc4985ff700 1 -- start start 2023-10-06T03:25:25.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.992+0000 7fc4985ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc49006d4a0 0x7fc4900c4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:25.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.992+0000 7fc4985ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc490140990 0x7fc49016a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:25.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.992+0000 7fc4985ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc490140d60 0x7fc49015a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:25.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.992+0000 7fc4985ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4900c42f0 con 0x7fc490140d60 2023-10-06T03:25:25.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.992+0000 7fc4985ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49016aa00 con 0x7fc49006d4a0 2023-10-06T03:25:25.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.992+0000 7fc4985ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4900c3670 con 0x7fc490140990 2023-10-06T03:25:25.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.992+0000 7fc496b9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc490140d60 0x7fc49015a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:25.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.992+0000 7fc496b9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc490140d60 0x7fc49015a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35530/0 (socket says 172.21.15.81:35530) 2023-10-06T03:25:25.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.992+0000 7fc496b9c700 1 -- 172.21.15.81:0/4274008191 learned_addr learned my addr 172.21.15.81:0/4274008191 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:25.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.993+0000 7fc495b9a700 1 --2- 172.21.15.81:0/4274008191 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc490140990 0x7fc49016a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:25.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.993+0000 7fc49639b700 1 --2- 172.21.15.81:0/4274008191 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc49006d4a0 0x7fc4900c4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:25.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.993+0000 7fc496b9c700 1 -- 172.21.15.81:0/4274008191 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc490140990 msgr2=0x7fc49016a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:25.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.993+0000 7fc496b9c700 1 --2- 172.21.15.81:0/4274008191 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc490140990 0x7fc49016a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.993+0000 7fc496b9c700 1 -- 172.21.15.81:0/4274008191 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc49006d4a0 msgr2=0x7fc4900c4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:25.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.993+0000 7fc496b9c700 1 --2- 172.21.15.81:0/4274008191 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc49006d4a0 0x7fc4900c4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:25.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.993+0000 7fc496b9c700 1 -- 172.21.15.81:0/4274008191 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc48c0094f0 con 0x7fc490140d60 2023-10-06T03:25:25.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.993+0000 7fc49639b700 1 --2- 172.21.15.81:0/4274008191 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc49006d4a0 0x7fc4900c4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:25.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.993+0000 7fc496b9c700 1 --2- 172.21.15.81:0/4274008191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc490140d60 0x7fc49015a060 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc48800c930 tx=0x7fc4880026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:25.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.993+0000 7fc4867fc700 1 -- 172.21.15.81:0/4274008191 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc488012630 con 0x7fc490140d60 2023-10-06T03:25:25.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.993+0000 7fc4867fc700 1 -- 172.21.15.81:0/4274008191 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4880127d0 con 0x7fc490140d60 2023-10-06T03:25:25.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.993+0000 7fc4985ff700 1 -- 172.21.15.81:0/4274008191 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4900c3950 con 0x7fc490140d60 2023-10-06T03:25:25.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.993+0000 7fc4867fc700 1 -- 172.21.15.81:0/4274008191 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc488012b90 con 0x7fc490140d60 2023-10-06T03:25:25.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.993+0000 7fc4985ff700 1 -- 172.21.15.81:0/4274008191 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4900c3f10 con 0x7fc490140d60 2023-10-06T03:25:25.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.994+0000 7fc4985ff700 1 -- 172.21.15.81:0/4274008191 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc49004c3c0 con 0x7fc490140d60 2023-10-06T03:25:25.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.995+0000 7fc4867fc700 1 -- 172.21.15.81:0/4274008191 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc48800a3b0 con 0x7fc490140d60 2023-10-06T03:25:25.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.996+0000 7fc4867fc700 1 --2- 172.21.15.81:0/4274008191 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc474066f30 0x7fc4740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:25.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.996+0000 7fc4867fc700 1 -- 172.21.15.81:0/4274008191 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5698+0+0 (secure 0 0 0) 0x7fc4880842e0 con 0x7fc490140d60 2023-10-06T03:25:25.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.996+0000 7fc49639b700 1 --2- 172.21.15.81:0/4274008191 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc474066f30 0x7fc4740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:25.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.996+0000 7fc4867fc700 1 --2- 172.21.15.81:0/4274008191 >> [v2:172.21.15.83:6800/85785,v1:172.21.15.83:6801/85785] conn(0x7fc47406d8f0 0x7fc47406fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:25.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.996+0000 7fc4867fc700 1 -- 172.21.15.81:0/4274008191 --> [v2:172.21.15.83:6800/85785,v1:172.21.15.83:6801/85785] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc4740703f0 con 0x7fc47406d8f0 2023-10-06T03:25:25.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.996+0000 7fc4867fc700 1 -- 172.21.15.81:0/4274008191 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc488086840 con 0x7fc490140d60 2023-10-06T03:25:25.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.997+0000 7fc49639b700 1 --2- 172.21.15.81:0/4274008191 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc474066f30 0x7fc4740693e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc48c0099b0 tx=0x7fc48c016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:25.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.997+0000 7fc495b9a700 1 --2- 172.21.15.81:0/4274008191 >> [v2:172.21.15.83:6800/85785,v1:172.21.15.83:6801/85785] conn(0x7fc47406d8f0 0x7fc47406fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:25.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.997+0000 7fc495b9a700 1 --2- 172.21.15.81:0/4274008191 >> [v2:172.21.15.83:6800/85785,v1:172.21.15.83:6801/85785] conn(0x7fc47406d8f0 0x7fc47406fd20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:25.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:25.998+0000 7fc4867fc700 1 -- 172.21.15.81:0/4274008191 <== osd.4 v2:172.21.15.83:6800/85785 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fc4740703f0 con 0x7fc47406d8f0 2023-10-06T03:25:26.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.012+0000 7fc4985ff700 1 -- 172.21.15.81:0/4274008191 --> [v2:172.21.15.83:6800/85785,v1:172.21.15.83:6801/85785] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc4900c1f20 con 0x7fc47406d8f0 2023-10-06T03:25:26.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.013+0000 7fc4867fc700 1 -- 172.21.15.81:0/4274008191 <== osd.4 v2:172.21.15.83:6800/85785 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fc4900c1f20 con 0x7fc47406d8f0 2023-10-06T03:25:26.014 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T03:25:26.014 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:25:26.014 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T03:25:26.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.013+0000 7fc4985ff700 1 -- 172.21.15.81:0/4274008191 >> [v2:172.21.15.83:6800/85785,v1:172.21.15.83:6801/85785] conn(0x7fc47406d8f0 msgr2=0x7fc47406fd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:26.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.013+0000 7fc4985ff700 1 --2- 172.21.15.81:0/4274008191 >> [v2:172.21.15.83:6800/85785,v1:172.21.15.83:6801/85785] conn(0x7fc47406d8f0 0x7fc47406fd20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:26.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.014+0000 7fc4985ff700 1 -- 172.21.15.81:0/4274008191 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc474066f30 msgr2=0x7fc4740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:26.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.014+0000 7fc4985ff700 1 --2- 172.21.15.81:0/4274008191 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fc474066f30 0x7fc4740693e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc48c0099b0 tx=0x7fc48c016000 comp rx=0 tx=0).stop 2023-10-06T03:25:26.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.014+0000 7fc4985ff700 1 -- 172.21.15.81:0/4274008191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc490140d60 msgr2=0x7fc49015a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:26.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.014+0000 7fc4985ff700 1 --2- 172.21.15.81:0/4274008191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc490140d60 0x7fc49015a060 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc48800c930 tx=0x7fc4880026e0 comp rx=0 tx=0).stop 2023-10-06T03:25:26.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.014+0000 7fc496b9c700 1 -- 172.21.15.81:0/4274008191 reap_dead start 2023-10-06T03:25:26.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.014+0000 7fc4985ff700 1 -- 172.21.15.81:0/4274008191 shutdown_connections 2023-10-06T03:25:26.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.014+0000 7fc4985ff700 1 -- 172.21.15.81:0/4274008191 >> 172.21.15.81:0/4274008191 conn(0x7fc4900cc050 msgr2=0x7fc4900cc420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:26.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.014+0000 7fc4985ff700 1 -- 172.21.15.81:0/4274008191 shutdown_connections 2023-10-06T03:25:26.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.014+0000 7fc4985ff700 1 -- 172.21.15.81:0/4274008191 wait complete. 2023-10-06T03:25:26.031 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-06T03:25:26.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.211+0000 7f765efff700 1 Processor -- start 2023-10-06T03:25:26.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.212+0000 7f765efff700 1 -- start start 2023-10-06T03:25:26.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.213+0000 7f765efff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f76581595b0 0x7f76580af020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:26.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.213+0000 7f765efff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7658068bc0 0x7f76580ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:26.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.213+0000 7f765efff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f76580cd300 0x7f76580cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:26.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.213+0000 7f765efff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76580ce720 con 0x7f76580cd300 2023-10-06T03:25:26.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.213+0000 7f765efff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76580ce110 con 0x7f7658068bc0 2023-10-06T03:25:26.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.213+0000 7f765efff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76580af990 con 0x7f76581595b0 2023-10-06T03:25:26.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.213+0000 7f765d59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f76580cd300 0x7f76580cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:26.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.213+0000 7f765d59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f76580cd300 0x7f76580cebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35534/0 (socket says 172.21.15.81:35534) 2023-10-06T03:25:26.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.213+0000 7f765d59c700 1 -- 172.21.15.81:0/261005470 learned_addr learned my addr 172.21.15.81:0/261005470 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:26.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.213+0000 7f7657fff700 1 --2- 172.21.15.81:0/261005470 >> v2:172.21.15.83:3300/0 conn(0x7f7658068bc0 0x7f76580ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:26.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.213+0000 7f765cd9b700 1 --2- 172.21.15.81:0/261005470 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f76581595b0 0x7f76580af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:26.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.214+0000 7f765d59c700 1 -- 172.21.15.81:0/261005470 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f76581595b0 msgr2=0x7f76580af020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:26.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.214+0000 7f765d59c700 1 --2- 172.21.15.81:0/261005470 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f76581595b0 0x7f76580af020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:26.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.214+0000 7f765d59c700 1 -- 172.21.15.81:0/261005470 >> v2:172.21.15.83:3300/0 conn(0x7f7658068bc0 msgr2=0x7f76580ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:26.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.214+0000 7f765d59c700 1 --2- 172.21.15.81:0/261005470 >> v2:172.21.15.83:3300/0 conn(0x7f7658068bc0 0x7f76580ccdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:26.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.214+0000 7f765d59c700 1 -- 172.21.15.81:0/261005470 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76580ce3b0 con 0x7f76580cd300 2023-10-06T03:25:26.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.214+0000 7f765d59c700 1 --2- 172.21.15.81:0/261005470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76580cd300 0x7f76580cebb0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f76580676d0 tx=0x7f7650009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6be11d616157917 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:26.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.214+0000 7f76577fe700 1 -- 172.21.15.81:0/261005470 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765000e070 con 0x7f76580cd300 2023-10-06T03:25:26.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.214+0000 7f76577fe700 1 -- 172.21.15.81:0/261005470 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f765000b970 con 0x7f76580cd300 2023-10-06T03:25:26.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.214+0000 7f76577fe700 1 -- 172.21.15.81:0/261005470 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76500092e0 con 0x7f76580cd300 2023-10-06T03:25:26.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.215+0000 7f765efff700 1 -- 172.21.15.81:0/261005470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76580cd300 msgr2=0x7f76580cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:26.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.215+0000 7f765efff700 1 --2- 172.21.15.81:0/261005470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76580cd300 0x7f76580cebb0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f76580676d0 tx=0x7f7650009840 comp rx=0 tx=0).stop 2023-10-06T03:25:26.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.215+0000 7f765efff700 1 -- 172.21.15.81:0/261005470 shutdown_connections 2023-10-06T03:25:26.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.215+0000 7f765efff700 1 --2- 172.21.15.81:0/261005470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76580cd300 0x7f76580cebb0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:26.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.215+0000 7f765efff700 1 --2- 172.21.15.81:0/261005470 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f76581595b0 0x7f76580af020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:26.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.215+0000 7f765efff700 1 --2- 172.21.15.81:0/261005470 >> v2:172.21.15.83:3300/0 conn(0x7f7658068bc0 0x7f76580ccdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:26.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.215+0000 7f765efff700 1 -- 172.21.15.81:0/261005470 >> 172.21.15.81:0/261005470 conn(0x7f765806f7e0 msgr2=0x7f76580682b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:26.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.215+0000 7f765efff700 1 -- 172.21.15.81:0/261005470 shutdown_connections 2023-10-06T03:25:26.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.215+0000 7f765efff700 1 -- 172.21.15.81:0/261005470 wait complete. 2023-10-06T03:25:26.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.216+0000 7f765efff700 1 Processor -- start 2023-10-06T03:25:26.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.216+0000 7f765efff700 1 -- start start 2023-10-06T03:25:26.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.217+0000 7f765efff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7658068bc0 0x7f76580b5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:26.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.217+0000 7f765efff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76580cd300 0x7f76581549c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:26.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.217+0000 7f765efff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f76581595b0 0x7f765815d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:26.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.217+0000 7f765efff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76580b4b20 con 0x7f76580cd300 2023-10-06T03:25:26.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.217+0000 7f765efff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76580b4e00 con 0x7f7658068bc0 2023-10-06T03:25:26.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.217+0000 7f765efff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76580b50e0 con 0x7f76581595b0 2023-10-06T03:25:26.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.218+0000 7f7657fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76580cd300 0x7f76581549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:26.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.218+0000 7f7657fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76580cd300 0x7f76581549c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35538/0 (socket says 172.21.15.81:35538) 2023-10-06T03:25:26.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.218+0000 7f7657fff700 1 -- 172.21.15.81:0/3646347472 learned_addr learned my addr 172.21.15.81:0/3646347472 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:26.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.218+0000 7f765d59c700 1 --2- 172.21.15.81:0/3646347472 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f76581595b0 0x7f765815d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:26.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.218+0000 7f765cd9b700 1 --2- 172.21.15.81:0/3646347472 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7658068bc0 0x7f76580b5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:26.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.218+0000 7f7657fff700 1 -- 172.21.15.81:0/3646347472 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f76581595b0 msgr2=0x7f765815d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:26.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.218+0000 7f7657fff700 1 --2- 172.21.15.81:0/3646347472 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f76581595b0 0x7f765815d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:26.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.218+0000 7f7657fff700 1 -- 172.21.15.81:0/3646347472 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7658068bc0 msgr2=0x7f76580b5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:26.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.218+0000 7f7657fff700 1 --2- 172.21.15.81:0/3646347472 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7658068bc0 0x7f76580b5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:26.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.218+0000 7f7657fff700 1 -- 172.21.15.81:0/3646347472 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7650009ae0 con 0x7f76580cd300 2023-10-06T03:25:26.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.218+0000 7f7657fff700 1 --2- 172.21.15.81:0/3646347472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76580cd300 0x7f76581549c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f764400ec50 tx=0x7f76440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:26.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.219+0000 7f7654ff9700 1 -- 172.21.15.81:0/3646347472 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764400c850 con 0x7f76580cd300 2023-10-06T03:25:26.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.219+0000 7f7654ff9700 1 -- 172.21.15.81:0/3646347472 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f764400c9b0 con 0x7f76580cd300 2023-10-06T03:25:26.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.219+0000 7f7654ff9700 1 -- 172.21.15.81:0/3646347472 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764400cd70 con 0x7f76580cd300 2023-10-06T03:25:26.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.219+0000 7f765efff700 1 -- 172.21.15.81:0/3646347472 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76580b53c0 con 0x7f76580cd300 2023-10-06T03:25:26.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.219+0000 7f765efff700 1 -- 172.21.15.81:0/3646347472 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76580b6100 con 0x7f76580cd300 2023-10-06T03:25:26.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.220+0000 7f765efff700 1 -- 172.21.15.81:0/3646347472 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76580b58e0 con 0x7f76580cd300 2023-10-06T03:25:26.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.220+0000 7f7654ff9700 1 -- 172.21.15.81:0/3646347472 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7644013680 con 0x7f76580cd300 2023-10-06T03:25:26.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.221+0000 7f7654ff9700 1 --2- 172.21.15.81:0/3646347472 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f763c066f30 0x7f763c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:26.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.221+0000 7f7654ff9700 1 -- 172.21.15.81:0/3646347472 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f76440847c0 con 0x7f76580cd300 2023-10-06T03:25:26.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.222+0000 7f765cd9b700 1 --2- 172.21.15.81:0/3646347472 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f763c066f30 0x7f763c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:26.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.222+0000 7f765cd9b700 1 --2- 172.21.15.81:0/3646347472 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f763c066f30 0x7f763c0693e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f764c009d10 tx=0x7f764c0091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:26.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.226+0000 7f7654ff9700 1 -- 172.21.15.81:0/3646347472 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f76580b58e0 con 0x7f76580cd300 2023-10-06T03:25:26.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.414+0000 7f765efff700 1 -- 172.21.15.81:0/3646347472 --> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f76580b4f70 con 0x7f763c066f30 2023-10-06T03:25:26.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.415+0000 7f7654ff9700 1 -- 172.21.15.81:0/3646347472 <== mgr.4100 v2:172.21.15.81:6832/85286 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f76580b4f70 con 0x7f763c066f30 2023-10-06T03:25:26.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.417+0000 7f765efff700 1 -- 172.21.15.81:0/3646347472 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f763c066f30 msgr2=0x7f763c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:26.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.417+0000 7f765efff700 1 --2- 172.21.15.81:0/3646347472 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f763c066f30 0x7f763c0693e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f764c009d10 tx=0x7f764c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:26.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.417+0000 7f765efff700 1 -- 172.21.15.81:0/3646347472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76580cd300 msgr2=0x7f76581549c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:26.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.417+0000 7f765efff700 1 --2- 172.21.15.81:0/3646347472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76580cd300 0x7f76581549c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f764400ec50 tx=0x7f76440091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:26.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.417+0000 7f765efff700 1 -- 172.21.15.81:0/3646347472 shutdown_connections 2023-10-06T03:25:26.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.417+0000 7f765efff700 1 --2- 172.21.15.81:0/3646347472 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f763c066f30 0x7f763c0693e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:26.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.417+0000 7f765efff700 1 --2- 172.21.15.81:0/3646347472 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f76581595b0 0x7f765815d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:26.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.417+0000 7f765efff700 1 --2- 172.21.15.81:0/3646347472 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7658068bc0 0x7f76580b5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:26.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.417+0000 7f765efff700 1 --2- 172.21.15.81:0/3646347472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76580cd300 0x7f76581549c0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:26.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.417+0000 7f765efff700 1 -- 172.21.15.81:0/3646347472 >> 172.21.15.81:0/3646347472 conn(0x7f765806f7e0 msgr2=0x7f76580b2210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:26.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.417+0000 7f765efff700 1 -- 172.21.15.81:0/3646347472 shutdown_connections 2023-10-06T03:25:26.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.417+0000 7f765efff700 1 -- 172.21.15.81:0/3646347472 wait complete. 2023-10-06T03:25:26.419 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 4 to deep-scrub 2023-10-06T03:25:26.435 INFO:tasks.ceph:Scrubbing osd.5 2023-10-06T03:25:26.435 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:25:26.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.618+0000 7ffb0c99d700 1 Processor -- start 2023-10-06T03:25:26.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.618+0000 7ffb0c99d700 1 -- start start 2023-10-06T03:25:26.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.619+0000 7ffb0c99d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ffb080b1f20 0x7ffb081599b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:26.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.619+0000 7ffb0c99d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb081571a0 0x7ffb0815d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:26.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.619+0000 7ffb0c99d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb0815a930 con 0x7ffb080b22f0 2023-10-06T03:25:26.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.619+0000 7ffb0c99d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb0815a090 con 0x7ffb080b1f20 2023-10-06T03:25:26.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.619+0000 7ffb0c99d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0815a370 con 0x7ffb081571a0 2023-10-06T03:25:26.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.620+0000 7ffb077fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ffb080b1f20 0x7ffb081599b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:26.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.620+0000 7ffb07fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb081571a0 0x7ffb0815d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:26.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.620+0000 7ffb07fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb081571a0 0x7ffb0815d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.81:39140/0 (socket says 172.21.15.81:39140) 2023-10-06T03:25:26.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.620+0000 7ffb07fff700 1 -- 172.21.15.81:0/707875761 learned_addr learned my addr 172.21.15.81:0/707875761 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:26.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.620+0000 7ffb06ffd700 1 --1- 172.21.15.81:0/707875761 >> v1:172.21.15.83:6789/0 conn(0x7ffb080b22f0 0x7ffb08156a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.81:33796/0 (socket says 172.21.15.81:33796) 2023-10-06T03:25:26.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.620+0000 7ffb077fe700 1 -- 172.21.15.81:0/707875761 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb081571a0 msgr2=0x7ffb0815d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:26.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.620+0000 7ffb077fe700 1 --2- 172.21.15.81:0/707875761 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb081571a0 0x7ffb0815d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:26.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.620+0000 7ffb077fe700 1 -- 172.21.15.81:0/707875761 >> v1:172.21.15.83:6789/0 conn(0x7ffb080b22f0 legacy=0x7ffb08156a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:26.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.620+0000 7ffb077fe700 1 -- 172.21.15.81:0/707875761 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb0815a650 con 0x7ffb080b1f20 2023-10-06T03:25:26.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.620+0000 7ffb07fff700 1 --2- 172.21.15.81:0/707875761 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb081571a0 0x7ffb0815d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:25:26.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.620+0000 7ffb067fc700 1 -- 172.21.15.81:0/707875761 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4248893083 0 0) 0x7ffb0815a930 con 0x7ffb080b22f0 2023-10-06T03:25:26.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.621+0000 7ffb077fe700 1 --2- 172.21.15.81:0/707875761 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb080b1f20 0x7ffb081599b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ffaf80098e0 tx=0x7ffaf80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb13a67501dfc016 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:26.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.621+0000 7ffb067fc700 1 -- 172.21.15.81:0/707875761 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf800b640 con 0x7ffb080b1f20 2023-10-06T03:25:26.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.621+0000 7ffb067fc700 1 -- 172.21.15.81:0/707875761 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaf800b7a0 con 0x7ffb080b1f20 2023-10-06T03:25:26.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.621+0000 7ffb067fc700 1 -- 172.21.15.81:0/707875761 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf800bb40 con 0x7ffb080b1f20 2023-10-06T03:25:26.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.621+0000 7ffb0c99d700 1 -- 172.21.15.81:0/707875761 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb080b1f20 msgr2=0x7ffb081599b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:26.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.621+0000 7ffb0c99d700 1 --2- 172.21.15.81:0/707875761 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb080b1f20 0x7ffb081599b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ffaf80098e0 tx=0x7ffaf80091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:26.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.621+0000 7ffb0c99d700 1 -- 172.21.15.81:0/707875761 shutdown_connections 2023-10-06T03:25:26.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.621+0000 7ffb0c99d700 1 --2- 172.21.15.81:0/707875761 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb081571a0 0x7ffb0815d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:26.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.621+0000 7ffb0c99d700 1 --2- 172.21.15.81:0/707875761 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb080b1f20 0x7ffb081599b0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:26.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.621+0000 7ffb0c99d700 1 -- 172.21.15.81:0/707875761 >> 172.21.15.81:0/707875761 conn(0x7ffb080698d0 msgr2=0x7ffb08069ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:26.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.621+0000 7ffb0c99d700 1 -- 172.21.15.81:0/707875761 shutdown_connections 2023-10-06T03:25:26.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.622+0000 7ffb0c99d700 1 -- 172.21.15.81:0/707875761 wait complete. 2023-10-06T03:25:26.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.623+0000 7ffb0c99d700 1 Processor -- start 2023-10-06T03:25:26.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.623+0000 7ffb0c99d700 1 -- start start 2023-10-06T03:25:26.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.624+0000 7ffb0c99d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb080b1f20 0x7ffb0814bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:26.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.624+0000 7ffb0c99d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb080b22f0 0x7ffb080cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:26.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.624+0000 7ffb0c99d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb081571a0 0x7ffb080c8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:26.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.624+0000 7ffb0c99d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb080cc240 con 0x7ffb080b1f20 2023-10-06T03:25:26.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.624+0000 7ffb0c99d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb080cb630 con 0x7ffb081571a0 2023-10-06T03:25:26.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.624+0000 7ffb0c99d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb080cb910 con 0x7ffb080b22f0 2023-10-06T03:25:26.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.624+0000 7ffb077fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb080b1f20 0x7ffb0814bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:26.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.624+0000 7ffb077fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb080b1f20 0x7ffb0814bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35550/0 (socket says 172.21.15.81:35550) 2023-10-06T03:25:26.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.624+0000 7ffb077fe700 1 -- 172.21.15.81:0/424435911 learned_addr learned my addr 172.21.15.81:0/424435911 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:26.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.624+0000 7ffb06ffd700 1 --2- 172.21.15.81:0/424435911 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb080b22f0 0x7ffb080cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:26.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.624+0000 7ffb07fff700 1 --2- 172.21.15.81:0/424435911 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb081571a0 0x7ffb080c8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:26.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.625+0000 7ffb077fe700 1 -- 172.21.15.81:0/424435911 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb080b22f0 msgr2=0x7ffb080cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:26.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.625+0000 7ffb077fe700 1 --2- 172.21.15.81:0/424435911 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb080b22f0 0x7ffb080cabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:26.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.625+0000 7ffb077fe700 1 -- 172.21.15.81:0/424435911 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb081571a0 msgr2=0x7ffb080c8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:26.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.625+0000 7ffb077fe700 1 --2- 172.21.15.81:0/424435911 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb081571a0 0x7ffb080c8060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:26.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.625+0000 7ffb077fe700 1 -- 172.21.15.81:0/424435911 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb00009ae0 con 0x7ffb080b1f20 2023-10-06T03:25:26.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.625+0000 7ffb077fe700 1 --2- 172.21.15.81:0/424435911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb080b1f20 0x7ffb0814bcb0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ffaf80093f0 tx=0x7ffaf8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:26.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.625+0000 7ffaef7fe700 1 -- 172.21.15.81:0/424435911 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf800bb20 con 0x7ffb080b1f20 2023-10-06T03:25:26.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.625+0000 7ffaef7fe700 1 -- 172.21.15.81:0/424435911 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaf8000c90 con 0x7ffb080b1f20 2023-10-06T03:25:26.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.625+0000 7ffaef7fe700 1 -- 172.21.15.81:0/424435911 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf8011650 con 0x7ffb080b1f20 2023-10-06T03:25:26.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.625+0000 7ffb0c99d700 1 -- 172.21.15.81:0/424435911 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaf8009420 con 0x7ffb080b1f20 2023-10-06T03:25:26.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.625+0000 7ffb0c99d700 1 -- 172.21.15.81:0/424435911 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb080cbed0 con 0x7ffb080b1f20 2023-10-06T03:25:26.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.626+0000 7ffb0c99d700 1 -- 172.21.15.81:0/424435911 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffb0804c3c0 con 0x7ffb080b1f20 2023-10-06T03:25:26.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.627+0000 7ffaef7fe700 1 -- 172.21.15.81:0/424435911 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffaf8011a40 con 0x7ffb080b1f20 2023-10-06T03:25:26.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.628+0000 7ffaef7fe700 1 --2- 172.21.15.81:0/424435911 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ffaf4066f30 0x7ffaf40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:26.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.628+0000 7ffaef7fe700 1 -- 172.21.15.81:0/424435911 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5698+0+0 (secure 0 0 0) 0x7ffaf8085e70 con 0x7ffb080b1f20 2023-10-06T03:25:26.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.628+0000 7ffb06ffd700 1 --2- 172.21.15.81:0/424435911 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ffaf4066f30 0x7ffaf40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:26.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.628+0000 7ffaef7fe700 1 --2- 172.21.15.81:0/424435911 >> [v2:172.21.15.83:6824/85818,v1:172.21.15.83:6825/85818] conn(0x7ffaf406d8f0 0x7ffaf406fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:26.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.628+0000 7ffaef7fe700 1 -- 172.21.15.81:0/424435911 --> [v2:172.21.15.83:6824/85818,v1:172.21.15.83:6825/85818] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffaf40703f0 con 0x7ffaf406d8f0 2023-10-06T03:25:26.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.628+0000 7ffaef7fe700 1 -- 172.21.15.81:0/424435911 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffaf8088370 con 0x7ffb080b1f20 2023-10-06T03:25:26.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.629+0000 7ffb06ffd700 1 --2- 172.21.15.81:0/424435911 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ffaf4066f30 0x7ffaf40693e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ffb0816c910 tx=0x7ffafc007d50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:26.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.629+0000 7ffb07fff700 1 --2- 172.21.15.81:0/424435911 >> [v2:172.21.15.83:6824/85818,v1:172.21.15.83:6825/85818] conn(0x7ffaf406d8f0 0x7ffaf406fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:26.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.629+0000 7ffb07fff700 1 --2- 172.21.15.81:0/424435911 >> [v2:172.21.15.83:6824/85818,v1:172.21.15.83:6825/85818] conn(0x7ffaf406d8f0 0x7ffaf406fd20 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:26.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.630+0000 7ffaef7fe700 1 -- 172.21.15.81:0/424435911 <== osd.5 v2:172.21.15.83:6824/85818 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7ffaf40703f0 con 0x7ffaf406d8f0 2023-10-06T03:25:26.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.644+0000 7ffb0c99d700 1 -- 172.21.15.81:0/424435911 --> [v2:172.21.15.83:6824/85818,v1:172.21.15.83:6825/85818] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ffb080b34d0 con 0x7ffaf406d8f0 2023-10-06T03:25:26.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.645+0000 7ffaef7fe700 1 -- 172.21.15.81:0/424435911 <== osd.5 v2:172.21.15.83:6824/85818 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ffb080b34d0 con 0x7ffaf406d8f0 2023-10-06T03:25:26.646 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T03:25:26.646 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:25:26.646 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T03:25:26.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.645+0000 7ffb0c99d700 1 -- 172.21.15.81:0/424435911 >> [v2:172.21.15.83:6824/85818,v1:172.21.15.83:6825/85818] conn(0x7ffaf406d8f0 msgr2=0x7ffaf406fd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:26.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.645+0000 7ffb0c99d700 1 --2- 172.21.15.81:0/424435911 >> [v2:172.21.15.83:6824/85818,v1:172.21.15.83:6825/85818] conn(0x7ffaf406d8f0 0x7ffaf406fd20 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:26.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.646+0000 7ffb0c99d700 1 -- 172.21.15.81:0/424435911 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ffaf4066f30 msgr2=0x7ffaf40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:26.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.646+0000 7ffb0c99d700 1 --2- 172.21.15.81:0/424435911 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7ffaf4066f30 0x7ffaf40693e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ffb0816c910 tx=0x7ffafc007d50 comp rx=0 tx=0).stop 2023-10-06T03:25:26.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.646+0000 7ffb0c99d700 1 -- 172.21.15.81:0/424435911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb080b1f20 msgr2=0x7ffb0814bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:26.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.646+0000 7ffb0c99d700 1 --2- 172.21.15.81:0/424435911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb080b1f20 0x7ffb0814bcb0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ffaf80093f0 tx=0x7ffaf8017000 comp rx=0 tx=0).stop 2023-10-06T03:25:26.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.646+0000 7ffb07fff700 1 -- 172.21.15.81:0/424435911 reap_dead start 2023-10-06T03:25:26.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.646+0000 7ffb0c99d700 1 -- 172.21.15.81:0/424435911 shutdown_connections 2023-10-06T03:25:26.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.646+0000 7ffb0c99d700 1 -- 172.21.15.81:0/424435911 >> 172.21.15.81:0/424435911 conn(0x7ffb080698d0 msgr2=0x7ffb08155fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:26.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.646+0000 7ffb0c99d700 1 -- 172.21.15.81:0/424435911 shutdown_connections 2023-10-06T03:25:26.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.646+0000 7ffb0c99d700 1 -- 172.21.15.81:0/424435911 wait complete. 2023-10-06T03:25:26.663 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-06T03:25:26.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.843+0000 7fc017dff700 1 Processor -- start 2023-10-06T03:25:26.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.843+0000 7fc017dff700 1 -- start start 2023-10-06T03:25:26.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.845+0000 7fc017dff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc01006d680 0x7fc0100c6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:26.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.845+0000 7fc017dff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc01006da50 0x7fc0100c7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:26.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.845+0000 7fc017dff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc01006a190 con 0x7fc0100aee50 2023-10-06T03:25:26.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.845+0000 7fc017dff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc010069650 con 0x7fc01006d680 2023-10-06T03:25:26.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.845+0000 7fc017dff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc010069860 con 0x7fc01006da50 2023-10-06T03:25:26.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.845+0000 7fc015b9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc01006d680 0x7fc0100c6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:26.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.845+0000 7fc01639c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc0100aee50 0x7fc010140710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39752/0 (socket says 172.21.15.81:39752) 2023-10-06T03:25:26.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.845+0000 7fc01639c700 1 -- 172.21.15.81:0/505251964 learned_addr learned my addr 172.21.15.81:0/505251964 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:25:26.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.845+0000 7fc01539a700 1 --2- 172.21.15.81:0/505251964 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc01006da50 0x7fc0100c7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:26.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.845+0000 7fc014b99700 1 -- 172.21.15.81:0/505251964 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3230814258 0 0) 0x7fc01006a190 con 0x7fc0100aee50 2023-10-06T03:25:26.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.845+0000 7fc015b9b700 1 -- 172.21.15.81:0/505251964 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc01006da50 msgr2=0x7fc0100c7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:26.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.845+0000 7fc015b9b700 1 --2- 172.21.15.81:0/505251964 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc01006da50 0x7fc0100c7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:26.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.845+0000 7fc015b9b700 1 -- 172.21.15.81:0/505251964 >> v1:172.21.15.81:6789/0 conn(0x7fc0100aee50 legacy=0x7fc010140710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:26.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.845+0000 7fc015b9b700 1 -- 172.21.15.81:0/505251964 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc010069b40 con 0x7fc01006d680 2023-10-06T03:25:26.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.846+0000 7fc015b9b700 1 --2- 172.21.15.81:0/505251964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc01006d680 0x7fc0100c6b10 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fc00c0098e0 tx=0x7fc00c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8c8f7bfe0e23bf2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:26.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.846+0000 7fc014b99700 1 -- 172.21.15.81:0/505251964 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00c00b640 con 0x7fc01006d680 2023-10-06T03:25:26.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.846+0000 7fc014b99700 1 -- 172.21.15.81:0/505251964 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc00c00b7a0 con 0x7fc01006d680 2023-10-06T03:25:26.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.846+0000 7fc014b99700 1 -- 172.21.15.81:0/505251964 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00c00bb40 con 0x7fc01006d680 2023-10-06T03:25:26.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.846+0000 7fc017dff700 1 -- 172.21.15.81:0/505251964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc01006d680 msgr2=0x7fc0100c6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:26.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.846+0000 7fc017dff700 1 --2- 172.21.15.81:0/505251964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc01006d680 0x7fc0100c6b10 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fc00c0098e0 tx=0x7fc00c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:26.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.847+0000 7fc017dff700 1 -- 172.21.15.81:0/505251964 shutdown_connections 2023-10-06T03:25:26.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.847+0000 7fc017dff700 1 --2- 172.21.15.81:0/505251964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc01006d680 0x7fc0100c6b10 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:26.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.847+0000 7fc017dff700 1 --2- 172.21.15.81:0/505251964 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc01006da50 0x7fc0100c7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:26.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.847+0000 7fc017dff700 1 -- 172.21.15.81:0/505251964 >> 172.21.15.81:0/505251964 conn(0x7fc0100cc090 msgr2=0x7fc0100cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:26.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.847+0000 7fc017dff700 1 -- 172.21.15.81:0/505251964 shutdown_connections 2023-10-06T03:25:26.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.847+0000 7fc017dff700 1 -- 172.21.15.81:0/505251964 wait complete. 2023-10-06T03:25:26.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.848+0000 7fc017dff700 1 Processor -- start 2023-10-06T03:25:26.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.848+0000 7fc017dff700 1 -- start start 2023-10-06T03:25:26.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.849+0000 7fc017dff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc01006d680 0x7fc0100ae1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:26.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.849+0000 7fc017dff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc01006da50 0x7fc010157020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:26.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.849+0000 7fc017dff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0100aee50 0x7fc01015c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:26.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.849+0000 7fc017dff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0100ab690 con 0x7fc0100aee50 2023-10-06T03:25:26.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.849+0000 7fc017dff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01015afd0 con 0x7fc01006d680 2023-10-06T03:25:26.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.849+0000 7fc017dff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc01015b2b0 con 0x7fc01006da50 2023-10-06T03:25:26.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.849+0000 7fc01639c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0100aee50 0x7fc01015c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:26.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.849+0000 7fc01639c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0100aee50 0x7fc01015c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35574/0 (socket says 172.21.15.81:35574) 2023-10-06T03:25:26.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.849+0000 7fc01639c700 1 -- 172.21.15.81:0/2678868663 learned_addr learned my addr 172.21.15.81:0/2678868663 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:26.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.850+0000 7fc01539a700 1 --2- 172.21.15.81:0/2678868663 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc01006da50 0x7fc010157020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:26.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.850+0000 7fc015b9b700 1 --2- 172.21.15.81:0/2678868663 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc01006d680 0x7fc0100ae1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:26.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.850+0000 7fc01639c700 1 -- 172.21.15.81:0/2678868663 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc01006da50 msgr2=0x7fc010157020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:26.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.850+0000 7fc01639c700 1 --2- 172.21.15.81:0/2678868663 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc01006da50 0x7fc010157020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:26.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.850+0000 7fc01639c700 1 -- 172.21.15.81:0/2678868663 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc01006d680 msgr2=0x7fc0100ae1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:26.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.850+0000 7fc01639c700 1 --2- 172.21.15.81:0/2678868663 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc01006d680 0x7fc0100ae1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:26.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.850+0000 7fc01639c700 1 -- 172.21.15.81:0/2678868663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc00c009420 con 0x7fc0100aee50 2023-10-06T03:25:26.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.850+0000 7fc015b9b700 1 --2- 172.21.15.81:0/2678868663 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc01006d680 0x7fc0100ae1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:26.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.850+0000 7fc01639c700 1 --2- 172.21.15.81:0/2678868663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0100aee50 0x7fc01015c040 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fc00800cc90 tx=0x7fc008001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:26.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.850+0000 7fc005ffb700 1 -- 172.21.15.81:0/2678868663 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00800cea0 con 0x7fc0100aee50 2023-10-06T03:25:26.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.850+0000 7fc005ffb700 1 -- 172.21.15.81:0/2678868663 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc00800ab70 con 0x7fc0100aee50 2023-10-06T03:25:26.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.850+0000 7fc017dff700 1 -- 172.21.15.81:0/2678868663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc01015b590 con 0x7fc0100aee50 2023-10-06T03:25:26.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.850+0000 7fc005ffb700 1 -- 172.21.15.81:0/2678868663 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0080070f0 con 0x7fc0100aee50 2023-10-06T03:25:26.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.850+0000 7fc017dff700 1 -- 172.21.15.81:0/2678868663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc010157560 con 0x7fc0100aee50 2023-10-06T03:25:26.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.851+0000 7fc017dff700 1 -- 172.21.15.81:0/2678868663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc01004c3c0 con 0x7fc0100aee50 2023-10-06T03:25:26.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.852+0000 7fc005ffb700 1 -- 172.21.15.81:0/2678868663 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc008007460 con 0x7fc0100aee50 2023-10-06T03:25:26.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.853+0000 7fc005ffb700 1 --2- 172.21.15.81:0/2678868663 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fbff4066f30 0x7fbff40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:26.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.853+0000 7fc005ffb700 1 -- 172.21.15.81:0/2678868663 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5698+0+0 (secure 0 0 0) 0x7fc008084970 con 0x7fc0100aee50 2023-10-06T03:25:26.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.853+0000 7fc015b9b700 1 --2- 172.21.15.81:0/2678868663 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fbff4066f30 0x7fbff40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:26.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.854+0000 7fc015b9b700 1 --2- 172.21.15.81:0/2678868663 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fbff4066f30 0x7fbff40693e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc00c00a010 tx=0x7fc00c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:26.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:26.858+0000 7fc005ffb700 1 -- 172.21.15.81:0/2678868663 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc008051c60 con 0x7fc0100aee50 2023-10-06T03:25:27.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.049+0000 7fc017dff700 1 -- 172.21.15.81:0/2678868663 --> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fc010069e20 con 0x7fbff4066f30 2023-10-06T03:25:27.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.050+0000 7fc005ffb700 1 -- 172.21.15.81:0/2678868663 <== mgr.4100 v2:172.21.15.81:6832/85286 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc010069e20 con 0x7fbff4066f30 2023-10-06T03:25:27.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.052+0000 7fc017dff700 1 -- 172.21.15.81:0/2678868663 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fbff4066f30 msgr2=0x7fbff40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:27.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.052+0000 7fc017dff700 1 --2- 172.21.15.81:0/2678868663 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fbff4066f30 0x7fbff40693e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc00c00a010 tx=0x7fc00c017000 comp rx=0 tx=0).stop 2023-10-06T03:25:27.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.052+0000 7fc017dff700 1 -- 172.21.15.81:0/2678868663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0100aee50 msgr2=0x7fc01015c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:27.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.052+0000 7fc017dff700 1 --2- 172.21.15.81:0/2678868663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0100aee50 0x7fc01015c040 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fc00800cc90 tx=0x7fc008001a80 comp rx=0 tx=0).stop 2023-10-06T03:25:27.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.052+0000 7fc017dff700 1 -- 172.21.15.81:0/2678868663 shutdown_connections 2023-10-06T03:25:27.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.052+0000 7fc017dff700 1 --2- 172.21.15.81:0/2678868663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0100aee50 0x7fc01015c040 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.052+0000 7fc017dff700 1 --2- 172.21.15.81:0/2678868663 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc01006d680 0x7fc0100ae1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.052+0000 7fc017dff700 1 --2- 172.21.15.81:0/2678868663 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fbff4066f30 0x7fbff40693e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.052+0000 7fc017dff700 1 --2- 172.21.15.81:0/2678868663 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc01006da50 0x7fc010157020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.052+0000 7fc017dff700 1 -- 172.21.15.81:0/2678868663 >> 172.21.15.81:0/2678868663 conn(0x7fc0100cc090 msgr2=0x7fc01013d550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:27.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.052+0000 7fc017dff700 1 -- 172.21.15.81:0/2678868663 shutdown_connections 2023-10-06T03:25:27.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.052+0000 7fc017dff700 1 -- 172.21.15.81:0/2678868663 wait complete. 2023-10-06T03:25:27.055 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 5 to deep-scrub 2023-10-06T03:25:27.072 INFO:tasks.ceph:Scrubbing osd.6 2023-10-06T03:25:27.240 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:25:27.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.424+0000 7fb2689fe700 1 Processor -- start 2023-10-06T03:25:27.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.424+0000 7fb2689fe700 1 -- start start 2023-10-06T03:25:27.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.425+0000 7fb2689fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb264159720 0x7fb2640cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:27.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.425+0000 7fb2689fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb264159af0 0x7fb2640cb130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:27.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.425+0000 7fb2689fe700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2640c6980 con 0x7fb264155400 2023-10-06T03:25:27.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.425+0000 7fb2689fe700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2640aba30 con 0x7fb264159720 2023-10-06T03:25:27.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.425+0000 7fb2689fe700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2640c6f40 con 0x7fb264159af0 2023-10-06T03:25:27.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.425+0000 7fb262d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb264159720 0x7fb2640cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:27.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.425+0000 7fb262d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb264159720 0x7fb2640cabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35582/0 (socket says 172.21.15.81:35582) 2023-10-06T03:25:27.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.425+0000 7fb262d9d700 1 -- 172.21.15.81:0/2669551052 learned_addr learned my addr 172.21.15.81:0/2669551052 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:27.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.426+0000 7fb26259c700 1 --2- 172.21.15.81:0/2669551052 >> v2:172.21.15.83:3300/0 conn(0x7fb264159af0 0x7fb2640cb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:27.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.426+0000 7fb262d9d700 1 -- 172.21.15.81:0/2669551052 >> v2:172.21.15.83:3300/0 conn(0x7fb264159af0 msgr2=0x7fb2640cb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:27.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.426+0000 7fb262d9d700 1 --2- 172.21.15.81:0/2669551052 >> v2:172.21.15.83:3300/0 conn(0x7fb264159af0 0x7fb2640cb130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.426+0000 7fb262d9d700 1 -- 172.21.15.81:0/2669551052 >> v1:172.21.15.83:6789/0 conn(0x7fb264155400 legacy=0x7fb264155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:27.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.426+0000 7fb262d9d700 1 -- 172.21.15.81:0/2669551052 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2640cb710 con 0x7fb264159720 2023-10-06T03:25:27.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.426+0000 7fb262d9d700 1 --2- 172.21.15.81:0/2669551052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb264159720 0x7fb2640cabf0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fb2640c2e00 tx=0x7fb25400a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39534733af82ef22 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:27.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.426+0000 7fb261d9b700 1 -- 172.21.15.81:0/2669551052 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25400f070 con 0x7fb264159720 2023-10-06T03:25:27.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.426+0000 7fb261d9b700 1 -- 172.21.15.81:0/2669551052 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb25400a2e0 con 0x7fb264159720 2023-10-06T03:25:27.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.426+0000 7fb261d9b700 1 -- 172.21.15.81:0/2669551052 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25400cd30 con 0x7fb264159720 2023-10-06T03:25:27.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.427+0000 7fb2689fe700 1 -- 172.21.15.81:0/2669551052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb264159720 msgr2=0x7fb2640cabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:27.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.427+0000 7fb2689fe700 1 --2- 172.21.15.81:0/2669551052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb264159720 0x7fb2640cabf0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fb2640c2e00 tx=0x7fb25400a950 comp rx=0 tx=0).stop 2023-10-06T03:25:27.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.427+0000 7fb2689fe700 1 -- 172.21.15.81:0/2669551052 shutdown_connections 2023-10-06T03:25:27.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.427+0000 7fb2689fe700 1 --2- 172.21.15.81:0/2669551052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb264159720 0x7fb2640cabf0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.427+0000 7fb2689fe700 1 --2- 172.21.15.81:0/2669551052 >> v2:172.21.15.83:3300/0 conn(0x7fb264159af0 0x7fb2640cb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.427+0000 7fb2689fe700 1 -- 172.21.15.81:0/2669551052 >> 172.21.15.81:0/2669551052 conn(0x7fb2640cbe80 msgr2=0x7fb2640cc280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:27.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.427+0000 7fb2689fe700 1 -- 172.21.15.81:0/2669551052 shutdown_connections 2023-10-06T03:25:27.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.427+0000 7fb2689fe700 1 -- 172.21.15.81:0/2669551052 wait complete. 2023-10-06T03:25:27.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.428+0000 7fb2689fe700 1 Processor -- start 2023-10-06T03:25:27.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.429+0000 7fb2689fe700 1 -- start start 2023-10-06T03:25:27.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.429+0000 7fb2689fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb264155400 0x7fb26414e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:27.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.429+0000 7fb2689fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb264159720 0x7fb2641586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:27.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.430+0000 7fb2689fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb264159af0 0x7fb2640c2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:27.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.430+0000 7fb2689fe700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26414e760 con 0x7fb264155400 2023-10-06T03:25:27.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.430+0000 7fb2689fe700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2640c5360 con 0x7fb264159af0 2023-10-06T03:25:27.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.430+0000 7fb2689fe700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2640c4790 con 0x7fb264159720 2023-10-06T03:25:27.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.430+0000 7fb262d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb264155400 0x7fb26414e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:27.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.430+0000 7fb262d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb264155400 0x7fb26414e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35590/0 (socket says 172.21.15.81:35590) 2023-10-06T03:25:27.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.430+0000 7fb262d9d700 1 -- 172.21.15.81:0/2687230601 learned_addr learned my addr 172.21.15.81:0/2687230601 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:27.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.430+0000 7fb262d9d700 1 -- 172.21.15.81:0/2687230601 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb264159720 msgr2=0x7fb2641586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:27.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.430+0000 7fb262d9d700 1 --2- 172.21.15.81:0/2687230601 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb264159720 0x7fb2641586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.430+0000 7fb262d9d700 1 -- 172.21.15.81:0/2687230601 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb264159af0 msgr2=0x7fb2640c2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:27.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.430+0000 7fb262d9d700 1 --2- 172.21.15.81:0/2687230601 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb264159af0 0x7fb2640c2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.430+0000 7fb262d9d700 1 -- 172.21.15.81:0/2687230601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb25400abf0 con 0x7fb264155400 2023-10-06T03:25:27.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.430+0000 7fb262d9d700 1 --2- 172.21.15.81:0/2687230601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb264155400 0x7fb26414e220 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb25400c740 tx=0x7fb254019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:27.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.431+0000 7fb24affd700 1 -- 172.21.15.81:0/2687230601 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb254008930 con 0x7fb264155400 2023-10-06T03:25:27.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.431+0000 7fb24affd700 1 -- 172.21.15.81:0/2687230601 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb254008a90 con 0x7fb264155400 2023-10-06T03:25:27.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.431+0000 7fb24affd700 1 -- 172.21.15.81:0/2687230601 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb254008e50 con 0x7fb264155400 2023-10-06T03:25:27.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.431+0000 7fb2689fe700 1 -- 172.21.15.81:0/2687230601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2640c4a30 con 0x7fb264155400 2023-10-06T03:25:27.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.431+0000 7fb2689fe700 1 -- 172.21.15.81:0/2687230601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2640c4ff0 con 0x7fb264155400 2023-10-06T03:25:27.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.432+0000 7fb2689fe700 1 -- 172.21.15.81:0/2687230601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb26404c3c0 con 0x7fb264155400 2023-10-06T03:25:27.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.433+0000 7fb24affd700 1 -- 172.21.15.81:0/2687230601 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb25401d410 con 0x7fb264155400 2023-10-06T03:25:27.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.434+0000 7fb24affd700 1 --2- 172.21.15.81:0/2687230601 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb250066f60 0x7fb250069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:27.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.434+0000 7fb24affd700 1 -- 172.21.15.81:0/2687230601 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5698+0+0 (secure 0 0 0) 0x7fb254086200 con 0x7fb264155400 2023-10-06T03:25:27.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.434+0000 7fb26259c700 1 --2- 172.21.15.81:0/2687230601 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb250066f60 0x7fb250069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:27.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.434+0000 7fb24affd700 1 --2- 172.21.15.81:0/2687230601 >> [v2:172.21.15.83:6809/85787,v1:172.21.15.83:6811/85787] conn(0x7fb25006d920 0x7fb25006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:27.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.434+0000 7fb24affd700 1 -- 172.21.15.81:0/2687230601 --> [v2:172.21.15.83:6809/85787,v1:172.21.15.83:6811/85787] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb250070420 con 0x7fb25006d920 2023-10-06T03:25:27.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.434+0000 7fb24affd700 1 -- 172.21.15.81:0/2687230601 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb254088700 con 0x7fb264155400 2023-10-06T03:25:27.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.434+0000 7fb26259c700 1 --2- 172.21.15.81:0/2687230601 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb250066f60 0x7fb250069410 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb264069d60 tx=0x7fb2580091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:27.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.434+0000 7fb26359e700 1 --2- 172.21.15.81:0/2687230601 >> [v2:172.21.15.83:6809/85787,v1:172.21.15.83:6811/85787] conn(0x7fb25006d920 0x7fb25006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:27.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.435+0000 7fb26359e700 1 --2- 172.21.15.81:0/2687230601 >> [v2:172.21.15.83:6809/85787,v1:172.21.15.83:6811/85787] conn(0x7fb25006d920 0x7fb25006fd50 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:27.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.436+0000 7fb24affd700 1 -- 172.21.15.81:0/2687230601 <== osd.6 v2:172.21.15.83:6809/85787 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fb250070420 con 0x7fb25006d920 2023-10-06T03:25:27.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.450+0000 7fb2689fe700 1 -- 172.21.15.81:0/2687230601 --> [v2:172.21.15.83:6809/85787,v1:172.21.15.83:6811/85787] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb2640cb9f0 con 0x7fb25006d920 2023-10-06T03:25:27.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.451+0000 7fb24affd700 1 -- 172.21.15.81:0/2687230601 <== osd.6 v2:172.21.15.83:6809/85787 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb2640cb9f0 con 0x7fb25006d920 2023-10-06T03:25:27.452 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T03:25:27.452 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:25:27.452 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T03:25:27.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.451+0000 7fb2689fe700 1 -- 172.21.15.81:0/2687230601 >> [v2:172.21.15.83:6809/85787,v1:172.21.15.83:6811/85787] conn(0x7fb25006d920 msgr2=0x7fb25006fd50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:27.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.451+0000 7fb2689fe700 1 --2- 172.21.15.81:0/2687230601 >> [v2:172.21.15.83:6809/85787,v1:172.21.15.83:6811/85787] conn(0x7fb25006d920 0x7fb25006fd50 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.452+0000 7fb2689fe700 1 -- 172.21.15.81:0/2687230601 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb250066f60 msgr2=0x7fb250069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:27.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.452+0000 7fb2689fe700 1 --2- 172.21.15.81:0/2687230601 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7fb250066f60 0x7fb250069410 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb264069d60 tx=0x7fb2580091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.452+0000 7fb2689fe700 1 -- 172.21.15.81:0/2687230601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb264155400 msgr2=0x7fb26414e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:27.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.452+0000 7fb2689fe700 1 --2- 172.21.15.81:0/2687230601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb264155400 0x7fb26414e220 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb25400c740 tx=0x7fb254019000 comp rx=0 tx=0).stop 2023-10-06T03:25:27.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.452+0000 7fb26359e700 1 -- 172.21.15.81:0/2687230601 reap_dead start 2023-10-06T03:25:27.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.452+0000 7fb2689fe700 1 -- 172.21.15.81:0/2687230601 shutdown_connections 2023-10-06T03:25:27.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.452+0000 7fb2689fe700 1 -- 172.21.15.81:0/2687230601 >> 172.21.15.81:0/2687230601 conn(0x7fb2640cbe80 msgr2=0x7fb2640adfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:27.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.452+0000 7fb2689fe700 1 -- 172.21.15.81:0/2687230601 shutdown_connections 2023-10-06T03:25:27.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.452+0000 7fb2689fe700 1 -- 172.21.15.81:0/2687230601 wait complete. 2023-10-06T03:25:27.469 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-06T03:25:27.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.651+0000 7f0d4a99d700 1 Processor -- start 2023-10-06T03:25:27.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.651+0000 7f0d4a99d700 1 -- start start 2023-10-06T03:25:27.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.653+0000 7f0d4a99d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0d44159340 0x7f0d440ab4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:27.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.653+0000 7f0d4a99d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f0d44159710 0x7f0d4415d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:27.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.653+0000 7f0d4a99d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d440aaa60 con 0x7f0d4415d6c0 2023-10-06T03:25:27.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.653+0000 7f0d4a99d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d4415dc40 con 0x7f0d44159340 2023-10-06T03:25:27.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.653+0000 7f0d4a99d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d4415df20 con 0x7f0d44159710 2023-10-06T03:25:27.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.653+0000 7f0d4999b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0d44159340 0x7f0d440ab4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:27.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.653+0000 7f0d4a19c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0d4415d6c0 0x7f0d440685f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39764/0 (socket says 172.21.15.81:39764) 2023-10-06T03:25:27.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.653+0000 7f0d4a19c700 1 -- 172.21.15.81:0/3972308488 learned_addr learned my addr 172.21.15.81:0/3972308488 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:25:27.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.653+0000 7f0d4919a700 1 --2- 172.21.15.81:0/3972308488 >> v2:172.21.15.83:3300/0 conn(0x7f0d44159710 0x7f0d4415d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:27.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.653+0000 7f0d4999b700 1 -- 172.21.15.81:0/3972308488 >> v2:172.21.15.83:3300/0 conn(0x7f0d44159710 msgr2=0x7f0d4415d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:27.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.653+0000 7f0d4999b700 1 --2- 172.21.15.81:0/3972308488 >> v2:172.21.15.83:3300/0 conn(0x7f0d44159710 0x7f0d4415d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.653+0000 7f0d4999b700 1 -- 172.21.15.81:0/3972308488 >> v1:172.21.15.81:6789/0 conn(0x7f0d4415d6c0 legacy=0x7f0d440685f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:27.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.653+0000 7f0d4999b700 1 -- 172.21.15.81:0/3972308488 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d440aacb0 con 0x7f0d44159340 2023-10-06T03:25:27.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.653+0000 7f0d48999700 1 -- 172.21.15.81:0/3972308488 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3208617332 0 0) 0x7f0d440aaa60 con 0x7f0d4415d6c0 2023-10-06T03:25:27.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.654+0000 7f0d4999b700 1 --2- 172.21.15.81:0/3972308488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d44159340 0x7f0d440ab4b0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f0d4406e9f0 tx=0x7f0d400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68f2ebce24e44771 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:27.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.654+0000 7f0d48999700 1 -- 172.21.15.81:0/3972308488 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4000b6b0 con 0x7f0d44159340 2023-10-06T03:25:27.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.654+0000 7f0d48999700 1 -- 172.21.15.81:0/3972308488 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d4000b810 con 0x7f0d44159340 2023-10-06T03:25:27.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.654+0000 7f0d48999700 1 -- 172.21.15.81:0/3972308488 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4000bbb0 con 0x7f0d44159340 2023-10-06T03:25:27.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.654+0000 7f0d4a99d700 1 -- 172.21.15.81:0/3972308488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d44159340 msgr2=0x7f0d440ab4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:27.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.654+0000 7f0d4a99d700 1 --2- 172.21.15.81:0/3972308488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d44159340 0x7f0d440ab4b0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f0d4406e9f0 tx=0x7f0d400091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.655+0000 7f0d4a99d700 1 -- 172.21.15.81:0/3972308488 shutdown_connections 2023-10-06T03:25:27.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.655+0000 7f0d4a99d700 1 --2- 172.21.15.81:0/3972308488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d44159340 0x7f0d440ab4b0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.655+0000 7f0d4a99d700 1 --2- 172.21.15.81:0/3972308488 >> v2:172.21.15.83:3300/0 conn(0x7f0d44159710 0x7f0d4415d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.655+0000 7f0d4a99d700 1 -- 172.21.15.81:0/3972308488 >> 172.21.15.81:0/3972308488 conn(0x7f0d4406db80 msgr2=0x7f0d4406df80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:27.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.655+0000 7f0d4a99d700 1 -- 172.21.15.81:0/3972308488 shutdown_connections 2023-10-06T03:25:27.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.655+0000 7f0d4a99d700 1 -- 172.21.15.81:0/3972308488 wait complete. 2023-10-06T03:25:27.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.656+0000 7f0d4a99d700 1 Processor -- start 2023-10-06T03:25:27.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.656+0000 7f0d4a99d700 1 -- start start 2023-10-06T03:25:27.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.657+0000 7f0d4a99d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d44159340 0x7f0d44169e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:27.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.657+0000 7f0d4a99d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0d44159710 0x7f0d440c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:27.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.657+0000 7f0d4a99d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0d4415d6c0 0x7f0d44147290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:27.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.657+0000 7f0d4a99d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d440ca4a0 con 0x7f0d44159340 2023-10-06T03:25:27.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.657+0000 7f0d4a99d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d440cb2e0 con 0x7f0d44159710 2023-10-06T03:25:27.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.657+0000 7f0d4a99d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d441477d0 con 0x7f0d4415d6c0 2023-10-06T03:25:27.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.657+0000 7f0d4999b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d44159340 0x7f0d44169e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:27.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.657+0000 7f0d4999b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d44159340 0x7f0d44169e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35604/0 (socket says 172.21.15.81:35604) 2023-10-06T03:25:27.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.657+0000 7f0d4999b700 1 -- 172.21.15.81:0/1286826858 learned_addr learned my addr 172.21.15.81:0/1286826858 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:27.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.657+0000 7f0d4919a700 1 --2- 172.21.15.81:0/1286826858 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0d44159710 0x7f0d440c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:27.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.657+0000 7f0d4a19c700 1 --2- 172.21.15.81:0/1286826858 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0d4415d6c0 0x7f0d44147290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:27.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.658+0000 7f0d4999b700 1 -- 172.21.15.81:0/1286826858 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0d4415d6c0 msgr2=0x7f0d44147290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:27.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.658+0000 7f0d4999b700 1 --2- 172.21.15.81:0/1286826858 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0d4415d6c0 0x7f0d44147290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.658+0000 7f0d4999b700 1 -- 172.21.15.81:0/1286826858 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0d44159710 msgr2=0x7f0d440c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:27.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.658+0000 7f0d4999b700 1 --2- 172.21.15.81:0/1286826858 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0d44159710 0x7f0d440c9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.658+0000 7f0d4999b700 1 -- 172.21.15.81:0/1286826858 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d40009420 con 0x7f0d44159340 2023-10-06T03:25:27.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.658+0000 7f0d4999b700 1 --2- 172.21.15.81:0/1286826858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d44159340 0x7f0d44169e10 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f0d440691e0 tx=0x7f0d40017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:27.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.658+0000 7f0d39ffb700 1 -- 172.21.15.81:0/1286826858 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d40011420 con 0x7f0d44159340 2023-10-06T03:25:27.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.658+0000 7f0d39ffb700 1 -- 172.21.15.81:0/1286826858 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d40011580 con 0x7f0d44159340 2023-10-06T03:25:27.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.658+0000 7f0d4a99d700 1 -- 172.21.15.81:0/1286826858 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d440ca6d0 con 0x7f0d44159340 2023-10-06T03:25:27.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.658+0000 7f0d39ffb700 1 -- 172.21.15.81:0/1286826858 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d40011940 con 0x7f0d44159340 2023-10-06T03:25:27.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.658+0000 7f0d4a99d700 1 -- 172.21.15.81:0/1286826858 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d440cac90 con 0x7f0d44159340 2023-10-06T03:25:27.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.659+0000 7f0d4a99d700 1 -- 172.21.15.81:0/1286826858 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d4406cdc0 con 0x7f0d44159340 2023-10-06T03:25:27.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.660+0000 7f0d39ffb700 1 -- 172.21.15.81:0/1286826858 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0d40011d30 con 0x7f0d44159340 2023-10-06T03:25:27.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.661+0000 7f0d39ffb700 1 --2- 172.21.15.81:0/1286826858 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0d28066f30 0x7f0d280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:27.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.661+0000 7f0d39ffb700 1 -- 172.21.15.81:0/1286826858 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f0d40085950 con 0x7f0d44159340 2023-10-06T03:25:27.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.661+0000 7f0d4919a700 1 --2- 172.21.15.81:0/1286826858 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0d28066f30 0x7f0d280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:27.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.662+0000 7f0d4919a700 1 --2- 172.21.15.81:0/1286826858 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0d28066f30 0x7f0d280693e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0d4406b520 tx=0x7f0d34008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:27.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.665+0000 7f0d39ffb700 1 -- 172.21.15.81:0/1286826858 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0d40052bc0 con 0x7f0d44159340 2023-10-06T03:25:27.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.856+0000 7f0d4a99d700 1 -- 172.21.15.81:0/1286826858 --> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f0d4404bb80 con 0x7f0d28066f30 2023-10-06T03:25:27.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.857+0000 7f0d39ffb700 1 -- 172.21.15.81:0/1286826858 <== mgr.4100 v2:172.21.15.81:6832/85286 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0d4404bb80 con 0x7f0d28066f30 2023-10-06T03:25:27.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.859+0000 7f0d4a99d700 1 -- 172.21.15.81:0/1286826858 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0d28066f30 msgr2=0x7f0d280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:27.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.859+0000 7f0d4a99d700 1 --2- 172.21.15.81:0/1286826858 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0d28066f30 0x7f0d280693e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0d4406b520 tx=0x7f0d34008040 comp rx=0 tx=0).stop 2023-10-06T03:25:27.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.859+0000 7f0d4a99d700 1 -- 172.21.15.81:0/1286826858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d44159340 msgr2=0x7f0d44169e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:27.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.859+0000 7f0d4a99d700 1 --2- 172.21.15.81:0/1286826858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d44159340 0x7f0d44169e10 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f0d440691e0 tx=0x7f0d40017000 comp rx=0 tx=0).stop 2023-10-06T03:25:27.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.859+0000 7f0d4a99d700 1 -- 172.21.15.81:0/1286826858 shutdown_connections 2023-10-06T03:25:27.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.859+0000 7f0d4a99d700 1 --2- 172.21.15.81:0/1286826858 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f0d28066f30 0x7f0d280693e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.859+0000 7f0d4a99d700 1 --2- 172.21.15.81:0/1286826858 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0d4415d6c0 0x7f0d44147290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.859+0000 7f0d4a99d700 1 --2- 172.21.15.81:0/1286826858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d44159340 0x7f0d44169e10 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.859+0000 7f0d4a99d700 1 --2- 172.21.15.81:0/1286826858 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0d44159710 0x7f0d440c9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:27.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.859+0000 7f0d4a99d700 1 -- 172.21.15.81:0/1286826858 >> 172.21.15.81:0/1286826858 conn(0x7f0d4406db80 msgr2=0x7f0d440af820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:27.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.859+0000 7f0d4a99d700 1 -- 172.21.15.81:0/1286826858 shutdown_connections 2023-10-06T03:25:27.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:27.859+0000 7f0d4a99d700 1 -- 172.21.15.81:0/1286826858 wait complete. 2023-10-06T03:25:27.861 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 6 to deep-scrub 2023-10-06T03:25:27.877 INFO:tasks.ceph:Scrubbing osd.7 2023-10-06T03:25:27.877 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:25:28.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.061+0000 7f11153ff700 1 Processor -- start 2023-10-06T03:25:28.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.061+0000 7f11153ff700 1 -- start start 2023-10-06T03:25:28.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.063+0000 7f11153ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f11101557c0 0x7f111006da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:28.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.063+0000 7f11153ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1110155b90 0x7f11100c2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:28.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.063+0000 7f11153ff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f111006ed50 con 0x7f11100c70a0 2023-10-06T03:25:28.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.063+0000 7f11153ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11100c6d10 con 0x7f11101557c0 2023-10-06T03:25:28.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.063+0000 7f11153ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f111006e140 con 0x7f1110155b90 2023-10-06T03:25:28.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.063+0000 7f110f7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f11100c70a0 0x7f1110159620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39780/0 (socket says 172.21.15.81:39780) 2023-10-06T03:25:28.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.063+0000 7f110f7fe700 1 -- 172.21.15.81:0/4230054061 learned_addr learned my addr 172.21.15.81:0/4230054061 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:25:28.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.063+0000 7f110effd700 1 --2- 172.21.15.81:0/4230054061 >> v2:172.21.15.81:3300/0 conn(0x7f11101557c0 0x7f111006da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:28.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.063+0000 7f110e7fc700 1 --2- 172.21.15.81:0/4230054061 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1110155b90 0x7f11100c2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:28.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.063+0000 7f110dffb700 1 -- 172.21.15.81:0/4230054061 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1181230180 0 0) 0x7f111006ed50 con 0x7f11100c70a0 2023-10-06T03:25:28.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.063+0000 7f110dffb700 1 -- 172.21.15.81:0/4230054061 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10f8003570 con 0x7f11100c70a0 2023-10-06T03:25:28.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.063+0000 7f110effd700 1 -- 172.21.15.81:0/4230054061 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1110155b90 msgr2=0x7f11100c2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:28.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.063+0000 7f110effd700 1 --2- 172.21.15.81:0/4230054061 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1110155b90 0x7f11100c2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:28.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.063+0000 7f110effd700 1 -- 172.21.15.81:0/4230054061 >> v1:172.21.15.81:6789/0 conn(0x7f11100c70a0 legacy=0x7f1110159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:28.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.063+0000 7f110effd700 1 -- 172.21.15.81:0/4230054061 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f111006e420 con 0x7f11101557c0 2023-10-06T03:25:28.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.064+0000 7f110effd700 1 --2- 172.21.15.81:0/4230054061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11101557c0 0x7f111006da60 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f11000098e0 tx=0x7f11000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0ffb1cf81e9573a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:28.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.064+0000 7f110dffb700 1 -- 172.21.15.81:0/4230054061 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1100011630 con 0x7f11101557c0 2023-10-06T03:25:28.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.064+0000 7f110dffb700 1 -- 172.21.15.81:0/4230054061 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1100011790 con 0x7f11101557c0 2023-10-06T03:25:28.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.064+0000 7f110dffb700 1 -- 172.21.15.81:0/4230054061 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1100011b30 con 0x7f11101557c0 2023-10-06T03:25:28.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.064+0000 7f11153ff700 1 -- 172.21.15.81:0/4230054061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11101557c0 msgr2=0x7f111006da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:28.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.064+0000 7f11153ff700 1 --2- 172.21.15.81:0/4230054061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11101557c0 0x7f111006da60 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f11000098e0 tx=0x7f11000091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:28.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.065+0000 7f11153ff700 1 -- 172.21.15.81:0/4230054061 shutdown_connections 2023-10-06T03:25:28.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.065+0000 7f11153ff700 1 --2- 172.21.15.81:0/4230054061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11101557c0 0x7f111006da60 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:28.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.065+0000 7f11153ff700 1 --2- 172.21.15.81:0/4230054061 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1110155b90 0x7f11100c2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:28.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.065+0000 7f11153ff700 1 -- 172.21.15.81:0/4230054061 >> 172.21.15.81:0/4230054061 conn(0x7f11100cc050 msgr2=0x7f11100cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:28.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.065+0000 7f11153ff700 1 -- 172.21.15.81:0/4230054061 shutdown_connections 2023-10-06T03:25:28.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.065+0000 7f11153ff700 1 -- 172.21.15.81:0/4230054061 wait complete. 2023-10-06T03:25:28.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.066+0000 7f11153ff700 1 Processor -- start 2023-10-06T03:25:28.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.066+0000 7f11153ff700 1 -- start start 2023-10-06T03:25:28.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.067+0000 7f11153ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f11100c70a0 0x7f11101526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:28.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.067+0000 7f11153ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f11101557c0 0x7f1110157160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:28.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.067+0000 7f11153ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1110155b90 0x7f11100c88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:28.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.067+0000 7f11153ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11101590d0 con 0x7f1110155b90 2023-10-06T03:25:28.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.067+0000 7f11153ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1110152c30 con 0x7f11100c70a0 2023-10-06T03:25:28.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.067+0000 7f11153ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11101576a0 con 0x7f11101557c0 2023-10-06T03:25:28.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.067+0000 7f110f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1110155b90 0x7f11100c88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:28.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.067+0000 7f110f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1110155b90 0x7f11100c88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35622/0 (socket says 172.21.15.81:35622) 2023-10-06T03:25:28.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.067+0000 7f110f7fe700 1 -- 172.21.15.81:0/472231831 learned_addr learned my addr 172.21.15.81:0/472231831 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:28.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.067+0000 7f110e7fc700 1 --2- 172.21.15.81:0/472231831 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f11101557c0 0x7f1110157160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:28.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.067+0000 7f110effd700 1 --2- 172.21.15.81:0/472231831 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f11100c70a0 0x7f11101526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:28.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.068+0000 7f110f7fe700 1 -- 172.21.15.81:0/472231831 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f11101557c0 msgr2=0x7f1110157160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:28.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.068+0000 7f110f7fe700 1 --2- 172.21.15.81:0/472231831 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f11101557c0 0x7f1110157160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:28.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.068+0000 7f110f7fe700 1 -- 172.21.15.81:0/472231831 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f11100c70a0 msgr2=0x7f11101526f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:28.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.068+0000 7f110f7fe700 1 --2- 172.21.15.81:0/472231831 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f11100c70a0 0x7f11101526f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:28.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.068+0000 7f110f7fe700 1 -- 172.21.15.81:0/472231831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1100009420 con 0x7f1110155b90 2023-10-06T03:25:28.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.068+0000 7f110f7fe700 1 --2- 172.21.15.81:0/472231831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1110155b90 0x7f11100c88a0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f1108001460 tx=0x7f1108001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:28.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.068+0000 7f10f6ffd700 1 -- 172.21.15.81:0/472231831 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110800a890 con 0x7f1110155b90 2023-10-06T03:25:28.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.068+0000 7f10f6ffd700 1 -- 172.21.15.81:0/472231831 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f110800a9f0 con 0x7f1110155b90 2023-10-06T03:25:28.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.068+0000 7f11153ff700 1 -- 172.21.15.81:0/472231831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1110158450 con 0x7f1110155b90 2023-10-06T03:25:28.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.068+0000 7f10f6ffd700 1 -- 172.21.15.81:0/472231831 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110800ad70 con 0x7f1110155b90 2023-10-06T03:25:28.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.068+0000 7f11153ff700 1 -- 172.21.15.81:0/472231831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1110158a10 con 0x7f1110155b90 2023-10-06T03:25:28.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.069+0000 7f11153ff700 1 -- 172.21.15.81:0/472231831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f111006cf80 con 0x7f1110155b90 2023-10-06T03:25:28.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.070+0000 7f10f6ffd700 1 -- 172.21.15.81:0/472231831 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1108007300 con 0x7f1110155b90 2023-10-06T03:25:28.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.071+0000 7f10f6ffd700 1 --2- 172.21.15.81:0/472231831 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f10fc066f30 0x7f10fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:28.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.071+0000 7f10f6ffd700 1 -- 172.21.15.81:0/472231831 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f1108084a50 con 0x7f1110155b90 2023-10-06T03:25:28.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.071+0000 7f110effd700 1 --2- 172.21.15.81:0/472231831 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f10fc066f30 0x7f10fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:28.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.071+0000 7f10f6ffd700 1 --2- 172.21.15.81:0/472231831 >> [v2:172.21.15.83:6808/85786,v1:172.21.15.83:6810/85786] conn(0x7f10fc06d8f0 0x7f10fc06fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:28.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.071+0000 7f10f6ffd700 1 -- 172.21.15.81:0/472231831 --> [v2:172.21.15.83:6808/85786,v1:172.21.15.83:6810/85786] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f10fc0703f0 con 0x7f10fc06d8f0 2023-10-06T03:25:28.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.071+0000 7f10f6ffd700 1 -- 172.21.15.81:0/472231831 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1108089220 con 0x7f1110155b90 2023-10-06T03:25:28.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.072+0000 7f110effd700 1 --2- 172.21.15.81:0/472231831 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f10fc066f30 0x7f10fc0693e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f11000091e0 tx=0x7f1100017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:28.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.072+0000 7f110e7fc700 1 --2- 172.21.15.81:0/472231831 >> [v2:172.21.15.83:6808/85786,v1:172.21.15.83:6810/85786] conn(0x7f10fc06d8f0 0x7f10fc06fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:28.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.072+0000 7f110e7fc700 1 --2- 172.21.15.81:0/472231831 >> [v2:172.21.15.83:6808/85786,v1:172.21.15.83:6810/85786] conn(0x7f10fc06d8f0 0x7f10fc06fd20 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:28.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.073+0000 7f10f6ffd700 1 -- 172.21.15.81:0/472231831 <== osd.7 v2:172.21.15.83:6808/85786 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f10fc0703f0 con 0x7f10fc06d8f0 2023-10-06T03:25:28.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.087+0000 7f11153ff700 1 -- 172.21.15.81:0/472231831 --> [v2:172.21.15.83:6808/85786,v1:172.21.15.83:6810/85786] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f111004c3c0 con 0x7f10fc06d8f0 2023-10-06T03:25:28.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.088+0000 7f10f6ffd700 1 -- 172.21.15.81:0/472231831 <== osd.7 v2:172.21.15.83:6808/85786 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f111004c3c0 con 0x7f10fc06d8f0 2023-10-06T03:25:28.089 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-06T03:25:28.089 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:25:28.089 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-06T03:25:28.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.088+0000 7f11153ff700 1 -- 172.21.15.81:0/472231831 >> [v2:172.21.15.83:6808/85786,v1:172.21.15.83:6810/85786] conn(0x7f10fc06d8f0 msgr2=0x7f10fc06fd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:28.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.088+0000 7f11153ff700 1 --2- 172.21.15.81:0/472231831 >> [v2:172.21.15.83:6808/85786,v1:172.21.15.83:6810/85786] conn(0x7f10fc06d8f0 0x7f10fc06fd20 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:28.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.088+0000 7f11153ff700 1 -- 172.21.15.81:0/472231831 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f10fc066f30 msgr2=0x7f10fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:28.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.088+0000 7f11153ff700 1 --2- 172.21.15.81:0/472231831 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f10fc066f30 0x7f10fc0693e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f11000091e0 tx=0x7f1100017000 comp rx=0 tx=0).stop 2023-10-06T03:25:28.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.088+0000 7f11153ff700 1 -- 172.21.15.81:0/472231831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1110155b90 msgr2=0x7f11100c88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:28.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.088+0000 7f11153ff700 1 --2- 172.21.15.81:0/472231831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1110155b90 0x7f11100c88a0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f1108001460 tx=0x7f1108001ae0 comp rx=0 tx=0).stop 2023-10-06T03:25:28.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.088+0000 7f110f7fe700 1 -- 172.21.15.81:0/472231831 reap_dead start 2023-10-06T03:25:28.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.088+0000 7f11153ff700 1 -- 172.21.15.81:0/472231831 shutdown_connections 2023-10-06T03:25:28.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.088+0000 7f11153ff700 1 -- 172.21.15.81:0/472231831 >> 172.21.15.81:0/472231831 conn(0x7f11100cc050 msgr2=0x7f11100b0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:28.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.089+0000 7f11153ff700 1 -- 172.21.15.81:0/472231831 shutdown_connections 2023-10-06T03:25:28.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.089+0000 7f11153ff700 1 -- 172.21.15.81:0/472231831 wait complete. 2023-10-06T03:25:28.105 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-06T03:25:28.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.285+0000 7f80f19ff700 1 Processor -- start 2023-10-06T03:25:28.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.285+0000 7f80f19ff700 1 -- start start 2023-10-06T03:25:28.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.286+0000 7f80f19ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f80ec1557f0 0x7f80ec156c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:28.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.286+0000 7f80f19ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80ec069ee0 0x7f80ec06a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:28.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.286+0000 7f80f19ff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80ec0c9c60 con 0x7f80ec155bc0 2023-10-06T03:25:28.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.286+0000 7f80f19ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80ec06df20 con 0x7f80ec1557f0 2023-10-06T03:25:28.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.287+0000 7f80f19ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80ec06a8a0 con 0x7f80ec069ee0 2023-10-06T03:25:28.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.287+0000 7f80eaffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f80ec1557f0 0x7f80ec156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:28.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.287+0000 7f80eaffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f80ec1557f0 0x7f80ec156c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35626/0 (socket says 172.21.15.81:35626) 2023-10-06T03:25:28.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.287+0000 7f80eaffd700 1 -- 172.21.15.81:0/3672580147 learned_addr learned my addr 172.21.15.81:0/3672580147 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:28.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.287+0000 7f80eb7fe700 1 --2- 172.21.15.81:0/3672580147 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80ec069ee0 0x7f80ec06a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:28.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.287+0000 7f80eaffd700 1 -- 172.21.15.81:0/3672580147 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80ec069ee0 msgr2=0x7f80ec06a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:28.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.287+0000 7f80eaffd700 1 --2- 172.21.15.81:0/3672580147 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80ec069ee0 0x7f80ec06a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:28.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.287+0000 7f80eaffd700 1 -- 172.21.15.81:0/3672580147 >> v1:172.21.15.83:6789/0 conn(0x7f80ec155bc0 legacy=0x7f80ec0c6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:28.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.287+0000 7f80eaffd700 1 -- 172.21.15.81:0/3672580147 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80ec06dc60 con 0x7f80ec1557f0 2023-10-06T03:25:28.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.287+0000 7f80eaffd700 1 --2- 172.21.15.81:0/3672580147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80ec1557f0 0x7f80ec156c90 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f80dc00bc50 tx=0x7f80dc00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4f286c7e916149c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:28.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.288+0000 7f80e9ffb700 1 -- 172.21.15.81:0/3672580147 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc00be60 con 0x7f80ec1557f0 2023-10-06T03:25:28.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.288+0000 7f80e9ffb700 1 -- 172.21.15.81:0/3672580147 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80dc00de00 con 0x7f80ec1557f0 2023-10-06T03:25:28.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.288+0000 7f80e9ffb700 1 -- 172.21.15.81:0/3672580147 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc0196b0 con 0x7f80ec1557f0 2023-10-06T03:25:28.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.288+0000 7f80f19ff700 1 -- 172.21.15.81:0/3672580147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80ec1557f0 msgr2=0x7f80ec156c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:28.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.288+0000 7f80f19ff700 1 --2- 172.21.15.81:0/3672580147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80ec1557f0 0x7f80ec156c90 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f80dc00bc50 tx=0x7f80dc00b4f0 comp rx=0 tx=0).stop 2023-10-06T03:25:28.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.288+0000 7f80f19ff700 1 -- 172.21.15.81:0/3672580147 shutdown_connections 2023-10-06T03:25:28.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.288+0000 7f80f19ff700 1 --2- 172.21.15.81:0/3672580147 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80ec069ee0 0x7f80ec06a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:28.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.288+0000 7f80f19ff700 1 --2- 172.21.15.81:0/3672580147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80ec1557f0 0x7f80ec156c90 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:28.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.288+0000 7f80f19ff700 1 -- 172.21.15.81:0/3672580147 >> 172.21.15.81:0/3672580147 conn(0x7f80ec0cc090 msgr2=0x7f80ec0cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:28.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.288+0000 7f80f19ff700 1 -- 172.21.15.81:0/3672580147 shutdown_connections 2023-10-06T03:25:28.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.288+0000 7f80f19ff700 1 -- 172.21.15.81:0/3672580147 wait complete. 2023-10-06T03:25:28.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.290+0000 7f80f19ff700 1 Processor -- start 2023-10-06T03:25:28.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.290+0000 7f80f19ff700 1 -- start start 2023-10-06T03:25:28.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.291+0000 7f80f19ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80ec069ee0 0x7f80ec165730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:28.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.291+0000 7f80f19ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80ec1557f0 0x7f80ec154920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:28.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.291+0000 7f80f19ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80ec155bc0 0x7f80ec15ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:28.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.291+0000 7f80f19ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ec165c70 con 0x7f80ec069ee0 2023-10-06T03:25:28.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.291+0000 7f80f19ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ec0c4540 con 0x7f80ec1557f0 2023-10-06T03:25:28.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.291+0000 7f80f19ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80ec0c4de0 con 0x7f80ec155bc0 2023-10-06T03:25:28.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.291+0000 7f80eaffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80ec069ee0 0x7f80ec165730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:28.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.291+0000 7f80eaffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80ec069ee0 0x7f80ec165730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35642/0 (socket says 172.21.15.81:35642) 2023-10-06T03:25:28.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.291+0000 7f80eaffd700 1 -- 172.21.15.81:0/2659865098 learned_addr learned my addr 172.21.15.81:0/2659865098 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:28.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.291+0000 7f80eb7fe700 1 --2- 172.21.15.81:0/2659865098 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80ec155bc0 0x7f80ec15ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:28.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.291+0000 7f80ea7fc700 1 --2- 172.21.15.81:0/2659865098 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80ec1557f0 0x7f80ec154920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:28.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.291+0000 7f80eaffd700 1 -- 172.21.15.81:0/2659865098 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80ec155bc0 msgr2=0x7f80ec15ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:28.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.291+0000 7f80eaffd700 1 --2- 172.21.15.81:0/2659865098 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80ec155bc0 0x7f80ec15ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:28.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.291+0000 7f80eaffd700 1 -- 172.21.15.81:0/2659865098 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80ec1557f0 msgr2=0x7f80ec154920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:28.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.291+0000 7f80eaffd700 1 --2- 172.21.15.81:0/2659865098 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80ec1557f0 0x7f80ec154920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:28.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.291+0000 7f80eaffd700 1 -- 172.21.15.81:0/2659865098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80dc00b790 con 0x7f80ec069ee0 2023-10-06T03:25:28.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.291+0000 7f80ea7fc700 1 --2- 172.21.15.81:0/2659865098 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80ec1557f0 0x7f80ec154920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:28.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.292+0000 7f80eaffd700 1 --2- 172.21.15.81:0/2659865098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80ec069ee0 0x7f80ec165730 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f80ec0690e0 tx=0x7f80dc01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:28.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.292+0000 7f80d2ffd700 1 -- 172.21.15.81:0/2659865098 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc010640 con 0x7f80ec069ee0 2023-10-06T03:25:28.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.292+0000 7f80d2ffd700 1 -- 172.21.15.81:0/2659865098 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80dc0107a0 con 0x7f80ec069ee0 2023-10-06T03:25:28.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.292+0000 7f80d2ffd700 1 -- 172.21.15.81:0/2659865098 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc010b40 con 0x7f80ec069ee0 2023-10-06T03:25:28.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.292+0000 7f80f19ff700 1 -- 172.21.15.81:0/2659865098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80ec0b0570 con 0x7f80ec069ee0 2023-10-06T03:25:28.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.292+0000 7f80f19ff700 1 -- 172.21.15.81:0/2659865098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80ec0c4a70 con 0x7f80ec069ee0 2023-10-06T03:25:28.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.293+0000 7f80f19ff700 1 -- 172.21.15.81:0/2659865098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80ec04c3c0 con 0x7f80ec069ee0 2023-10-06T03:25:28.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.294+0000 7f80d2ffd700 1 -- 172.21.15.81:0/2659865098 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f80dc022030 con 0x7f80ec069ee0 2023-10-06T03:25:28.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.295+0000 7f80d2ffd700 1 --2- 172.21.15.81:0/2659865098 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f80d8066f30 0x7f80d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:28.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.295+0000 7f80d2ffd700 1 -- 172.21.15.81:0/2659865098 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f80dc014070 con 0x7f80ec069ee0 2023-10-06T03:25:28.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.295+0000 7f80ea7fc700 1 --2- 172.21.15.81:0/2659865098 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f80d8066f30 0x7f80d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:28.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.296+0000 7f80ea7fc700 1 --2- 172.21.15.81:0/2659865098 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f80d8066f30 0x7f80d80693e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f80ec168c70 tx=0x7f80e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:28.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.299+0000 7f80d2ffd700 1 -- 172.21.15.81:0/2659865098 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f80dc0558b0 con 0x7f80ec069ee0 2023-10-06T03:25:28.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.491+0000 7f80f19ff700 1 -- 172.21.15.81:0/2659865098 --> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f80ec065720 con 0x7f80d8066f30 2023-10-06T03:25:28.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.491+0000 7f80d2ffd700 1 -- 172.21.15.81:0/2659865098 <== mgr.4100 v2:172.21.15.81:6832/85286 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f80ec065720 con 0x7f80d8066f30 2023-10-06T03:25:28.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.494+0000 7f80f19ff700 1 -- 172.21.15.81:0/2659865098 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f80d8066f30 msgr2=0x7f80d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:28.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.494+0000 7f80f19ff700 1 --2- 172.21.15.81:0/2659865098 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f80d8066f30 0x7f80d80693e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f80ec168c70 tx=0x7f80e0009040 comp rx=0 tx=0).stop 2023-10-06T03:25:28.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.494+0000 7f80f19ff700 1 -- 172.21.15.81:0/2659865098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80ec069ee0 msgr2=0x7f80ec165730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:28.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.494+0000 7f80f19ff700 1 --2- 172.21.15.81:0/2659865098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80ec069ee0 0x7f80ec165730 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f80ec0690e0 tx=0x7f80dc01b000 comp rx=0 tx=0).stop 2023-10-06T03:25:28.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.494+0000 7f80f19ff700 1 -- 172.21.15.81:0/2659865098 shutdown_connections 2023-10-06T03:25:28.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.494+0000 7f80f19ff700 1 --2- 172.21.15.81:0/2659865098 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f80d8066f30 0x7f80d80693e0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:28.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.494+0000 7f80f19ff700 1 --2- 172.21.15.81:0/2659865098 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80ec155bc0 0x7f80ec15ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:28.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.494+0000 7f80f19ff700 1 --2- 172.21.15.81:0/2659865098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80ec069ee0 0x7f80ec165730 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:28.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.494+0000 7f80f19ff700 1 --2- 172.21.15.81:0/2659865098 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80ec1557f0 0x7f80ec154920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:28.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.494+0000 7f80f19ff700 1 -- 172.21.15.81:0/2659865098 >> 172.21.15.81:0/2659865098 conn(0x7f80ec0cc090 msgr2=0x7f80ec158070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:28.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.494+0000 7f80f19ff700 1 -- 172.21.15.81:0/2659865098 shutdown_connections 2023-10-06T03:25:28.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.494+0000 7f80f19ff700 1 -- 172.21.15.81:0/2659865098 wait complete. 2023-10-06T03:25:28.496 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 7 to deep-scrub 2023-10-06T03:25:28.512 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:25:28.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.694+0000 7f1e671ff700 1 Processor -- start 2023-10-06T03:25:28.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.694+0000 7f1e671ff700 1 -- start start 2023-10-06T03:25:28.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.696+0000 7f1e671ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1e6013fd90 0x7f1e60159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:28.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.696+0000 7f1e671ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1e6015a3f0 0x7f1e600c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:28.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.696+0000 7f1e671ff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e600cad30 con 0x7f1e6013f9c0 2023-10-06T03:25:28.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.696+0000 7f1e671ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e6015a870 con 0x7f1e6015a3f0 2023-10-06T03:25:28.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.696+0000 7f1e671ff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e600cafe0 con 0x7f1e6013fd90 2023-10-06T03:25:28.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.696+0000 7f1e6579c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1e6015a3f0 0x7f1e600c6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:28.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.696+0000 7f1e6579c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1e6015a3f0 0x7f1e600c6ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35658/0 (socket says 172.21.15.81:35658) 2023-10-06T03:25:28.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.696+0000 7f1e6579c700 1 -- 172.21.15.81:0/3398666356 learned_addr learned my addr 172.21.15.81:0/3398666356 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:28.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.696+0000 7f1e5ffff700 1 --2- 172.21.15.81:0/3398666356 >> v2:172.21.15.83:3300/0 conn(0x7f1e6013fd90 0x7f1e60159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:28.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.696+0000 7f1e6579c700 1 -- 172.21.15.81:0/3398666356 >> v2:172.21.15.83:3300/0 conn(0x7f1e6013fd90 msgr2=0x7f1e60159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:28.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.697+0000 7f1e6579c700 1 --2- 172.21.15.81:0/3398666356 >> v2:172.21.15.83:3300/0 conn(0x7f1e6013fd90 0x7f1e60159eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:28.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.697+0000 7f1e6579c700 1 -- 172.21.15.81:0/3398666356 >> v1:172.21.15.83:6789/0 conn(0x7f1e6013f9c0 legacy=0x7f1e600ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:28.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.697+0000 7f1e6579c700 1 -- 172.21.15.81:0/3398666356 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e600cb2c0 con 0x7f1e6015a3f0 2023-10-06T03:25:28.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.697+0000 7f1e5ffff700 1 --2- 172.21.15.81:0/3398666356 >> v2:172.21.15.83:3300/0 conn(0x7f1e6013fd90 0x7f1e60159eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:25:28.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.697+0000 7f1e6579c700 1 --2- 172.21.15.81:0/3398666356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e6015a3f0 0x7f1e600c6ab0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f1e6006cb60 tx=0x7f1e5800ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19df52c041e6c956 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:28.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.697+0000 7f1e5f7fe700 1 -- 172.21.15.81:0/3398666356 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e58010070 con 0x7f1e6015a3f0 2023-10-06T03:25:28.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.697+0000 7f1e5f7fe700 1 -- 172.21.15.81:0/3398666356 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e5800de50 con 0x7f1e6015a3f0 2023-10-06T03:25:28.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.697+0000 7f1e5f7fe700 1 -- 172.21.15.81:0/3398666356 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5800b320 con 0x7f1e6015a3f0 2023-10-06T03:25:28.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.698+0000 7f1e671ff700 1 -- 172.21.15.81:0/3398666356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e6015a3f0 msgr2=0x7f1e600c6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:28.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.698+0000 7f1e671ff700 1 --2- 172.21.15.81:0/3398666356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e6015a3f0 0x7f1e600c6ab0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f1e6006cb60 tx=0x7f1e5800ba50 comp rx=0 tx=0).stop 2023-10-06T03:25:28.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.698+0000 7f1e671ff700 1 -- 172.21.15.81:0/3398666356 shutdown_connections 2023-10-06T03:25:28.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.698+0000 7f1e671ff700 1 --2- 172.21.15.81:0/3398666356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e6015a3f0 0x7f1e600c6ab0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:28.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.698+0000 7f1e671ff700 1 --2- 172.21.15.81:0/3398666356 >> v2:172.21.15.83:3300/0 conn(0x7f1e6013fd90 0x7f1e60159eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:28.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.698+0000 7f1e671ff700 1 -- 172.21.15.81:0/3398666356 >> 172.21.15.81:0/3398666356 conn(0x7f1e600cc090 msgr2=0x7f1e600cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:28.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.698+0000 7f1e671ff700 1 -- 172.21.15.81:0/3398666356 shutdown_connections 2023-10-06T03:25:28.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.698+0000 7f1e671ff700 1 -- 172.21.15.81:0/3398666356 wait complete. 2023-10-06T03:25:28.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.699+0000 7f1e671ff700 1 Processor -- start 2023-10-06T03:25:28.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.699+0000 7f1e671ff700 1 -- start start 2023-10-06T03:25:28.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.700+0000 7f1e671ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e6013f9c0 0x7f1e60157520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:28.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.700+0000 7f1e671ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e6013fd90 0x7f1e600b0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:28.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.700+0000 7f1e671ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e6015a3f0 0x7f1e600b1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:28.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.700+0000 7f1e671ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e60164ed0 con 0x7f1e6013fd90 2023-10-06T03:25:28.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.700+0000 7f1e671ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e60165a40 con 0x7f1e6015a3f0 2023-10-06T03:25:28.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.700+0000 7f1e671ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e60157a60 con 0x7f1e6013f9c0 2023-10-06T03:25:28.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.700+0000 7f1e5ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e6013fd90 0x7f1e600b0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:28.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.700+0000 7f1e5ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e6013fd90 0x7f1e600b0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35670/0 (socket says 172.21.15.81:35670) 2023-10-06T03:25:28.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.700+0000 7f1e5ffff700 1 -- 172.21.15.81:0/1341575277 learned_addr learned my addr 172.21.15.81:0/1341575277 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:28.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.701+0000 7f1e64f9b700 1 --2- 172.21.15.81:0/1341575277 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e6013f9c0 0x7f1e60157520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:28.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.701+0000 7f1e6579c700 1 --2- 172.21.15.81:0/1341575277 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e6015a3f0 0x7f1e600b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:28.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.701+0000 7f1e5ffff700 1 -- 172.21.15.81:0/1341575277 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e6013f9c0 msgr2=0x7f1e60157520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:28.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.701+0000 7f1e5ffff700 1 --2- 172.21.15.81:0/1341575277 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e6013f9c0 0x7f1e60157520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:28.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.701+0000 7f1e5ffff700 1 -- 172.21.15.81:0/1341575277 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e6015a3f0 msgr2=0x7f1e600b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:28.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.701+0000 7f1e5ffff700 1 --2- 172.21.15.81:0/1341575277 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e6015a3f0 0x7f1e600b1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:28.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.701+0000 7f1e5ffff700 1 -- 172.21.15.81:0/1341575277 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e5800bcf0 con 0x7f1e6013fd90 2023-10-06T03:25:28.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.701+0000 7f1e6579c700 1 --2- 172.21.15.81:0/1341575277 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e6015a3f0 0x7f1e600b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:28.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.701+0000 7f1e5ffff700 1 --2- 172.21.15.81:0/1341575277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e6013fd90 0x7f1e600b0cc0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c00c860 tx=0x7f1e4c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:28.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.701+0000 7f1e5cff9700 1 -- 172.21.15.81:0/1341575277 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c011600 con 0x7f1e6013fd90 2023-10-06T03:25:28.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.701+0000 7f1e5cff9700 1 -- 172.21.15.81:0/1341575277 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e4c011760 con 0x7f1e6013fd90 2023-10-06T03:25:28.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.701+0000 7f1e671ff700 1 -- 172.21.15.81:0/1341575277 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e6013c990 con 0x7f1e6013fd90 2023-10-06T03:25:28.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.701+0000 7f1e5cff9700 1 -- 172.21.15.81:0/1341575277 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c011b20 con 0x7f1e6013fd90 2023-10-06T03:25:28.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.702+0000 7f1e671ff700 1 -- 172.21.15.81:0/1341575277 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e601653f0 con 0x7f1e6013fd90 2023-10-06T03:25:28.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.702+0000 7f1e671ff700 1 -- 172.21.15.81:0/1341575277 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e60165bd0 con 0x7f1e6013fd90 2023-10-06T03:25:28.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.703+0000 7f1e5cff9700 1 -- 172.21.15.81:0/1341575277 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1e4c0193b0 con 0x7f1e6013fd90 2023-10-06T03:25:28.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.704+0000 7f1e5cff9700 1 --2- 172.21.15.81:0/1341575277 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f1e44066f30 0x7f1e440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:28.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.704+0000 7f1e5cff9700 1 -- 172.21.15.81:0/1341575277 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f1e4c0845b0 con 0x7f1e6013fd90 2023-10-06T03:25:28.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.704+0000 7f1e64f9b700 1 --2- 172.21.15.81:0/1341575277 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f1e44066f30 0x7f1e440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:28.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.705+0000 7f1e64f9b700 1 --2- 172.21.15.81:0/1341575277 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f1e44066f30 0x7f1e440693e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1e54003a30 tx=0x7f1e54007ea0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:28.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.708+0000 7f1e5cff9700 1 -- 172.21.15.81:0/1341575277 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1e4c051780 con 0x7f1e6013fd90 2023-10-06T03:25:28.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.895+0000 7f1e671ff700 1 -- 172.21.15.81:0/1341575277 --> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1e6004c3c0 con 0x7f1e44066f30 2023-10-06T03:25:28.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.898+0000 7f1e5cff9700 1 -- 172.21.15.81:0/1341575277 <== mgr.4100 v2:172.21.15.81:6832/85286 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72890 (secure 0 0 0) 0x7f1e6004c3c0 con 0x7f1e44066f30 2023-10-06T03:25:28.900 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:25:28.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.901+0000 7f1e671ff700 1 -- 172.21.15.81:0/1341575277 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f1e44066f30 msgr2=0x7f1e440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:28.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.901+0000 7f1e671ff700 1 --2- 172.21.15.81:0/1341575277 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f1e44066f30 0x7f1e440693e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1e54003a30 tx=0x7f1e54007ea0 comp rx=0 tx=0).stop 2023-10-06T03:25:28.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.901+0000 7f1e671ff700 1 -- 172.21.15.81:0/1341575277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e6013fd90 msgr2=0x7f1e600b0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:28.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.901+0000 7f1e671ff700 1 --2- 172.21.15.81:0/1341575277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e6013fd90 0x7f1e600b0cc0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c00c860 tx=0x7f1e4c008040 comp rx=0 tx=0).stop 2023-10-06T03:25:28.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.901+0000 7f1e671ff700 1 -- 172.21.15.81:0/1341575277 shutdown_connections 2023-10-06T03:25:28.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.901+0000 7f1e671ff700 1 --2- 172.21.15.81:0/1341575277 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e6015a3f0 0x7f1e600b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:28.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.901+0000 7f1e671ff700 1 --2- 172.21.15.81:0/1341575277 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f1e44066f30 0x7f1e440693e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:28.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.901+0000 7f1e671ff700 1 --2- 172.21.15.81:0/1341575277 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e6013f9c0 0x7f1e60157520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:28.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.901+0000 7f1e671ff700 1 --2- 172.21.15.81:0/1341575277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e6013fd90 0x7f1e600b0cc0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:28.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.901+0000 7f1e671ff700 1 -- 172.21.15.81:0/1341575277 >> 172.21.15.81:0/1341575277 conn(0x7f1e600cc090 msgr2=0x7f1e600cc460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:28.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.901+0000 7f1e671ff700 1 -- 172.21.15.81:0/1341575277 shutdown_connections 2023-10-06T03:25:28.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:28.901+0000 7f1e671ff700 1 -- 172.21.15.81:0/1341575277 wait complete. 2023-10-06T03:25:28.903 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-06T03:25:28.919 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2023-10-06T03:25:27.574703+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":41,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2383428,"kb_used_data":5124,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752591292,"statfs":{"total":773094113280,"available":770653483008,"internally_reserved":0,"allocated":5246976,"data_stored":3027967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1,"num_objects":-1,"num_object_clones":0,"num_object_copies":-2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1,"num_whiteouts":0,"num_read":-2,"num_read_kb":-1,"num_write":-1,"num_write_kb":-1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001334"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":36,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:25:17.183372+0000","last_change":"2023-10-06T03:23:35.397971+0000","last_active":"2023-10-06T03:25:17.183372+0000","last_peered":"2023-10-06T03:25:17.183372+0000","last_clean":"2023-10-06T03:25:17.183372+0000","last_became_active":"2023-10-06T03:23:35.397649+0000","last_became_peered":"2023-10-06T03:23:35.397649+0000","last_unstale":"2023-10-06T03:25:17.183372+0000","last_undegraded":"2023-10-06T03:25:17.183372+0000","last_fullsized":"2023-10-06T03:25:17.183372+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:11.974461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":34,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:25:17.600352+0000","last_change":"2023-10-06T03:23:34.866196+0000","last_active":"2023-10-06T03:25:17.600352+0000","last_peered":"2023-10-06T03:25:17.600352+0000","last_clean":"2023-10-06T03:25:17.600352+0000","last_became_active":"2023-10-06T03:23:34.865914+0000","last_became_peered":"2023-10-06T03:23:34.865914+0000","last_unstale":"2023-10-06T03:25:17.600352+0000","last_undegraded":"2023-10-06T03:25:17.600352+0000","last_fullsized":"2023-10-06T03:25:17.600352+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:11.974461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":35,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:25:17.182175+0000","last_change":"2023-10-06T03:23:34.874380+0000","last_active":"2023-10-06T03:25:17.182175+0000","last_peered":"2023-10-06T03:25:17.182175+0000","last_clean":"2023-10-06T03:25:17.182175+0000","last_became_active":"2023-10-06T03:23:34.873972+0000","last_became_peered":"2023-10-06T03:23:34.873972+0000","last_unstale":"2023-10-06T03:25:17.182175+0000","last_undegraded":"2023-10-06T03:25:17.182175+0000","last_fullsized":"2023-10-06T03:25:17.182175+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:30.204999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":183,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:25:17.597762+0000","last_change":"2023-10-06T03:23:34.864626+0000","last_active":"2023-10-06T03:25:17.597762+0000","last_peered":"2023-10-06T03:25:17.597762+0000","last_clean":"2023-10-06T03:25:17.597762+0000","last_became_active":"2023-10-06T03:23:34.863539+0000","last_became_peered":"2023-10-06T03:23:34.863539+0000","last_unstale":"2023-10-06T03:25:17.597762+0000","last_undegraded":"2023-10-06T03:25:17.597762+0000","last_fullsized":"2023-10-06T03:25:17.597762+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:11.750836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:25:17.598525+0000","last_change":"2023-10-06T03:23:34.864399+0000","last_active":"2023-10-06T03:25:17.598525+0000","last_peered":"2023-10-06T03:25:17.598525+0000","last_clean":"2023-10-06T03:25:17.598525+0000","last_became_active":"2023-10-06T03:23:34.863991+0000","last_became_peered":"2023-10-06T03:23:34.863991+0000","last_unstale":"2023-10-06T03:25:17.598525+0000","last_undegraded":"2023-10-06T03:25:17.598525+0000","last_fullsized":"2023-10-06T03:25:17.598525+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:56:32.358597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:25:17.597613+0000","last_change":"2023-10-06T03:23:34.865125+0000","last_active":"2023-10-06T03:25:17.597613+0000","last_peered":"2023-10-06T03:25:17.597613+0000","last_clean":"2023-10-06T03:25:17.597613+0000","last_became_active":"2023-10-06T03:23:34.864752+0000","last_became_peered":"2023-10-06T03:23:34.864752+0000","last_unstale":"2023-10-06T03:25:17.597613+0000","last_undegraded":"2023-10-06T03:25:17.597613+0000","last_fullsized":"2023-10-06T03:25:17.597613+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:00.374963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":36,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:25:17.183773+0000","last_change":"2023-10-06T03:23:34.864329+0000","last_active":"2023-10-06T03:25:17.183773+0000","last_peered":"2023-10-06T03:25:17.183773+0000","last_clean":"2023-10-06T03:25:17.183773+0000","last_became_active":"2023-10-06T03:23:34.863953+0000","last_became_peered":"2023-10-06T03:23:34.863953+0000","last_unstale":"2023-10-06T03:25:17.183773+0000","last_undegraded":"2023-10-06T03:25:17.183773+0000","last_fullsized":"2023-10-06T03:25:17.183773+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:30.204999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":32,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:25:17.600169+0000","last_change":"2023-10-06T03:23:34.873939+0000","last_active":"2023-10-06T03:25:17.600169+0000","last_peered":"2023-10-06T03:25:17.600169+0000","last_clean":"2023-10-06T03:25:17.600169+0000","last_became_active":"2023-10-06T03:23:34.873623+0000","last_became_peered":"2023-10-06T03:23:34.873623+0000","last_unstale":"2023-10-06T03:25:17.600169+0000","last_undegraded":"2023-10-06T03:25:17.600169+0000","last_fullsized":"2023-10-06T03:25:17.600169+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:30.204999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":32,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T03:25:17.600722+0000","last_change":"2023-10-06T03:23:34.872453+0000","last_active":"2023-10-06T03:25:17.600722+0000","last_peered":"2023-10-06T03:25:17.600722+0000","last_clean":"2023-10-06T03:25:17.600722+0000","last_became_active":"2023-10-06T03:23:34.872139+0000","last_became_peered":"2023-10-06T03:23:34.872139+0000","last_unstale":"2023-10-06T03:25:17.600722+0000","last_undegraded":"2023-10-06T03:25:17.600722+0000","last_fullsized":"2023-10-06T03:25:17.600722+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:23:33.848165+0000","last_clean_scrub_stamp":"2023-10-06T03:23:33.848165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:25:46.214290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298364,"kb_used_data":1076,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073476,"statfs":{"total":96636764160,"available":96331239424,"internally_reserved":0,"allocated":1101824,"data_stored":821441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.69399999999999995}]},{"osd":1,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.77300000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.78300000000000003}]},{"osd":3,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.71399999999999997}]},{"osd":4,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.68400000000000005}]},{"osd":5,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.79900000000000004}]},{"osd":6,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.65100000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297780,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074060,"statfs":{"total":96636764160,"available":96331837440,"internally_reserved":0,"allocated":503808,"data_stored":229720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.746},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.54400000000000004}]},{"osd":1,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.67500000000000004}]},{"osd":2,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.629}]},{"osd":3,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.57299999999999995}]},{"osd":4,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.496},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.76700000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.79200000000000004}]},{"osd":7,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.73199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298364,"kb_used_data":1076,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073476,"statfs":{"total":96636764160,"available":96331239424,"internally_reserved":0,"allocated":1101824,"data_stored":821441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:35 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.377},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.42899999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:24:35 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.46400000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:24:35 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.49099999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:24:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.87}]},{"osd":5,"last update":"Fri Oct 6 03:24:35 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.73899999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:24:35 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.89500000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:24:35 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.80700000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297784,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074056,"statfs":{"total":96636764160,"available":96331833344,"internally_reserved":0,"allocated":507904,"data_stored":231073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.40200000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.32700000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.376},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.42099999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.68200000000000005}]},{"osd":5,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.749}]},{"osd":6,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.82899999999999996}]},{"osd":7,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.80700000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297784,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074056,"statfs":{"total":96636764160,"available":96331833344,"internally_reserved":0,"allocated":507904,"data_stored":231073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.53900000000000003}]},{"osd":1,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.627},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.58199999999999996}]},{"osd":3,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":0.504}]},{"osd":4,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.62}]},{"osd":5,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.64200000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.71199999999999997}]},{"osd":7,"last update":"Fri Oct 6 03:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.66500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297784,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074056,"statfs":{"total":96636764160,"available":96331833344,"internally_reserved":0,"allocated":507904,"data_stored":231073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.46100000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.496},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.47599999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.443}]},{"osd":4,"last update":"Fri Oct 6 03:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.64900000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.58499999999999996}]},{"osd":6,"last update":"Fri Oct 6 03:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.59299999999999997}]},{"osd":7,"last update":"Fri Oct 6 03:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.57599999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297784,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074056,"statfs":{"total":96636764160,"available":96331833344,"internally_reserved":0,"allocated":507904,"data_stored":231073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.745},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.73299999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.67400000000000004}]},{"osd":2,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.81599999999999995}]},{"osd":3,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.71699999999999997}]},{"osd":5,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.76200000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.79200000000000004}]},{"osd":7,"last update":"Fri Oct 6 03:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.84699999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297784,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074056,"statfs":{"total":96636764160,"available":96331833344,"internally_reserved":0,"allocated":507904,"data_stored":231073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.753}]},{"osd":1,"last update":"Fri Oct 6 03:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.71299999999999997}]},{"osd":2,"last update":"Fri Oct 6 03:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.64200000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.78500000000000003}]},{"osd":4,"last update":"Fri Oct 6 03:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.80200000000000005}]},{"osd":6,"last update":"Fri Oct 6 03:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":0.82199999999999995}]},{"osd":7,"last update":"Fri Oct 6 03:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.73199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:25:28.923 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2023-10-06T03:23:33.848165+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=23, tm_sec=33, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:25:28.924 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2023-10-06T03:23:33.848165+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=23, tm_sec=33, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:25:28.924 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2023-10-06T03:23:33.848165+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=23, tm_sec=33, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:25:28.924 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-06T03:23:33.848165+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=23, tm_sec=33, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:25:28.924 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2023-10-06T03:23:33.848165+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=23, tm_sec=33, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:25:28.924 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-06T03:23:33.848165+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=23, tm_sec=33, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:25:28.924 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2023-10-06T03:23:33.848165+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=23, tm_sec=33, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:25:28.924 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2023-10-06T03:23:33.848165+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=23, tm_sec=33, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:25:28.925 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2023-10-06T03:23:33.848165+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=23, tm_sec=33, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:25:28.925 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-06T03:25:41.681 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:25:41.687 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:25:48.926 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:25:49.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.115+0000 7f29f27ff700 1 Processor -- start 2023-10-06T03:25:49.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.115+0000 7f29f27ff700 1 -- start start 2023-10-06T03:25:49.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.116+0000 7f29f27ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f29ec1595b0 0x7f29ec0af020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:49.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.116+0000 7f29f27ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f29ec0cfbc0 0x7f29ec1632b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:49.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.116+0000 7f29f27ff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29ec0ce720 con 0x7f29ec068bc0 2023-10-06T03:25:49.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.116+0000 7f29f27ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29ec0ce110 con 0x7f29ec1595b0 2023-10-06T03:25:49.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.116+0000 7f29f27ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec0af990 con 0x7f29ec0cfbc0 2023-10-06T03:25:49.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.117+0000 7f29ebfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f29ec1595b0 0x7f29ec0af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:49.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.117+0000 7f29eb7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f29ec068bc0 0x7f29ec0ccdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35892/0 (socket says 172.21.15.81:35892) 2023-10-06T03:25:49.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.117+0000 7f29eb7fe700 1 -- 172.21.15.81:0/3277276483 learned_addr learned my addr 172.21.15.81:0/3277276483 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-06T03:25:49.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.117+0000 7f29f0d9c700 1 --2- 172.21.15.81:0/3277276483 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f29ec0cfbc0 0x7f29ec1632b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:49.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.117+0000 7f29eaffd700 1 -- 172.21.15.81:0/3277276483 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1791526757 0 0) 0x7f29ec0ce720 con 0x7f29ec068bc0 2023-10-06T03:25:49.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.117+0000 7f29ebfff700 1 -- 172.21.15.81:0/3277276483 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f29ec0cfbc0 msgr2=0x7f29ec1632b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:49.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.117+0000 7f29ebfff700 1 --2- 172.21.15.81:0/3277276483 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f29ec0cfbc0 0x7f29ec1632b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.117+0000 7f29ebfff700 1 -- 172.21.15.81:0/3277276483 >> v1:172.21.15.81:6789/0 conn(0x7f29ec068bc0 legacy=0x7f29ec0ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:49.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.117+0000 7f29ebfff700 1 -- 172.21.15.81:0/3277276483 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ec0ce3b0 con 0x7f29ec1595b0 2023-10-06T03:25:49.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.117+0000 7f29ebfff700 1 --2- 172.21.15.81:0/3277276483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29ec1595b0 0x7f29ec0af020 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f29dc0098e0 tx=0x7f29dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3464c88cb7c2d8cd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:49.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.118+0000 7f29eaffd700 1 -- 172.21.15.81:0/3277276483 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29dc009e80 con 0x7f29ec1595b0 2023-10-06T03:25:49.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.118+0000 7f29eaffd700 1 -- 172.21.15.81:0/3277276483 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29dc00b860 con 0x7f29ec1595b0 2023-10-06T03:25:49.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.118+0000 7f29eaffd700 1 -- 172.21.15.81:0/3277276483 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29dc00bbe0 con 0x7f29ec1595b0 2023-10-06T03:25:49.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.118+0000 7f29f27ff700 1 -- 172.21.15.81:0/3277276483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29ec1595b0 msgr2=0x7f29ec0af020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:49.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.118+0000 7f29f27ff700 1 --2- 172.21.15.81:0/3277276483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29ec1595b0 0x7f29ec0af020 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f29dc0098e0 tx=0x7f29dc0091a0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.118+0000 7f29f27ff700 1 -- 172.21.15.81:0/3277276483 shutdown_connections 2023-10-06T03:25:49.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.118+0000 7f29f27ff700 1 --2- 172.21.15.81:0/3277276483 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f29ec0cfbc0 0x7f29ec1632b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.118+0000 7f29f27ff700 1 --2- 172.21.15.81:0/3277276483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29ec1595b0 0x7f29ec0af020 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.118+0000 7f29f27ff700 1 -- 172.21.15.81:0/3277276483 >> 172.21.15.81:0/3277276483 conn(0x7f29ec06f7e0 msgr2=0x7f29ec0682b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:49.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.118+0000 7f29f27ff700 1 -- 172.21.15.81:0/3277276483 shutdown_connections 2023-10-06T03:25:49.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.118+0000 7f29f27ff700 1 -- 172.21.15.81:0/3277276483 wait complete. 2023-10-06T03:25:49.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.120+0000 7f29f27ff700 1 Processor -- start 2023-10-06T03:25:49.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.120+0000 7f29f27ff700 1 -- start start 2023-10-06T03:25:49.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.121+0000 7f29f27ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f29ec068bc0 0x7f29ec16c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:49.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.121+0000 7f29f27ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f29ec0cfbc0 0x7f29ec15b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:49.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.121+0000 7f29f27ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29ec1595b0 0x7f29ec0b5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:49.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.121+0000 7f29f27ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec16dd40 con 0x7f29ec1595b0 2023-10-06T03:25:49.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.121+0000 7f29f27ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec16cd10 con 0x7f29ec068bc0 2023-10-06T03:25:49.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.121+0000 7f29f27ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec15bee0 con 0x7f29ec0cfbc0 2023-10-06T03:25:49.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.121+0000 7f29f0d9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29ec1595b0 0x7f29ec0b5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:49.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.121+0000 7f29f0d9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29ec1595b0 0x7f29ec0b5650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60972/0 (socket says 172.21.15.81:60972) 2023-10-06T03:25:49.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.121+0000 7f29f0d9c700 1 -- 172.21.15.81:0/2642182312 learned_addr learned my addr 172.21.15.81:0/2642182312 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:49.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.121+0000 7f29ebfff700 1 --2- 172.21.15.81:0/2642182312 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f29ec068bc0 0x7f29ec16c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:49.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.121+0000 7f29eb7fe700 1 --2- 172.21.15.81:0/2642182312 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f29ec0cfbc0 0x7f29ec15b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:49.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.121+0000 7f29f0d9c700 1 -- 172.21.15.81:0/2642182312 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f29ec0cfbc0 msgr2=0x7f29ec15b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:49.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.121+0000 7f29f0d9c700 1 --2- 172.21.15.81:0/2642182312 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f29ec0cfbc0 0x7f29ec15b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.121+0000 7f29f0d9c700 1 -- 172.21.15.81:0/2642182312 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f29ec068bc0 msgr2=0x7f29ec16c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:49.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.121+0000 7f29f0d9c700 1 --2- 172.21.15.81:0/2642182312 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f29ec068bc0 0x7f29ec16c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.121+0000 7f29f0d9c700 1 -- 172.21.15.81:0/2642182312 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29dc009420 con 0x7f29ec1595b0 2023-10-06T03:25:49.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.122+0000 7f29f0d9c700 1 --2- 172.21.15.81:0/2642182312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29ec1595b0 0x7f29ec0b5650 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f29e4007f30 tx=0x7f29e40098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:49.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.122+0000 7f29d3fff700 1 -- 172.21.15.81:0/2642182312 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e400eb90 con 0x7f29ec1595b0 2023-10-06T03:25:49.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.122+0000 7f29d3fff700 1 -- 172.21.15.81:0/2642182312 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e400ecf0 con 0x7f29ec1595b0 2023-10-06T03:25:49.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.122+0000 7f29f27ff700 1 -- 172.21.15.81:0/2642182312 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29ec16d130 con 0x7f29ec1595b0 2023-10-06T03:25:49.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.122+0000 7f29d3fff700 1 -- 172.21.15.81:0/2642182312 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e4014670 con 0x7f29ec1595b0 2023-10-06T03:25:49.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.122+0000 7f29f27ff700 1 -- 172.21.15.81:0/2642182312 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29ec16d6f0 con 0x7f29ec1595b0 2023-10-06T03:25:49.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.123+0000 7f29f27ff700 1 -- 172.21.15.81:0/2642182312 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29ec04c3c0 con 0x7f29ec1595b0 2023-10-06T03:25:49.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.124+0000 7f29d3fff700 1 -- 172.21.15.81:0/2642182312 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f29e4014a20 con 0x7f29ec1595b0 2023-10-06T03:25:49.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.125+0000 7f29d3fff700 1 --2- 172.21.15.81:0/2642182312 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f29d8066f30 0x7f29d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:49.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.125+0000 7f29d3fff700 1 -- 172.21.15.81:0/2642182312 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f29e4084b70 con 0x7f29ec1595b0 2023-10-06T03:25:49.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.125+0000 7f29ebfff700 1 --2- 172.21.15.81:0/2642182312 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f29d8066f30 0x7f29d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:49.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.126+0000 7f29ebfff700 1 --2- 172.21.15.81:0/2642182312 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f29d8066f30 0x7f29d80693e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f29dc0091e0 tx=0x7f29dc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:49.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.129+0000 7f29d3fff700 1 -- 172.21.15.81:0/2642182312 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f29e4051de0 con 0x7f29ec1595b0 2023-10-06T03:25:49.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.316+0000 7f29f27ff700 1 -- 172.21.15.81:0/2642182312 --> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f29ec16de80 con 0x7f29d8066f30 2023-10-06T03:25:49.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.319+0000 7f29d3fff700 1 -- 172.21.15.81:0/2642182312 <== mgr.4100 v2:172.21.15.81:6832/85286 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73305 (secure 0 0 0) 0x7f29ec16de80 con 0x7f29d8066f30 2023-10-06T03:25:49.321 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:25:49.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.321+0000 7f29f27ff700 1 -- 172.21.15.81:0/2642182312 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f29d8066f30 msgr2=0x7f29d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:49.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.321+0000 7f29f27ff700 1 --2- 172.21.15.81:0/2642182312 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f29d8066f30 0x7f29d80693e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f29dc0091e0 tx=0x7f29dc017000 comp rx=0 tx=0).stop 2023-10-06T03:25:49.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.321+0000 7f29f27ff700 1 -- 172.21.15.81:0/2642182312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29ec1595b0 msgr2=0x7f29ec0b5650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:49.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.321+0000 7f29f27ff700 1 --2- 172.21.15.81:0/2642182312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29ec1595b0 0x7f29ec0b5650 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f29e4007f30 tx=0x7f29e40098e0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.321+0000 7f29f27ff700 1 -- 172.21.15.81:0/2642182312 shutdown_connections 2023-10-06T03:25:49.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.321+0000 7f29f27ff700 1 --2- 172.21.15.81:0/2642182312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29ec1595b0 0x7f29ec0b5650 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.321+0000 7f29f27ff700 1 --2- 172.21.15.81:0/2642182312 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f29ec068bc0 0x7f29ec16c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.321+0000 7f29f27ff700 1 --2- 172.21.15.81:0/2642182312 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f29d8066f30 0x7f29d80693e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.321+0000 7f29f27ff700 1 --2- 172.21.15.81:0/2642182312 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f29ec0cfbc0 0x7f29ec15b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.321+0000 7f29f27ff700 1 -- 172.21.15.81:0/2642182312 >> 172.21.15.81:0/2642182312 conn(0x7f29ec06f7e0 msgr2=0x7f29ec0b2210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:49.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.321+0000 7f29f27ff700 1 -- 172.21.15.81:0/2642182312 shutdown_connections 2023-10-06T03:25:49.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.321+0000 7f29f27ff700 1 -- 172.21.15.81:0/2642182312 wait complete. 2023-10-06T03:25:49.324 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-06T03:25:49.340 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":103,"stamp":"2023-10-06T03:25:47.579283+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2383428,"kb_used_data":5124,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752591292,"statfs":{"total":773094113280,"available":770653483008,"internally_reserved":0,"allocated":5246976,"data_stored":3027967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002766"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":47,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T03:25:30.123278+0000","last_change":"2023-10-06T03:25:30.123246+0000","last_active":"2023-10-06T03:25:30.123278+0000","last_peered":"2023-10-06T03:25:30.123278+0000","last_clean":"2023-10-06T03:25:30.123278+0000","last_became_active":"2023-10-06T03:23:35.397649+0000","last_became_peered":"2023-10-06T03:23:35.397649+0000","last_unstale":"2023-10-06T03:25:30.123278+0000","last_undegraded":"2023-10-06T03:25:30.123278+0000","last_fullsized":"2023-10-06T03:25:30.123278+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:30.123154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:30.123154+0000","last_clean_scrub_stamp":"2023-10-06T03:25:30.123154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:04:20.728587+0000","scrub_duration":0.002523558,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":45,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T03:25:28.649978+0000","last_change":"2023-10-06T03:25:28.649955+0000","last_active":"2023-10-06T03:25:28.649978+0000","last_peered":"2023-10-06T03:25:28.649978+0000","last_clean":"2023-10-06T03:25:28.649978+0000","last_became_active":"2023-10-06T03:23:34.865914+0000","last_became_peered":"2023-10-06T03:23:34.865914+0000","last_unstale":"2023-10-06T03:25:28.649978+0000","last_undegraded":"2023-10-06T03:25:28.649978+0000","last_fullsized":"2023-10-06T03:25:28.649978+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:28.649884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:28.649884+0000","last_clean_scrub_stamp":"2023-10-06T03:25:28.649884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:13:33.440029+0000","scrub_duration":0.0021795130000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":46,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T03:25:27.175790+0000","last_change":"2023-10-06T03:25:27.175767+0000","last_active":"2023-10-06T03:25:27.175790+0000","last_peered":"2023-10-06T03:25:27.175790+0000","last_clean":"2023-10-06T03:25:27.175790+0000","last_became_active":"2023-10-06T03:23:34.873972+0000","last_became_peered":"2023-10-06T03:23:34.873972+0000","last_unstale":"2023-10-06T03:25:27.175790+0000","last_undegraded":"2023-10-06T03:25:27.175790+0000","last_fullsized":"2023-10-06T03:25:27.175790+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:27.175701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:27.175701+0000","last_clean_scrub_stamp":"2023-10-06T03:25:27.175701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:06:46.796757+0000","scrub_duration":0.002195673,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"43'119","reported_seq":196,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T03:25:32.363886+0000","last_change":"2023-10-06T03:25:32.363833+0000","last_active":"2023-10-06T03:25:32.363886+0000","last_peered":"2023-10-06T03:25:32.363886+0000","last_clean":"2023-10-06T03:25:32.363886+0000","last_became_active":"2023-10-06T03:23:34.863539+0000","last_became_peered":"2023-10-06T03:23:34.863539+0000","last_unstale":"2023-10-06T03:25:32.363886+0000","last_undegraded":"2023-10-06T03:25:32.363886+0000","last_fullsized":"2023-10-06T03:25:32.363886+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'119","last_scrub_stamp":"2023-10-06T03:25:32.363732+0000","last_deep_scrub":"43'119","last_deep_scrub_stamp":"2023-10-06T03:25:32.363732+0000","last_clean_scrub_stamp":"2023-10-06T03:25:32.363732+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:09:14.321239+0000","scrub_duration":0.0062334199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":44,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T03:25:30.406279+0000","last_change":"2023-10-06T03:25:30.406249+0000","last_active":"2023-10-06T03:25:30.406279+0000","last_peered":"2023-10-06T03:25:30.406279+0000","last_clean":"2023-10-06T03:25:30.406279+0000","last_became_active":"2023-10-06T03:23:34.863991+0000","last_became_peered":"2023-10-06T03:23:34.863991+0000","last_unstale":"2023-10-06T03:25:30.406279+0000","last_undegraded":"2023-10-06T03:25:30.406279+0000","last_fullsized":"2023-10-06T03:25:30.406279+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:30.406162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:30.406162+0000","last_clean_scrub_stamp":"2023-10-06T03:25:30.406162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:43:44.713709+0000","scrub_duration":0.0020042049999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":44,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T03:25:31.377114+0000","last_change":"2023-10-06T03:25:31.377072+0000","last_active":"2023-10-06T03:25:31.377114+0000","last_peered":"2023-10-06T03:25:31.377114+0000","last_clean":"2023-10-06T03:25:31.377114+0000","last_became_active":"2023-10-06T03:23:34.864752+0000","last_became_peered":"2023-10-06T03:23:34.864752+0000","last_unstale":"2023-10-06T03:25:31.377114+0000","last_undegraded":"2023-10-06T03:25:31.377114+0000","last_fullsized":"2023-10-06T03:25:31.377114+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:31.376984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:31.376984+0000","last_clean_scrub_stamp":"2023-10-06T03:25:31.376984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:39.593776+0000","scrub_duration":0.0022594989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":47,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T03:25:28.013456+0000","last_change":"2023-10-06T03:25:28.013426+0000","last_active":"2023-10-06T03:25:28.013456+0000","last_peered":"2023-10-06T03:25:28.013456+0000","last_clean":"2023-10-06T03:25:28.013456+0000","last_became_active":"2023-10-06T03:23:34.863953+0000","last_became_peered":"2023-10-06T03:23:34.863953+0000","last_unstale":"2023-10-06T03:25:28.013456+0000","last_undegraded":"2023-10-06T03:25:28.013456+0000","last_fullsized":"2023-10-06T03:25:28.013456+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:28.013341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:28.013341+0000","last_clean_scrub_stamp":"2023-10-06T03:25:28.013341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:58.575311+0000","scrub_duration":0.001864182,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":43,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T03:25:41.098853+0000","last_change":"2023-10-06T03:25:41.098818+0000","last_active":"2023-10-06T03:25:41.098853+0000","last_peered":"2023-10-06T03:25:41.098853+0000","last_clean":"2023-10-06T03:25:41.098853+0000","last_became_active":"2023-10-06T03:23:34.873623+0000","last_became_peered":"2023-10-06T03:23:34.873623+0000","last_unstale":"2023-10-06T03:25:41.098853+0000","last_undegraded":"2023-10-06T03:25:41.098853+0000","last_fullsized":"2023-10-06T03:25:41.098853+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:41.098710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:41.098710+0000","last_clean_scrub_stamp":"2023-10-06T03:25:41.098710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:09:23.056217+0000","scrub_duration":0.0025927519999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":43,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T03:25:39.093549+0000","last_change":"2023-10-06T03:25:39.093507+0000","last_active":"2023-10-06T03:25:39.093549+0000","last_peered":"2023-10-06T03:25:39.093549+0000","last_clean":"2023-10-06T03:25:39.093549+0000","last_became_active":"2023-10-06T03:23:34.872139+0000","last_became_peered":"2023-10-06T03:23:34.872139+0000","last_unstale":"2023-10-06T03:25:39.093549+0000","last_undegraded":"2023-10-06T03:25:39.093549+0000","last_fullsized":"2023-10-06T03:25:39.093549+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:25:39.093400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:25:39.093400+0000","last_clean_scrub_stamp":"2023-10-06T03:25:39.093400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:09.655370+0000","scrub_duration":0.0025928919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574878,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298364,"kb_used_data":1076,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073476,"statfs":{"total":96636764160,"available":96331239424,"internally_reserved":0,"allocated":1101824,"data_stored":821441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.60999999999999999,"15min":0.61399999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.76200000000000001,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.65200000000000002,"15min":0.65500000000000003},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.86899999999999999,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.57299999999999995}]},{"osd":1,"last update":"Fri Oct 6 03:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68600000000000005,"15min":0.68799999999999994},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.93799999999999994,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.76200000000000001,"15min":0.77800000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.94099999999999995,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.72299999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64700000000000002,"15min":0.64900000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.71199999999999997,"15min":0.72199999999999998},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88300000000000001,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.61399999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.745,"15min":0.752},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.76500000000000001,"15min":0.77700000000000002},"min":{"1min":0.53700000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.66300000000000003}]},{"osd":4,"last update":"Fri Oct 6 03:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.71799999999999997,"15min":0.73399999999999999},"min":{"1min":0.442,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.94199999999999995,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.78900000000000003,"15min":0.79600000000000004},"min":{"1min":0.56499999999999995,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.754}]},{"osd":5,"last update":"Fri Oct 6 03:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.73699999999999999,"15min":0.75700000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.97999999999999998,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.77700000000000002,"15min":0.79300000000000004},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.89500000000000002,"5min":1.155,"15min":1.155},"last":0.68100000000000005}]},{"osd":6,"last update":"Fri Oct 6 03:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.84599999999999997,"15min":0.86599999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0840000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.747},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.76600000000000001,"15min":0.77500000000000002},"min":{"1min":0.45200000000000001,"5min":0.433,"15min":0.433},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.78200000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297780,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074060,"statfs":{"total":96636764160,"available":96331837440,"internally_reserved":0,"allocated":503808,"data_stored":229720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.65700000000000003,"15min":0.65100000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.94399999999999995,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.628,"15min":0.626},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.83299999999999996}]},{"osd":1,"last update":"Fri Oct 6 03:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.63100000000000001,"15min":0.63300000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.83599999999999997,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.67300000000000004,"15min":0.67400000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.97099999999999997,"5min":1.024,"15min":1.024},"last":0.72099999999999997}]},{"osd":2,"last update":"Fri Oct 6 03:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.70599999999999996,"15min":0.70899999999999996},"min":{"1min":0.49399999999999999,"5min":0.439,"15min":0.439},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.90700000000000003}]},{"osd":3,"last update":"Fri Oct 6 03:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.68300000000000005,"15min":0.68100000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.70299999999999996,"15min":0.70899999999999996},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.90200000000000002,"5min":1.101,"15min":1.101},"last":0.85999999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.73999999999999999,"15min":0.751},"min":{"1min":0.45900000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.149,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.72999999999999998,"15min":0.72499999999999998},"min":{"1min":0.52000000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.879}]},{"osd":5,"last update":"Fri Oct 6 03:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.70699999999999996,"15min":0.71399999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.96099999999999997,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.79300000000000004,"15min":0.79900000000000004},"min":{"1min":0.55600000000000005,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1060000000000001,"5min":1.298,"15min":1.298},"last":0.60299999999999998}]},{"osd":7,"last update":"Fri Oct 6 03:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.78800000000000003,"15min":0.79500000000000004},"min":{"1min":0.53200000000000003,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0880000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.80100000000000005,"15min":0.81100000000000005},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1259999999999999,"5min":1.325,"15min":1.325},"last":0.74299999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298364,"kb_used_data":1076,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073476,"statfs":{"total":96636764160,"available":96331239424,"internally_reserved":0,"allocated":1101824,"data_stored":821441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.41599999999999998,"15min":0.42199999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.51900000000000002,"15min":0.52700000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.64400000000000002,"5min":1.399,"15min":1.399},"last":0.52000000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.47399999999999998,"15min":0.48199999999999998},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.54500000000000004,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.51400000000000001,"15min":0.52200000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.64500000000000002,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.54200000000000004}]},{"osd":3,"last update":"Fri Oct 6 03:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.54800000000000004,"15min":0.55300000000000005},"min":{"1min":0.40000000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.52300000000000002,"15min":0.53300000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.53000000000000003,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.69899999999999995}]},{"osd":4,"last update":"Fri Oct 6 03:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.76100000000000001,"15min":0.76500000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.92200000000000004,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.80600000000000005,"15min":0.81100000000000005},"min":{"1min":0.59599999999999997,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.93000000000000005,"5min":1.143,"15min":1.143},"last":0.78100000000000003}]},{"osd":5,"last update":"Fri Oct 6 03:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.79500000000000004,"15min":0.80500000000000005},"min":{"1min":0.58199999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.90100000000000002,"5min":1.468,"15min":1.468},"last":0.75},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.755,"15min":0.76600000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.92600000000000005,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.68300000000000005}]},{"osd":6,"last update":"Fri Oct 6 03:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.82099999999999995,"15min":0.83299999999999996},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0409999999999999,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.82299999999999995,"15min":0.83099999999999996},"min":{"1min":0.59499999999999997,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":0.95299999999999996,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.91600000000000004}]},{"osd":7,"last update":"Fri Oct 6 03:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.80200000000000005,"15min":0.81000000000000005},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.94699999999999995,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.752,"5min":0.82799999999999996,"15min":0.83999999999999997},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0389999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.89300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297784,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074056,"statfs":{"total":96636764160,"available":96331833344,"internally_reserved":0,"allocated":507904,"data_stored":231073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.47499999999999998,"15min":0.48699999999999999},"min":{"1min":0.28100000000000003,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.60099999999999998,"5min":1.115,"15min":1.115},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.5,"5min":0.504,"15min":0.504},"min":{"1min":0.35999999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.48499999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.50600000000000001,"15min":0.51700000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.55800000000000005,"5min":1.079,"15min":1.079},"last":0.504},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.52100000000000002,"15min":0.53600000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.57499999999999996,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.38900000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.51400000000000001,"15min":0.52000000000000002},"min":{"1min":0.315,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.66300000000000003,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.63300000000000001,"15min":0.64900000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.747,"5min":1.478,"15min":1.478},"last":0.54600000000000004}]},{"osd":4,"last update":"Fri Oct 6 03:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.72799999999999998,"15min":0.71999999999999997},"min":{"1min":0.61599999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.73499999999999999,"15min":0.73299999999999998},"min":{"1min":0.57099999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.95599999999999996}]},{"osd":5,"last update":"Fri Oct 6 03:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.64500000000000002,"5min":0.5,"15min":0.5},"max":{"1min":0.97399999999999998,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.76300000000000001,"15min":0.754},"min":{"1min":0.64400000000000002,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.81399999999999995}]},{"osd":6,"last update":"Fri Oct 6 03:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.72299999999999998,"15min":0.72399999999999998},"min":{"1min":0.53800000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.86199999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.81799999999999995,"15min":0.81999999999999995},"min":{"1min":0.627,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":0.96599999999999997,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.72499999999999998}]},{"osd":7,"last update":"Fri Oct 6 03:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.78300000000000003,"15min":0.78200000000000003},"min":{"1min":0.61299999999999999,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.78200000000000003,"15min":0.78600000000000003},"min":{"1min":0.56899999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.98499999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.86399999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297784,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074056,"statfs":{"total":96636764160,"available":96331833344,"internally_reserved":0,"allocated":507904,"data_stored":231073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.49399999999999999,"15min":0.50900000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.64900000000000002,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.49399999999999999,"15min":0.498},"min":{"1min":0.36499999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.59799999999999998,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.36699999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.56399999999999995,"15min":0.57999999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.627,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.53400000000000003,"15min":0.54200000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.66900000000000004,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.50800000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.52300000000000002,"15min":0.53200000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.66100000000000003,"5min":1.601,"15min":1.601},"last":0.44},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.61099999999999999,"15min":0.629},"min":{"1min":0.40500000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.69599999999999995,"5min":1.657,"15min":1.657},"last":0.59499999999999997}]},{"osd":4,"last update":"Fri Oct 6 03:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.79300000000000004,"15min":0.80500000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.97099999999999997,"5min":1.202,"15min":1.202},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.77200000000000002,"15min":0.77400000000000002},"min":{"1min":0.60899999999999999,"5min":0.495,"15min":0.495},"max":{"1min":1.0029999999999999,"5min":1.081,"15min":1.081},"last":0.84099999999999997}]},{"osd":5,"last update":"Fri Oct 6 03:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.629,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.97999999999999998,"5min":1.109,"15min":1.109},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.77600000000000002,"15min":0.78200000000000003},"min":{"1min":0.60499999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.98299999999999998,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.92100000000000004}]},{"osd":6,"last update":"Fri Oct 6 03:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.77700000000000002,"15min":0.78200000000000003},"min":{"1min":0.58599999999999997,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.82299999999999995,"15min":0.82699999999999996},"min":{"1min":0.66200000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0329999999999999,"5min":1.232,"15min":1.232},"last":0.82299999999999995}]},{"osd":7,"last update":"Fri Oct 6 03:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.79500000000000004,"15min":0.79700000000000004},"min":{"1min":0.65100000000000002,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.96199999999999997,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.79200000000000004,"15min":0.79600000000000004},"min":{"1min":0.65100000000000002,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.026,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.88}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297784,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074056,"statfs":{"total":96636764160,"available":96331833344,"internally_reserved":0,"allocated":507904,"data_stored":231073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.42599999999999999,"15min":0.42399999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.51800000000000002,"15min":0.52000000000000002},"min":{"1min":0.38400000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.72299999999999998,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.69599999999999995}]},{"osd":1,"last update":"Fri Oct 6 03:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.45400000000000001,"15min":0.45500000000000002},"min":{"1min":0.317,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.50900000000000001,"15min":0.51300000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.67200000000000004,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.67200000000000004}]},{"osd":2,"last update":"Fri Oct 6 03:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.504,"15min":0.51100000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.67700000000000005,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.49199999999999999,"15min":0.48899999999999999},"min":{"1min":0.36799999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.71099999999999997}]},{"osd":4,"last update":"Fri Oct 6 03:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.77500000000000002,"15min":0.77900000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.92700000000000005,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.79800000000000004,"15min":0.80300000000000005},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":0.94699999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.89600000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.754,"15min":0.76100000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.90700000000000003,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.73899999999999999,"15min":0.74299999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.90600000000000003,"5min":1.123,"15min":1.123},"last":0.77800000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.78100000000000003,"15min":0.78900000000000003},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.97899999999999998,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.78100000000000003,"15min":0.79300000000000004},"min":{"1min":0.57499999999999996,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.90500000000000003,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.80000000000000004}]},{"osd":7,"last update":"Fri Oct 6 03:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.77300000000000002,"15min":0.77900000000000003},"min":{"1min":0.58899999999999997,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.85199999999999998,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.81699999999999995,"15min":0.83299999999999996},"min":{"1min":0.57599999999999996,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.94899999999999995,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.91700000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297784,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074056,"statfs":{"total":96636764160,"available":96331833344,"internally_reserved":0,"allocated":507904,"data_stored":231073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.66500000000000004,"15min":0.64300000000000002},"min":{"1min":0.42799999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":3.6190000000000002,"5min":3.6190000000000002,"15min":3.6190000000000002},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.70499999999999996,"15min":0.70199999999999996},"min":{"1min":0.55700000000000005,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.80900000000000005}]},{"osd":1,"last update":"Fri Oct 6 03:25:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.63,"15min":0.62},"min":{"1min":0.55200000000000005,"5min":0.437,"15min":0.437},"max":{"1min":0.89800000000000002,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.66600000000000004,"15min":0.66800000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.76400000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:25:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.66800000000000004,"15min":0.66400000000000003},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":2.0539999999999998,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.70299999999999996,"15min":0.70399999999999996},"min":{"1min":0.56899999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.82599999999999996,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.871}]},{"osd":3,"last update":"Fri Oct 6 03:25:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.68500000000000005,"15min":0.68300000000000005},"min":{"1min":0.51300000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.88800000000000001,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.73499999999999999,"15min":0.74399999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.92900000000000005,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.84499999999999997}]},{"osd":5,"last update":"Fri Oct 6 03:25:34 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.66000000000000003,"15min":0.67000000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.72899999999999998,"15min":0.73899999999999999},"min":{"1min":0.48299999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.94899999999999995,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.56899999999999995}]},{"osd":6,"last update":"Fri Oct 6 03:25:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.73799999999999999,"15min":0.74199999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.72399999999999998,"15min":0.72999999999999998},"min":{"1min":0.47999999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.90800000000000003,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.65000000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:25:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.78600000000000003,"15min":0.78400000000000003},"min":{"1min":0.48899999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":2.1179999999999999,"5min":2.1179999999999999,"15min":2.1179999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.78800000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297784,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074056,"statfs":{"total":96636764160,"available":96331833344,"internally_reserved":0,"allocated":507904,"data_stored":231073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:25:37 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.628,"15min":0.624},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.92100000000000004,"5min":1.327,"15min":1.327},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.63300000000000001,"15min":0.63200000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.89100000000000001,"5min":1.115,"15min":1.115},"last":0.72199999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:25:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.69099999999999995,"15min":0.69599999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.99099999999999999,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.69199999999999995,"15min":0.69799999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.004,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.84999999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:25:37 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69999999999999996,"15min":0.70799999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.026,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.67800000000000005,"15min":0.67500000000000004},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.93600000000000005,"5min":1.018,"15min":1.018},"last":0.78200000000000003}]},{"osd":3,"last update":"Fri Oct 6 03:25:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.71099999999999997,"15min":0.71699999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.0620000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.748},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.754,"15min":0.75900000000000001},"min":{"1min":0.47899999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.94699999999999995,"5min":1.304,"15min":1.304},"last":0.83199999999999996}]},{"osd":4,"last update":"Fri Oct 6 03:25:37 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.75,"15min":0.76000000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.93500000000000005,"5min":1.609,"15min":1.609},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.745,"5min":0.75700000000000001,"15min":0.75900000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.97299999999999998,"5min":1.468,"15min":1.468},"last":0.68200000000000005}]},{"osd":6,"last update":"Fri Oct 6 03:25:37 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.73799999999999999,"15min":0.746},"min":{"1min":0.51100000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.91500000000000004,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.77200000000000002,"15min":0.77900000000000003},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.91100000000000003,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":0.60499999999999998}]},{"osd":7,"last update":"Fri Oct 6 03:25:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.75600000000000001,"15min":0.76000000000000001},"min":{"1min":0.53900000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.92300000000000004,"5min":1.591,"15min":1.591},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.82299999999999995,"15min":0.83099999999999996},"min":{"1min":0.58099999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.95399999999999996,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.879}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:25:49.343 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-06T03:25:49.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.515+0000 7f7f9cf9d700 1 Processor -- start 2023-10-06T03:25:49.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.515+0000 7f7f9cf9d700 1 -- start start 2023-10-06T03:25:49.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.516+0000 7f7f9cf9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7f98159750 0x7f7f980aba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:49.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.516+0000 7f7f9cf9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7f980ae560 0x7f7f980c7420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:49.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.516+0000 7f7f9cf9d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f980c7cc0 con 0x7f7f98159b20 2023-10-06T03:25:49.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.516+0000 7f7f9cf9d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f980abfa0 con 0x7f7f98159750 2023-10-06T03:25:49.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.516+0000 7f7f9cf9d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f980c7fa0 con 0x7f7f980ae560 2023-10-06T03:25:49.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.516+0000 7f7f977fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7f98159750 0x7f7f980aba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:49.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.516+0000 7f7f977fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7f98159750 0x7f7f980aba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60984/0 (socket says 172.21.15.81:60984) 2023-10-06T03:25:49.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.516+0000 7f7f977fe700 1 -- 172.21.15.81:0/1918292981 learned_addr learned my addr 172.21.15.81:0/1918292981 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:49.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.516+0000 7f7f96ffd700 1 --2- 172.21.15.81:0/1918292981 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7f980ae560 0x7f7f980c7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:49.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.517+0000 7f7f977fe700 1 -- 172.21.15.81:0/1918292981 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7f980ae560 msgr2=0x7f7f980c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:49.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.517+0000 7f7f977fe700 1 --2- 172.21.15.81:0/1918292981 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7f980ae560 0x7f7f980c7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.517+0000 7f7f977fe700 1 -- 172.21.15.81:0/1918292981 >> v1:172.21.15.83:6789/0 conn(0x7f7f98159b20 legacy=0x7f7f98155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:49.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.517+0000 7f7f977fe700 1 -- 172.21.15.81:0/1918292981 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f98069350 con 0x7f7f98159750 2023-10-06T03:25:49.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.517+0000 7f7f96ffd700 1 --2- 172.21.15.81:0/1918292981 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7f980ae560 0x7f7f980c7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:25:49.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.517+0000 7f7f977fe700 1 --2- 172.21.15.81:0/1918292981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f98159750 0x7f7f980aba60 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f7f880099b0 tx=0x7f7f88009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af8dadd9beed4ea2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:49.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.517+0000 7f7f967fc700 1 -- 172.21.15.81:0/1918292981 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8800b860 con 0x7f7f98159750 2023-10-06T03:25:49.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.517+0000 7f7f967fc700 1 -- 172.21.15.81:0/1918292981 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f8800b9c0 con 0x7f7f98159750 2023-10-06T03:25:49.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.517+0000 7f7f967fc700 1 -- 172.21.15.81:0/1918292981 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8800bd60 con 0x7f7f98159750 2023-10-06T03:25:49.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.518+0000 7f7f9cf9d700 1 -- 172.21.15.81:0/1918292981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f98159750 msgr2=0x7f7f980aba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:49.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.518+0000 7f7f9cf9d700 1 --2- 172.21.15.81:0/1918292981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f98159750 0x7f7f980aba60 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f7f880099b0 tx=0x7f7f88009250 comp rx=0 tx=0).stop 2023-10-06T03:25:49.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.518+0000 7f7f9cf9d700 1 -- 172.21.15.81:0/1918292981 shutdown_connections 2023-10-06T03:25:49.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.518+0000 7f7f9cf9d700 1 --2- 172.21.15.81:0/1918292981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f98159750 0x7f7f980aba60 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.518+0000 7f7f9cf9d700 1 --2- 172.21.15.81:0/1918292981 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7f980ae560 0x7f7f980c7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.518+0000 7f7f9cf9d700 1 -- 172.21.15.81:0/1918292981 >> 172.21.15.81:0/1918292981 conn(0x7f7f980680b0 msgr2=0x7f7f980cbeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:49.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.518+0000 7f7f9cf9d700 1 -- 172.21.15.81:0/1918292981 shutdown_connections 2023-10-06T03:25:49.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.518+0000 7f7f9cf9d700 1 -- 172.21.15.81:0/1918292981 wait complete. 2023-10-06T03:25:49.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.519+0000 7f7f9cf9d700 1 Processor -- start 2023-10-06T03:25:49.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.519+0000 7f7f9cf9d700 1 -- start start 2023-10-06T03:25:49.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.520+0000 7f7f9cf9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f980ae560 0x7f7f980b15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:49.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.520+0000 7f7f9cf9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f98159750 0x7f7f980af5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:49.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.520+0000 7f7f9cf9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7f98159b20 0x7f7f980c4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:49.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.520+0000 7f7f9cf9d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f980c3c80 con 0x7f7f980ae560 2023-10-06T03:25:49.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.520+0000 7f7f9cf9d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f980b1b20 con 0x7f7f98159750 2023-10-06T03:25:49.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.520+0000 7f7f9cf9d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f980af2c0 con 0x7f7f98159b20 2023-10-06T03:25:49.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.520+0000 7f7f977fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f980ae560 0x7f7f980b15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:49.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.520+0000 7f7f977fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f980ae560 0x7f7f980b15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60996/0 (socket says 172.21.15.81:60996) 2023-10-06T03:25:49.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.520+0000 7f7f977fe700 1 -- 172.21.15.81:0/3139116681 learned_addr learned my addr 172.21.15.81:0/3139116681 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:49.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.521+0000 7f7f97fff700 1 --2- 172.21.15.81:0/3139116681 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7f98159b20 0x7f7f980c4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:49.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.521+0000 7f7f96ffd700 1 --2- 172.21.15.81:0/3139116681 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f98159750 0x7f7f980af5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:49.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.521+0000 7f7f977fe700 1 -- 172.21.15.81:0/3139116681 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7f98159b20 msgr2=0x7f7f980c4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:49.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.521+0000 7f7f977fe700 1 --2- 172.21.15.81:0/3139116681 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7f98159b20 0x7f7f980c4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.521+0000 7f7f977fe700 1 -- 172.21.15.81:0/3139116681 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f98159750 msgr2=0x7f7f980af5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:49.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.521+0000 7f7f977fe700 1 --2- 172.21.15.81:0/3139116681 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f98159750 0x7f7f980af5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.521+0000 7f7f977fe700 1 -- 172.21.15.81:0/3139116681 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f880094f0 con 0x7f7f980ae560 2023-10-06T03:25:49.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.521+0000 7f7f977fe700 1 --2- 172.21.15.81:0/3139116681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f980ae560 0x7f7f980b15e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f7f88009290 tx=0x7f7f88017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:49.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.521+0000 7f7f7f7fe700 1 -- 172.21.15.81:0/3139116681 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f88026480 con 0x7f7f980ae560 2023-10-06T03:25:49.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.521+0000 7f7f7f7fe700 1 -- 172.21.15.81:0/3139116681 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f8801f070 con 0x7f7f980ae560 2023-10-06T03:25:49.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.521+0000 7f7f7f7fe700 1 -- 172.21.15.81:0/3139116681 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f88026830 con 0x7f7f980ae560 2023-10-06T03:25:49.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.521+0000 7f7f9cf9d700 1 -- 172.21.15.81:0/3139116681 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f980bf6b0 con 0x7f7f980ae560 2023-10-06T03:25:49.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.522+0000 7f7f9cf9d700 1 -- 172.21.15.81:0/3139116681 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f980aefe0 con 0x7f7f980ae560 2023-10-06T03:25:49.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.522+0000 7f7f9cf9d700 1 -- 172.21.15.81:0/3139116681 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f980c3f60 con 0x7f7f980ae560 2023-10-06T03:25:49.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.523+0000 7f7f7f7fe700 1 -- 172.21.15.81:0/3139116681 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7f8801a430 con 0x7f7f980ae560 2023-10-06T03:25:49.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.524+0000 7f7f7f7fe700 1 --2- 172.21.15.81:0/3139116681 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7f84066f30 0x7f7f840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:49.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.524+0000 7f7f7f7fe700 1 -- 172.21.15.81:0/3139116681 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f7f88021070 con 0x7f7f980ae560 2023-10-06T03:25:49.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.524+0000 7f7f96ffd700 1 --2- 172.21.15.81:0/3139116681 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7f84066f30 0x7f7f840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:49.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.525+0000 7f7f96ffd700 1 --2- 172.21.15.81:0/3139116681 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7f84066f30 0x7f7f840693e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c006f00 tx=0x7f7f8c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:49.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.528+0000 7f7f7f7fe700 1 -- 172.21.15.81:0/3139116681 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7f88053820 con 0x7f7f980ae560 2023-10-06T03:25:49.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.721+0000 7f7f9cf9d700 1 -- 172.21.15.81:0/3139116681 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f7f9804c3c0 con 0x7f7f980ae560 2023-10-06T03:25:49.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.725+0000 7f7f7f7fe700 1 -- 172.21.15.81:0/3139116681 <== mon.0 v2:172.21.15.81:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7f88053820 con 0x7f7f980ae560 2023-10-06T03:25:49.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.726+0000 7f7f7f7fe700 1 -- 172.21.15.81:0/3139116681 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7f7f88056e40 con 0x7f7f980ae560 2023-10-06T03:25:49.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.728+0000 7f7f9cf9d700 1 -- 172.21.15.81:0/3139116681 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7f84066f30 msgr2=0x7f7f840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:49.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.728+0000 7f7f9cf9d700 1 --2- 172.21.15.81:0/3139116681 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7f84066f30 0x7f7f840693e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c006f00 tx=0x7f7f8c008040 comp rx=0 tx=0).stop 2023-10-06T03:25:49.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.728+0000 7f7f9cf9d700 1 -- 172.21.15.81:0/3139116681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f980ae560 msgr2=0x7f7f980b15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:49.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.728+0000 7f7f9cf9d700 1 --2- 172.21.15.81:0/3139116681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f980ae560 0x7f7f980b15e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f7f88009290 tx=0x7f7f88017000 comp rx=0 tx=0).stop 2023-10-06T03:25:49.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.729+0000 7f7f9cf9d700 1 -- 172.21.15.81:0/3139116681 shutdown_connections 2023-10-06T03:25:49.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.729+0000 7f7f9cf9d700 1 --2- 172.21.15.81:0/3139116681 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7f84066f30 0x7f7f840693e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.729+0000 7f7f9cf9d700 1 --2- 172.21.15.81:0/3139116681 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7f98159b20 0x7f7f980c4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.729+0000 7f7f9cf9d700 1 --2- 172.21.15.81:0/3139116681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f980ae560 0x7f7f980b15e0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.729+0000 7f7f9cf9d700 1 --2- 172.21.15.81:0/3139116681 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f98159750 0x7f7f980af5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.729+0000 7f7f9cf9d700 1 -- 172.21.15.81:0/3139116681 >> 172.21.15.81:0/3139116681 conn(0x7f7f980680b0 msgr2=0x7f7f980c8610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:49.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.729+0000 7f7f9cf9d700 1 -- 172.21.15.81:0/3139116681 shutdown_connections 2023-10-06T03:25:49.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.729+0000 7f7f9cf9d700 1 -- 172.21.15.81:0/3139116681 wait complete. 2023-10-06T03:25:49.748 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T03:25:49.748 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:25:49.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.926+0000 7f7e243ff700 1 Processor -- start 2023-10-06T03:25:49.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.926+0000 7f7e243ff700 1 -- start start 2023-10-06T03:25:49.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.928+0000 7f7e243ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7e1c1557f0 0x7f7e1c156c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:49.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.928+0000 7f7e243ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7e1c155bc0 0x7f7e1c0c6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:49.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.928+0000 7f7e243ff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e1c0c9c60 con 0x7f7e1c069ee0 2023-10-06T03:25:49.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.928+0000 7f7e243ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e1c06df20 con 0x7f7e1c1557f0 2023-10-06T03:25:49.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.928+0000 7f7e243ff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e1c0c74e0 con 0x7f7e1c155bc0 2023-10-06T03:25:49.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.928+0000 7f7e2219b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7e1c1557f0 0x7f7e1c156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:49.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.928+0000 7f7e2219b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7e1c1557f0 0x7f7e1c156c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49854/0 (socket says 172.21.15.81:49854) 2023-10-06T03:25:49.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.928+0000 7f7e2219b700 1 -- 172.21.15.81:0/1959620304 learned_addr learned my addr 172.21.15.81:0/1959620304 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:49.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.928+0000 7f7e2199a700 1 --2- 172.21.15.81:0/1959620304 >> v2:172.21.15.83:3300/0 conn(0x7f7e1c155bc0 0x7f7e1c0c6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:49.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.928+0000 7f7e2219b700 1 -- 172.21.15.81:0/1959620304 >> v2:172.21.15.83:3300/0 conn(0x7f7e1c155bc0 msgr2=0x7f7e1c0c6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:25:49.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.928+0000 7f7e2219b700 1 --2- 172.21.15.81:0/1959620304 >> v2:172.21.15.83:3300/0 conn(0x7f7e1c155bc0 0x7f7e1c0c6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.928+0000 7f7e2219b700 1 -- 172.21.15.81:0/1959620304 >> v1:172.21.15.83:6789/0 conn(0x7f7e1c069ee0 legacy=0x7f7e1c159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:49.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.928+0000 7f7e2219b700 1 -- 172.21.15.81:0/1959620304 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e1c06dc60 con 0x7f7e1c1557f0 2023-10-06T03:25:49.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.929+0000 7f7e2219b700 1 --2- 172.21.15.81:0/1959620304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e1c1557f0 0x7f7e1c156c90 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c0cd0c0 tx=0x7f7e18009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=638f006df490182a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:49.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.929+0000 7f7e21199700 1 -- 172.21.15.81:0/1959620304 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e18009e70 con 0x7f7e1c1557f0 2023-10-06T03:25:49.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.929+0000 7f7e21199700 1 -- 172.21.15.81:0/1959620304 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7e1800b860 con 0x7f7e1c1557f0 2023-10-06T03:25:49.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.929+0000 7f7e21199700 1 -- 172.21.15.81:0/1959620304 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1800bc20 con 0x7f7e1c1557f0 2023-10-06T03:25:49.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.929+0000 7f7e243ff700 1 -- 172.21.15.81:0/1959620304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e1c1557f0 msgr2=0x7f7e1c156c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:49.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.929+0000 7f7e243ff700 1 --2- 172.21.15.81:0/1959620304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e1c1557f0 0x7f7e1c156c90 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c0cd0c0 tx=0x7f7e18009250 comp rx=0 tx=0).stop 2023-10-06T03:25:49.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.930+0000 7f7e243ff700 1 -- 172.21.15.81:0/1959620304 shutdown_connections 2023-10-06T03:25:49.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.930+0000 7f7e243ff700 1 --2- 172.21.15.81:0/1959620304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e1c1557f0 0x7f7e1c156c90 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.930+0000 7f7e243ff700 1 --2- 172.21.15.81:0/1959620304 >> v2:172.21.15.83:3300/0 conn(0x7f7e1c155bc0 0x7f7e1c0c6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.930+0000 7f7e243ff700 1 -- 172.21.15.81:0/1959620304 >> 172.21.15.81:0/1959620304 conn(0x7f7e1c0cc090 msgr2=0x7f7e1c0cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:49.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.930+0000 7f7e243ff700 1 -- 172.21.15.81:0/1959620304 shutdown_connections 2023-10-06T03:25:49.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.930+0000 7f7e243ff700 1 -- 172.21.15.81:0/1959620304 wait complete. 2023-10-06T03:25:49.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.931+0000 7f7e243ff700 1 Processor -- start 2023-10-06T03:25:49.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.931+0000 7f7e243ff700 1 -- start start 2023-10-06T03:25:49.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.932+0000 7f7e243ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e1c069ee0 0x7f7e1c0c3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:49.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.932+0000 7f7e243ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7e1c1557f0 0x7f7e1c14c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:49.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.932+0000 7f7e243ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e1c155bc0 0x7f7e1c1549a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:49.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.932+0000 7f7e243ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c14bfa0 con 0x7f7e1c155bc0 2023-10-06T03:25:49.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.932+0000 7f7e243ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c0c3680 con 0x7f7e1c1557f0 2023-10-06T03:25:49.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.932+0000 7f7e243ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c14b200 con 0x7f7e1c069ee0 2023-10-06T03:25:49.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.932+0000 7f7e2299c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e1c155bc0 0x7f7e1c1549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:49.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.932+0000 7f7e2299c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e1c155bc0 0x7f7e1c1549a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49864/0 (socket says 172.21.15.81:49864) 2023-10-06T03:25:49.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.932+0000 7f7e2299c700 1 -- 172.21.15.81:0/4020498310 learned_addr learned my addr 172.21.15.81:0/4020498310 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-06T03:25:49.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.932+0000 7f7e2199a700 1 --2- 172.21.15.81:0/4020498310 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7e1c1557f0 0x7f7e1c14c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:49.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.932+0000 7f7e2219b700 1 --2- 172.21.15.81:0/4020498310 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e1c069ee0 0x7f7e1c0c3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:49.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.933+0000 7f7e2299c700 1 -- 172.21.15.81:0/4020498310 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e1c069ee0 msgr2=0x7f7e1c0c3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:49.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.933+0000 7f7e2299c700 1 --2- 172.21.15.81:0/4020498310 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e1c069ee0 0x7f7e1c0c3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.933+0000 7f7e2299c700 1 -- 172.21.15.81:0/4020498310 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7e1c1557f0 msgr2=0x7f7e1c14c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:49.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.933+0000 7f7e2299c700 1 --2- 172.21.15.81:0/4020498310 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7e1c1557f0 0x7f7e1c14c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:49.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.933+0000 7f7e2299c700 1 -- 172.21.15.81:0/4020498310 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e180094f0 con 0x7f7e1c155bc0 2023-10-06T03:25:49.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.933+0000 7f7e2299c700 1 --2- 172.21.15.81:0/4020498310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e1c155bc0 0x7f7e1c1549a0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f7e1400c840 tx=0x7f7e14001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:49.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.933+0000 7f7e127fc700 1 -- 172.21.15.81:0/4020498310 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e14012630 con 0x7f7e1c155bc0 2023-10-06T03:25:49.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.933+0000 7f7e127fc700 1 -- 172.21.15.81:0/4020498310 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7e140127b0 con 0x7f7e1c155bc0 2023-10-06T03:25:49.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.933+0000 7f7e127fc700 1 -- 172.21.15.81:0/4020498310 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e14012b90 con 0x7f7e1c155bc0 2023-10-06T03:25:49.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.933+0000 7f7e243ff700 1 -- 172.21.15.81:0/4020498310 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e1c14b4e0 con 0x7f7e1c155bc0 2023-10-06T03:25:49.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.933+0000 7f7e243ff700 1 -- 172.21.15.81:0/4020498310 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e1c14bc30 con 0x7f7e1c155bc0 2023-10-06T03:25:49.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.934+0000 7f7e243ff700 1 -- 172.21.15.81:0/4020498310 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e1c14c150 con 0x7f7e1c155bc0 2023-10-06T03:25:49.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.935+0000 7f7e127fc700 1 -- 172.21.15.81:0/4020498310 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7e1401b400 con 0x7f7e1c155bc0 2023-10-06T03:25:49.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.936+0000 7f7e127fc700 1 --2- 172.21.15.81:0/4020498310 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7e00066f30 0x7f7e000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:25:49.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.936+0000 7f7e127fc700 1 -- 172.21.15.81:0/4020498310 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f7e14084a00 con 0x7f7e1c155bc0 2023-10-06T03:25:49.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.936+0000 7f7e2219b700 1 --2- 172.21.15.81:0/4020498310 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7e00066f30 0x7f7e000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:25:49.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.937+0000 7f7e2219b700 1 --2- 172.21.15.81:0/4020498310 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7e00066f30 0x7f7e000693e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c0cd0c0 tx=0x7f7e18009250 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:25:49.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:49.940+0000 7f7e127fc700 1 -- 172.21.15.81:0/4020498310 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7e1c14c150 con 0x7f7e1c155bc0 2023-10-06T03:25:50.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:50.175+0000 7f7e243ff700 1 -- 172.21.15.81:0/4020498310 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7e1c14ba80 con 0x7f7e1c155bc0 2023-10-06T03:25:50.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:50.176+0000 7f7e127fc700 1 -- 172.21.15.81:0/4020498310 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+3523 (secure 0 0 0) 0x7f7e14051c50 con 0x7f7e1c155bc0 2023-10-06T03:25:50.178 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-06T03:25:50.178 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":29,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5065,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6834/822949628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":822949628},{"type":"v1","addr":"172.21.15.83:6834","nonce":822949628}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5068,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3024690603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6833","nonce":3024690603},{"type":"v1","addr":"172.21.15.83:6835","nonce":3024690603}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5074,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2638072815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2638072815},{"type":"v1","addr":"172.21.15.81:6837","nonce":2638072815}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5463,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/312237496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":312237496},{"type":"v1","addr":"172.21.15.81:6835","nonce":312237496}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[]} 2023-10-06T03:25:50.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:50.178+0000 7f7e243ff700 1 -- 172.21.15.81:0/4020498310 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7e00066f30 msgr2=0x7f7e000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:50.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:50.178+0000 7f7e243ff700 1 --2- 172.21.15.81:0/4020498310 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7e00066f30 0x7f7e000693e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c0cd0c0 tx=0x7f7e18009250 comp rx=0 tx=0).stop 2023-10-06T03:25:50.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:50.178+0000 7f7e243ff700 1 -- 172.21.15.81:0/4020498310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e1c155bc0 msgr2=0x7f7e1c1549a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:25:50.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:50.178+0000 7f7e243ff700 1 --2- 172.21.15.81:0/4020498310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e1c155bc0 0x7f7e1c1549a0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f7e1400c840 tx=0x7f7e14001670 comp rx=0 tx=0).stop 2023-10-06T03:25:50.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:50.178+0000 7f7e243ff700 1 -- 172.21.15.81:0/4020498310 shutdown_connections 2023-10-06T03:25:50.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:50.178+0000 7f7e243ff700 1 --2- 172.21.15.81:0/4020498310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e1c155bc0 0x7f7e1c1549a0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:50.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:50.178+0000 7f7e243ff700 1 --2- 172.21.15.81:0/4020498310 >> [v2:172.21.15.81:6832/85286,v1:172.21.15.81:6833/85286] conn(0x7f7e00066f30 0x7f7e000693e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:50.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:50.178+0000 7f7e243ff700 1 --2- 172.21.15.81:0/4020498310 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7e1c069ee0 0x7f7e1c0c3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:50.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:50.178+0000 7f7e243ff700 1 --2- 172.21.15.81:0/4020498310 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7e1c1557f0 0x7f7e1c14c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:25:50.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:50.178+0000 7f7e243ff700 1 -- 172.21.15.81:0/4020498310 >> 172.21.15.81:0/4020498310 conn(0x7f7e1c0cc090 msgr2=0x7f7e1c069630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:25:50.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:50.178+0000 7f7e243ff700 1 -- 172.21.15.81:0/4020498310 shutdown_connections 2023-10-06T03:25:50.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-06T03:25:50.178+0000 7f7e243ff700 1 -- 172.21.15.81:0/4020498310 wait complete. 2023-10-06T03:25:50.181 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 29 2023-10-06T03:25:50.197 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-06T03:25:50.198 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-06T03:25:50.198 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T03:25:50.198 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:25:50.210 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T03:25:50.211 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T03:25:50.211 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:25:50.264 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T03:25:50.264 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T03:25:50.264 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:25:50.280 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T03:25:50.280 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T03:25:50.280 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:25:50.335 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T03:25:50.335 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-06T03:25:50.336 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-06T03:25:50.336 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:25:50.370 INFO:tasks.ceph.osd.0:Stopped 2023-10-06T03:25:50.371 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-06T03:25:50.371 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:25:50.448 INFO:tasks.ceph.osd.1:Stopped 2023-10-06T03:25:50.448 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-06T03:25:50.448 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:25:50.520 INFO:tasks.ceph.osd.2:Stopped 2023-10-06T03:25:50.521 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-06T03:25:50.521 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:25:50.594 INFO:tasks.ceph.osd.3:Stopped 2023-10-06T03:25:50.595 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-06T03:25:50.595 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:25:50.641 INFO:tasks.ceph.osd.4:Stopped 2023-10-06T03:25:50.641 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-06T03:25:50.642 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:25:50.687 INFO:tasks.ceph.osd.5:Stopped 2023-10-06T03:25:50.687 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-06T03:25:50.687 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:25:50.745 INFO:tasks.ceph.osd.6:Stopped 2023-10-06T03:25:50.745 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-06T03:25:50.745 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:25:50.790 INFO:tasks.ceph.osd.7:Stopped 2023-10-06T03:25:50.791 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-06T03:25:50.791 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-06T03:25:50.791 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:25:50.852 INFO:tasks.ceph.mgr.y:Stopped 2023-10-06T03:25:50.852 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-06T03:25:50.852 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:25:50.909 INFO:tasks.ceph.mgr.x:Stopped 2023-10-06T03:25:50.909 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-06T03:25:50.909 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-06T03:25:50.909 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:25:50.928 INFO:tasks.ceph.mon.a:Stopped 2023-10-06T03:25:50.928 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-06T03:25:50.928 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:25:50.944 INFO:tasks.ceph.mon.b:Stopped 2023-10-06T03:25:50.945 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-06T03:25:50.945 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:25:51.004 INFO:tasks.ceph.mon.c:Stopped 2023-10-06T03:25:51.004 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-06T03:25:51.004 DEBUG:teuthology.orchestra.run.smithi081:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-06T03:25:51.073 INFO:teuthology.orchestra.run.smithi081.stdout:1696562619.890102 mon.a (mon.0) 220 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-06T03:25:51.074 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-10-06T03:25:51.074 DEBUG:teuthology.orchestra.run.smithi081:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-06T03:25:51.143 DEBUG:teuthology.orchestra.run.smithi081:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-06T03:25:51.216 DEBUG:teuthology.orchestra.run.smithi081:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-06T03:25:51.284 INFO:teuthology.orchestra.run.smithi081.stdout:1696562619.890102 mon.a (mon.0) 220 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-06T03:25:51.285 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi081.front.sepia.ceph.com 2023-10-06T03:25:51.286 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-06T03:25:51.616 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi081.front.sepia.ceph.com 2023-10-06T03:25:51.616 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-06T03:25:51.840 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi081.front.sepia.ceph.com 2023-10-06T03:25:51.840 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-06T03:25:52.063 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi081.front.sepia.ceph.com 2023-10-06T03:25:52.063 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-06T03:25:52.234 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T03:25:52.234 DEBUG:teuthology.orchestra.run.smithi083:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-06T03:25:52.559 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T03:25:52.560 DEBUG:teuthology.orchestra.run.smithi083:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-06T03:25:52.746 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T03:25:52.746 DEBUG:teuthology.orchestra.run.smithi083:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-06T03:25:52.962 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T03:25:52.962 DEBUG:teuthology.orchestra.run.smithi083:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-06T03:25:53.205 INFO:tasks.ceph:Archiving mon data... 2023-10-06T03:25:53.207 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412190/data/mon.a.tgz 2023-10-06T03:25:53.207 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2023-10-06T03:25:53.247 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.Xas7DyVUVA 2023-10-06T03:25:53.247 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.Xas7DyVUVA 2023-10-06T03:25:53.421 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.Xas7DyVUVA 2023-10-06T03:25:53.520 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.Xas7DyVUVA is 301KB 2023-10-06T03:25:53.610 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.Xas7DyVUVA 2023-10-06T03:25:53.646 DEBUG:teuthology.misc:Transferring archived files from smithi083:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412190/data/mon.b.tgz 2023-10-06T03:25:53.646 DEBUG:teuthology.orchestra.run.smithi083:> mktemp 2023-10-06T03:25:53.682 INFO:teuthology.orchestra.run.smithi083.stdout:/tmp/tmp.3qXbn54RV3 2023-10-06T03:25:53.683 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.3qXbn54RV3 2023-10-06T03:25:53.872 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 0666 /tmp/tmp.3qXbn54RV3 2023-10-06T03:25:53.970 DEBUG:teuthology.orchestra.remote:smithi083:/tmp/tmp.3qXbn54RV3 is 398KB 2023-10-06T03:25:54.060 DEBUG:teuthology.orchestra.run.smithi083:> rm -fr /tmp/tmp.3qXbn54RV3 2023-10-06T03:25:54.095 DEBUG:teuthology.misc:Transferring archived files from smithi083:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412190/data/mon.c.tgz 2023-10-06T03:25:54.095 DEBUG:teuthology.orchestra.run.smithi083:> mktemp 2023-10-06T03:25:54.170 INFO:teuthology.orchestra.run.smithi083.stdout:/tmp/tmp.YtGOgJ7pYX 2023-10-06T03:25:54.170 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.YtGOgJ7pYX 2023-10-06T03:25:54.345 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 0666 /tmp/tmp.YtGOgJ7pYX 2023-10-06T03:25:54.443 DEBUG:teuthology.orchestra.remote:smithi083:/tmp/tmp.YtGOgJ7pYX is 398KB 2023-10-06T03:25:54.532 DEBUG:teuthology.orchestra.run.smithi083:> rm -fr /tmp/tmp.YtGOgJ7pYX 2023-10-06T03:25:54.567 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-06T03:25:54.567 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T03:25:54.572 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T03:25:54.667 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-06T03:25:54.667 DEBUG:teuthology.orchestra.run.smithi081:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T03:25:54.671 DEBUG:teuthology.orchestra.run.smithi083:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T03:25:54.734 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T03:25:54.741 INFO:teuthology.orchestra.run.smithi083.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T03:25:54.757 INFO:tasks.ceph:Archiving crash dumps... 2023-10-06T03:25:54.759 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412190/remote/smithi081/crash 2023-10-06T03:25:54.760 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T03:25:54.819 DEBUG:teuthology.misc:Transferring archived files from smithi083:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412190/remote/smithi083/crash 2023-10-06T03:25:54.820 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T03:25:54.879 INFO:tasks.ceph:Shutting down logrotate 2023-10-06T03:25:54.879 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:25:54.883 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:25:54.972 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T03:25:55.031 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T03:25:55.092 INFO:tasks.ceph:Compressing logs... 2023-10-06T03:25:55.092 DEBUG:teuthology.orchestra.run.smithi081:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T03:25:55.097 DEBUG:teuthology.orchestra.run.smithi083:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T03:25:58.604 INFO:tasks.ceph:Archiving logs... 2023-10-06T03:25:58.604 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412190/remote/smithi081/log 2023-10-06T03:25:58.605 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T03:25:59.206 DEBUG:teuthology.misc:Transferring archived files from smithi083:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412190/remote/smithi083/log 2023-10-06T03:25:59.206 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T03:25:59.659 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-06T03:25:59.670 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-06T03:25:59.670 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T03:25:59.675 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T03:25:59.789 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-06T03:25:59.799 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-06T03:25:59.799 DEBUG:teuthology.orchestra.run.smithi081:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T03:25:59.804 DEBUG:teuthology.orchestra.run.smithi083:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T03:25:59.834 INFO:teuthology.orchestra.run.smithi081.stderr:bash: ntpq: command not found 2023-10-06T03:25:59.837 INFO:teuthology.orchestra.run.smithi083.stderr:bash: ntpq: command not found 2023-10-06T03:25:59.840 INFO:teuthology.orchestra.run.smithi081.stdout:210 Number of sources = 4 2023-10-06T03:25:59.840 INFO:teuthology.orchestra.run.smithi081.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T03:25:59.840 INFO:teuthology.orchestra.run.smithi081.stdout:=============================================================================== 2023-10-06T03:25:59.840 INFO:teuthology.orchestra.run.smithi081.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 5 -226us[ -215us] +/- 90ms 2023-10-06T03:25:59.840 INFO:teuthology.orchestra.run.smithi081.stdout:^* hv02.front.sepia.ceph.com 3 6 377 4 -320us[ -309us] +/- 63ms 2023-10-06T03:25:59.841 INFO:teuthology.orchestra.run.smithi081.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 6 +541us[ +551us] +/- 69ms 2023-10-06T03:25:59.841 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T03:25:59.842 INFO:teuthology.orchestra.run.smithi083.stdout:210 Number of sources = 4 2023-10-06T03:25:59.842 INFO:teuthology.orchestra.run.smithi083.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T03:25:59.842 INFO:teuthology.orchestra.run.smithi083.stdout:=============================================================================== 2023-10-06T03:25:59.842 INFO:teuthology.orchestra.run.smithi083.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 4 -220us[ -220us] +/- 90ms 2023-10-06T03:25:59.842 INFO:teuthology.orchestra.run.smithi083.stdout:^* hv02.front.sepia.ceph.com 3 6 377 5 -308us[ -300us] +/- 63ms 2023-10-06T03:25:59.842 INFO:teuthology.orchestra.run.smithi083.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 4 +538us[ +538us] +/- 69ms 2023-10-06T03:25:59.843 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T03:25:59.843 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-06T03:25:59.853 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-06T03:25:59.854 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-06T03:25:59.863 DEBUG:teuthology.orchestra.run.smithi081:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-06T03:26:00.046 DEBUG:teuthology.orchestra.run.smithi083:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-06T03:26:00.203 DEBUG:teuthology.orchestra.run.smithi081:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T03:26:00.271 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:26:00.272 DEBUG:teuthology.orchestra.run.smithi083:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T03:26:00.338 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:26:00.339 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-06T03:26:00.349 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-06T03:26:00.359 INFO:teuthology.task.internal:Duration was 1004.213195 seconds 2023-10-06T03:26:00.359 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-06T03:26:00.368 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-06T03:26:00.368 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T03:26:00.373 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T03:26:00.477 INFO:teuthology.orchestra.run.smithi081.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T03:26:00.481 INFO:teuthology.orchestra.run.smithi083.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T03:26:00.773 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-06T03:26:00.773 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi081.front.sepia.ceph.com 2023-10-06T03:26:00.773 DEBUG:teuthology.orchestra.run.smithi081:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T03:26:00.824 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T03:26:00.824 DEBUG:teuthology.orchestra.run.smithi083:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T03:26:00.874 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-06T03:26:00.874 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T03:26:00.879 DEBUG:teuthology.orchestra.run.smithi083:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T03:26:00.957 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-06T03:26:00.957 DEBUG:teuthology.orchestra.run.smithi081:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T03:26:00.961 DEBUG:teuthology.orchestra.run.smithi083:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T03:26:01.076 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-06T03:26:01.086 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-06T03:26:01.086 DEBUG:teuthology.orchestra.run.smithi081:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T03:26:01.147 DEBUG:teuthology.orchestra.run.smithi083:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T03:26:01.208 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-06T03:26:01.218 DEBUG:teuthology.orchestra.run.smithi081:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T03:26:01.223 DEBUG:teuthology.orchestra.run.smithi083:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T03:26:01.279 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = core 2023-10-06T03:26:01.283 INFO:teuthology.orchestra.run.smithi083.stdout:kernel.core_pattern = core 2023-10-06T03:26:01.318 DEBUG:teuthology.orchestra.run.smithi081:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T03:26:01.352 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:26:01.353 DEBUG:teuthology.orchestra.run.smithi083:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T03:26:01.387 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:26:01.388 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-06T03:26:01.398 INFO:teuthology.task.internal:Transferring archived files... 2023-10-06T03:26:01.399 DEBUG:teuthology.misc:Transferring archived files from smithi081:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412190/remote/smithi081 2023-10-06T03:26:01.399 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T03:26:01.472 DEBUG:teuthology.misc:Transferring archived files from smithi083:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412190/remote/smithi083 2023-10-06T03:26:01.472 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T03:26:01.543 INFO:teuthology.task.internal:Removing archive directory... 2023-10-06T03:26:01.544 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T03:26:01.548 DEBUG:teuthology.orchestra.run.smithi083:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T03:26:01.584 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-06T03:26:01.596 INFO:teuthology.task.internal:Not uploading archives. 2023-10-06T03:26:01.596 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-06T03:26:01.607 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-06T03:26:01.607 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T03:26:01.625 DEBUG:teuthology.orchestra.run.smithi083:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T03:26:01.657 INFO:teuthology.orchestra.run.smithi081.stdout: 524293 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 03:26 /home/ubuntu/cephtest 2023-10-06T03:26:01.661 INFO:teuthology.orchestra.run.smithi083.stdout: 524301 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 03:26 /home/ubuntu/cephtest 2023-10-06T03:26:01.664 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-06T03:26:01.675 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-06T03:26:01.697 INFO:teuthology.nuke:Checking targets against current locks 2023-10-06T03:26:01.725 DEBUG:teuthology.nuke:shortname: smithi081 2023-10-06T03:26:01.725 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T03:26:01.750 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412190', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 02:59:34.853740', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAng7mx3KK1mbrZaEcAuFf4OFz3tDcmGoUSySkZNN4nrOuQCh6AdwilToSGjD2wT5DO2iskM/PGDZ6iRRZoS2cg='} 2023-10-06T03:26:01.753 DEBUG:teuthology.nuke:shortname: smithi083 2023-10-06T03:26:01.753 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T03:26:01.775 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi083.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412190', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 02:59:34.851707', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNRMH/N5QcDWa4IoLhxpFtPD4tBR5xwZfDHY9UNeUhQ9Aa3PdfqvWber4izkcZSlWpbVFZNH8PUk2XaPboLbaSs='} 2023-10-06T03:26:01.803 INFO:teuthology.orchestra.console.smithi081:Power off 2023-10-06T03:26:01.803 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T03:26:01.826 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off 2023-10-06T03:26:01.826 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:26:01.851 INFO:teuthology.orchestra.console.smithi083:Power off 2023-10-06T03:26:01.851 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T03:26:01.861 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on 2023-10-06T03:26:01.879 DEBUG:teuthology.orchestra.console.smithi083:power off output: Chassis Power Control: Down/Off 2023-10-06T03:26:01.879 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:26:01.902 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is on 2023-10-06T03:26:05.863 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:26:05.903 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:26:05.974 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on 2023-10-06T03:26:06.012 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is on 2023-10-06T03:26:09.978 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:26:10.013 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:26:10.088 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2023-10-06T03:26:10.122 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is off 2023-10-06T03:26:10.190 INFO:teuthology.orchestra.console.smithi081:Power off completed 2023-10-06T03:26:10.223 INFO:teuthology.orchestra.console.smithi083:Power off completed 2023-10-06T03:26:10.331 INFO:teuthology.run:Summary data: client.0-kernel-sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c client.1-kernel-sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/recovery-fs} duration: 1004.2131946086884 failure_reason: '"1696562619.890102 mon.a (mon.0) 220 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log' flavor: default owner: scheduled_yuriw@teuthology success: false 2023-10-06T03:26:10.333 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T03:26:10.434 INFO:teuthology.run:FAIL